Insert timeout

[Philmod]

Hey,

I'm having this error after few minutes running it:

[12/19/14 00:22:39] [EROR] insert error (read tcp 127.0.0.1:27017: i/o timeout)
[12/19/14 00:22:39] [CRIT] Failed: failed insert on collection archived: read tcp 127.0.0.1:27017: i/o timeout

And so the script stops.

Any idea?

Thanks

[Philmod]

Decreasing this constant helped.

[nstott]

Those constants are good to tweak, seed tries to send data as fast as possible, even if it's a little too much for the destination database to handle.
check the lock percentage on the destination database, (mongostat)
if your database has a lot of indexes, you might try changing this (https://github.com/MongoHQ/seed/blob/master/seed.go#L36 ) and changing when the indexes are built. other then that, you found the right tunables. THose used to be tunable on the command line, but I found there were too many flags, and tried to find reasonable defaults instead

[Philmod]

👍

[nstott]

Check out transporter for a slightly different take on this problem
https://github.com/compose/transporter
You might find it interesting

[Philmod]

Hey,

The import does work better now. Thanks :-)

But I have an issue with the following daemon on the ops log:

[12/20/14 03:18:53] [INFO] Sockets in use: 98, sentOps: 299102, receivedOps: 219725, receivedDocs: 156598732
[12/20/14 03:18:55] [INFO] Sockets in use: 98, sentOps: 299104, receivedOps: 219727, receivedDocs: 156598734
[12/20/14 03:18:57] [INFO] Sockets in use: 98, sentOps: 299106, receivedOps: 219729, receivedDocs: 156598736
[12/20/14 03:18:59] [INFO] Sockets in use: 98, sentOps: 299108, receivedOps: 219731, receivedDocs: 156598738
[12/20/14 03:19:01] [INFO] Sockets in use: 98, sentOps: 299110, receivedOps: 219733, receivedDocs: 156598740
[12/20/14 03:19:03] [INFO] Sockets in use: 98, sentOps: 299110, receivedOps: 219733, receivedDocs: 156598740
[12/20/14 03:19:05] [INFO] Sockets in use: 98, sentOps: 299112, receivedOps: 219735, receivedDocs: 156598742
[12/20/14 03:19:07] [INFO] Sockets in use: 98, sentOps: 299114, receivedOps: 219737, receivedDocs: 156598744
[12/20/14 03:19:09] [CRIT] Failed: Could not add index: read tcp 127.0.0.1:27017: i/o timeout

And so it stopped listening to the first database.

How can I fix that?

Thanks,
Philmod

[eagleeye]

yeap, i think i fixed that, check this: #5