Skip to content

SSL SYSCALL error when syncing multiple tables #36

Description

@rbhalla

When I attempt to sync multiple tables I'm getting the following error after a few tables have finished syncing:

Traceback (most recent call last):
  File "/src/salesforce/.meltano/extractors/tap-redshift-salesforce/venv/bin/tap-redshift", line 11, in <module>
INFO Table 'campaign_members' exists
    sys.exit(main())
  File "/src/salesforce/.meltano/extractors/tap-redshift-salesforce/venv/lib/python3.6/site-packages/singer/utils.py", line 181, in wrapped
    return fn(*args, **kwargs)
  File "/src/salesforce/.meltano/extractors/tap-redshift-salesforce/venv/lib/python3.6/site-packages/tap_redshift/__init__.py", line 525, in main
    main_impl()
  File "/src/salesforce/.meltano/extractors/tap-redshift-salesforce/venv/lib/python3.6/site-packages/tap_redshift/__init__.py", line 514, in main_impl
    do_sync(connection, db_schema, args.catalog, state)
  File "/src/salesforce/.meltano/extractors/tap-redshift-salesforce/venv/lib/python3.6/site-packages/tap_redshift/__init__.py", line 447, in do_sync
    for message in generate_messages(conn, db_schema, catalog, state):
  File "/src/salesforce/.meltano/extractors/tap-redshift-salesforce/venv/lib/python3.6/site-packages/tap_redshift/__init__.py", line 430, in generate_messages
    for message in sync_table(conn, catalog_entry, state):
  File "/src/salesforce/.meltano/extractors/tap-redshift-salesforce/venv/lib/python3.6/site-packages/tap_redshift/__init__.py", line 366, in sync_table
    cursor.execute(select, params)
psycopg2.OperationalError: SSL SYSCALL error: EOF detected

From the stack trace you can see that the table campaign_members is failing. If I try and run this table individually, it does work.

Not sure I understand enough about Redshift's cursors to debug, anybody encountered this before?

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions