Error: socket hang up, with cpu at 90%

Community
1 
Error: socket hang up
    at Socket.socketOnEnd (node:_http_client:530:25)
    at Socket.emit (node:events:530:35)
    at endReadableNT (node:internal/streams/readable:1698:12)
    at processTicksAndRejections (node:internal/process/task_queues:90:21)

We’re inserting massively through multiple machines a few millions of rows, our questdb machine has 8x cores and 16gb ram, it’s running steadly at 89.1% of cpu load, and sometimes we’re getting this error.

Is there something we can adjust to make this not appear or not throw?

This is our server.conf:

# Validate configuration strictly
config.validation.strict=true

# Use all available CPU cores for shared worker pool
shared.worker.count=2

# Limit RAM usage to 75% of total system RAM (16gb in our case)
ram.usage.limit.percent=75

################ HTTP settings ##################

# Enable HTTP server
http.enabled=true
http.net.bind.to=0.0.0.0:9000
http.net.connection.limit=512
http.receive.buffer.size=8m
http.worker.count=1
http.send.buffer.size=8m
http.net.connection.timeout=300000
http.net.connection.queue.timeout=30000


################ Cairo settings ##################

# Enable Write-Ahead Logging (WAL)
cairo.wal.supported=true
cairo.wal.enabled.default=true

# Increase max uncommitted rows to handle large inserts
cairo.max.uncommitted.rows=2000000

# Adjust O3 (Out-of-Order) max lag to buffer more data before committing
cairo.o3.max.lag=900000

################ LINE TCP settings ##################

line.tcp.enabled=true
line.tcp.net.bind.to=0.0.0.0:9009
line.tcp.net.connection.limit=512
line.tcp.writer.queue.capacity=256
line.tcp.writer.worker.count=1
line.tcp.io.worker.count=1
line.tcp.disconnect.on.error=false

################ WAL settings ##################

# Allocate a dedicated worker for WAL apply to improve write performance
wal.apply.worker.count=1

################ PG Wire settings ##################

pg.enabled=true
pg.net.bind.to=0.0.0.0:8812
pg.net.connection.limit=256
pg.worker.count=1

################ Miscellaneous Settings ##################

# Enable JIT compiler for better query performance
cairo.sql.jit.mode=on

If it’s useful we’re running on 8.2.0 of questdb and this is the table where we insert data:

CREATE TABLE IF NOT EXISTS pSeries (
          id STRING,
          instrumentId SYMBOL CAPACITY 1000000 NOCACHE,
          entityId SYMBOL CAPACITY 50000,
          date TIMESTAMP,
          price DOUBLE,
          currency SYMBOL CAPACITY 1000,
          createdAt TIMESTAMP,
          updatedAt TIMESTAMP),
          INDEX(instrumentId),
          INDEX(entityId),
          INDEX(currency)
        TIMESTAMP(date)
        PARTITION BY YEAR
        DEDUP UPSERT KEYS(instrumentId, date);

Any help would be amazing and really appreciated! :cupid: