66 Commits

Author SHA1 Message Date
Luke Berndt
917a8faca6 Remove upload temp files on every exit path
Rejected uploads (unknown system, bad key, invalid file or source list) and
uploads that threw returned without deleting multer's temp file, leaking
751k files (39 GB) in the backend container since April.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-11-09 18:26:15 -05:00
Luke Berndt
6825aaf9a4 Reduce backend per-upload CPU to relieve upload timeouts
The Node main thread was saturated at about 39 uploads/s, overflowing the
listen queue so uploads timed out connecting from nginx.

- Enable keepAlive on the S3 agent; every upload did a full TLS handshake
- Remove OpenTelemetry tracing
- Cache the system key lookup for 60s
- Use lean queries when listing calls
- Serialize each call once in notify_clients, not per recipient
- Add an nginx upstream keepalive pool, and hold Node's keepAliveTimeout
  above it so nginx never reuses a connection Node has closed

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-11-09 18:06:48 -05:00
Luke Berndt
7dea9e614b AWS S3 SDK fix 2025-02-06 22:08:05 -05:00
Tad Smith
350c83c259 Save patch infomation for calls. 2024-12-13 20:46:06 +00:00
Luke Berndt
414599dfa3 upgrade Mongo!! 2024-10-19 09:29:23 -04:00
Luke Berndt
a3616fc3b9 what is slow, really? 2024-10-13 16:57:23 -04:00
Luke Berndt
abee28c030 less messages, more meaning 2024-10-13 09:58:21 -04:00
Luke Berndt
5eaf2308f8 Merge pull request #174 from openmhz/wavesurfer
Wavesurfer
2024-09-22 22:16:43 -04:00
Luke Berndt
752bb3dfa9 More Mongoose connections - updated wavesurfer look 2024-09-22 21:56:44 -04:00
Luke Berndt
470447f93c add Prefix for each shortname and talkgroup 2024-09-09 22:05:32 -04:00
Luke Berndt
1be715c042 fixed admin 2024-09-07 09:53:26 -04:00
Luke Berndt
f9bff813d2 less debug - normal sockets 2024-09-07 08:43:34 -04:00
Luke Berndt
370afd64f1 tons of sockets 2024-09-06 15:32:41 -04:00
Luke Berndt
1ce0f06ad8 more data 2024-09-06 15:03:06 -04:00
Luke Berndt
1266281a8e better math 2024-09-06 11:57:37 -04:00
Luke Berndt
5cf0291a14 agh 2024-09-06 11:50:42 -04:00
Luke Berndt
ac0ff712da fixed 2024-09-06 11:49:51 -04:00
Luke Berndt
17a9d50290 debug message 2024-09-06 11:47:00 -04:00
Luke Berndt
9a9f94bd99 no retry for upload 2024-09-06 11:13:03 -04:00
Luke Berndt
e15195fcb9 better diagnose upload errors 2024-08-28 21:55:54 -04:00
Luke Berndt
d9823a6af9 trying... 2024-08-25 09:44:17 -04:00
Luke Berndt
00dbc4725e its working 2024-08-21 21:41:57 -04:00
Luke Berndt
0e6e69c56e Update uploads.js 2024-08-21 15:11:23 -04:00
Luke Berndt
7352c8af82 Update uploads.js 2024-08-21 15:02:41 -04:00
Luke Berndt
fc77bd2934 upgrading telem 2024-08-21 10:43:39 -04:00
Luke Berndt
3ea2613ba9 Update uploads.js 2024-08-20 11:40:57 -04:00
Luke Berndt
2e42051973 Update uploads.js 2024-08-20 11:36:35 -04:00
Luke Berndt
bf7e09d4e9 Update uploads.js 2024-08-20 11:29:48 -04:00
Luke Berndt
be11cd2006 Merge branch 'system-test' into better-honeycomb 2024-08-20 11:25:32 -04:00
Luke Berndt
e3e14a229a ability to use a different public URL for S3 2024-08-19 17:09:09 -04:00
Luke Berndt
0cc8caeba0 more sockets 2024-08-18 21:29:02 -04:00
Luke Berndt
bbbd4e1819 better tracing 2024-08-18 21:09:03 -04:00
Luke Berndt
85ea4579dc more sockets? 2024-08-13 15:35:10 -04:00
Luke Berndt
040c6728fc cleaning things up 2024-02-19 09:38:13 -05:00
Luke Berndt
5940565039 increase the S3 retry attempts to 3 2024-02-08 06:59:37 -05:00
Luke Berndt
d44638e32f remove spans 2024-02-06 07:59:44 -05:00
Luke Berndt
2594872acf context fix 2024-02-04 21:41:00 -05:00
Luke Berndt
55f0a662d4 additional require 2024-02-04 21:37:21 -05:00
Luke Berndt
63271e5305 fixed bug 2024-02-04 21:21:51 -05:00
Luke Berndt
34d5550d5f manual tracing for Upload 2024-02-04 10:54:40 -05:00
Luke Berndt
4049d6cdee block for sensitive talkgroups 2023-11-24 13:54:15 -05:00
tadscottsmith
098ab6cc10 Allow MP3 files. 2023-11-10 14:01:10 -06:00
Luke Berndt
a8bea173a2 Fix the error with the crashing 2023-08-08 22:06:46 -04:00
Luke Berndt
3f73d12254 changing upload approach 2023-04-11 08:59:06 -04:00
Luke Berndt
4de89c9ac2 catching more errors 2023-04-10 15:53:24 -04:00
Luke Berndt
1fce1d5eef catch more errors! 2023-04-10 15:02:59 -04:00
Luke Berndt
50055c47b7 maybe? 2023-04-10 10:35:51 -04:00
Luke Berndt
89f5346d72 change error leevel 2023-04-10 10:09:23 -04:00
Luke Berndt
fd779e91da Everything looks like it is workings with the upgraded backend 2023-04-09 22:39:00 -04:00
Luke Berndt
ef9eb0a89a it is working with the new AWS S3 SDK 2023-04-09 13:31:13 -04:00