|
|
c27ac6ce97
|
Experimental fix to the memory leak issue in ingester. Additional work on the indexer
|
2024-09-13 10:43:33 +03:00 |
|
|
|
e5663e3c30
|
removed boolean types for ring and nested indices. Made the indexer create both indexes at once as it is faster.
|
2024-09-12 16:47:00 +03:00 |
|
|
|
84f373d590
|
added ORDER and NSIDE as arguments for the indexer script
|
2024-09-12 15:52:38 +03:00 |
|
|
|
3acef66a89
|
monitor.py to restart ingester periodically hopefully avoiding memory leaks.
|
2024-09-12 14:30:59 +03:00 |
|
|
|
83888cd2f9
|
removed script
|
2024-09-12 13:53:09 +03:00 |
|
|
|
2d45a653fc
|
added the current_time function to ingester too
|
2024-09-12 11:52:56 +03:00 |
|
|
|
4eaad008e1
|
added the monitor script cycle.sh. Made it check for the finish flag file. Added the finish flag generation to ingester.
|
2024-09-12 11:50:23 +03:00 |
|
|
|
e37387b68f
|
made ingester functional without inputs in preparation for a monitor script restarting it
|
2024-09-12 11:45:02 +03:00 |
|
|
|
2ea452cf81
|
returned to pyarrow backend in pandas, added timestamped outputs to the indexer implementation
|
2024-09-12 10:43:43 +03:00 |
|
|
|
0f3d33ac13
|
switched backend back to numpy so it maybe fixes the memory leak
|
2024-09-12 10:32:33 +03:00 |
|
|
|
a8854fe4a4
|
removed regular gc calls; added var=None in attempt to mitigate memory leaks
|
2024-09-12 09:46:31 +03:00 |
|
|
|
b4117d2ee7
|
implemented regular garbage collection in ingester
|
2024-09-11 15:45:46 +03:00 |
|
|
|
5fe96c3b86
|
prototype indexer implementation
|
2024-09-11 15:06:47 +03:00 |
|
|
|
6df8af77df
|
started work on the indexer script
|
2024-09-11 12:11:33 +03:00 |
|
|
|
9f26052fe2
|
switched root dir to the application itself
|
2024-09-10 15:08:51 +03:00 |
|
|
|
b923798799
|
minor tweak
|
2024-09-10 15:03:01 +03:00 |
|
|
|
61cd9978c8
|
rename application to GaiaDBInterface
|
2024-09-10 15:00:06 +03:00 |
|
|
|
96148bac02
|
rename application to GaiaDBInterface
|
2024-09-10 14:59:39 +03:00 |
|
|
|
2437eff8fc
|
minor tweaks
|
2024-09-10 14:44:06 +03:00 |
|
|
|
f2e17ee603
|
added previous dir choice
|
2024-09-10 14:38:23 +03:00 |
|
|
|
3a9ba2f320
|
reorganization
|
2024-09-10 14:28:57 +03:00 |
|
|
|
0f1088a066
|
move ingester to be a manage command
|
2024-09-10 13:47:46 +03:00 |
|
|
|
db126af85a
|
initial commit
|
2024-09-10 12:28:01 +03:00 |
|
|
|
92a8174bdf
|
Initial commit
|
2024-09-10 12:23:25 +03:00 |
|
