Commit Graph

  • c1e56539b7 Update README.md main Никита Тырин 2024-09-20 11:42:55 +03:00
  • e9c38ab778 work on the POST request for bulk-querying tyrin 2024-09-19 16:12:29 +03:00
  • 77ae33a1e8 added healpix order argument to the cone search api tyrin 2024-09-19 11:10:09 +03:00
  • fae86166e4 changed the query format so that the parameters are extracted from the query string instead tyrin 2024-09-18 16:28:50 +03:00
  • ee8624e2ab swagger api documentation decorator tyrin 2024-09-17 17:26:58 +03:00
  • 4ae88fd94b api work tyrin 2024-09-17 16:16:54 +03:00
  • 0bbc34086f added api endpoint tyrin 2024-09-17 15:17:22 +03:00
  • c0c520c6ac first prototype API implementation tyrin 2024-09-17 15:07:32 +03:00
  • 95702c3fb2 first prototype API implementation tyrin 2024-09-17 15:04:04 +03:00
  • b17dadfb9c Update README.md Никита Тырин 2024-09-17 13:10:34 +03:00
  • 89eec0ab8a added requirements.txt tyrin 2024-09-17 13:07:22 +03:00
  • 7a18b1b2ff API: started work, added a serializer tyrin 2024-09-17 11:37:03 +03:00
  • c6df41f903 supplementary to the previous tyrin 2024-09-16 15:47:02 +03:00
  • ea9832a365 Remove gaia designation from the model to save on disk space tyrin 2024-09-16 15:46:01 +03:00
  • 3d9c950751 Remove most fields from the model to save disk space tyrin 2024-09-16 11:27:56 +03:00
  • c122b271e9 Indexer: made code more legible, added some comments tyrin 2024-09-16 10:44:40 +03:00
  • 862efc5cbd Indexer: additional work on the multithreaded version tyrin 2024-09-16 10:35:43 +03:00
  • eec4ebbbfc Indexer: switched to user input (with previous value support) for the NSIDE value. Testing indexer_multithread version added. Ingester: minor code tweaks tyrin 2024-09-13 15:27:49 +03:00
  • e83b23a35c Indexer: improved outputs, added progress reporting. tyrin 2024-09-13 13:09:39 +03:00
  • ec27a495b1 Additional work on the Indexer tyrin 2024-09-13 12:19:04 +03:00
  • c27ac6ce97 Experimental fix to the memory leak issue in ingester. Additional work on the indexer tyrin 2024-09-13 10:43:33 +03:00
  • e5663e3c30 removed boolean types for ring and nested indices. Made the indexer create both indexes at once as it is faster. tyrin 2024-09-12 16:47:00 +03:00
  • 84f373d590 added ORDER and NSIDE as arguments for the indexer script tyrin 2024-09-12 15:52:38 +03:00
  • 3acef66a89 monitor.py to restart ingester periodically hopefully avoiding memory leaks. tyrin 2024-09-12 14:30:59 +03:00
  • 83888cd2f9 removed script tyrin 2024-09-12 13:53:09 +03:00
  • 2d45a653fc added the current_time function to ingester too tyrin 2024-09-12 11:52:56 +03:00
  • 4eaad008e1 added the monitor script cycle.sh. Made it check for the finish flag file. Added the finish flag generation to ingester. tyrin 2024-09-12 11:50:23 +03:00
  • e37387b68f made ingester functional without inputs in preparation for a monitor script restarting it tyrin 2024-09-12 11:45:02 +03:00
  • 2ea452cf81 returned to pyarrow backend in pandas, added timestamped outputs to the indexer implementation tyrin 2024-09-12 10:43:43 +03:00
  • 0f3d33ac13 switched backend back to numpy so it maybe fixes the memory leak tyrin 2024-09-12 10:32:33 +03:00
  • a8854fe4a4 removed regular gc calls; added var=None in attempt to mitigate memory leaks tyrin 2024-09-12 09:46:31 +03:00
  • b4117d2ee7 implemented regular garbage collection in ingester tyrin 2024-09-11 15:45:46 +03:00
  • 5fe96c3b86 prototype indexer implementation tyrin 2024-09-11 15:06:47 +03:00
  • 6df8af77df started work on the indexer script tyrin 2024-09-11 12:11:33 +03:00
  • 9f26052fe2 switched root dir to the application itself tyrin 2024-09-10 15:08:51 +03:00
  • b923798799 minor tweak tyrin 2024-09-10 15:03:01 +03:00
  • 61cd9978c8 rename application to GaiaDBInterface tyrin 2024-09-10 15:00:06 +03:00
  • 96148bac02 rename application to GaiaDBInterface tyrin 2024-09-10 14:59:39 +03:00
  • 2437eff8fc minor tweaks tyrin 2024-09-10 14:44:06 +03:00
  • f2e17ee603 added previous dir choice tyrin 2024-09-10 14:38:23 +03:00
  • 3a9ba2f320 reorganization tyrin 2024-09-10 14:28:57 +03:00
  • 0f1088a066 move ingester to be a manage command tyrin 2024-09-10 13:47:46 +03:00
  • db126af85a initial commit tyrin 2024-09-10 12:28:01 +03:00
  • 92a8174bdf Initial commit Никита Тырин 2024-09-10 12:23:25 +03:00