Commit graph

72 commits

Author SHA1 Message Date
powe97 9eb5e195dc
Use dd instead of rsync 2024-03-03 17:40:25 -05:00
powe97 57d9f5dc4c
See previous commit 2024-03-02 19:08:06 -05:00
powe97 58e509d1bb
Clean up and potentially fix rsync 2024-03-02 18:35:44 -05:00
powe97 c3e0d558d7
List data folder before copying (rsync seems to not work every time?) 2024-03-02 16:17:11 -05:00
powe97 d5f58d8576
Create json dir if it doesn't already exist 2024-03-02 01:44:28 -05:00
powe97 c508798f20
Create courses dir if it doesn't already exist 2024-03-02 01:41:43 -05:00
powe97 5fe4ee9f13
Change manually run workflow to have timeout of 2 mins 2024-03-01 13:12:23 -05:00
powe97 997d3c16a8
2hr timeout → 45m 2024-03-01 12:48:20 -05:00
powe97 019b777228
Make transfer scraper run continuously (at least as much as Github allows) 2024-03-01 01:45:06 -05:00
powe97 53891400ea
Every 15 minutes 2024-02-29 22:29:51 -05:00
powe97 682b1679b4
Run every 15 mins 2024-02-29 22:25:22 -05:00
powe97 55e34c9dd4
Bump versions of actions 2024-02-29 22:06:23 -05:00
powe97 efad1e9103
Bump versions for actions 2024-02-29 22:01:40 -05:00
powe97 cf953b2f02
Merge branch 'main' of https://github.com/quatalog/quatalog 2024-02-29 21:45:29 -05:00
powe97 44067261c3
Don't put whole repo in artifact 2024-02-29 21:45:22 -05:00
powe97 d268233d8b
Update transfer.yml 2024-02-29 21:38:17 -05:00
powe97 fd2da56aee
Make checkout data repo actually check the data repo out 2024-02-29 21:23:29 -05:00
powe97 4916feeb19
Add debug timeout to workflow 2024-02-29 21:16:07 -05:00
powe97 f216c45748
Add if __name__ == "__main__" and fix workflow 2024-02-29 20:49:45 -05:00
powe97 15b09123ee
Set up workflow for transfer scraper 2024-02-29 20:40:15 -05:00
powe97 382f9080e5
Add transfer workflow 2024-02-29 17:18:50 -05:00
powe97 03fd5b8494
Disable autocompile 2024-02-01 23:28:41 -05:00
powe97 9ec4198155
add header to csv 2023-07-29 17:17:48 -04:00
powe97 9b877abe66
Fix typo 2023-07-29 17:10:27 -04:00
powe97 18ccae5fa7
Issue with relative paths 2023-07-27 23:58:34 -04:00
powe97 4601554c9a
Add Kuzmin CSV file 2023-07-27 23:54:26 -04:00
powe97 7b7128ed25 Run every hour 2023-03-14 00:02:59 -04:00
powe97 182f90eceb Does not need to run every hour 2023-03-05 18:55:52 -05:00
powe97 c2fe36b88c Rearrange some stuff 2023-02-16 21:20:04 -05:00
3eef8a28f26fb2bcc514e6f1938929a1f931762 29d537a6b6 Fix typo 2023-02-10 20:52:16 -05:00
3eef8a28f26fb2bcc514e6f1938929a1f931762 cc90efffbc Update scraper.yml 2023-02-10 20:44:27 -05:00
3eef8a28f26fb2bcc514e6f1938929a1f931762 cbbc371e97 Working on search, need new helper file 2023-02-10 20:43:13 -05:00
powe97 5ed84a8e71 Update scraper.yml 2023-02-10 20:17:28 -05:00
3eef8a28f26fb2bcc514e6f1938929a1f931762 51dc7bd0f8 Update scraper.yml 2023-02-10 18:35:48 -05:00
3eef8a28f26fb2bcc514e6f1938929a1f931762 8d324bab84 Update scraper.yml 2023-02-10 18:33:32 -05:00
3eef8a28f26fb2bcc514e6f1938929a1f931762 29e57fd98b Try again 2023-02-10 18:24:18 -05:00
3eef8a28f26fb2bcc514e6f1938929a1f931762 f02ae11e2e The hell? 2023-02-10 18:16:58 -05:00
3eef8a28f26fb2bcc514e6f1938929a1f931762 7c28bf2d8f Update github pages action to not serve LICENSE and README.md files 2023-02-10 18:10:28 -05:00
3eef8a28f26fb2bcc514e6f1938929a1f931762 dc2d60a4c8 Fix typo 2023-02-10 17:43:27 -05:00
3eef8a28f26fb2bcc514e6f1938929a1f931762 cee1698764 Add searchable catalog file generation 2023-02-10 17:30:05 -05:00
powe97 7be0c67beb Update autocompile.yml 2023-02-10 15:57:07 -05:00
powe97 c2668bd553 Update scraper.yml 2023-02-10 00:41:24 -05:00
powe97 1c84117432 Try to fix configure-pages 2023-02-10 00:37:40 -05:00
powe97 7eb875a593 Attempt at merging actions 2023-02-10 00:33:40 -05:00
powe97 c5f4070c70 Update scraper.yml 2023-02-09 23:01:58 -05:00
powe97 c5546f4887 Update scraper.yml 2023-02-09 23:01:27 -05:00
powe97 3881dd9aac Update scraper.yml 2023-02-09 22:59:40 -05:00
powe97 1c7fdadfec Fix artifact stuff 2023-02-09 22:33:35 -05:00
powe97 f82b5f6f50 Update scraper.yml 2023-02-09 22:14:12 -05:00
powe97 a500b29431 Update scraper.yml 2023-02-09 22:12:25 -05:00