Commit Graph

154 Commits (fbd151f9ef8d1a783add9f833fa7f0f4798a7e6b)

Author SHA1 Message Date
Bel LaPointe fbd151f9ef when initializing slack, stash token in driver 2024-04-17 16:07:43 -06:00
Bel LaPointe 5f21098fdc test and update asset pattern to catch ip addresses 2024-04-17 03:58:43 -06:00
Bel LaPointe 7c2d663401 do not cry to me 2024-04-16 15:08:21 -06:00
Bel LaPointe 95b0394199 slack can parse optional channel wrapper for scrape 2024-04-16 15:03:24 -06:00
Bel LaPointe d9d91193dd oh yeah one big todo 2024-04-16 11:03:14 -06:00
Bel LaPointe 2033cefc2a todo now that we have https://grafana.render.com/d/a5df6a90-087b-4655-90d0-e51dcb89f568/2024-04-16-spocbotvr?orgId=1&from=now-7d&to=now&var-interval=1h&var-Teams=All&var-Assets=All&var-Name=All&var-Names=All 2024-04-16 11:01:45 -06:00
Bel LaPointe 600a2e0111 drop URL from Message as it is unfilled and superfluous 2024-04-16 09:13:44 -06:00
Bel LaPointe 4f3b8ec866 we are ready to ship 2024-04-16 09:09:44 -06:00
Bel LaPointe c4a7eaf04a i am capped at 9args per a bug somewhere between pq and postgres but heck if i care 2024-04-16 09:06:32 -06:00
Bel LaPointe 5557c0920a pg passing mvp test with queue 2024-04-16 08:53:09 -06:00
Bel LaPointe c7f5cdb040 TODO 2024-04-16 08:33:30 -06:00
Bel LaPointe a8e8fdc451 synchronous fanout from channel to threads for scrape 2024-04-16 08:33:21 -06:00
Bel LaPointe d88a8bb23a oof string != byte arr got it 2024-04-16 08:08:47 -06:00
Bel LaPointe 39c0056190 found running locally that i dont need rest, pipeline needs a way to drop messages as garbage 2024-04-16 07:56:54 -06:00
Bel LaPointe d87af2fadc readme todo 2024-04-16 07:40:51 -06:00
Bel LaPointe 9bc47bfde6 added scraping Routing Team as Team 2024-04-16 07:40:43 -06:00
Bel LaPointe 098986eb07 nil ptr in main test on pipeline spinup race 2024-04-16 07:36:12 -06:00
Bel LaPointe 5bc068451f find Author from slack 2024-04-16 07:35:58 -06:00
Bel LaPointe 5fa21d0cd9 model to persist pipeline tests OK 2024-04-16 07:29:42 -06:00
Bel LaPointe 709f2ac254 slack to model pipeline tested and K 2024-04-16 07:19:25 -06:00
Bel LaPointe ba06796b8c save what i need from old .Message 2024-04-16 07:05:30 -06:00
Bel LaPointe f38c183fe8 stubbing 2024-04-16 06:53:30 -06:00
Bel LaPointe 8ae8f47753 tests run and fail again 2024-04-16 06:52:07 -06:00
Bel LaPointe e372be4288 rm temp 2024-04-16 06:46:30 -06:00
Bel LaPointe acfd95e5af everything just werks for storage 2024-04-16 06:45:40 -06:00
Bel LaPointe d70a0e313f STORAGE TEST WERKS 2024-04-16 06:43:25 -06:00
Bel LaPointe 0cecd5ea04 add external id to .model 2024-04-16 05:55:35 -06:00
Bel LaPointe a7d5d021d6 fill model 2024-04-16 05:51:08 -06:00
bel 44db0c6939 todo 2024-04-15 21:25:13 -06:00
bel dd98aedb5d class diagram pretty 2024-04-15 21:04:54 -06:00
bel 254cb1ec0a yay 2024-04-15 20:43:43 -06:00
Bel LaPointe 38a68de67f todo 2024-04-15 17:10:34 -06:00
Bel LaPointe 3c62411927 wip normalize 2024-04-15 17:09:31 -06:00
Bel LaPointe c84d80e8d3 test message to persistence 2024-04-15 17:00:15 -06:00
Bel LaPointe 74477fc09c data design time procrastination 2024-04-15 16:38:01 -06:00
Bel LaPointe 1fd4b72b22 todo 2024-04-15 16:36:25 -06:00
Bel LaPointe d9244e4e1c t.Parallel pls 2024-04-15 16:35:51 -06:00
Bel LaPointe c9d3b4998b sql :memory: dont work so make a helper NewTestDriver 2024-04-15 16:34:19 -06:00
Bel LaPointe c5e1556f61 sp 2024-04-15 16:26:24 -06:00
Bel LaPointe d76f8e2c15 stub second pipeline 2024-04-15 16:26:16 -06:00
Bel LaPointe ff280997b1 main can run many pipelines 2024-04-15 16:23:41 -06:00
Bel LaPointe 83c0ee3f53 ok report still botched but im werkin on it 2024-04-15 16:13:31 -06:00
Bel LaPointe 9d7a175c62 at least main_test runs 2024-04-15 16:12:41 -06:00
Bel LaPointe 1dcffdd956 ew compile errs 2024-04-15 16:04:12 -06:00
Bel LaPointe 580068d98b revive message and test slack pipeline parses slack into message 2024-04-15 15:57:56 -06:00
Bel LaPointe eec5c39725 go mod tidy 2024-04-15 15:50:29 -06:00
Bel LaPointe 9848492b1e no test driver non driver things 2024-04-15 15:50:18 -06:00
Bel LaPointe a674022357 revive ai, config*.go 2024-04-15 15:49:48 -06:00
Bel LaPointe 80df07089f rename ingest to pipeline 2024-04-15 15:22:23 -06:00
Bel LaPointe d792626c2f test ingest 2024-04-15 15:18:03 -06:00