Commit Graph

144 Commits

Author SHA1 Message Date
Bel LaPointe
c7f5cdb040 TODO 2024-04-16 08:33:30 -06:00
Bel LaPointe
a8e8fdc451 synchronous fanout from channel to threads for scrape 2024-04-16 08:33:21 -06:00
Bel LaPointe
d88a8bb23a oof string != byte arr got it 2024-04-16 08:08:47 -06:00
Bel LaPointe
39c0056190 found running locally that i dont need rest, pipeline needs a way to drop messages as garbage 2024-04-16 07:56:54 -06:00
Bel LaPointe
d87af2fadc readme todo 2024-04-16 07:40:51 -06:00
Bel LaPointe
9bc47bfde6 added scraping Routing Team as Team 2024-04-16 07:40:43 -06:00
Bel LaPointe
098986eb07 nil ptr in main test on pipeline spinup race 2024-04-16 07:36:12 -06:00
Bel LaPointe
5bc068451f find Author from slack 2024-04-16 07:35:58 -06:00
Bel LaPointe
5fa21d0cd9 model to persist pipeline tests OK 2024-04-16 07:29:42 -06:00
Bel LaPointe
709f2ac254 slack to model pipeline tested and K 2024-04-16 07:19:25 -06:00
Bel LaPointe
ba06796b8c save what i need from old .Message 2024-04-16 07:05:30 -06:00
Bel LaPointe
f38c183fe8 stubbing 2024-04-16 06:53:30 -06:00
Bel LaPointe
8ae8f47753 tests run and fail again 2024-04-16 06:52:07 -06:00
Bel LaPointe
e372be4288 rm temp 2024-04-16 06:46:30 -06:00
Bel LaPointe
acfd95e5af everything just werks for storage 2024-04-16 06:45:40 -06:00
Bel LaPointe
d70a0e313f STORAGE TEST WERKS 2024-04-16 06:43:25 -06:00
Bel LaPointe
0cecd5ea04 add external id to .model 2024-04-16 05:55:35 -06:00
Bel LaPointe
a7d5d021d6 fill model 2024-04-16 05:51:08 -06:00
bel
44db0c6939 todo 2024-04-15 21:25:13 -06:00
bel
dd98aedb5d class diagram pretty 2024-04-15 21:04:54 -06:00
bel
254cb1ec0a yay 2024-04-15 20:43:43 -06:00
Bel LaPointe
38a68de67f todo 2024-04-15 17:10:34 -06:00
Bel LaPointe
3c62411927 wip normalize 2024-04-15 17:09:31 -06:00
Bel LaPointe
c84d80e8d3 test message to persistence 2024-04-15 17:00:15 -06:00
Bel LaPointe
74477fc09c data design time procrastination 2024-04-15 16:38:01 -06:00
Bel LaPointe
1fd4b72b22 todo 2024-04-15 16:36:25 -06:00
Bel LaPointe
d9244e4e1c t.Parallel pls 2024-04-15 16:35:51 -06:00
Bel LaPointe
c9d3b4998b sql :memory: dont work so make a helper NewTestDriver 2024-04-15 16:34:19 -06:00
Bel LaPointe
c5e1556f61 sp 2024-04-15 16:26:24 -06:00
Bel LaPointe
d76f8e2c15 stub second pipeline 2024-04-15 16:26:16 -06:00
Bel LaPointe
ff280997b1 main can run many pipelines 2024-04-15 16:23:41 -06:00
Bel LaPointe
83c0ee3f53 ok report still botched but im werkin on it 2024-04-15 16:13:31 -06:00
Bel LaPointe
9d7a175c62 at least main_test runs 2024-04-15 16:12:41 -06:00
Bel LaPointe
1dcffdd956 ew compile errs 2024-04-15 16:04:12 -06:00
Bel LaPointe
580068d98b revive message and test slack pipeline parses slack into message 2024-04-15 15:57:56 -06:00
Bel LaPointe
eec5c39725 go mod tidy 2024-04-15 15:50:29 -06:00
Bel LaPointe
9848492b1e no test driver non driver things 2024-04-15 15:50:18 -06:00
Bel LaPointe
a674022357 revive ai, config*.go 2024-04-15 15:49:48 -06:00
Bel LaPointe
80df07089f rename ingest to pipeline 2024-04-15 15:22:23 -06:00
Bel LaPointe
d792626c2f test ingest 2024-04-15 15:18:03 -06:00
Bel LaPointe
acac2a60b0 finish ingest loop 2024-04-15 14:19:53 -06:00
Bel LaPointe
eef78d6e39 noop queue and topics embedded 2024-04-15 14:18:39 -06:00
Bel LaPointe
42c5b7d7ad multi topic done 2024-04-15 13:30:35 -06:00
Bel LaPointe
e85a2d25a1 queue from Dequeue to Syn for SynAck 2024-04-15 13:18:14 -06:00
Bel LaPointe
8193bf7377 f sql jeez 2024-04-15 13:08:21 -06:00
Bel LaPointe
2f3739b24f functions are good 2024-04-15 09:14:59 -06:00
Bel LaPointe
d38352f050 ooooo it is pretty 2024-04-15 09:09:09 -06:00
Bel LaPointe
ba833fa315 this is getting k 2024-04-15 08:45:20 -06:00
Bel LaPointe
d7cbcb9926 d3js not for me 2024-04-15 08:23:10 -06:00
Bel LaPointe
961be827d0 log less 2024-04-15 07:35:39 -06:00