haopengzhan/hireme
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

feat: implement Meta crawler using chromedp and register it in worker pool

Browse Source
This commit is contained in:
haopengzhan
2026-08-22 01:06:47 -07:00
parent f8bfc4b5e3
commit af1ee1c9b3
6 changed files with 251 additions and 2 deletions
Download Patch File Download Diff File Expand all files Collapse all files
go.mod
+8
View File
@@ -4,6 +4,8 @@ go 1.26
require (
github.com/JohannesKaufmann/html-to-markdown/v2 v2.5.2
github.com/chromedp/cdproto v0.0.0-20260714215040-dc233986426f
github.com/chromedp/chromedp v0.16.0
github.com/mattn/go-sqlite3 v1.14.42
github.com/spf13/cobra v1.9.1
github.com/spf13/pflag v1.0.6
@@ -14,6 +16,12 @@ require (
require (
github.com/JohannesKaufmann/dom v0.3.1 // indirect
github.com/chromedp/sysutil v1.1.0 // indirect
github.com/go-json-experiment/json v0.0.0-20260623181947-01eb4420fa68 // indirect
github.com/gobwas/httphead v0.1.0 // indirect
github.com/gobwas/pool v0.2.1 // indirect
github.com/gobwas/ws v1.4.0 // indirect
github.com/inconshreveable/mousetrap v1.1.0 // indirect
go.uber.org/multierr v1.10.0 // indirect
golang.org/x/sys v0.47.0 // indirect
)