Τα Πάντα ῥεῖ

Dataflow Kit is Web scraping open source framework written in Go.

Turn websites data into spreadsheets, JSON or APIs with a simple point-and-click toolkit


Try Dataflow Kit

spider

Advanced Data Extraction.

DFK platform provides easy and comfortable way to extract data from web pages.

Fetched data can be stored in structured form like spreadsheet or database. CSV, Microsoft Excel, JSON or XML output data formats are currently supported.

It can be used in many ways for data mining, data processing or archiving.

  • Point, click and extract.
  • Work on any interactive site
  • Scrape a website behind a login form
  • Extract data from multiple pages.
  • Scrape infinite scrolled pages.
  • Scrape details from linked pages.
  • Follow the direction of robots.txt
  • Save results as CSV, JSON, XML
  • Convert resulted JSON to the most popular RDBMS or Clouds with   DBConvert JSON to SQL

See Dataflow kit in action.

Open source

Dataflow kit is completely open source and we welcome all contributors who are interested in collaborating.

Whether you want to help with issues, coding features, releasing the project, scripting, tests, benchmarking, documentation, updating samples or share an information about Dataflow kit.

Please star DFK GitHub repository.


Dataflow kit on Github