Streamsets MongoDB Destinations Use

Testing integrates the directory (Excel) and Redis && field splitter components

Pipeline flow

Docker-compose Configuration

Redis Services && Streamsets

version: "3"services:   sets:     image: streamsets/datacollector      volumes:     - "./ms/data:/data"     - "./ms/logs:/logs"     - "./ms/tmp:/tmp"     ports:     - "8000:8000"     - "18630:18630"   redis:     image: redis     ports:     - "6379:6379"   mongodb:     image: mongo     ports:     - "27017:27017"

Directory Configuration

Reference https://www.cnblogs.com/rongfengliang/p/9509467.html uses Excel format
Excel format

Field Splitter

Add Expression Evaluator Configuration

Add a crud Header

MongoDB Configuration

Run && Effect

• Run
  
• Mongodb
  

Resources

Https://streamsets.com/documentation/datacollector/latest/help/datacollector/UserGuide/Destinations/Redis.html #concept_ktc_gw2_gw
Https://github.com/rongfengliang/streamsets-demos

Streamsets MongoDB Destinations Use