Data cleansing and ETL - Log Service
raw data must be cleansed, converted, and sorted using methods like ETL (Extract Transformation Load) to get the final results like city, region, ZIP code.
(GPS-X,GPS-Y) -- (GPS-X, GPS-Y, City, District, ZipCode)This is a typical ETL requirement. Use the ...
Development guide - Log Service
The data consumer terminal of Log Service custom ETL function is running on the Alibaba Cloud Function Compute service. You can use function templates provided by Log Service or user-defined functions according to different ETL purposes ...
Big Data - Product Comparison
/GB Public beta, free for the time being. ETL support Lambda JSON/CSV/Parquet Function computer Connected to MaxCompute and Blink platform, Alibaba Cloud DataHub supports all ETL tools on these two platforms ...
Log Service trigger - Function Compute
, Transform, and Load (ETL) of the log updates in Function Compute.
ScenariosThe Log Service trigger is suitable for Data scrubbing and ETL. Log Service allows you to quickly perform log collection, ETL, query, and analysis, as shown in the following figure ...
2. Author your function - Function Compute
about programming, see Log Service topic Development guide for ETL function.
Sample function for Python 2.7You can use this code, and Load (ETL) job in Log Service. A Log Service trigger in Function Compute corresponds to an ETL job in Log Service.
taskId: The ...
Log analysis - Object Storage Service
Configure the log data delivery and ETL functions. If you do not need to deliver log data, click OK. If you want to deliver log data, click Enable delivery on the required delivery method and ETL function, and then click OK ...