npawar opened a new pull request #5681:
URL: https://github.com/apache/incubator-pinot/pull/5681


   ## Description
   Add TransformConfigs list to IngestionConfig. This is based on discussion in 
Extensions in the Filtering design doc: 
https://docs.google.com/document/d/1Cahnas3nh0XErETH0KHLaecN6xCnRVYWNKO3rDn7qcI/edit#heading=h.gr3yby6x7mlv
   
   ## Release Notes
   Transform functions can be set in the table config instead of schema. In a 
future release, support for transform functions in schema will go away.
   
   ## Documentation
   TBD for gitbooks
   Example config
   ```
   "ingestionConfig": {
         "filterConfig": {
           "filterFunction": "Groovy({foo == \"VALUE1\"}, foo)"
         },
         "transformConfigs": [{
           "columnName": "bar",
           "transformFunction": "lower(moo)"
         },
         {
           "columnName": "hoursSinceEpoch",
           "transformFunction": "toEpochHours(millis)"
         }]
       }
   ```
   


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org



---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscr...@pinot.apache.org
For additional commands, e-mail: commits-h...@pinot.apache.org

Reply via email to