[jira] [Updated] (NIFI-7820) How to connect to controller service DBCP connection pool and execute the sql using that connection via python
[
https://issues.apache.org/jira/browse/NIFI-7820?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
zeyk updated NIFI-7820:
---
Attachment: image-2020-09-20-17-37-12-487.png
> How to connect to controller service DBCP connection pool and execute the sql
> using that connection via python
> ---
>
> Key: NIFI-7820
> URL: https://issues.apache.org/jira/browse/NIFI-7820
> Project: Apache NiFi
> Issue Type: Task
> Components: NiFi Stateless
>Reporter: zeyk
>Priority: Major
> Attachments: enumsWithPython.xml, execute_script.py,
> image-2020-09-20-01-44-32-117.png, image-2020-09-20-01-45-19-739.png,
> image-2020-09-20-01-58-03-615.png, image-2020-09-20-17-36-02-743.png,
> image-2020-09-20-17-37-12-487.png, image-2020-09-20-17-37-49-409.png
>
>
> I have a python code updated with my own logic to replace the index of enums
> with values, but in order to do so , i need to execute certain sql commands
> to get some values and the best thing would be to get the dbcp connection
> pool connection from nifi controller services and execute the commands , but
> i dont know to how to implement that in python, since few modules such as
> pymysql doesnt support in Nifi(Jython) ,Please find the code below:
> Any kind of help would be highly appreciated. Thanks in advance
>
> {color:#89ddff}import{color}{color:#ee} json{color}
> {color:#89ddff}import{color}{color:#ee} re{color}
> {color:#89ddff}import{color}{color:#ee} sys{color}
> {color:#89ddff}import{color}{color:#ee} traceback{color}
> {color:#89ddff}from{color}{color:#ee} java.nio.charset
> {color}{color:#89ddff}import{color}{color:#ee} StandardCharsets{color}
> {color:#89ddff}from{color}{color:#ee} org.apache.commons.io
> {color}{color:#89ddff}import{color}{color:#ee} IOUtils{color}
> {color:#89ddff}from{color}{color:#ee} org.apache.nifi.processor.io
> {color}{color:#89ddff}import{color}{color:#ee} StreamCallback{color}
> {color:#89ddff}from{color}{color:#ee} org.python.core.util
> {color}{color:#89ddff}import{color}{color:#ee} StringUtil{color}
> {color:#c792ea}class{color}{color:#ee}
> {color}{color:#ffcb6b}TransformCallback{color}{color:#89ddff}({color}{color:#c3e88d}StreamCallback{color}{color:#89ddff}):{color}
> {color:#ee}{color}{color:#c792ea}def{color}{color:#ee}
> {color}{color:#82aaff}__init__{color}{color:#89ddff}({color}{color:#ff5370}self{color}{color:#89ddff}):{color}
> {color:#ee}{color}{color:#89ddff}pass{color}
> {color:#ee}{color}{color:#c792ea}def{color}{color:#ee}
> {color}{color:#82aaff}process{color}{color:#89ddff}({color}{color:#ff5370}self{color}{color:#89ddff},{color}{color:#ee}
>
> {color}{color:#ff5370}inputStream{color}{color:#89ddff},{color}{color:#ee}
> {color}{color:#ff5370}outputStream{color}{color:#89ddff}):{color}
> {color:#ee}{color}{color:#89ddff}try{color}{color:#ee}:{color}
> {color:#89ddff}{color}{color:#546e7a}# Read input FlowFile
> content{color}
> {color:#ee}input_text
> {color}{color:#c792ea}={color}{color:#ee}
> IOUtils.toString{color}{color:#89ddff}({color}{color:#ee}inputStream,
> StandardCharsets.UTF_8{color}{color:#89ddff}){color}
> {color:#ee}input_obj
> {color}{color:#c792ea}={color}{color:#ee}
> json.loads{color}{color:#89ddff}({color}{color:#ee}input_text{color}{color:#89ddff}){color}
> {color:#ee} {color}
> {color:#ee}{color}
> {color:#ee} {color}{color:#ee}table_name
> {color}{color:#c792ea}={color}{color:#ee}
> input_obj{color}{color:#89ddff}[{color}{color:#89ddff}'{color}{color:#c3e88d}table_name{color}{color:#89ddff}'{color}{color:#89ddff}]{color}
> {color:#ee}column_name
> {color}{color:#c792ea}={color}{color:#ee}
> {color}{color:#89ddff}"{color}{color:#f78c6c}SELECT{color}{color:#c3e88d}
> column_name {color}{color:#f78c6c}FROM{color}{color:#c3e88d}
> INFORMATION_SCHEMA.COLUMNS {color}{color:#f78c6c}WHERE{color}{color:#c3e88d}
> table_name{color}{color:#c792ea}={color}{color:#89ddff}'{color}{color:#c3e88d}"+table_name+"'
> {color}{color:#f78c6c}AND{color}{color:#c3e88d}
> data_type{color}{color:#c792ea}={color}{color:#89ddff}'{color}{color:#c3e88d}enum'{color}{color:#89ddff}"{color}
> {color:#ee}enum_value_sql
> {color}{color:#c792ea}={color}{color:#ee}
> {color}{color:#89ddff}"{color}{color:#f78c6c}SELECT{color}{color:#c3e88d}
> {color}{color:#82aaff}REPLACE{color}{color:#c3e88d}({color}{color:#82aaff}REPLACE{color}{color:#c3e88d}({color}{color:#82aaff}REPLACE{color}{color:#c3e88d}({color}{color:#82aaff}REPLACE{color}{color:#c3e88d}(column_type,{color}{color:#89ddff}'{col
[jira] [Updated] (NIFI-7820) How to connect to controller service DBCP connection pool and execute the sql using that connection via python
[
https://issues.apache.org/jira/browse/NIFI-7820?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
zeyk updated NIFI-7820:
---
Attachment: image-2020-09-20-17-37-49-409.png
> How to connect to controller service DBCP connection pool and execute the sql
> using that connection via python
> ---
>
> Key: NIFI-7820
> URL: https://issues.apache.org/jira/browse/NIFI-7820
> Project: Apache NiFi
> Issue Type: Task
> Components: NiFi Stateless
>Reporter: zeyk
>Priority: Major
> Attachments: enumsWithPython.xml, execute_script.py,
> image-2020-09-20-01-44-32-117.png, image-2020-09-20-01-45-19-739.png,
> image-2020-09-20-01-58-03-615.png, image-2020-09-20-17-36-02-743.png,
> image-2020-09-20-17-37-12-487.png, image-2020-09-20-17-37-49-409.png
>
>
> I have a python code updated with my own logic to replace the index of enums
> with values, but in order to do so , i need to execute certain sql commands
> to get some values and the best thing would be to get the dbcp connection
> pool connection from nifi controller services and execute the commands , but
> i dont know to how to implement that in python, since few modules such as
> pymysql doesnt support in Nifi(Jython) ,Please find the code below:
> Any kind of help would be highly appreciated. Thanks in advance
>
> {color:#89ddff}import{color}{color:#ee} json{color}
> {color:#89ddff}import{color}{color:#ee} re{color}
> {color:#89ddff}import{color}{color:#ee} sys{color}
> {color:#89ddff}import{color}{color:#ee} traceback{color}
> {color:#89ddff}from{color}{color:#ee} java.nio.charset
> {color}{color:#89ddff}import{color}{color:#ee} StandardCharsets{color}
> {color:#89ddff}from{color}{color:#ee} org.apache.commons.io
> {color}{color:#89ddff}import{color}{color:#ee} IOUtils{color}
> {color:#89ddff}from{color}{color:#ee} org.apache.nifi.processor.io
> {color}{color:#89ddff}import{color}{color:#ee} StreamCallback{color}
> {color:#89ddff}from{color}{color:#ee} org.python.core.util
> {color}{color:#89ddff}import{color}{color:#ee} StringUtil{color}
> {color:#c792ea}class{color}{color:#ee}
> {color}{color:#ffcb6b}TransformCallback{color}{color:#89ddff}({color}{color:#c3e88d}StreamCallback{color}{color:#89ddff}):{color}
> {color:#ee}{color}{color:#c792ea}def{color}{color:#ee}
> {color}{color:#82aaff}__init__{color}{color:#89ddff}({color}{color:#ff5370}self{color}{color:#89ddff}):{color}
> {color:#ee}{color}{color:#89ddff}pass{color}
> {color:#ee}{color}{color:#c792ea}def{color}{color:#ee}
> {color}{color:#82aaff}process{color}{color:#89ddff}({color}{color:#ff5370}self{color}{color:#89ddff},{color}{color:#ee}
>
> {color}{color:#ff5370}inputStream{color}{color:#89ddff},{color}{color:#ee}
> {color}{color:#ff5370}outputStream{color}{color:#89ddff}):{color}
> {color:#ee}{color}{color:#89ddff}try{color}{color:#ee}:{color}
> {color:#89ddff}{color}{color:#546e7a}# Read input FlowFile
> content{color}
> {color:#ee}input_text
> {color}{color:#c792ea}={color}{color:#ee}
> IOUtils.toString{color}{color:#89ddff}({color}{color:#ee}inputStream,
> StandardCharsets.UTF_8{color}{color:#89ddff}){color}
> {color:#ee}input_obj
> {color}{color:#c792ea}={color}{color:#ee}
> json.loads{color}{color:#89ddff}({color}{color:#ee}input_text{color}{color:#89ddff}){color}
> {color:#ee} {color}
> {color:#ee}{color}
> {color:#ee} {color}{color:#ee}table_name
> {color}{color:#c792ea}={color}{color:#ee}
> input_obj{color}{color:#89ddff}[{color}{color:#89ddff}'{color}{color:#c3e88d}table_name{color}{color:#89ddff}'{color}{color:#89ddff}]{color}
> {color:#ee}column_name
> {color}{color:#c792ea}={color}{color:#ee}
> {color}{color:#89ddff}"{color}{color:#f78c6c}SELECT{color}{color:#c3e88d}
> column_name {color}{color:#f78c6c}FROM{color}{color:#c3e88d}
> INFORMATION_SCHEMA.COLUMNS {color}{color:#f78c6c}WHERE{color}{color:#c3e88d}
> table_name{color}{color:#c792ea}={color}{color:#89ddff}'{color}{color:#c3e88d}"+table_name+"'
> {color}{color:#f78c6c}AND{color}{color:#c3e88d}
> data_type{color}{color:#c792ea}={color}{color:#89ddff}'{color}{color:#c3e88d}enum'{color}{color:#89ddff}"{color}
> {color:#ee}enum_value_sql
> {color}{color:#c792ea}={color}{color:#ee}
> {color}{color:#89ddff}"{color}{color:#f78c6c}SELECT{color}{color:#c3e88d}
> {color}{color:#82aaff}REPLACE{color}{color:#c3e88d}({color}{color:#82aaff}REPLACE{color}{color:#c3e88d}({color}{color:#82aaff}REPLACE{color}{color:#c3e88d}({color}{color:#82aaff}REPLACE{color}{color:#c3e88d}(column_type,{color}{color:#89ddff}'{col
[jira] [Updated] (NIFI-7820) How to connect to controller service DBCP connection pool and execute the sql using that connection via python
[
https://issues.apache.org/jira/browse/NIFI-7820?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
zeyk updated NIFI-7820:
---
Attachment: image-2020-09-20-17-36-02-743.png
> How to connect to controller service DBCP connection pool and execute the sql
> using that connection via python
> ---
>
> Key: NIFI-7820
> URL: https://issues.apache.org/jira/browse/NIFI-7820
> Project: Apache NiFi
> Issue Type: Task
> Components: NiFi Stateless
>Reporter: zeyk
>Priority: Major
> Attachments: enumsWithPython.xml, execute_script.py,
> image-2020-09-20-01-44-32-117.png, image-2020-09-20-01-45-19-739.png,
> image-2020-09-20-01-58-03-615.png, image-2020-09-20-17-36-02-743.png
>
>
> I have a python code updated with my own logic to replace the index of enums
> with values, but in order to do so , i need to execute certain sql commands
> to get some values and the best thing would be to get the dbcp connection
> pool connection from nifi controller services and execute the commands , but
> i dont know to how to implement that in python, since few modules such as
> pymysql doesnt support in Nifi(Jython) ,Please find the code below:
> Any kind of help would be highly appreciated. Thanks in advance
>
> {color:#89ddff}import{color}{color:#ee} json{color}
> {color:#89ddff}import{color}{color:#ee} re{color}
> {color:#89ddff}import{color}{color:#ee} sys{color}
> {color:#89ddff}import{color}{color:#ee} traceback{color}
> {color:#89ddff}from{color}{color:#ee} java.nio.charset
> {color}{color:#89ddff}import{color}{color:#ee} StandardCharsets{color}
> {color:#89ddff}from{color}{color:#ee} org.apache.commons.io
> {color}{color:#89ddff}import{color}{color:#ee} IOUtils{color}
> {color:#89ddff}from{color}{color:#ee} org.apache.nifi.processor.io
> {color}{color:#89ddff}import{color}{color:#ee} StreamCallback{color}
> {color:#89ddff}from{color}{color:#ee} org.python.core.util
> {color}{color:#89ddff}import{color}{color:#ee} StringUtil{color}
> {color:#c792ea}class{color}{color:#ee}
> {color}{color:#ffcb6b}TransformCallback{color}{color:#89ddff}({color}{color:#c3e88d}StreamCallback{color}{color:#89ddff}):{color}
> {color:#ee}{color}{color:#c792ea}def{color}{color:#ee}
> {color}{color:#82aaff}__init__{color}{color:#89ddff}({color}{color:#ff5370}self{color}{color:#89ddff}):{color}
> {color:#ee}{color}{color:#89ddff}pass{color}
> {color:#ee}{color}{color:#c792ea}def{color}{color:#ee}
> {color}{color:#82aaff}process{color}{color:#89ddff}({color}{color:#ff5370}self{color}{color:#89ddff},{color}{color:#ee}
>
> {color}{color:#ff5370}inputStream{color}{color:#89ddff},{color}{color:#ee}
> {color}{color:#ff5370}outputStream{color}{color:#89ddff}):{color}
> {color:#ee}{color}{color:#89ddff}try{color}{color:#ee}:{color}
> {color:#89ddff}{color}{color:#546e7a}# Read input FlowFile
> content{color}
> {color:#ee}input_text
> {color}{color:#c792ea}={color}{color:#ee}
> IOUtils.toString{color}{color:#89ddff}({color}{color:#ee}inputStream,
> StandardCharsets.UTF_8{color}{color:#89ddff}){color}
> {color:#ee}input_obj
> {color}{color:#c792ea}={color}{color:#ee}
> json.loads{color}{color:#89ddff}({color}{color:#ee}input_text{color}{color:#89ddff}){color}
> {color:#ee} {color}
> {color:#ee}{color}
> {color:#ee} {color}{color:#ee}table_name
> {color}{color:#c792ea}={color}{color:#ee}
> input_obj{color}{color:#89ddff}[{color}{color:#89ddff}'{color}{color:#c3e88d}table_name{color}{color:#89ddff}'{color}{color:#89ddff}]{color}
> {color:#ee}column_name
> {color}{color:#c792ea}={color}{color:#ee}
> {color}{color:#89ddff}"{color}{color:#f78c6c}SELECT{color}{color:#c3e88d}
> column_name {color}{color:#f78c6c}FROM{color}{color:#c3e88d}
> INFORMATION_SCHEMA.COLUMNS {color}{color:#f78c6c}WHERE{color}{color:#c3e88d}
> table_name{color}{color:#c792ea}={color}{color:#89ddff}'{color}{color:#c3e88d}"+table_name+"'
> {color}{color:#f78c6c}AND{color}{color:#c3e88d}
> data_type{color}{color:#c792ea}={color}{color:#89ddff}'{color}{color:#c3e88d}enum'{color}{color:#89ddff}"{color}
> {color:#ee}enum_value_sql
> {color}{color:#c792ea}={color}{color:#ee}
> {color}{color:#89ddff}"{color}{color:#f78c6c}SELECT{color}{color:#c3e88d}
> {color}{color:#82aaff}REPLACE{color}{color:#c3e88d}({color}{color:#82aaff}REPLACE{color}{color:#c3e88d}({color}{color:#82aaff}REPLACE{color}{color:#c3e88d}({color}{color:#82aaff}REPLACE{color}{color:#c3e88d}(column_type,{color}{color:#89ddff}'{color}{color:#c3e88d}enum',{color}{color:#89ddff}'{color}{color:#c3e88d}'),{
[jira] [Updated] (NIFI-7820) How to connect to controller service DBCP connection pool and execute the sql using that connection via python
[
https://issues.apache.org/jira/browse/NIFI-7820?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Roberto Garcia updated NIFI-7820:
-
Attachment: enumsWithPython.xml
> How to connect to controller service DBCP connection pool and execute the sql
> using that connection via python
> ---
>
> Key: NIFI-7820
> URL: https://issues.apache.org/jira/browse/NIFI-7820
> Project: Apache NiFi
> Issue Type: Task
> Components: NiFi Stateless
>Reporter: zeyk
>Priority: Major
> Attachments: enumsWithPython.xml, execute_script.py,
> image-2020-09-20-01-44-32-117.png, image-2020-09-20-01-45-19-739.png,
> image-2020-09-20-01-58-03-615.png
>
>
> I have a python code updated with my own logic to replace the index of enums
> with values, but in order to do so , i need to execute certain sql commands
> to get some values and the best thing would be to get the dbcp connection
> pool connection from nifi controller services and execute the commands , but
> i dont know to how to implement that in python, since few modules such as
> pymysql doesnt support in Nifi(Jython) ,Please find the code below:
> Any kind of help would be highly appreciated. Thanks in advance
>
> {color:#89ddff}import{color}{color:#ee} json{color}
> {color:#89ddff}import{color}{color:#ee} re{color}
> {color:#89ddff}import{color}{color:#ee} sys{color}
> {color:#89ddff}import{color}{color:#ee} traceback{color}
> {color:#89ddff}from{color}{color:#ee} java.nio.charset
> {color}{color:#89ddff}import{color}{color:#ee} StandardCharsets{color}
> {color:#89ddff}from{color}{color:#ee} org.apache.commons.io
> {color}{color:#89ddff}import{color}{color:#ee} IOUtils{color}
> {color:#89ddff}from{color}{color:#ee} org.apache.nifi.processor.io
> {color}{color:#89ddff}import{color}{color:#ee} StreamCallback{color}
> {color:#89ddff}from{color}{color:#ee} org.python.core.util
> {color}{color:#89ddff}import{color}{color:#ee} StringUtil{color}
> {color:#c792ea}class{color}{color:#ee}
> {color}{color:#ffcb6b}TransformCallback{color}{color:#89ddff}({color}{color:#c3e88d}StreamCallback{color}{color:#89ddff}):{color}
> {color:#ee}{color}{color:#c792ea}def{color}{color:#ee}
> {color}{color:#82aaff}__init__{color}{color:#89ddff}({color}{color:#ff5370}self{color}{color:#89ddff}):{color}
> {color:#ee}{color}{color:#89ddff}pass{color}
> {color:#ee}{color}{color:#c792ea}def{color}{color:#ee}
> {color}{color:#82aaff}process{color}{color:#89ddff}({color}{color:#ff5370}self{color}{color:#89ddff},{color}{color:#ee}
>
> {color}{color:#ff5370}inputStream{color}{color:#89ddff},{color}{color:#ee}
> {color}{color:#ff5370}outputStream{color}{color:#89ddff}):{color}
> {color:#ee}{color}{color:#89ddff}try{color}{color:#ee}:{color}
> {color:#89ddff}{color}{color:#546e7a}# Read input FlowFile
> content{color}
> {color:#ee}input_text
> {color}{color:#c792ea}={color}{color:#ee}
> IOUtils.toString{color}{color:#89ddff}({color}{color:#ee}inputStream,
> StandardCharsets.UTF_8{color}{color:#89ddff}){color}
> {color:#ee}input_obj
> {color}{color:#c792ea}={color}{color:#ee}
> json.loads{color}{color:#89ddff}({color}{color:#ee}input_text{color}{color:#89ddff}){color}
> {color:#ee} {color}
> {color:#ee}{color}
> {color:#ee} {color}{color:#ee}table_name
> {color}{color:#c792ea}={color}{color:#ee}
> input_obj{color}{color:#89ddff}[{color}{color:#89ddff}'{color}{color:#c3e88d}table_name{color}{color:#89ddff}'{color}{color:#89ddff}]{color}
> {color:#ee}column_name
> {color}{color:#c792ea}={color}{color:#ee}
> {color}{color:#89ddff}"{color}{color:#f78c6c}SELECT{color}{color:#c3e88d}
> column_name {color}{color:#f78c6c}FROM{color}{color:#c3e88d}
> INFORMATION_SCHEMA.COLUMNS {color}{color:#f78c6c}WHERE{color}{color:#c3e88d}
> table_name{color}{color:#c792ea}={color}{color:#89ddff}'{color}{color:#c3e88d}"+table_name+"'
> {color}{color:#f78c6c}AND{color}{color:#c3e88d}
> data_type{color}{color:#c792ea}={color}{color:#89ddff}'{color}{color:#c3e88d}enum'{color}{color:#89ddff}"{color}
> {color:#ee}enum_value_sql
> {color}{color:#c792ea}={color}{color:#ee}
> {color}{color:#89ddff}"{color}{color:#f78c6c}SELECT{color}{color:#c3e88d}
> {color}{color:#82aaff}REPLACE{color}{color:#c3e88d}({color}{color:#82aaff}REPLACE{color}{color:#c3e88d}({color}{color:#82aaff}REPLACE{color}{color:#c3e88d}({color}{color:#82aaff}REPLACE{color}{color:#c3e88d}(column_type,{color}{color:#89ddff}'{color}{color:#c3e88d}enum',{color}{color:#89ddff}'{color}{color:#c3e88d}'),{color}{color:#89ddff}'{color}
[jira] [Updated] (NIFI-7820) How to connect to controller service DBCP connection pool and execute the sql using that connection via python
[
https://issues.apache.org/jira/browse/NIFI-7820?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Roberto Garcia updated NIFI-7820:
-
Attachment: image-2020-09-20-01-58-03-615.png
> How to connect to controller service DBCP connection pool and execute the sql
> using that connection via python
> ---
>
> Key: NIFI-7820
> URL: https://issues.apache.org/jira/browse/NIFI-7820
> Project: Apache NiFi
> Issue Type: Task
> Components: NiFi Stateless
>Reporter: zeyk
>Priority: Major
> Attachments: execute_script.py, image-2020-09-20-01-44-32-117.png,
> image-2020-09-20-01-45-19-739.png, image-2020-09-20-01-58-03-615.png
>
>
> I have a python code updated with my own logic to replace the index of enums
> with values, but in order to do so , i need to execute certain sql commands
> to get some values and the best thing would be to get the dbcp connection
> pool connection from nifi controller services and execute the commands , but
> i dont know to how to implement that in python, since few modules such as
> pymysql doesnt support in Nifi(Jython) ,Please find the code below:
> Any kind of help would be highly appreciated. Thanks in advance
>
> {color:#89ddff}import{color}{color:#ee} json{color}
> {color:#89ddff}import{color}{color:#ee} re{color}
> {color:#89ddff}import{color}{color:#ee} sys{color}
> {color:#89ddff}import{color}{color:#ee} traceback{color}
> {color:#89ddff}from{color}{color:#ee} java.nio.charset
> {color}{color:#89ddff}import{color}{color:#ee} StandardCharsets{color}
> {color:#89ddff}from{color}{color:#ee} org.apache.commons.io
> {color}{color:#89ddff}import{color}{color:#ee} IOUtils{color}
> {color:#89ddff}from{color}{color:#ee} org.apache.nifi.processor.io
> {color}{color:#89ddff}import{color}{color:#ee} StreamCallback{color}
> {color:#89ddff}from{color}{color:#ee} org.python.core.util
> {color}{color:#89ddff}import{color}{color:#ee} StringUtil{color}
> {color:#c792ea}class{color}{color:#ee}
> {color}{color:#ffcb6b}TransformCallback{color}{color:#89ddff}({color}{color:#c3e88d}StreamCallback{color}{color:#89ddff}):{color}
> {color:#ee}{color}{color:#c792ea}def{color}{color:#ee}
> {color}{color:#82aaff}__init__{color}{color:#89ddff}({color}{color:#ff5370}self{color}{color:#89ddff}):{color}
> {color:#ee}{color}{color:#89ddff}pass{color}
> {color:#ee}{color}{color:#c792ea}def{color}{color:#ee}
> {color}{color:#82aaff}process{color}{color:#89ddff}({color}{color:#ff5370}self{color}{color:#89ddff},{color}{color:#ee}
>
> {color}{color:#ff5370}inputStream{color}{color:#89ddff},{color}{color:#ee}
> {color}{color:#ff5370}outputStream{color}{color:#89ddff}):{color}
> {color:#ee}{color}{color:#89ddff}try{color}{color:#ee}:{color}
> {color:#89ddff}{color}{color:#546e7a}# Read input FlowFile
> content{color}
> {color:#ee}input_text
> {color}{color:#c792ea}={color}{color:#ee}
> IOUtils.toString{color}{color:#89ddff}({color}{color:#ee}inputStream,
> StandardCharsets.UTF_8{color}{color:#89ddff}){color}
> {color:#ee}input_obj
> {color}{color:#c792ea}={color}{color:#ee}
> json.loads{color}{color:#89ddff}({color}{color:#ee}input_text{color}{color:#89ddff}){color}
> {color:#ee} {color}
> {color:#ee}{color}
> {color:#ee} {color}{color:#ee}table_name
> {color}{color:#c792ea}={color}{color:#ee}
> input_obj{color}{color:#89ddff}[{color}{color:#89ddff}'{color}{color:#c3e88d}table_name{color}{color:#89ddff}'{color}{color:#89ddff}]{color}
> {color:#ee}column_name
> {color}{color:#c792ea}={color}{color:#ee}
> {color}{color:#89ddff}"{color}{color:#f78c6c}SELECT{color}{color:#c3e88d}
> column_name {color}{color:#f78c6c}FROM{color}{color:#c3e88d}
> INFORMATION_SCHEMA.COLUMNS {color}{color:#f78c6c}WHERE{color}{color:#c3e88d}
> table_name{color}{color:#c792ea}={color}{color:#89ddff}'{color}{color:#c3e88d}"+table_name+"'
> {color}{color:#f78c6c}AND{color}{color:#c3e88d}
> data_type{color}{color:#c792ea}={color}{color:#89ddff}'{color}{color:#c3e88d}enum'{color}{color:#89ddff}"{color}
> {color:#ee}enum_value_sql
> {color}{color:#c792ea}={color}{color:#ee}
> {color}{color:#89ddff}"{color}{color:#f78c6c}SELECT{color}{color:#c3e88d}
> {color}{color:#82aaff}REPLACE{color}{color:#c3e88d}({color}{color:#82aaff}REPLACE{color}{color:#c3e88d}({color}{color:#82aaff}REPLACE{color}{color:#c3e88d}({color}{color:#82aaff}REPLACE{color}{color:#c3e88d}(column_type,{color}{color:#89ddff}'{color}{color:#c3e88d}enum',{color}{color:#89ddff}'{color}{color:#c3e88d}'),{color}{color:#89ddff}'{color}{color:#c3
[jira] [Updated] (NIFI-7820) How to connect to controller service DBCP connection pool and execute the sql using that connection via python
[
https://issues.apache.org/jira/browse/NIFI-7820?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Roberto Garcia updated NIFI-7820:
-
Attachment: image-2020-09-20-01-45-19-739.png
> How to connect to controller service DBCP connection pool and execute the sql
> using that connection via python
> ---
>
> Key: NIFI-7820
> URL: https://issues.apache.org/jira/browse/NIFI-7820
> Project: Apache NiFi
> Issue Type: Task
> Components: NiFi Stateless
>Reporter: zeyk
>Priority: Major
> Attachments: execute_script.py, image-2020-09-20-01-44-32-117.png,
> image-2020-09-20-01-45-19-739.png
>
>
> I have a python code updated with my own logic to replace the index of enums
> with values, but in order to do so , i need to execute certain sql commands
> to get some values and the best thing would be to get the dbcp connection
> pool connection from nifi controller services and execute the commands , but
> i dont know to how to implement that in python, since few modules such as
> pymysql doesnt support in Nifi(Jython) ,Please find the code below:
> Any kind of help would be highly appreciated. Thanks in advance
>
> {color:#89ddff}import{color}{color:#ee} json{color}
> {color:#89ddff}import{color}{color:#ee} re{color}
> {color:#89ddff}import{color}{color:#ee} sys{color}
> {color:#89ddff}import{color}{color:#ee} traceback{color}
> {color:#89ddff}from{color}{color:#ee} java.nio.charset
> {color}{color:#89ddff}import{color}{color:#ee} StandardCharsets{color}
> {color:#89ddff}from{color}{color:#ee} org.apache.commons.io
> {color}{color:#89ddff}import{color}{color:#ee} IOUtils{color}
> {color:#89ddff}from{color}{color:#ee} org.apache.nifi.processor.io
> {color}{color:#89ddff}import{color}{color:#ee} StreamCallback{color}
> {color:#89ddff}from{color}{color:#ee} org.python.core.util
> {color}{color:#89ddff}import{color}{color:#ee} StringUtil{color}
> {color:#c792ea}class{color}{color:#ee}
> {color}{color:#ffcb6b}TransformCallback{color}{color:#89ddff}({color}{color:#c3e88d}StreamCallback{color}{color:#89ddff}):{color}
> {color:#ee}{color}{color:#c792ea}def{color}{color:#ee}
> {color}{color:#82aaff}__init__{color}{color:#89ddff}({color}{color:#ff5370}self{color}{color:#89ddff}):{color}
> {color:#ee}{color}{color:#89ddff}pass{color}
> {color:#ee}{color}{color:#c792ea}def{color}{color:#ee}
> {color}{color:#82aaff}process{color}{color:#89ddff}({color}{color:#ff5370}self{color}{color:#89ddff},{color}{color:#ee}
>
> {color}{color:#ff5370}inputStream{color}{color:#89ddff},{color}{color:#ee}
> {color}{color:#ff5370}outputStream{color}{color:#89ddff}):{color}
> {color:#ee}{color}{color:#89ddff}try{color}{color:#ee}:{color}
> {color:#89ddff}{color}{color:#546e7a}# Read input FlowFile
> content{color}
> {color:#ee}input_text
> {color}{color:#c792ea}={color}{color:#ee}
> IOUtils.toString{color}{color:#89ddff}({color}{color:#ee}inputStream,
> StandardCharsets.UTF_8{color}{color:#89ddff}){color}
> {color:#ee}input_obj
> {color}{color:#c792ea}={color}{color:#ee}
> json.loads{color}{color:#89ddff}({color}{color:#ee}input_text{color}{color:#89ddff}){color}
> {color:#ee} {color}
> {color:#ee}{color}
> {color:#ee} {color}{color:#ee}table_name
> {color}{color:#c792ea}={color}{color:#ee}
> input_obj{color}{color:#89ddff}[{color}{color:#89ddff}'{color}{color:#c3e88d}table_name{color}{color:#89ddff}'{color}{color:#89ddff}]{color}
> {color:#ee}column_name
> {color}{color:#c792ea}={color}{color:#ee}
> {color}{color:#89ddff}"{color}{color:#f78c6c}SELECT{color}{color:#c3e88d}
> column_name {color}{color:#f78c6c}FROM{color}{color:#c3e88d}
> INFORMATION_SCHEMA.COLUMNS {color}{color:#f78c6c}WHERE{color}{color:#c3e88d}
> table_name{color}{color:#c792ea}={color}{color:#89ddff}'{color}{color:#c3e88d}"+table_name+"'
> {color}{color:#f78c6c}AND{color}{color:#c3e88d}
> data_type{color}{color:#c792ea}={color}{color:#89ddff}'{color}{color:#c3e88d}enum'{color}{color:#89ddff}"{color}
> {color:#ee}enum_value_sql
> {color}{color:#c792ea}={color}{color:#ee}
> {color}{color:#89ddff}"{color}{color:#f78c6c}SELECT{color}{color:#c3e88d}
> {color}{color:#82aaff}REPLACE{color}{color:#c3e88d}({color}{color:#82aaff}REPLACE{color}{color:#c3e88d}({color}{color:#82aaff}REPLACE{color}{color:#c3e88d}({color}{color:#82aaff}REPLACE{color}{color:#c3e88d}(column_type,{color}{color:#89ddff}'{color}{color:#c3e88d}enum',{color}{color:#89ddff}'{color}{color:#c3e88d}'),{color}{color:#89ddff}'{color}{color:#c3e88d})',{color}{color:#89ddff}'{col
[jira] [Updated] (NIFI-7820) How to connect to controller service DBCP connection pool and execute the sql using that connection via python
[
https://issues.apache.org/jira/browse/NIFI-7820?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Roberto Garcia updated NIFI-7820:
-
Attachment: image-2020-09-20-01-44-32-117.png
> How to connect to controller service DBCP connection pool and execute the sql
> using that connection via python
> ---
>
> Key: NIFI-7820
> URL: https://issues.apache.org/jira/browse/NIFI-7820
> Project: Apache NiFi
> Issue Type: Task
> Components: NiFi Stateless
>Reporter: zeyk
>Priority: Major
> Attachments: execute_script.py, image-2020-09-20-01-44-32-117.png
>
>
> I have a python code updated with my own logic to replace the index of enums
> with values, but in order to do so , i need to execute certain sql commands
> to get some values and the best thing would be to get the dbcp connection
> pool connection from nifi controller services and execute the commands , but
> i dont know to how to implement that in python, since few modules such as
> pymysql doesnt support in Nifi(Jython) ,Please find the code below:
> Any kind of help would be highly appreciated. Thanks in advance
>
> {color:#89ddff}import{color}{color:#ee} json{color}
> {color:#89ddff}import{color}{color:#ee} re{color}
> {color:#89ddff}import{color}{color:#ee} sys{color}
> {color:#89ddff}import{color}{color:#ee} traceback{color}
> {color:#89ddff}from{color}{color:#ee} java.nio.charset
> {color}{color:#89ddff}import{color}{color:#ee} StandardCharsets{color}
> {color:#89ddff}from{color}{color:#ee} org.apache.commons.io
> {color}{color:#89ddff}import{color}{color:#ee} IOUtils{color}
> {color:#89ddff}from{color}{color:#ee} org.apache.nifi.processor.io
> {color}{color:#89ddff}import{color}{color:#ee} StreamCallback{color}
> {color:#89ddff}from{color}{color:#ee} org.python.core.util
> {color}{color:#89ddff}import{color}{color:#ee} StringUtil{color}
> {color:#c792ea}class{color}{color:#ee}
> {color}{color:#ffcb6b}TransformCallback{color}{color:#89ddff}({color}{color:#c3e88d}StreamCallback{color}{color:#89ddff}):{color}
> {color:#ee}{color}{color:#c792ea}def{color}{color:#ee}
> {color}{color:#82aaff}__init__{color}{color:#89ddff}({color}{color:#ff5370}self{color}{color:#89ddff}):{color}
> {color:#ee}{color}{color:#89ddff}pass{color}
> {color:#ee}{color}{color:#c792ea}def{color}{color:#ee}
> {color}{color:#82aaff}process{color}{color:#89ddff}({color}{color:#ff5370}self{color}{color:#89ddff},{color}{color:#ee}
>
> {color}{color:#ff5370}inputStream{color}{color:#89ddff},{color}{color:#ee}
> {color}{color:#ff5370}outputStream{color}{color:#89ddff}):{color}
> {color:#ee}{color}{color:#89ddff}try{color}{color:#ee}:{color}
> {color:#89ddff}{color}{color:#546e7a}# Read input FlowFile
> content{color}
> {color:#ee}input_text
> {color}{color:#c792ea}={color}{color:#ee}
> IOUtils.toString{color}{color:#89ddff}({color}{color:#ee}inputStream,
> StandardCharsets.UTF_8{color}{color:#89ddff}){color}
> {color:#ee}input_obj
> {color}{color:#c792ea}={color}{color:#ee}
> json.loads{color}{color:#89ddff}({color}{color:#ee}input_text{color}{color:#89ddff}){color}
> {color:#ee} {color}
> {color:#ee}{color}
> {color:#ee} {color}{color:#ee}table_name
> {color}{color:#c792ea}={color}{color:#ee}
> input_obj{color}{color:#89ddff}[{color}{color:#89ddff}'{color}{color:#c3e88d}table_name{color}{color:#89ddff}'{color}{color:#89ddff}]{color}
> {color:#ee}column_name
> {color}{color:#c792ea}={color}{color:#ee}
> {color}{color:#89ddff}"{color}{color:#f78c6c}SELECT{color}{color:#c3e88d}
> column_name {color}{color:#f78c6c}FROM{color}{color:#c3e88d}
> INFORMATION_SCHEMA.COLUMNS {color}{color:#f78c6c}WHERE{color}{color:#c3e88d}
> table_name{color}{color:#c792ea}={color}{color:#89ddff}'{color}{color:#c3e88d}"+table_name+"'
> {color}{color:#f78c6c}AND{color}{color:#c3e88d}
> data_type{color}{color:#c792ea}={color}{color:#89ddff}'{color}{color:#c3e88d}enum'{color}{color:#89ddff}"{color}
> {color:#ee}enum_value_sql
> {color}{color:#c792ea}={color}{color:#ee}
> {color}{color:#89ddff}"{color}{color:#f78c6c}SELECT{color}{color:#c3e88d}
> {color}{color:#82aaff}REPLACE{color}{color:#c3e88d}({color}{color:#82aaff}REPLACE{color}{color:#c3e88d}({color}{color:#82aaff}REPLACE{color}{color:#c3e88d}({color}{color:#82aaff}REPLACE{color}{color:#c3e88d}(column_type,{color}{color:#89ddff}'{color}{color:#c3e88d}enum',{color}{color:#89ddff}'{color}{color:#c3e88d}'),{color}{color:#89ddff}'{color}{color:#c3e88d})',{color}{color:#89ddff}'{color}{color:#c3e88d}'),{color}{color:#89
[jira] [Updated] (NIFI-7820) How to connect to controller service DBCP connection pool and execute the sql using that connection via python
[
https://issues.apache.org/jira/browse/NIFI-7820?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
zeyk updated NIFI-7820:
---
Attachment: execute_script.py
> How to connect to controller service DBCP connection pool and execute the sql
> using that connection via python
> ---
>
> Key: NIFI-7820
> URL: https://issues.apache.org/jira/browse/NIFI-7820
> Project: Apache NiFi
> Issue Type: Task
> Components: NiFi Stateless
>Reporter: zeyk
>Priority: Major
> Attachments: execute_script.py
>
>
> I have a python code updated with my own logic to replace the index of enums
> with values, but in order to do so , i need to execute certain sql commands
> to get some values and the best thing would be to get the dbcp connection
> pool connection from nifi controller services and execute the commands , but
> i dont know to how to implement that in python, since few modules such as
> pymysql doesnt support in Nifi(Jython) ,Please find the code below:
> Any kind of help would be highly appreciated. Thanks in advance
>
> {color:#89ddff}import{color}{color:#ee} json{color}
> {color:#89ddff}import{color}{color:#ee} re{color}
> {color:#89ddff}import{color}{color:#ee} sys{color}
> {color:#89ddff}import{color}{color:#ee} traceback{color}
> {color:#89ddff}from{color}{color:#ee} java.nio.charset
> {color}{color:#89ddff}import{color}{color:#ee} StandardCharsets{color}
> {color:#89ddff}from{color}{color:#ee} org.apache.commons.io
> {color}{color:#89ddff}import{color}{color:#ee} IOUtils{color}
> {color:#89ddff}from{color}{color:#ee} org.apache.nifi.processor.io
> {color}{color:#89ddff}import{color}{color:#ee} StreamCallback{color}
> {color:#89ddff}from{color}{color:#ee} org.python.core.util
> {color}{color:#89ddff}import{color}{color:#ee} StringUtil{color}
> {color:#c792ea}class{color}{color:#ee}
> {color}{color:#ffcb6b}TransformCallback{color}{color:#89ddff}({color}{color:#c3e88d}StreamCallback{color}{color:#89ddff}):{color}
> {color:#ee}{color}{color:#c792ea}def{color}{color:#ee}
> {color}{color:#82aaff}__init__{color}{color:#89ddff}({color}{color:#ff5370}self{color}{color:#89ddff}):{color}
> {color:#ee}{color}{color:#89ddff}pass{color}
> {color:#ee}{color}{color:#c792ea}def{color}{color:#ee}
> {color}{color:#82aaff}process{color}{color:#89ddff}({color}{color:#ff5370}self{color}{color:#89ddff},{color}{color:#ee}
>
> {color}{color:#ff5370}inputStream{color}{color:#89ddff},{color}{color:#ee}
> {color}{color:#ff5370}outputStream{color}{color:#89ddff}):{color}
> {color:#ee}{color}{color:#89ddff}try{color}{color:#ee}:{color}
> {color:#89ddff}{color}{color:#546e7a}# Read input FlowFile
> content{color}
> {color:#ee}input_text
> {color}{color:#c792ea}={color}{color:#ee}
> IOUtils.toString{color}{color:#89ddff}({color}{color:#ee}inputStream,
> StandardCharsets.UTF_8{color}{color:#89ddff}){color}
> {color:#ee}input_obj
> {color}{color:#c792ea}={color}{color:#ee}
> json.loads{color}{color:#89ddff}({color}{color:#ee}input_text{color}{color:#89ddff}){color}
> {color:#ee} {color}
> {color:#ee}{color}
> {color:#ee} {color}{color:#ee}table_name
> {color}{color:#c792ea}={color}{color:#ee}
> input_obj{color}{color:#89ddff}[{color}{color:#89ddff}'{color}{color:#c3e88d}table_name{color}{color:#89ddff}'{color}{color:#89ddff}]{color}
> {color:#ee}column_name
> {color}{color:#c792ea}={color}{color:#ee}
> {color}{color:#89ddff}"{color}{color:#f78c6c}SELECT{color}{color:#c3e88d}
> column_name {color}{color:#f78c6c}FROM{color}{color:#c3e88d}
> INFORMATION_SCHEMA.COLUMNS {color}{color:#f78c6c}WHERE{color}{color:#c3e88d}
> table_name{color}{color:#c792ea}={color}{color:#89ddff}'{color}{color:#c3e88d}"+table_name+"'
> {color}{color:#f78c6c}AND{color}{color:#c3e88d}
> data_type{color}{color:#c792ea}={color}{color:#89ddff}'{color}{color:#c3e88d}enum'{color}{color:#89ddff}"{color}
> {color:#ee}enum_value_sql
> {color}{color:#c792ea}={color}{color:#ee}
> {color}{color:#89ddff}"{color}{color:#f78c6c}SELECT{color}{color:#c3e88d}
> {color}{color:#82aaff}REPLACE{color}{color:#c3e88d}({color}{color:#82aaff}REPLACE{color}{color:#c3e88d}({color}{color:#82aaff}REPLACE{color}{color:#c3e88d}({color}{color:#82aaff}REPLACE{color}{color:#c3e88d}(column_type,{color}{color:#89ddff}'{color}{color:#c3e88d}enum',{color}{color:#89ddff}'{color}{color:#c3e88d}'),{color}{color:#89ddff}'{color}{color:#c3e88d})',{color}{color:#89ddff}'{color}{color:#c3e88d}'),{color}{color:#89ddff}'{color}{color:#c3e88d}(',{color}{color:#89ddff}'{color}{color:#c3
