I'm looking for mongodb to be both input and output if possible.

https://docs.zingg.ai/zingg0.4.0/connectors/mongodb

yes Sonal G. I saw that, but, wondering how it works underlying.https://github.com/zinggAI/zingg/blob/e02e25c1eeb79b9aadf2cc85b7c42b3615d7bd6a/common/client/src/main/java/zingg/common/client/pipe/Pipe.java does it work as a JDBC connection?

And how to add that to python code.

It uses the spark mongodb connector. You will have to add the relevant jars to the Zingg conf when you run the python program. The docs have a section on that

got it. I'm super new to java and spark so please forgive my ignorance. Why is there no mongodb FORMAT in the code above?

The format works as a runtime property so it doesn’t need to be there. Just like the fields you define or your schema isn’t, but when you configure those values will be used

Sonal G. so where should I start to connect mongodb in the python app?

you can use the python Pipe object, set its values. Then add the jars to zingg conf and pass those while running the program through zingg.sh

okay one last stupid question Sonal G. where do I find the mongo jar? Also, I think mongo can use JDBC can I just use that format/schema?

No its not a stupid question. https://www.mongodb.com/docs/spark-connector/current/getting-started/

if you look at this link, use the values here to configure the pipe. https://www.mongodb.com/docs/spark-connector/current/batch-mode/batch-write/#std-label-batch-write-to-mongodb

options go to zingg pipe properties

format you already know.

kk will do my best, thank you.

Is there any default jars you need just for CSVPipe?