Role: ADF developer

Location: Harrison, NY

Duration: Contracting 

Job Description:

Cloud : Azure (Azure Data Factory, Databricks, MS-SQL, Azure Blob, Azure Datalake Gen2, Azure Analysis Service, Secrets, Buildling Pipeline etc )

Language:Python (pyspark - Primary), Scala-secondary.

Framework : Spark, Hadoop.

Database: Oracle-SQL, MS-SQL,

File System: .csv,.txt, parquet files etc

•  Looking for a candidate who can create entire pipeline for ETL operations to migrate the data from Different source system, transform it and pushing it to MS-SQL DB.
• Candidate with Azure Analysis Service experience .
• Candidate should be able to write Databricks jobs using pyspark-Python with Spark.
• Strong understanding of ETL operations.
• Strong SQL knowledge is a must.