Azure Data Engineer
Atyeti Inc-
Job Type
Full Time -
Experience
4-6 year -
Salary
$122,000 - $256,000 / Year -
Location
Morrisville, NC, USA -
Job Function
-
Industry
Information Technology -
Qualification
Key Skills
Apache Airflow, Azure, Data Lake, Databricks, Design, Oracle, PowerBI, PySpark, Python Programming, RDBMS, Snowflake, SPARK Programming, SQL
Job Description
Demonstrable experience designing and developing big data applications using Apache Spark and Airflow
- Experience leveraging Databricks to develop Spark based applications along with very good understanding about data engineering capabilities provided by the service
- Excellent Python programming skills and experience delivering projects using PySpark is a must. Scala programming experience is nice to have.
- Experience designing and developing Airflow DAGs, Operators etc…
- Experience leveraging Azure Storage and Data Lake Store Gen 2 in Azure based big data projects along with integration to other Azure Data services
- Experience designing and developing real time data processing applications using Spark streaming, Kafka, Event Hub etc..
- Experience using Cloud data warehouse technologies such as Snowflake is highly desired
Must have expertise on RDBMS solutions such as Oracle, SQL Server, Azure SQL DB etc..
Qualifications
Demonstrable experience designing and developing big data applications using Apache Spark and Airflow
- Experience leveraging Databricks to develop Spark based applications along with very good understanding about data engineering capabilities provided by the service
- Excellent Python programming skills and experience delivering projects using PySpark is a must. Scala programming experience is nice to have.
- Experience designing and developing Airflow DAGs, Operators etc…
- Experience leveraging Azure Storage and Data Lake Store Gen 2 in Azure based big data projects along with integration to other Azure Data services
- Experience designing and developing real time data processing applications using Spark streaming, Kafka, Event Hub etc..
- Experience using Cloud data warehouse technologies such as Snowflake is highly desired
Must have expertise on RDBMS solutions such as Oracle, SQL Server, Azure SQL DB etc..
#Azure, #Databricks, #Spark, #Datawarehouse, #Datalake, #Power BI, #SQL
Company Info.
Atyeti IncAtyeti is leading professional services firm, Atyeti helps companies solve business problems and build for the future with a focus on enabling Digital Transformation. Atyeti’s capabilities drive Business value based on a foundation of Automation, Integrated Tooling, Application Modernization and Data.
-
IndustryInformation Technology
-
No. of Employees350
-
LocationPrinceton, NJ, USA
-
Website
-
Jobs Posted