Data Analytics-Python Developer
Bengaluru, Karnataka, India
PradeepIT
PradeepIT, supported by Asia's largest tech professional network, revolutionizing global talent acquisition. Discover the potential of hiring top Asian tech talents at ten times the speed, starting today!Mandatory skills
1.Python, Dagster, Docker containerization-3 5 years
2.Data Modeling-3 years
Required Qualifications:
· Proven experience as a Python Developer with a focus on data engineering.
· Hands-on experience with Dagster for building and maintaining data pipelines.
· Proficiency in Python libraries (Pandas, Polars, DuckDB) and ETL processes.
· Solid understanding of Docker containerization.
· Experience with Power BI, particularly connecting to Parquet data sources.
· Experience wih Dimentional modeling, start schema, snow-flake schema.
· Strong analytical, problem-solving, and communication skills.
Preferred Qualifications:
· Familiarity with Agile methodologies and a collaborative, team-oriented environment.
Responsibilities:
· Pipeline Development:
o Develop and maintain Dagster pipelines to connect with various data sources and
convert raw data into Parquet format.
o Optimize ETL processes for robust, scalable data workflows.
· Data Analysis & Transformation:
o Analyze different source systems to design efficient integration strategies.
o Modify and manage Parquet datasets to ensure data quality and performance.
· Technical Implementation:
o Utilize Python libraries such as Pandas, Polars, and DuckDB for data processing
and analysis.
o Deploy applications using Docker for seamless containerization and deployment.
· Data Modeling:
o Design innovative data models from source tables to staging, capturing time-series
data for advanced analytics.
· Collaboration:
o Work closely with
* Salary range is an estimate based on our AI, ML, Data Science Salary Index 💰
Tags: Agile Dagster Data analysis Data Analytics Data pipelines Data quality Docker Engineering ETL Pandas Parquet Pipelines Power BI Python
More jobs like this
Explore more career opportunities
Find even more open roles below ordered by popularity of job title or skills/products/technologies used.