Junior Data Engineer
Tasks
- Automate manual data movement
- Build and maintain Azure Data Factory ETL pipelines
- Create runbooks and document ETL logic
- Follow naming standards and controlled releases
- Handle API pagination rate limits and incremental extraction
- Ingest file based data CSV Excel and SFTP
- Integrate third party data sources using REST APIs
- Own data pipeline reliability
- Refactor ETL processes for scalability and maintainability
- Resolve data quality issues
- Troubleshoot pipeline failures and data anomalies
- Tune SQL performance and manage indexing
- Write SQL for data validation and reconciliation
Perks/Benefits
- N/A
Skills/Tech-stack
API Integration | Azure Data | Azure Data Factory | Azure SQL | CSV | Data Factory | ETL | Excel | JSON | OAuth | Power BI | REST APIs | SFTP | SQL | SQL Server
Education
N/A
Roles
Related jobs
-
Senior Data Engineer - Remote USD 150K-160KAPIs | Data Governance | Data Lineage | Data Management | Data Modeling401k | Dental insurance | Health and wellness programs | Health insurance | Life insuranceSenior-level Full TimeAtlanta, GA, US, 30328 R4h ago
-
Data Engineer I USD 68K-100KAPI Keys | Azure | Azure Data | Azure Data Factory | Azure Synapse401k match | Employee onboarding program | Flexible PTO | Health and wellness benefits | Onsite optionsEntry-level Full TimeMorrisville, NC, US, 275604h ago
-
Senior Analytics Engineer, Marketing USD 159K-201KAttribution | DBT | Data Modeling | Dimension tables | Dimensional ModelingAnnual equity refresh grants | New hire equity grant | Remote work flexibilitySenior-level Full TimeUnited States - Remote R7h ago
-
Senior-level Full TimeTampa, FL8h ago
-
Principal Data Engineer - Central Product Insights USD 178K-249KAWS | Apache Airflow | Apache Spark | Cloud platform | DBT401k match | Dental insurance | Flexible work schedule | Life insurance | Medical insuranceSenior-level Full TimeLos Angeles, USA11h ago
-
Sr Business Intelligence Engineer, AWS GDSP A&I USD 130K-194KAutomation | Business Analytics | Business Intelligence | Dashboards | Data ArchitectureWork-life balanceSenior-level Full TimeSeattle, Washington, USA11h ago
-
Sr. Business Intelligence Engineer, Prime Video Commerce USD 130K-194KAd-Hoc | Ad-hoc analysis | Automation | Business Intelligence | DashboardingSenior-level Full TimeSeattle, Washington, USA11h ago
-
Machine Learning Engineer USD 90K-167KData Modeling | Data Pipelines | Data Querying | Data Transformation | Data VisualizationDental insurance | Health insurance | Hybrid work environment | Mentorship | Paid time offMid-level Full TimeUSA, Massachusetts, Boston, 200 Berkeley Street, …11h ago
-
Apache Spark | Data Modeling | Data Quality | Data pipeline | LoggingEmployee travel credits | Remote work eligibilitySenior-level Full TimeUnited States12h ago
-
Senior Data Engineer USD 120K-126K3NF | API Design | API Management | API Versioning | APIM401k match | Charitable Gift Matching | Dental insurance | Discounted personal insurance | Employee stock ownership planSenior-level Full TimeWestern States or Midwest13h ago
-
Analytics Consultant USD 98K-150KAWS | Amazon Web Services | Analytics engineering | Business Intelligence | Dashboard DevelopmentHybrid work | Remote work eligibilitySenior-level Full TimeHouston, Texas, United States13h ago
-
Analytics Consultant USD 98K-150KAmazon Web Services | Dashboard Development | Data Governance | Data Modeling | Data QualityHybrid work schedule | Remote work optionSenior-level Full TimeLehi, Utah, United States13h ago
-
Sr. Analytics Engineer USD 145K-195KAvo | BigEye | BigQuery | DBT | Data CatalogCommuter benefits | Dog-friendly office | Flexible working hours | Free gympass subscription | Home office stipendSenior-level Full TimeSan Francisco, CA, Brooklyn, NY, Cambridge, … R13h ago
-
Senior Analytics Consulting Manager USD 142K-185KData Analysis | Data Science | Data Visualization | Healthcare Analytics | Machine Learning401k match | Disability insurance | Flexible time off | Health, dental, vision insurance | HolidaysSenior-level Full TimeUnited States R13h ago
-
Software Engineers/Data Scientists USD 140K-253KAWS | AWS Secrets | AWS Secrets Manager | Amazon RDS | Bash401k match | Employer-covered health insurance | Employer-covered life insurance | Family Vision Insurance | Family dental insuranceSenior-level Full TimeChantilly, VA13h ago
-
Data Engineer USD 115K-135KAPIs | Anomaly Detection | CDC | CI/CD | Cause analysis401k matching | Dental insurance | Health insurance | Paid Maternity Leave | Paid time offSenior-level Full TimeChicago, Illinois, United States13h ago
-
Staff Data Engineer, Search and Discovery USD 142K-309KAirflow | Amazon S3 | DBT | Dagster | Distributed Systems401k plan | Dental insurance | Employee assistance program | Flexible spending account | Health insuranceSenior-level Full TimeMountain View, USA13h ago
-
Senior Director - Data Platform & Analytics USD 178K-255KAccess Control | Airbyte | BigQuery | DBT | Data Governance401k | Educational reimbursement | Fertility and adoption assistance | Flexible paid time off | Health benefitsSenior-level Full TimeRemote (United States) R13h ago
-
Senior Data/ML Engineer USD 151K-205KDBT | Data Architecture | Data Governance | Data Observability | Data Quality401k match | Dental insurance | Equity | Family planning resources | Flexible vacation policySenior-level Full TimeRemote - USA R14h ago
-
Senior Data Engineer USD 200K-220KAirflow | Apache Beam | BigQuery | C# | C++401k match | Cell phone stipend | Commuter benefits | Employer HSA contributions | Health, dental, vision insuranceSenior-level Full TimeSan Francisco, CA - US14h ago
-
Staff Analytics Engineer USD 183K-225KAnomaly Detection | DBT | Dashboards | Data Governance | Data Lineage401k match | Dental insurance | Equity | Family planning resources | Flexible vacationSenior-level Full TimeRemote - USA R14h ago
-
Senior Manager, Analytics and Insight (Hybrid) USD 169K-186KA/B | A/B Testing | Attribution Modeling | B testing | DBT401k match | Disability insurance | FSA | HSA contribution | Identity theft protectionSenior-level Full TimeAustin, TX15h ago
-
Intern - Analytics USD 40K-40KAgile | Data Analysis | Data Visualization | Excel | Power BIHybrid workEntry-level InternshipDetroit, Michigan, United States15h ago
-
Senior AI Solutions Engineer USD 120K-140KAI-powered automation | API Integration | AWS Lambda | Atlassian JSM | JavaScriptSenior-level Full TimeRoseville, CA - HQ15h ago
-
Entry-level InternshipChicago15h ago