Data Engineer
New York, New York, United States
A USD 130K-130K Mid-level Full Time
Tasks
- Automate ingestion jobs
- Automate notifications and reports
- Build and maintain API connectors
- Coordinate agile delivery
- Develop data pipelines
- Implement data quality and security features
- Implement standardized pipelines with automated testing
- Improve performance and reduce compute and storage costs
- Ingest data from multiple sources
- Maintain backlog items
- Manage ad-hoc requests
- Monitor data pipeline operations
- Perform code reviews
- Run Scrum ceremonies
- Schedule workflows with Airflow
- Set up CI CD with Azure DevOps
- Store and wrangle data
Perks/Benefits
Skills/Tech-stack
API | AWS | Agile | Airflow | Azure DevOps | CI/CD | Data Ingestion | Data Lakehouse | Data integration | Glue | OneTrust | Redshift | Relational databases | SQL | Scrum | Version control
Education
Roles
Regions
Countries
States
Cities
Related jobs
-
Senior-level Full TimeAuburn Hills, MI, United States3h ago
-
Data Scientist (Graph analysis) USD 135K-185KCypher | Data Ingestion | Data Processing | Docker | ETLOn-site workMid-level Full TimeColumbia, MD, United States4h ago
-
SOFTWARE ENGINEER - Apache Spark/Big Data - 7+ yrs of Experience - TS/SCI w/Poly clearance is required - ID A USD 234K-241KAnomaly Detection | Apache Airflow | Apache Spark | Bash | Big Data401k retirement plan | Dental insurance | Life insurance | Long-term disability | Medical insuranceMid-level Full TimeFort George G Meade, United States6h ago
-
Data Management Engineer III USD 93K-163KCI/CD | Data Deduplication | Data Pipelines | Data Standardization | Data TransformationPublic Trust Clearance | Travel 10 to 15 percentSenior-level Full TimeArlington/Rosslyn, Virginia, United States7h ago
-
Partner Engineer, Generative AI USD 159K-223KAWS | Azure | Bias Mitigation | C plus plus | Cloud PlatformsEntry-level Full TimeMenlo Park, CA8h ago
-
Software Engineer III, AI/ML, gUP Customer Support USD 147K-211KAgile | C++ | Code review | Data Processing | DebuggingSenior-level Full TimeSunnyvale, CA, USA8h ago
-
Senior Software Engineer, Database Internals AlloyDB USD 174K-252KC plus plus | C# | Code optimization | Compute Technologies | Concurrency ControlEntry-level Full TimeSunnyvale, CA, USA8h ago
-
Staff Software Engineer, AI-Powered GRC Automation USD 207K-300KCloud Platforms | Cloud platform | Continuous controls monitoring | Controls monitoring | Data PipelinesSenior-level Full TimeSunnyvale, CA, USA; Kirkland, WA, USA8h ago
-
Senior Staff Software Engineer, BigQuery Core Analytics USD 262K-365KBigQuery | C plus plus | C++ | CI/CD | Distributed SystemsSenior-level Full TimeKirkland, WA, USA; Sunnyvale, CA, USA8h ago
-
ML Engineer, Surrogate Modeling (Vehicle Engineering) USD 125K-175KActive Learning | Adaptive Sampling | CFD | Continuous integration | Data Pipelines401k retirement plan | Employee stock purchase plan | Life insurance | Long-term disability insurance | Long-term incentivesEntry-level Full TimeHawthorne, CA15h ago
-
AI Software Engineer (Vehicle Engineering) USD 125K-175K3D Reconstruction | Agent systems | Agentic AI | Anomaly Detection | CI/CD401k retirement plan | Dental insurance | Employee stock purchase plan | Life insurance | Life insurance coverageSenior-level Full TimeHawthorne, CA19h ago
-
Lead AI Engineer (ML Ops) USD 116K-170KAPIs | AWS | Agile Scrum | Azure | CI/CD401k match | Employee assistance program | Employee charity match | Employee stock purchase plan | Health and wellness allowanceSenior-level Full TimeIrving - 6011 Connection, United States19h ago
-
Platform and Databricks DevOps Engineer USD 77K-176KAWS | Azure | Bash | CI/CD | DatabricksDependent care | Paid leave | Professional development | Tuition assistance | Work-life programsMid-level Full TimeUSA, VA, McLean (8283 Greensboro Dr, …19h ago
-
Data AI Solutions Sr Analyst - C12 - TAMPA USD 87K-130KAgentic AI | Artificial Intelligence | Data Catalog | Data Governance | Data LineageSenior-level Full Time3800 CITIGROUP CENTER DRIVE BUILDING F …19h ago
-
Senior Bioinformatics Data Engineer (Consultant) USD 168K-200KADaM | AWS ECS | AWS ECS Fargate | AWS Glue | AWS Glue CatalogBackground check | Code review feedback loops | Compliance training | Embedded pair working model | VPN AccessSenior-level Full TimeRaleigh, United States19h ago
-
AI assisted code | AI-assisted code generation | Amazon Redshift | Anomaly Detection | BigQueryAI focused engineering culture | Mentorship and growth opportunities | On-site collaborationSenior-level Full TimeBoston, MA19h ago
-
AWS | AWS Redshift | Attribution | Audience Segmentation | BigQueryCompetitive compensation | Growth opportunities | Hands on production experience | Mentorship | On-site collaborationEntry-level Full TimeBoston, MA19h ago
-
AWS | AWS Redshift | Amazon Kinesis | Anomaly Detection | Automated testingSenior-level Full TimeBoston, MA19h ago
-
Software Engineer AI/ML USD 112K-150KA/B | A/B Testing | AWS | Anomaly Detection | Artificial IntelligenceDental insurance | Employee assistance program | Health coaching program | Health insurance | Retirement benefitsMid-level Full TimeEvendale, United States R19h ago
-
Senior AI Engineer USD 130K-198KAPI Design | Azure | CI/CD | Data Pipelines | DatabricksFertility benefits | Flexible PTO | Mental health coverage | Paid parental leave | Paid volunteer time offSenior-level Full TimeArlington, VA, United States19h ago
-
Sr. AI Engineer - Forward Deployed Engineer Senior Manager· Databricks · Reinvention Centers USD 87K-293KAPI Integration | Anthropic API | Apache Spark | Autogen | CI/CD401k plan | Bonus opportunities | Dental insurance | Life insurance | Long-Term Disability coverageSenior-level Full TimeDallas, 5205 N OConnor Las Colinas, …19h ago
-
AWS EC2 | AWS Lambda | AWS RDS | AWS S3 | AWS Step FunctionsCareer advancement | Certification opportunities | Exposure to cutting-edge technologies | Mentorship | Ongoing trainingMid-level Full TimeD.C. (100% Onsite), DC19h ago
-
Algorithm Development | Computational Chemistry | Data Analysis | Data Display | Data IngestionSenior-level Full TimeRockville, MD, USA19h ago
-
AI Services | AWS Glue | AWS Lambda | AWS Step Functions | Amazon AICareer advancement | Certification opportunities | Exposure to cutting-edge technologies | Mentorship programs | Ongoing trainingMid-level Full TimeUnited States - Remote R19h ago
-
Mid-level Full TimeAMER - United States - California …19h ago