Data Engineer II
USA - NY - 7 Hudson Square, United States
USD 112K-150K Entry-level Full Time
Tasks
- Build API integrations
- Build lakehouse data platform
- Create metadata parsing
- Develop pipeline standards and best practices
- Develop shared libraries
- Ensure data reliability accuracy and uptime
- Extend data platform functionality
- Extend metastore API
- Implement observability lineage data quality logging and alerting
- Maintain data pipelines
- Maintain technical documentation
- Participate in agile scrum ceremonies
- Support data governance requirements
Perks/Benefits
- N/A
Skills/Tech-stack
AWS S3 | Apache Airflow | Apache Spark | Data Modeling | Data Warehousing | Databricks | Delta Lake | GraphQL | Infrastructure as Code | Python | SQL | Scala | Snowflake | “as-code”
Education
Roles
Related jobs
-
SOFTWARE ENGINEER - Apache Spark/Big Data - 7+ yrs of Experience - TS/SCI w/Poly clearance is required - ID A USD 234K-241KAnomaly Detection | Apache Airflow | Apache Spark | Bash | Big Data401k retirement plan | Dental insurance | Life insurance | Long-term disability | Medical insuranceMid-level Full TimeFort George G Meade, United States3h ago
-
Data Management Engineer III USD 93K-163KCI/CD | Data Deduplication | Data Pipelines | Data Standardization | Data TransformationPublic Trust Clearance | Travel 10 to 15 percentSenior-level Full TimeArlington/Rosslyn, Virginia, United States4h ago
-
Partner Engineer, Generative AI USD 159K-223KAWS | Azure | Bias Mitigation | C plus plus | Cloud PlatformsEntry-level Full TimeMenlo Park, CA6h ago
-
Adversarial ML | Benchmarking | Data Mining | Environment Design | Function CallingMid-level Full TimeMountain View, CA, USA; New York, …6h ago
-
Software Engineer III, AI/ML, gUP Customer Support USD 147K-211KAgile | C++ | Code review | Data Processing | DebuggingSenior-level Full TimeSunnyvale, CA, USA6h ago
-
Senior Software Engineer, Database Internals AlloyDB USD 174K-252KC plus plus | C# | Code optimization | Compute Technologies | Concurrency ControlEntry-level Full TimeSunnyvale, CA, USA6h ago
-
Senior Software Engineer, AI/ML GenAI, Google Cloud AI USD 174K-252KC++ | Cloud AI | Computer Vision | Data Processing | Google CloudSenior-level Full TimeSunnyvale, CA, USA; Kirkland, WA, USA6h ago
-
Staff Software Engineer, AI-Powered GRC Automation USD 207K-300KCloud Platforms | Cloud platform | Continuous controls monitoring | Controls monitoring | Data PipelinesSenior-level Full TimeSunnyvale, CA, USA; Kirkland, WA, USA6h ago
-
Continuous Delivery | Continuous integration | Databases | DevOps | DockerFlexible scheduling for students | Fully remote work | Online teaching toolsMid-level Full TimeChur, Institut für Data Analysis, Artificial … R6h ago
-
Staff Machine Learning Engineer, Embeddings USD 253K-354KA/B | A/B Testing | B testing | C++ | Cloud ComputingCaregiving support | Comprehensive healthcare benefits | Employer 401k match | Family planning support | Flexible vacationSenior-level Full TimeRemote - United States R12h ago
-
ML Engineer, Surrogate Modeling (Vehicle Engineering) USD 125K-175KActive Learning | Adaptive Sampling | CFD | Continuous integration | Data Pipelines401k retirement plan | Employee stock purchase plan | Life insurance | Long-term disability insurance | Long-term incentivesEntry-level Full TimeHawthorne, CA13h ago
-
Embedded Software Engineer, OS/Platform (Starlink) USD 125K-175KARM | Buildroot | C# | C++ | Continuous Monitoring401k retirement plan | Company shuttles | Dental insurance | Employee stock purchase plan | Extended hours and weekends as neededEntry-level Full TimeRedmond, WA13h ago
-
GenAI Enablement Specialist USD 170K-231KAgentic Frameworks | Embeddings | LLM | LLM Evaluation | Prompt engineeringBackup childcare | Financial coaching | Health care coverage | Mental health support | On-site health and wellness centersExecutive-level Full TimeNew York, NY, United States15h ago
-
Senior Software Engineer (Search / Retrieval) USD 180K-240KBM25 | Distributed Systems | Elasticsearch | Entity recognition | Language ProcessingFlexible work environment | Remote work opportunitySenior-level Full TimePalo Alto, California15h ago
-
Software Engineer - Developer Products (AI) USD 170K-240KAPI Design | APIs | CLIs | Data Structures | Data Structures and AlgorithmsEmployee benefits package | Remote-friendly work environmentSenior-level Full TimeSan Francisco, California15h ago
-
Senior-level Full TimePalo Alto, California15h ago
-
Forward Deployed Engineer USD 70K-100KAPIs | Agent systems | Automation | BPM | Cloud ComputingEquity | Health benefits | Remote workSenior-level Full TimeBoston, Massachusetts; New York, New York; …15h ago
-
Staff AI Engineer USD 215K-285KA/B | A/B Testing | B testing | Behavioral signals | Distributed SystemsSenior-level Full TimePalo Alto, California; San Francisco, California15h ago
-
Forward Deployed Engineer USD 70K-100KAPI Integration | Agent systems | Agentic AI | BPM | Cloud ComputingEquity | Flexible work environment | Health benefits | Remote work optionsSenior-level Full TimeBoston, Massachusetts; New York, New York; …15h ago
-
AI Software Engineer (Vehicle Engineering) USD 125K-175K3D Reconstruction | Agent systems | Agentic AI | Anomaly Detection | CI/CD401k retirement plan | Dental insurance | Employee stock purchase plan | Life insurance | Life insurance coverageSenior-level Full TimeHawthorne, CA16h ago
-
Lead AI Engineer (ML Ops) USD 116K-170KAPIs | AWS | Agile Scrum | Azure | CI/CD401k match | Employee assistance program | Employee charity match | Employee stock purchase plan | Health and wellness allowanceSenior-level Full TimeIrving - 6011 Connection, United States17h ago
-
Platform and Databricks DevOps Engineer USD 77K-176KAWS | Azure | Bash | CI/CD | DatabricksDependent care | Paid leave | Professional development | Tuition assistance | Work-life programsMid-level Full TimeUSA, VA, McLean (8283 Greensboro Dr, …17h ago
-
Adaptive Systems | Apache Spark | C++ | CUDA | Data ProcessingBenefits | EquitySenior-level Full TimeUS, CA, Santa Clara, United States17h ago
-
Data AI Solutions Sr Analyst - C12 - TAMPA USD 87K-130KAgentic AI | Artificial Intelligence | Data Catalog | Data Governance | Data LineageSenior-level Full Time3800 CITIGROUP CENTER DRIVE BUILDING F …17h ago
-
Senior Bioinformatics Data Engineer (Consultant) USD 168K-200KADaM | AWS ECS | AWS ECS Fargate | AWS Glue | AWS Glue CatalogBackground check | Code review feedback loops | Compliance training | Embedded pair working model | VPN AccessSenior-level Full TimeRaleigh, United States17h ago