Senior Data Engineer
New York, United States
R
USD 90K-110K (estimate) Senior-level Full Time
Tasks
- Automate data cleaning with logging
- Build ETL and data warehousing
- Build Kafka data flows
- Build data processors in Nifi
- Collaborate to improve scalability and consistency
- Convert data between external and internal representations
- Create data pipeline triggers and filters
- Design data models
- Design data pipelines
- Develop Nifi ingestion pipelines
- Establish unit testing for pipelines
- Follow data engineering best practices with scalable architecture
- Implement monitoring and error handling
- Use Docker for development testing environments
- Use Jira for agile delivery
- Write SQL queries for analytics and debugging
Perks/Benefits
- Autonomy
- Employee assistance program
- Flexible working hours
- Inclusive community
- Online training videos
- Teambuilding events
- Telecommuting
- Well-being app
Skills/Tech-stack
Agile | Amazon Web Services | Apache NiFi | Data Modeling | Data Warehousing | Docker | ETL | Java | Jira | Kafka | Python | SQL | Unit Testing | Web Services
Roles
Related jobs
-
Featured Feat. Principal Knowledge & Data Architect USD 174K-284KAWS Neptune | Canonicalization | Chunking | Cypher | DBTBenefits including health and wellness programs | Health, wellness, and retirement plansSenior-level Full TimeHeadquarters - Chevy Chase, MD R12d ago
-
Senior Data Engineer-JT0224 USD 115K-175K.Net Core | .Net Framework | AWS CloudFormation | Apache Airflow | Azure401k match | Career growth opportunities | Dental insurance | Employee resource groups | Health insuranceSenior-level Full TimeRemote, United States R4h ago
-
Senior Machine Learning Engineer USD 140K-224KAIOps | AWS | Apache Spark | Cloud platform | Data Analysis401k match | Dental insurance | Flexible paid time off | Life insurance | Medical insuranceSenior-level Full TimeRemote, United States R4h ago
-
Machine Learning Engineer / AI Model Developer (Mid to Senior)(Top Secret Clearance Required) (Hybrid) USD 77K-176KAPI Development | Agile | Backend Development | Cloud Computing | Data Preparation401k | Employee discounts | Employee referral rewards | Flexible work schedule | Health savings accountMid-level Full TimeQuantico, VA, US R10h ago
-
Machine Learning Engineer / AI Model Developer (Mid to Senior)(Top Secret Clearance Required) (Hybrid) USD 78K-176KAPIs | Agile methodologies | Backend Development | Cloud Computing | Data Preparation401k | Employee discount program | Employee referral rewards | Flexible spending account | Flexible work scheduleMid-level Full TimeFort Belvoir, VA, US R10h ago
-
Lead Software Engineer (Data)-7999 USD 129K-203KAmazon CloudWatch | Amazon EC2 | Amazon EMR | Amazon IAM | Amazon S3Comprehensive health benefits | Emotional wellbeing support | Financial support benefits | Personalized benefits | Remote work days per weekSenior-level Full TimeVA - Reston, 11951 Freedom Dr … R21h ago
-
Principal Advanced Analytics Analyst USD 123K-184KAgile | Data Modeling | Power Automate | Power BI | PowerApps401k matching | Dental insurance | Employee assistance program | Employee stock purchase plan | Flexible work scheduleSenior-level Full TimeUSA-MN, United States R21h ago
-
Sr. Software Engineer (Data)-0336 USD 132K-203KAWS | Apache Spark | ClickHouse | Databricks | GitHubEmotional support | Financial benefits | Health benefits | Remote work days per weekSenior-level Full TimeVA - Reston, 11951 Freedom Dr … R21h ago
-
Sr Staff Software Engineer- Data Platform USD 220K-255KAWS EMR | AWS Lambda | AWS S3 | Access Control | AlgorithmsDental insurance | Disability insurance | Flexible spending account | Health insurance | Health savings accountSenior-level Full TimeCalifornia - Remote Office, United States R21h ago
-
Senior Data Engineer USD 113K-254KAWS | Acceptance Testing | Azure | Best practices | CI/CD401k match | Career development opportunities | Charitable giving match | Dental insurance | Employee stock purchase planSenior-level Full TimeRemote, United States R21h ago
-
Sr. Embedded Software/Firmware Engineer USD 180K-240KARM | ASPICE | AUTOSAR | C# | C++Competitive compensation | Dental insurance | Flexible hours | Medical insurance | Pre-IPO stock optionsSenior-level Full TimeUnited States - Remote R21h ago
-
Sr. Engineer, Firmware & Embedded Software USD 79K-158KAgile | Azure DevOps | BDM | Bare Metal | BootloaderOccasional travel for onboarding | Remote work within the United StatesSenior-level Full TimeFlorida, United States R1d ago
-
Data Engineer / Data Architect (Mid to Senior) (Top Secret Clearance Required) (Hybrid) USD 140K-160KAPI Development | Agile | Backend Development | Cloud Native | Code review401k | Employee discount program | Employee referral program | Flexible spending account | Flexible work scheduleMid-level Full TimeFort Belvoir, MD, US R1d ago
-
Data Engineer / Data Architect (Mid to Senior) (Top Secret Clearance Required) (Hybrid) USD 140K-170KAPI Development | Agile | Backend Development | Cloud Computing | Data Architecture401k | Employee discount program | Employee referral rewards | Flexible spending accounts | Flexible work scheduleMid-level Full TimeQuantico, VA, US R1d ago
-
Software Engineer, Optimized Checkout & Link USD 161K-213KAPI Development | Automated testing | End to End | End-to-End Testing | GraphQL401k plan | Company bonus | Equity | Medical, dental, and vision benefits | TelecommutingMid-level Full TimeUS Remote R1d ago
-
Data Solutions Engineer - HYBRID/NC RESIDENTS ONLY USD 119K-164KApache Spark | Azure | Azure Data | Azure Data Factory | Azure Data Lake401k match | Dental insurance | Employee referral program | Flexible spending account | Health insuranceEntry-level Full TimeDurham, North Carolina, United States R1d ago
-
Senior Data Engineer - Digital Pathology (Hybrid) USD 98K-163KAPI Integration | Agile | Apache Airflow | Apache Spark | Batch ProcessingSenior-level Full TimeRochester, MN, United States R1d ago
-
Senior Software Engineer, MLOps USD 175K-220KAgile | Batch Processing | Consistency guarantees | Data Modeling | Data Pipelines401k match | Charitable donation match | Commuter benefits | Dental insurance | Flexible time offSenior-level Full TimeRemote - United States R1d ago
-
Senior Data Engineer - Finance USD 172K-203KARR | AWS | Apache Iceberg | Apache Spark | CRMDental insurance | Employee discounts | Flexible wellness time off | Health insurance | Hybrid workSenior-level Full TimeHybrid - San Francisco, California R1d ago
-
Senior-level Full TimeRemote - United States R1d ago
-
Sr. Data Engineer (HYBRID) USD 145K-160KAWS | AWS Glue | AWS Lambda | Amazon Athena | Amazon DynamoDBComplimentary club membership | Hybrid work schedule | Personal training | Pilates | Shop discountsSenior-level Full TimeNew York, NY, United States R1d ago
-
Staff Software Engineer, Data Products USD 171K-224KAWS | AWS Lambda | Amazon Athena | Amazon Redshift | Amazon S3401k retirement savings plan | Flexible time off | Generous parental leave | Health, dental, and vision insurance | Lifestyle spending account mental health support solutionsSenior-level Full TimeRemote, USA R1d ago
-
Senior Software Engineer (Data Engineer) USD 138K-162KAWS | Akka | Algorithms | Apache Spark | Cloud Native401k plan company match | Basic life insurance | Dental insurance | Health insurance | Vision insuranceSenior-level Full TimeUnited States R1d ago
-
Senior Data Engineer - Agentic AI Engineering USD 138K-173KAWS | Access Control | Airflow | Azure | Batch dataRemote-friendlySenior-level Full TimeUnited States of America R1d ago
-
AWS | AWS CDK | AWS CodeBuild | AWS CodePipeline | AWS Secrets401k | Healthcare coverage | PTO | Paid Company Holidays | Phone stipendSenior-level Full TimeSan Carlos - Hybrid R1d ago