Data Engineer, Engineering & Operations
New York, NEW YORK, United States
R
USD 115K-145K Mid-level Full Time
Tasks
- Build and operate privacy safe data integrations
- Build automated data quality checks
- Configure clean room environments
- Configure least privilege service accounts and grants
- Define and monitor data quality standards
- Deploy and manage Python libraries templates and reusable components
- Design scalable data pipelines
- Develop ELT pipelines and production data products
- Implement identity resolution logic
- Implement role based access control policies
- Optimize query performance and platform costs
- Provision curated Gold datasets
- Set up monitoring alerting runbooks and SOPs
- Support incident response and root cause analysis
- Validate identity mappings and match rates
Perks/Benefits
- 401k
- Dental insurance
- Discounts
- Fully remote
- Medical insurance
- Paid leave
- Tuition reimbursement
- Vision insurance
Skills/Tech-stack
Access Control | Aggregation Thresholds | Airflow | Alerting | Anonymization | Caching | Clustering | DBT | Data Quality | Data Quality Testing | Databricks | ELT | Great Expectations | Identity resolution | Incremental processing | Monitoring | Partitioning | Privacy-Preserving Techniques | Privacy-preserving | PySpark | Python | Quality testing | Query Tuning | RBAC | Release Management | Role-Based Access | Role-Based Access Control | Runbooks | SQL | Service accounts | Snowflake | Snowpark | Version control
Education
Bachelor of Engineering | Bachelor of Science | Bachelor of Science in Computer Science | Bachelor of Science in Data Engineering | Bachelor of Science in Electrical Engineering | Bachelor of Science in Electronics Engineering | Bachelor of Science in Information Systems | Bachelor of Science in Software Engineering
Roles
Related jobs
-
APIs | AWS Glue | AWS Redshift | Amazon Web Services | Apache AirflowFully remote | Health insurance | On call production support | Paid time off | Retirement plansSenior-level Full TimeOrlando, FL, United States R9h ago
-
Sr. Databricks Consultant USD 175K-250KAWS | Amazon S3 | Apache Spark | Azure | Azure DataRemote work | Travel as neededSenior-level Full TimeWork from home, VA, United States R13h ago
-
Ansible | C plus plus | C# | CMake | CUDAMid-level Full TimeBaltimore, MD, United States R15h ago
-
Senior AI Engineer | Sage Home Loans USD 150K-220KAgent Orchestration | DPO | Databricks | Fine Tuning | Golden datasets401k match | Disability insurance | Employee assistance program | Flexible PTO | Flexible spending accountsSenior-level Full TimeCharlotte, NC R15h ago
-
Hiring: Senior Principal AI Software Engineer – Agentic & Industry Solutions | Full-Time | Remote USD 138K-208KAWS | AWS Bedrock | Agent systems | Anthropic API | Autogen401k matching | Adoption Assistance | Dental insurance | Fertility treatments | Flexible work scheduleSenior-level Contract Full TimeRemote, OR, United States R17h ago
-
A/B | A/B Testing | AI Model Deployment | AI model | App ServiceRemote workMid-level ContractHartford, United States R17h ago
-
Senior Software Engineer, DeepMind USD 221K-253KAlgorithms | Audio Processing | C++ | Cause analysis | Data StructuresBonus | Equity | Hybrid scheduleSenior-level Full TimeMountain View, CA, USA R19h ago
-
Senior Data Engineer USD 90K-110KAgile | Amazon Web Services | Apache NiFi | Data Modeling | Data WarehousingAutonomy | Employee assistance program | Flexible working hours | Inclusive community | Online training videosSenior-level Full TimeNew York, United States R22h ago
-
Senior Software Engineer, Storage USD 217K-303KC++ | Caching | Cassandra | Data Storage | Distributed Systems401k employer match | Dental insurance | Equity compensation | Generous time off | Medical insuranceSenior-level Full TimeRemote - United States R1d ago
-
Data Engineer, Go To Market (Remote) USD 100K-155KAmazon Redshift | Apache Airflow | CI/CD | CRM | DBTSenior-level Full TimeUSA CA Remote, United States R1d ago
-
Senior Data Engineer USD 97K-185KAWS Batch | Agile | Amazon EC2 | Amazon EKS | Amazon RDSEducational assistance | Health care coverage | Paid time off | Parental leave | Retirement planSenior-level Full Time245 Summer St, Boston MA, United … R1d ago
-
Senior Data Engineer USD 91K-163KAI | Automation | Backup and Recovery | Capacity Planning | Change ManagementCareer development | Comprehensive benefits | Telecommute within United StatesSenior-level Full TimePrimary location: Eden Prairie, MN R1d ago
-
Data Governance and Master Data Management Expert USD 160K-220KBusiness glossary | Cause analysis | Data Compliance | Data Controls | Data GovernanceRemote workSenior-level ContractUnited States - Remote R1d ago
-
Databricks Platform Engineer (AWS) USD 115K-213KAWS | AWS Secrets | AWS Secrets Manager | CI/CD | DatabricksDental insurance | Disability insurance | Employee wellness | Health insurance | Life insuranceSenior-level Full TimeUSA VA Home based (CSC Location), … R1d ago
-
Staff Software Engineer, AI/ML USD 136K-265KAutogen | Cloud Platforms | CrewAI | Embeddings | GoContinuous learning culture | Remote work | Vacation packageSenior-level Full TimeRemote - USA, United States R1d ago
-
Machine Learning Engineer USD 196K-196KApache Airflow | CI/CD | Containerization | Docker | Experiment trackingFully remoteSenior-level Full TimeSan Francisco, CA R1d ago
-
AWS Bedrock | Agent systems | Anthropic API | Autogen | Azure401k matching program | Adoption Assistance | Development and career growth opportunities | Fertility treatments | Flexible work schedulesSenior-level Contract Full TimeRemote, OR, United States R1d ago
-
Software Engineer, Applied AI USD 190K-280KContext engineering | Data Processing | Data Storage | Debugging | Docker401k match | Dental insurance | Health insurance | Hybrid work model | Professional developmentSenior-level Full TimeNew York City R1d ago
-
Data Engineer USD 74K-133KAgile | Apache Airflow | BigQuery | Cloud Composer | Cloud Data401k retirement plan | Dental insurance | Disability insurance | Flexible time off | Health insuranceMid-level Full TimeLisle, IL, United States R1d ago
-
Senior Staff Data Engineer - Platform Data and Analytics USD 268K-368KAirflow | Alerting | Apache Spark | Capacity Planning | Cost OptimizationSenior-level Full TimeSan Francisco, CA R1d ago
-
Staff Data Engineer USD 185K-220KAWS | Apache Airflow | Apache Kafka | Benthos | Big DataDental insurance | Disability insurance | Flexible work hours | Health insurance | Health savings accountSenior-level Full TimeRosslyn, VA or Remote R1d ago
-
API Testing | Cypher | Data Quality | DataOps | DevOpsBenefits | Competitive pay | Growth opportunity | Remote work | Travel requiredSenior-level Full TimeReston, VA, United States R1d ago
-
Principal Engineer - Data Platform USD 221K-387KAWS | Airflow | Apache Hive | Apache Iceberg | Apache ImpalaRemote workSenior-level Full TimeSanta Clara, California, United States R1d ago
-
IT Infrastructure Engineer II USD 139K-178KAWS Organizations | Access Management | Amazon Web Services | Ansible | Application FirewallHealth and wellness resources | Remote work | Wellness FridaysSenior-level Full TimeRemote - United States R1d ago
-
Sr Machine Learning Engineer I USD 150K-241KAutomated retraining | Bayesian Filter | CI/CD | Data Analysis | Data AssociationDiscretionary paid time off | Emotional and mental wellness support | Employee resource groups | Fitness programs | Learning and development programsSenior-level Full TimeSeattle, Washington, United States R1d ago