Backend Engineer – High-Volume Data Processing
Backend Engineer – High-Volume Data Processing
Location: Brooklyn, NY (Dumbo)
Work Schedule: 100% Onsite – 5 Days per Week
Employment Type: Full-Time
Salary: $220,000–$300,000 + Equity
Relocation Assistance: Up to $10,000
Visa Sponsorship: OPT and H-1B transfers accepted; additional sponsorship may be considered.
Position Summary
We are seeking an experienced Backend Software Engineer to build, maintain, and improve systems that process large amounts of data used for AI training.
The ideal candidate has strong backend development skills, production experience, and a background working in a startup environment.
Important: This is a Backend Software Engineering position, NOT a traditional Data Engineer or ETL role.
Key Responsibilities
-
Backend Development: Design, build, and maintain backend systems that process large volumes of data.
-
Data Security: Develop processes to identify, remove, or mask sensitive information.
-
System Maintenance: Troubleshoot, monitor, and improve backend applications running in production.
-
Data Quality: Prevent duplicate records, missing data, and processing errors.
-
System Reliability: Build processes that handle failures, retries, recovery, and rollbacks.
-
Performance Optimization: Improve system speed, efficiency, and scalability.
-
Monitoring Tools: Develop internal dashboards and tools to monitor system performance.
-
Team Collaboration: Work with AI/ML, security, and engineering teams.
Required Qualifications – MUST HAVE
Candidates must meet ALL of the following requirements:
-
Experience: 3–10 years of software engineering experience, primarily in backend development.
-
Education: Bachelor's degree in a STEM field from a top-30 U.S. university (firm requirement).
-
Production Experience: Hands-on experience building, deploying, and maintaining backend systems in production.
-
Startup Background: Full-time experience working at an early-stage or high-growth startup.
-
Programming: Strong skills in Python, Go, Rust, Java, or a similar backend programming language.
-
Distributed Systems: Experience with asynchronous processing, queues, workers, concurrency, retries, and failure recovery.
-
AWS: Hands-on experience with AWS cloud services.
-
AI Knowledge: Understanding of Natural Language Processing (NLP) and Named Entity Recognition (NER).
-
Onsite: Must be available to work onsite in Brooklyn, NY, five days per week.
Technical Skills
Experience with some of the following technologies is preferred:
-
Languages: Python, Go, Rust, Java
-
Cloud: AWS
-
Data Processing: Apache Airflow, AWS Batch
-
Messaging & Storage: Amazon SQS, S3
-
Databases: DynamoDB, PostgreSQL
-
Architecture: Distributed systems, asynchronous processing, batch processing
-
AI: NLP, Named Entity Recognition (NER)
Candidates are not required to know every tool listed but must have strong backend engineering experience.
Preferred Qualifications
-
Experience building large-scale data-processing systems.
-
Experience developing monitoring dashboards.
-
Knowledge of batch processing and workflow automation.
-
Experience troubleshooting data accuracy and system performance issues.
-
Experience at both an established technology company and a startup.
-
Ability to independently manage backend projects from development to production.