Job description

Software Engineer/ Tech Lead - Scalable Data & Analytics Systems We are seeking exceptional Software Engineers to design and scale next-generation data processing and analytics platforms that power OLTP, OLAP, and large-scale distributed data systems. You will build and optimize pipelines and services that handle billions of records daily, enabling real-time transactions, analytical insights, and AI-driven decisioning. Securiti AI enables secure use of Enterprise AI and Data. To accomplish this mission, we analyze very large amounts of unstructured and structured data to establish Data and AI Security hygiene. As we serve large enterprises with massive amounts of data, we are geared to one of the biggest processors of data globally. Key Responsibilities • Transactional & Analytical Systems: Design and implement highly scalable OLTP systems for real-time workloads and OLAP systems for complex analytical queries on massive datasets. • Distributed Processing: Build, optimize, and maintain large-scale batch and streaming pipelines using frameworks such as Apache Spark, Flink, Presto/Trino, or Kafka Streams. • System Performance & Scale: Optimize systems for low-latency queries, high-throughput ingestion, and interactive analytics, ensuring seamless performance as data volumes scale to petabytes. • Data Infrastructure: Develop and integrate with modern storage and processing systems (e.g., Snowflake, BigQuery, Redshift, Cassandra, HDFS, Delta Lake, Iceberg) to support hybrid analytical/transactional workloads. • Reliability & Observability: Ensure high availability, reliability, and monitoring across large compute and storage clusters with automated failover and recovery. • Collaboration: Partner with data scientists, ML engineers, and product teams to build unified, secure, and cost-efficient data platforms. Required Skills & Experience • Strong proficiency in Java, Scala, Python, or Go, with proven experience building distributed back-end systems. • Deep understanding of database internals, query optimization, indexing, and ACID vs. eventual consistency trade-offs. • Hands-on experience with big data frameworks (Spark, Flink, Kafka) and distributed SQL engines (Presto, Trino, Hive, Impala). • Expertise in designing OLAP/OLTP architectures for scale and high concurrency. • Solid grounding in distributed systems, concurrency, parallelism, and caching techniques. Preferred Qualifications • Experience with HTAP (Hybrid Transactional/Analytical Processing) systems or real-time analytics platforms. • Familiarity with data lakehouse architectures and formats like Parquet, ORC, Delta, Iceberg, Hudi. • Knowledge of containerized deployments (Docker, Kubernetes) and cloud-native data architectures (AWS Redshift, GCP BigQuery, Azure Synapse). • Background in query engine development or contributing to open-source OLAP/OLTP frameworks. What Success Looks Like • OLAP systems that deliver interactive sub-second query performance across petabyte-scale datasets. • Spark and distributed pipelines that power real-time and batch processing for AI/ML and business analytics at enterprise scale. (1) We are an Equal Opportunity/Affirmative Action employer. All qualified applicants, upon confirmation, will receive fair consideration for employment without regard to race, color, religion, sex (including sexual orientation and gender identity), national origin, disability, protected Veteran Status, or any other characteristic protected by applicable federal, state, local or country law.(2) By submitting your profile for evaluation for this job offering, you are agreeing to the collection and processing of your personal data. Personal data submitted by job applicants will be strictly used for recruitment-related purposes, including evaluating applications, shortlisting and selecting candidates who meet our merit criteria and standards and for communicating with you. Your personal data may also be shared with third parties and partners for this purpose. Your personal data will be retained by us and may be used to contact/communicate with you in the future or to meet legal and regulatory requirements. Provided data will be protected through technical and organizational security measures to prevent unauthorized access, accidental or deliberate manipulation, destruction or disclosure. For more details on our data practices and your rights, please see our Privacy Policy. • Salary range 150k-210k OTE Equity Details - eligible for stock options Benefits - healthcare, PTO, Location - San Jose office

Requirements