Basics

Name Siddesh Shinde
Label Distributed Systems Engineer
Email sshindesiddesh@gmail.com
Phone +1(631) 820-5510
Url https://sshindesiddesh.github.io/
Summary Distributed Systems Engineer passionate about solving real-world problems at scale, with expertise in performance optimizations and resilient architectures.

Education

  • Masters in Computer Science - Stony Brook University
    AUG 2017 - DEC 2018

    Coursework: Operating Systems, Algorithms, Artificial Intelligence, Network Security, Database systems, Distributed Systems

  • Bachelors in E&TC in Electronics & Telecommunication Engineering - Pune Institute of Computer Technology
    AUG 2011 - JUN 2015

    Coursework: Data Structures, Real Time Operating Systems, Computer Architecture, System Programming, Computer Networks

Skills

Programming Languages
C, C++, Python, GoLang, Java, Rust
Distributed Datastores
MySQL, MongoDB, Zookeeper, Kafka, Redis, DynamoDB
Cloud & Infrastructure
AWS (EC2, S3, SQS, EMR), HDFS, Apache Spark, Apache Flink, Apache Airflow, Data Built Tool (dbt)
Backend Technologies
grpc, protocol buffers, TCP/IP, REST, Kubernetes, Docker Containers
Storage Engines
RocksDB, SQLite
Monitoring
OpenTelemetry, Prometheus, Graffana

Patents

  • High throughput distributed file system journaling using B+ Tree leaf packing.
    2024
  • Methods for high throughput sequential/bulk key additions in a B+ tree.
    2023
  • Algorithm to perform intent-less update transactions in distributed file systems.
    2023
  • Algorithm to perform optimal distributed file system directory Reverse Name Lookup.
    2022
  • Instant large objects/files truncation in a distributed file system.
    2022

Work

  • Staff Software Engineer - Core Datapath - Cohesity
    2019.03 - Present

    Currently contributing to the Distributed File Systems team.

    • Proposed and shipped several performance optimizations for creates, links, renames, lookups and reverse lookups (25% to 20x gains). 5 US patents filed.
    • Optimized read/write in Key-Value and Logical data replication services.
    • Worked on Cloud Native Data-Platform (kubernetes orchestrators, fault tolerance abstraction, data plane unification, etc).
    • Root caused several critical data integrity issues. Lead a project to detect, fix and prevent corruption issues leading to 70% reduction within 2 quarters.
  • Member of Technical Staff, Intern - Cloud Platforms - VMware
    2018.05 - 2018.08

    Developed a proof-of-concept for decentralized lifecycle management of Data Centers using GoLang.

    • Implemented a PoD service in AWS from the ground up, leveraging Kubernetes for container orchestration and scalability.
  • Software Engineer - Boot & Security - Qualcomm
    2016.12 - 2017.07

    Enhanced the kernel bootloader for Snapdragon 700 series by implementing a secure boot process with a robust chain of trust.

    • Utilized cryptographic algorithms and hardware-backed security features (Secure Boot, TrustZone).
  • Software Engineer - IoT R&D - Marvell Technology Group
    2015.07 - 2016.12

    Designed and implemented an SDK for Apple's HAP IoT on a WiFi+BLE product, Secure Tunnel.

    • Developed using networking layer libraries (HTTP, TCP/IP, GATT) on an RTOS with multithreaded support in C.

Paper

  • RoboChair : Health Monitoring IoT System for Wheelchair
    2015

    International Journal of Advance Research (IJOAR)

Projects

  • Distributed Resource Throttling Service

    Designed and developed system for managing abstract resources (network bandwidth, task execution, etc) with cluster-wide rate limit capabilities.

    • Integral to 20+ controlpath and datapath services across the infrastructure.
  • Instantaneous Large Object Truncation

    Developed and patented an algorithm for efficient truncation of large objects, reducing operation time from linear to logarithmic by dereferencing data blocks from the B+Tree.

    • Truncation is ~10x faster for a 1-100GB file.
  • Distributed Tracing Service

    Designed an observability platform using OpenTelemetry and implemented a collector service to aggregate traces/logs/metrics.

    • Exporting data to AWS S3 and processing telemetry data with Apache Spark on AWS EMR.
  • SBUnix - Design and Implementation of 64 bit kernel

    Developed a preemptive multitasking kernel by designing scheduler, paging, memory allocator (kernel/user), kernel threads, ring-3 user process, etc.

    • Implemented system calls copy-on-write fork, execve, waitpid, kill, etc.
    • Developed Virtual File System and support for ELF parsing and loading.
    • Shell that supports executing scripts/binaries/pipes and background processes.