Basics
Name | Siddesh Shinde |
Label | Distributed Systems Engineer |
sshindesiddesh@gmail.com | |
Phone | +1(631) 820-5510 |
Url | https://sshindesiddesh.github.io/ |
Summary | Distributed Systems Engineer passionate about solving real-world problems at scale, with expertise in performance optimizations and resilient architectures. |
Education
-
Masters in Computer Science - Stony Brook University
AUG 2017 - DEC 2018Coursework: Operating Systems, Algorithms, Artificial Intelligence, Network Security, Database systems, Distributed Systems
-
Bachelors in E&TC in Electronics & Telecommunication Engineering - Pune Institute of Computer Technology
AUG 2011 - JUN 2015Coursework: Data Structures, Real Time Operating Systems, Computer Architecture, System Programming, Computer Networks
Skills
Programming Languages | |
C, C++, Python, GoLang, Java, Rust |
Distributed Datastores | |
MySQL, MongoDB, Zookeeper, Kafka, Redis, DynamoDB |
Cloud & Infrastructure | |
AWS (EC2, S3, SQS, EMR), HDFS, Apache Spark, Apache Flink, Apache Airflow, Data Built Tool (dbt) |
Backend Technologies | |
grpc, protocol buffers, TCP/IP, REST, Kubernetes, Docker Containers |
Storage Engines | |
RocksDB, SQLite |
Monitoring | |
OpenTelemetry, Prometheus, Graffana |
Patents
- High throughput distributed file system journaling using B+ Tree leaf packing.2024
- Methods for high throughput sequential/bulk key additions in a B+ tree.2023
- Algorithm to perform intent-less update transactions in distributed file systems.2023
- Algorithm to perform optimal distributed file system directory Reverse Name Lookup.2022
- Instant large objects/files truncation in a distributed file system.2022
Work
-
Staff Software Engineer - Core Datapath - Cohesity
2019.03 - PresentCurrently contributing to the Distributed File Systems team.
- Proposed and shipped several performance optimizations for creates, links, renames, lookups and reverse lookups (25% to 20x gains). 5 US patents filed.
- Optimized read/write in Key-Value and Logical data replication services.
- Worked on Cloud Native Data-Platform (kubernetes orchestrators, fault tolerance abstraction, data plane unification, etc).
- Root caused several critical data integrity issues. Lead a project to detect, fix and prevent corruption issues leading to 70% reduction within 2 quarters.
-
Member of Technical Staff, Intern - Cloud Platforms - VMware
2018.05 - 2018.08Developed a proof-of-concept for decentralized lifecycle management of Data Centers using GoLang.
- Implemented a PoD service in AWS from the ground up, leveraging Kubernetes for container orchestration and scalability.
-
Software Engineer - Boot & Security - Qualcomm
2016.12 - 2017.07Enhanced the kernel bootloader for Snapdragon 700 series by implementing a secure boot process with a robust chain of trust.
- Utilized cryptographic algorithms and hardware-backed security features (Secure Boot, TrustZone).
-
Software Engineer - IoT R&D - Marvell Technology Group
2015.07 - 2016.12Designed and implemented an SDK for Apple's HAP IoT on a WiFi+BLE product, Secure Tunnel.
- Developed using networking layer libraries (HTTP, TCP/IP, GATT) on an RTOS with multithreaded support in C.
Paper
-
RoboChair : Health Monitoring IoT System for Wheelchair
2015International Journal of Advance Research (IJOAR)
Projects
-
Distributed Resource Throttling Service
Designed and developed system for managing abstract resources (network bandwidth, task execution, etc) with cluster-wide rate limit capabilities.
- Integral to 20+ controlpath and datapath services across the infrastructure.
-
Instantaneous Large Object Truncation
Developed and patented an algorithm for efficient truncation of large objects, reducing operation time from linear to logarithmic by dereferencing data blocks from the B+Tree.
- Truncation is ~10x faster for a 1-100GB file.
-
Distributed Tracing Service
Designed an observability platform using OpenTelemetry and implemented a collector service to aggregate traces/logs/metrics.
- Exporting data to AWS S3 and processing telemetry data with Apache Spark on AWS EMR.
-
SBUnix - Design and Implementation of 64 bit kernel
Developed a preemptive multitasking kernel by designing scheduler, paging, memory allocator (kernel/user), kernel threads, ring-3 user process, etc.
- Implemented system calls copy-on-write fork, execve, waitpid, kill, etc.
- Developed Virtual File System and support for ELF parsing and loading.
- Shell that supports executing scripts/binaries/pipes and background processes.