distributed-computing.md

July 15, 2021 · View on GitHub

Bookmarks tagged [distributed-computing]

www.codever.land/bookmarks/t/distributed-computing

GitHub - Netflix/chaosmonkey home page

https://github.com/Netflix/chaosmonkey

Chaos Monkey is a resiliency tool that helps applications tolerate random instance failures. - Netflix/chaosmonkey

Nordic.js 2019 • James Simpson - Building Distributed Systems with Node.js - 23min

https://www.youtube.com/watch?v=GUtd-zEDgjQ

Underneath every breakout website or app is a horizontally scaling back-end, but how do we get from a single process Node.js server to a highly-available, auto-scaling system? In this talk, we’ll take...

Level-triggered and edge-triggered

https://gengnosis.blogspot.com/2007/01/level-triggered-and-edge-triggered.html

Edge triggered things happen when some stimulus changes; level-triggered things happen when some stimulus crosses a threshold.

etcd home page

https://etcd.io/

etcd is a strongly consistent, distributed key-value store that provides a reliable way to store data that needs to be accessed by a distributed system or cluster of machines. It gracefully handle...

Kubernetes best practices: Setting up health checks with readiness and liveness probes

https://cloud.google.com/blog/products/gcp/kubernetes-best-practices-setting-up-health-checks-with-r...

In this episode of “Kubernetes Best Practices”, let’s learn about the subtleties of [readiness and liveness probes](https://kubernetes.io/docs/tasks/configure-pod-container/configure-liveness-readines...

PySpark

https://pypi.python.org/pypi/pyspark/

Apache Spark Python API.

dask

https://github.com/dask/dask

A flexible parallel computing library for analytic computing.

luigi

https://github.com/spotify/luigi

A module that helps you build complex pipelines of batch jobs.

mrjob

https://github.com/Yelp/mrjob

Run MapReduce jobs on Hadoop or Amazon Web Services.

Ray

https://github.com/ray-project/ray/

A system for parallel and distributed Python that unifies the machine learning ecosystem.

faust

https://github.com/robinhood/faust

A stream processing library, porting the ideas from Kafka Streams to Python.

streamparse

https://github.com/Parsely/streamparse

Run Python code against real-time streams of data via Apache Storm.

Consul Home

https://www.consul.io/

Consul is a highly available and distributed service discovery and KV store designed with support for the modern data center to make distributed systems and configuration easy.

Apache ZooKeeper - Home

http://zookeeper.apache.org/

Apache ZooKeeper is an effort to develop and maintain an open-source server which enables highly reliable distributed coordination.

CAP theorem - Wikipedia

https://en.wikipedia.org/wiki/CAP_theorem

In theoretical computer science, the CAP theorem, also named Brewer's theorem after computer scientist Eric Brewer, states that it is impossible for a distributed data store to simultaneously provide ...

Eventually Consistent - Revisited - All Things Distributed

https://www.allthingsdistributed.com/2008/12/eventually_consistent.html

The goal of this article is to raise awareness about the complexity of engineering systems that need to operate at a global scale and that require careful tuning to ensure that they can deliver the du...