分布式開發的謬論

Fallacies of distributed computing

 在Hbase的官方文檔中發現這篇《分布式開發的謬論》文章的鏈接 ，看了一下覺的都講到了每個分布式項目可能會遇到的痛點，很贊。

“分布式計算是很難的，做一個分布式系統需要很多軟硬件和網絡的技能。你的集群可以會因為各式各樣的錯誤發生故障。比如HBase本身的Bug,錯誤的配置(包括操作系統)，硬件的故障(網卡和磁盤甚至內存) 如果你一直在寫單機程序的話，你需要重新開始學習。”

 

The fallacies are:^[1] 謬論總結如下：

1. The network is reliable.網絡是可靠的
2. Latency is zero.延遲為0
3. Bandwidth is infinite.帶寬是無限的
4. The network is secure.網絡是安全的
5. Topology doesn't change.拓撲結構不會改變
6. There is one administrator.至少有一個管理員
7. Transport cost is zero.傳輸無需任何代價
8. The network is homogeneous.所有的網絡都是同質的

 

The effects of the fallacies[edit] 謬論導致的后果

1. Software applications are written with little error-handling on networking errors. During a network outage, such applications may stall or infinitely wait for an answer packet, permanently consuming memory or other resources. When the failed network becomes available, those applications may also fail to retry any stalled operations or require a (manual) restart.當網絡出現異常軟件應用會進行錯誤處理。在網絡中斷期間，這些應用程序可能會出現延遲或者阻塞等待響應包，這樣會持續的的消耗內存或其他資源。當網絡異常恢復，這些應用程序也可能無法重試任何停滯的操作，可能需要（手動）重啟
2. Ignorance of network latency, and of the packet loss it can cause, induces application- and transport-layer developers to allow unbounded traffic, greatly increasing dropped packets and wasting bandwidth.無視網絡延遲以及由延遲引起的報文丟失，會導致應用及傳輸層開發人員允許不受控的傳輸，從而極大增加丟失的報文數目和帶寬浪費.
3. Ignorance of bandwidth limits on the part of traffic senders can result in bottlenecks over frequency-multiplexed media.發送端忽視帶寬限制會導致頻率復用介質的傳輸瓶頸
4. Complacency regarding network security results in being blindsided by malicious users and programs that continually adapt to security measures.^[2]過度相信網絡的安全性會導致無法覺察到惡意用戶的入侵，從而無法及時采施
5. Changes in network topology can have effects on both bandwidth and latency issues, and therefore similar problems.網絡拓撲結構的變化可能會影響帶寬和潛在的問題，或因此的類似的問題
6. Multiple administrators, as with subnets for rival companies, may institute conflicting policies of which senders of network traffic must be aware in order to complete their desired paths.多個管理員，如同與競爭對手公司的子網可能互相沖突，其中網絡流量的發件人必須認識到為了完成所需的路徑
7. The "hidden" costs of building and maintaining a network or subnet are non-negligible and must consequently be noted in budgets to avoid vast shortfalls.建設和維護一個網絡的潛在成本是不容小覷的，而且還必須划出一筆預算來預防大范圍網絡失效
8. If a system assumes a homogeneous network, then it can lead to the same problems that result from the first three fallacies.如果一個系統是同質均勻的網絡，那么它會導致同樣的問題，如同謬論一到三