Проект

Общее

Профиль

OVERVIEW » История » Версия 31

Dmitry Chernyak, 19.06.2016 20:58

1 28 Dmitry Chernyak
h1. OVERVIEW
2 1 Dmitry Chernyak
3 1 Dmitry Chernyak
{{toc}}
4 1 Dmitry Chernyak
5 31 Dmitry Chernyak
[[OVERVIEW]] | [[INSTALL]] | [[SETUP]] | [[OPERATIONS]] | [[LICENSE]]
6 31 Dmitry Chernyak
[[ОБЗОР]] | [[УСТАНОВКА]] | [[НАСТРОЙКА]] | [[ОПЕРАЦИИ]] | [[ЛИЦЕНЗИЯ]]
7 1 Dmitry Chernyak
8 28 Dmitry Chernyak
h2. THE PROJECT
9 1 Dmitry Chernyak
10 28 Dmitry Chernyak
"SkyCover Infrastructure" (*SCI*) is the multipurpose, mostly automated high
11 28 Dmitry Chernyak
reliability virtual server infrastructure, equipped with automatic monitoring,
12 28 Dmitry Chernyak
backup and audit processes.
13 1 Dmitry Chernyak
14 28 Dmitry Chernyak
"SCI-CD" is the deployment engine for cheap and flexible virtual high
15 28 Dmitry Chernyak
reliability cluster, the ground level for *SCI*.
16 1 Dmitry Chernyak
17 28 Dmitry Chernyak
h2. INTRODUCTION
18 1 Dmitry Chernyak
19 28 Dmitry Chernyak
SCI-CD is created to make easy the deployment of the virtual infrastructure,
20 28 Dmitry Chernyak
based on the Ganeti project (http://code.google.com/p/ganeti/).
21 24 Dmitry Chernyak
22 28 Dmitry Chernyak
With Ganeti you will be able to install the "farm" of several computers -
23 28 Dmitry Chernyak
"nodes", each with it's own storage and to create the cluster environment over
24 28 Dmitry Chernyak
them when each virtual instance will be started on the one node and backed up
25 28 Dmitry Chernyak
on the another node with on-line disk synchronization (via DRBD) and fast
26 28 Dmitry Chernyak
failover.
27 1 Dmitry Chernyak
28 1 Dmitry Chernyak
!cluster-sync.jpg!
29 15 Dmitry Chernyak
30 28 Dmitry Chernyak
This provides the way to made cheap redundant high reliable systems.
31 1 Dmitry Chernyak
32 28 Dmitry Chernyak
Ganeti is also able to manage "regular", stand-alone virtual instances.
33 1 Dmitry Chernyak
34 28 Dmitry Chernyak
h2. SOFTWARE
35 1 Dmitry Chernyak
36 28 Dmitry Chernyak
SCI-CD is based on the Debian/GNU project and uses it's installer (simple-cdd)
37 28 Dmitry Chernyak
and also it's package repositories.
38 28 Dmitry Chernyak
Installing SCI-CD you'll not got a new thing - you'll got a regular Debian/GNU
39 28 Dmitry Chernyak
Linux system, just by the easy way and tuned as complex cluster platform.
40 1 Dmitry Chernyak
41 28 Dmitry Chernyak
SCI-CD contains the minimum of original software, instead it is focused on the
42 28 Dmitry Chernyak
proper usage of existing open source components.
43 15 Dmitry Chernyak
44 28 Dmitry Chernyak
h2. CONTENTS
45 1 Dmitry Chernyak
46 28 Dmitry Chernyak
SCI core platform consists of two Ganeti nodes and one *service instance* (virtual
47 28 Dmitry Chernyak
machine, named *sci*).
48 1 Dmitry Chernyak
49 28 Dmitry Chernyak
The service instance provides:
50 28 Dmitry Chernyak
* DNS for local zones, forwarders, hint (BIND9 chrooted),
51 28 Dmitry Chernyak
* DHCP server for LAN and with DDNS (disabled by default),
52 28 Dmitry Chernyak
* Configuation management, able to tune up new nodes and instances (Puppet),
53 28 Dmitry Chernyak
* Apt-proxy, with uplink to Debian mirrors and also with local repository,
54 28 Dmitry Chernyak
copied from SCI-CD CD-ROM (Approx).
55 1 Dmitry Chernyak
56 28 Dmitry Chernyak
More virtual instances may be created and more functions may be assigned to them
57 28 Dmitry Chernyak
using the regular Ganeti commands.
58 1 Dmitry Chernyak
59 28 Dmitry Chernyak
h2. HARDWARE
60 1 Dmitry Chernyak
61 28 Dmitry Chernyak
Minimal SCI core hardware is based on the two nodes which can be any two computers -
62 28 Dmitry Chernyak
the major brands, such as HP, IBM, the "China brands", such as
63 28 Dmitry Chernyak
SuperMicro or self-maiden servers or even workstations.
64 12 Dmitry Chernyak
65 28 Dmitry Chernyak
Of course, the performance of your system will be very dependent on the
66 28 Dmitry Chernyak
hardware you have chosed - the CPU, memory, RAID subsystem - all will matters
67 28 Dmitry Chernyak
as usual for the performance, but mostly - NOT for the high reliability
68 28 Dmitry Chernyak
capabilities.
69 1 Dmitry Chernyak
70 28 Dmitry Chernyak
The high reliability features are supported by providing two separate nodes with
71 28 Dmitry Chernyak
their own storage subsystems and on-line storage synchronization between them. In the
72 28 Dmitry Chernyak
most cases this level of redundancy is sufficient to cover the data losses and
73 28 Dmitry Chernyak
service interrupts even with the cheap hardware.
74 1 Dmitry Chernyak
75 28 Dmitry Chernyak
h2. LOCAL AREA NETWORKING
76 1 Dmitry Chernyak
77 28 Dmitry Chernyak
All nodes should be attached to the same TCP/IP LAN segment (or segments)nto be able
78 28 Dmitry Chernyak
to launch the clustered virtual linstances.
79 1 Dmitry Chernyak
80 28 Dmitry Chernyak
The SCI setup supports 802.1q VLAN tagging, so you can easy give your nodes and
81 28 Dmitry Chernyak
instances the interfaces in different network segments (the network switch with
82 28 Dmitry Chernyak
802.1q support is required).
83 1 Dmitry Chernyak
84 28 Dmitry Chernyak
h2. STORAGE NETWORKING
85 1 Dmitry Chernyak
86 28 Dmitry Chernyak
The nodes need to be interconnected with the fast TCP/IP interlink to transfer
87 28 Dmitry Chernyak
storage data (DRBD synchronization). 1GigE will be sufficient usually.
88 1 Dmitry Chernyak
89 28 Dmitry Chernyak
It is possible (and recommended) to separate the storage interlink from the main
90 28 Dmitry Chernyak
TCP/IP access interfaces. In the other words, each node should have a two network
91 28 Dmitry Chernyak
adapters and at least one of them should support 1GigE.
92 6 Владимир Ипатов
93 28 Dmitry Chernyak
For only two nodes the storage network may be implemented with the cat5e patch cord
94 28 Dmitry Chernyak
without an Ethernet switch.
95 1 Dmitry Chernyak
96 28 Dmitry Chernyak
For the simple and demo tasks there is possible to use only one network adapter
97 28 Dmitry Chernyak
on the node, but it *MUST* support 1GigE speed.
98 1 Dmitry Chernyak
99 28 Dmitry Chernyak
h2. INTERNET NETWORKING
100 1 Dmitry Chernyak
101 28 Dmitry Chernyak
In order to access to the Internet you should connect your local network segment
102 28 Dmitry Chernyak
to the Internet router.
103 1 Dmitry Chernyak
104 28 Dmitry Chernyak
The simplest way is to use the separate router with NAT.
105 1 Dmitry Chernyak
106 28 Dmitry Chernyak
The more advanced way is to construct the router/firewall on the cluster's virtual
107 28 Dmitry Chernyak
instance, probably with separate network interface.
108 1 Dmitry Chernyak
109 28 Dmitry Chernyak
h2. DEBIAN REPOSITORIES
110 1 Dmitry Chernyak
111 28 Dmitry Chernyak
The service instance provides "approx" apt proxy, which can be uplinked to
112 28 Dmitry Chernyak
regular Debian mirrors or to the intermediate mirrors or apt proxies in your LAN. 
113 27 Dmitry Chernyak
114 28 Dmitry Chernyak
In any case, the service instance's "approx" is loaded by the copy of the
115 28 Dmitry Chernyak
repository from the SCI-CD CD-ROM. It can be used even in absence of the uplink
116 28 Dmitry Chernyak
to the external sources.
117 27 Dmitry Chernyak
118 28 Dmitry Chernyak
The standard reposiporise list is pushed automatically into the sources.lists
119 28 Dmitry Chernyak
of the puppet-client instances (which are by default all the nodes and
120 28 Dmitry Chernyak
instances).
121 1 Dmitry Chernyak
122 28 Dmitry Chernyak
h2. INSTALLATION
123 1 Dmitry Chernyak
124 28 Dmitry Chernyak
Please read [[INSTALL]] for instructions.