Infrastruktura Hlídače státu

Velké problémy

Stav k 05. 07. 2022 18:15:55

Načíst znovu


Stav jednotlivých komponent Hlídače státu

Služba Stav Detail
Docker
Docker .201 Velké problémy Object reference not set to an instance of an object.
Docker .145 Menší problémy couchbase: error System.Net.Http.HttpRequestException: Connection failed
---> System.Net.Sockets.SocketException (10061): No connection could be made because the target machine actively refused it.
at Microsoft.Net.Http.Client.ManagedHandler.TCPSocketOpenerAsync(String host, Int32 port, CancellationToken cancellationToken)
at Microsoft.Net.Http.Client.ManagedHandler.ProcessRequestAsync(HttpRequestMessage request, CancellationToken cancellationToken)
--- End of inner exception stack trace ---
at Microsoft.Net.Http.Client.ManagedHandler.ProcessRequestAsync(HttpRequestMessage request, CancellationToken cancellationToken)
at Microsoft.Net.Http.Client.ManagedHandler.SendAsync(HttpRequestMessage request, CancellationToken cancellationToken)
at System.Net.Http.HttpClient.g__Core|83_0(HttpRequestMessage request, HttpCompletionOption completionOption, CancellationTokenSource cts, Boolean disposeCts, CancellationTokenSource pendingRequestsCts, CancellationToken originalCancellationToken)
at Docker.DotNet.DockerClient.PrivateMakeRequestAsync(TimeSpan timeout, HttpCompletionOption completionOption, HttpMethod method, String path, IQueryString queryString, IDictionary`2 headers, IRequestContent data, CancellationToken cancellationToken)
at Docker.DotNet.DockerClient.MakeRequestAsync(IEnumerable`1 errorHandlers, HttpMethod method, String path, IQueryString queryString, IRequestContent body, IDictionary`2 headers, TimeSpan timeout, CancellationToken token)
at Docker.DotNet.ContainerOperations.InspectContainerAsync(String id, CancellationToken cancellationToken)
at HlidacStatu.Web.HealthChecks.DockerContainer.CheckHealthAsync(HealthCheckContext context, CancellationToken cancellationToken) in P:\CCD\hs.team\Hlidac-Statu\Web.HealthChecks\DockerContainer.cs:line 43
couchbase: docker not responding
classificationrepair: error System.Net.Http.HttpRequestException: Connection failed
---> System.Net.Sockets.SocketException (10061): No connection could be made because the target machine actively refused it.
at Microsoft.Net.Http.Client.ManagedHandler.TCPSocketOpenerAsync(String host, Int32 port, CancellationToken cancellationToken)
at Microsoft.Net.Http.Client.ManagedHandler.ProcessRequestAsync(HttpRequestMessage request, CancellationToken cancellationToken)
--- End of inner exception stack trace ---
at Microsoft.Net.Http.Client.ManagedHandler.ProcessRequestAsync(HttpRequestMessage request, CancellationToken cancellationToken)
at Microsoft.Net.Http.Client.ManagedHandler.SendAsync(HttpRequestMessage request, CancellationToken cancellationToken)
at System.Net.Http.HttpClient.g__Core|83_0(HttpRequestMessage request, HttpCompletionOption completionOption, CancellationTokenSource cts, Boolean disposeCts, CancellationTokenSource pendingRequestsCts, CancellationToken originalCancellationToken)
at Docker.DotNet.DockerClient.PrivateMakeRequestAsync(TimeSpan timeout, HttpCompletionOption completionOption, HttpMethod method, String path, IQueryString queryString, IDictionary`2 headers, IRequestContent data, CancellationToken cancellationToken)
at Docker.DotNet.DockerClient.MakeRequestAsync(IEnumerable`1 errorHandlers, HttpMethod method, String path, IQueryString queryString, IRequestContent body, IDictionary`2 headers, TimeSpan timeout, CancellationToken token)
at Docker.DotNet.ContainerOperations.InspectContainerAsync(String id, CancellationToken cancellationToken)
at HlidacStatu.Web.HealthChecks.DockerContainer.CheckHealthAsync(HealthCheckContext context, CancellationToken cancellationToken) in P:\CCD\hs.team\Hlidac-Statu\Web.HealthChecks\DockerContainer.cs:line 43
classificationrepair: docker not responding
klasifikace-smluv: error System.Net.Http.HttpRequestException: Connection failed
---> System.Net.Sockets.SocketException (10061): No connection could be made because the target machine actively refused it.
at Microsoft.Net.Http.Client.ManagedHandler.TCPSocketOpenerAsync(String host, Int32 port, CancellationToken cancellationToken)
at Microsoft.Net.Http.Client.ManagedHandler.ProcessRequestAsync(HttpRequestMessage request, CancellationToken cancellationToken)
--- End of inner exception stack trace ---
at Microsoft.Net.Http.Client.ManagedHandler.ProcessRequestAsync(HttpRequestMessage request, CancellationToken cancellationToken)
at Microsoft.Net.Http.Client.ManagedHandler.SendAsync(HttpRequestMessage request, CancellationToken cancellationToken)
at System.Net.Http.HttpClient.g__Core|83_0(HttpRequestMessage request, HttpCompletionOption completionOption, CancellationTokenSource cts, Boolean disposeCts, CancellationTokenSource pendingRequestsCts, CancellationToken originalCancellationToken)
at Docker.DotNet.DockerClient.PrivateMakeRequestAsync(TimeSpan timeout, HttpCompletionOption completionOption, HttpMethod method, String path, IQueryString queryString, IDictionary`2 headers, IRequestContent data, CancellationToken cancellationToken)
at Docker.DotNet.DockerClient.MakeRequestAsync(IEnumerable`1 errorHandlers, HttpMethod method, String path, IQueryString queryString, IRequestContent body, IDictionary`2 headers, TimeSpan timeout, CancellationToken token)
at Docker.DotNet.ContainerOperations.InspectContainerAsync(String id, CancellationToken cancellationToken)
at HlidacStatu.Web.HealthChecks.DockerContainer.CheckHealthAsync(HealthCheckContext context, CancellationToken cancellationToken) in P:\CCD\hs.team\Hlidac-Statu\Web.HealthChecks\DockerContainer.cs:line 43
klasifikace-smluv: docker not responding
myrabbit: error System.Net.Http.HttpRequestException: Connection failed
---> System.Net.Sockets.SocketException (10061): No connection could be made because the target machine actively refused it.
at Microsoft.Net.Http.Client.ManagedHandler.TCPSocketOpenerAsync(String host, Int32 port, CancellationToken cancellationToken)
at Microsoft.Net.Http.Client.ManagedHandler.ProcessRequestAsync(HttpRequestMessage request, CancellationToken cancellationToken)
--- End of inner exception stack trace ---
at Microsoft.Net.Http.Client.ManagedHandler.ProcessRequestAsync(HttpRequestMessage request, CancellationToken cancellationToken)
at Microsoft.Net.Http.Client.ManagedHandler.SendAsync(HttpRequestMessage request, CancellationToken cancellationToken)
at System.Net.Http.HttpClient.g__Core|83_0(HttpRequestMessage request, HttpCompletionOption completionOption, CancellationTokenSource cts, Boolean disposeCts, CancellationTokenSource pendingRequestsCts, CancellationToken originalCancellationToken)
at Docker.DotNet.DockerClient.PrivateMakeRequestAsync(TimeSpan timeout, HttpCompletionOption completionOption, HttpMethod method, String path, IQueryString queryString, IDictionary`2 headers, IRequestContent data, CancellationToken cancellationToken)
at Docker.DotNet.DockerClient.MakeRequestAsync(IEnumerable`1 errorHandlers, HttpMethod method, String path, IQueryString queryString, IRequestContent body, IDictionary`2 headers, TimeSpan timeout, CancellationToken token)
at Docker.DotNet.ContainerOperations.InspectContainerAsync(String id, CancellationToken cancellationToken)
at HlidacStatu.Web.HealthChecks.DockerContainer.CheckHealthAsync(HealthCheckContext context, CancellationToken cancellationToken) in P:\CCD\hs.team\Hlidac-Statu\Web.HealthChecks\DockerContainer.cs:line 43
myrabbit: docker not responding
Docker .146 Menší problémy couchbase: error System.Net.Http.HttpRequestException: Connection failed
---> System.Net.Sockets.SocketException (10061): No connection could be made because the target machine actively refused it.
at Microsoft.Net.Http.Client.ManagedHandler.TCPSocketOpenerAsync(String host, Int32 port, CancellationToken cancellationToken)
at Microsoft.Net.Http.Client.ManagedHandler.ProcessRequestAsync(HttpRequestMessage request, CancellationToken cancellationToken)
--- End of inner exception stack trace ---
at Microsoft.Net.Http.Client.ManagedHandler.ProcessRequestAsync(HttpRequestMessage request, CancellationToken cancellationToken)
at Microsoft.Net.Http.Client.ManagedHandler.SendAsync(HttpRequestMessage request, CancellationToken cancellationToken)
at System.Net.Http.HttpClient.g__Core|83_0(HttpRequestMessage request, HttpCompletionOption completionOption, CancellationTokenSource cts, Boolean disposeCts, CancellationTokenSource pendingRequestsCts, CancellationToken originalCancellationToken)
at Docker.DotNet.DockerClient.PrivateMakeRequestAsync(TimeSpan timeout, HttpCompletionOption completionOption, HttpMethod method, String path, IQueryString queryString, IDictionary`2 headers, IRequestContent data, CancellationToken cancellationToken)
at Docker.DotNet.DockerClient.MakeRequestAsync(IEnumerable`1 errorHandlers, HttpMethod method, String path, IQueryString queryString, IRequestContent body, IDictionary`2 headers, TimeSpan timeout, CancellationToken token)
at Docker.DotNet.ContainerOperations.InspectContainerAsync(String id, CancellationToken cancellationToken)
at HlidacStatu.Web.HealthChecks.DockerContainer.CheckHealthAsync(HealthCheckContext context, CancellationToken cancellationToken) in P:\CCD\hs.team\Hlidac-Statu\Web.HealthChecks\DockerContainer.cs:line 43
couchbase: docker not responding
Docker .200 Menší problémy asrrunner: error System.Net.Http.HttpRequestException: Connection failed
---> System.Net.Sockets.SocketException (10061): No connection could be made because the target machine actively refused it.
at Microsoft.Net.Http.Client.ManagedHandler.TCPSocketOpenerAsync(String host, Int32 port, CancellationToken cancellationToken)
at Microsoft.Net.Http.Client.ManagedHandler.ProcessRequestAsync(HttpRequestMessage request, CancellationToken cancellationToken)
--- End of inner exception stack trace ---
at Microsoft.Net.Http.Client.ManagedHandler.ProcessRequestAsync(HttpRequestMessage request, CancellationToken cancellationToken)
at Microsoft.Net.Http.Client.ManagedHandler.SendAsync(HttpRequestMessage request, CancellationToken cancellationToken)
at System.Net.Http.HttpClient.g__Core|83_0(HttpRequestMessage request, HttpCompletionOption completionOption, CancellationTokenSource cts, Boolean disposeCts, CancellationTokenSource pendingRequestsCts, CancellationToken originalCancellationToken)
at Docker.DotNet.DockerClient.PrivateMakeRequestAsync(TimeSpan timeout, HttpCompletionOption completionOption, HttpMethod method, String path, IQueryString queryString, IDictionary`2 headers, IRequestContent data, CancellationToken cancellationToken)
at Docker.DotNet.DockerClient.MakeRequestAsync(IEnumerable`1 errorHandlers, HttpMethod method, String path, IQueryString queryString, IRequestContent body, IDictionary`2 headers, TimeSpan timeout, CancellationToken token)
at Docker.DotNet.ContainerOperations.InspectContainerAsync(String id, CancellationToken cancellationToken)
at HlidacStatu.Web.HealthChecks.DockerContainer.CheckHealthAsync(HealthCheckContext context, CancellationToken cancellationToken) in P:\CCD\hs.team\Hlidac-Statu\Web.HealthChecks\DockerContainer.cs:line 43
asrrunner: docker not responding
Camelot APIs V pořádku 100.169 (0:)
(0:)

150.204 (1.6.15.0/camelot, version 0.10.1)
stats: threads 0/40, 127 012 parsed (1H:0/24H:1 589), 1 649 160 (246 / 20 245) api calls, 86 113 errors (System.ArgumentException: Second path fragment), 5321 files 155,008 MB

150.201 (1.6.15.0/camelot, version 0.10.1)
stats: threads 0/40, 14 996 parsed (1H:0/24H:1 162), 173 938 (246 / 15 863) api calls, 58 204 errors (System.ArgumentException: Second path fragment), 11924 files 374,309 MB

150.200 (1.6.15.0/camelot, version 0.10.1)
stats: threads 0/40, 65 576 parsed (1H:0/24H:1 060), 1 346 557 (246 / 22 353) api calls, 121 215 errors (System.ArgumentException: Second path fragment), 6464 files 282,317 MB

moonlake (1.6.15.0/camelot, version 0.10.1)
stats: threads 0/30, 66 181 parsed (1H:0/24H:1 111), 1 449 658 (246 / 19 907) api calls, 69 573 errors (System.ArgumentException: Second path fragment), 4649 files 139,113 MB

docker55 (1.6.15.0/camelot, version 0.10.1)
stats: threads 0/10, 10 428 parsed (1H:0/24H:224), 1 037 938 (246 / 20 469) api calls, 2 809 errors (System.ArgumentException: Second path fragment), 162 files 8,226 MB

docker54 (1.6.15.0/camelot, version 0.10.1)
stats: threads 0/20, 12 089 parsed (1H:0/24H:418), 1 770 428 (246 / 42 276) api calls, 7 831 errors (System.ArgumentException: Second path fragment), 238 files 40,416 MB

docker53 (1.6.15.0/camelot, version 0.10.1)
stats: threads 0/20, 12 430 parsed (1H:0/24H:440), 1 738 939 (246 / 38 015) api calls, 4 989 errors (System.ArgumentException: Second path fragment), 195 files 18,974 MB

docker52 (1.6.15.0/camelot, version 0.10.1)
stats: threads 0/20, 11 758 parsed (1H:0/24H:298), 1 757 614 (246 / 32 864) api calls, 7 090 errors (System.ArgumentException: Second path fragment), 608 files 30,543 MB

docker51 (1.6.15.0/camelot, version 0.10.1)
stats: threads 0/10, 9 210 parsed (1H:0/24H:274), 1 057 885 (246 / 19 392) api calls, 1 809 errors (System.ArgumentException: Second path fragment), 204 files 5,239 MB

Docker .204 V pořádku teamcity: is running
healthcheckui: is running
camelotdockerapi: is running
Data
Zpracované VZ Menší problémy 2022-07-04: 1178 zakázek
2022-07-03: 82 zakázek
2022-07-02: 0 zakázek
Dataset Rozhodnuti UOHS V pořádku 8679 zaznamů za Týden
Dataset VEKLEP V pořádku 66 zaznamů za Týden
Dataset Vyjadření politiků V pořádku 2521 zaznamů za Den
Statistiky malých databází V pořádku
datasetcelkem zaznamuza Měsícposl.změna
skutecni-majitele61278921295405.07.22
zasedani-zastupitelstev24408004.07.22
rejstrik-trestu-pravnickych-osob98785504.07.22
seznam-politickych-stran443228.06.22
de-minimis546406026.06.22
stenozaznamy-psp405426025.06.22
stav-mostu19514015.05.22
covid-podpora314192014.05.22
firmy-na-sankcnim-seznamu83022.03.22
covid-podpory-mpo156946004.02.22
pomoc-covid48013.01.22
rada-ceske-televize247021.11.21
transparentni-ucty459022.08.21
transparentni-ucty-transakce170874022.08.21
vybory-psp684030.07.21
tiskove-konference-vlady1334016.07.21
jednani-vlady20406014.07.21
kapacity-nemocnic208031.03.21
kapacity-jedn-nemocnic47670025.03.21
kontrolni-akce-nku1077028.01.21
osoby-kontrolovane-nku11769028.01.21
clenove-kolegia-nku47012.12.20
cz-nuts114008.08.20
ministri353015.07.20
prijemci-podpory-covid-programu2531014.07.20
fond-hejtmanky-pokorne-jermanove3321030.05.20
narodni-investicni-plan20149010.05.20
publicchargingstations237004.01.20
ministry-invoices657583012.07.19
kvalifikovanidodavatele2614019.05.19
prijemcidotaci332172004.05.19
Zpracované smlouvy V pořádku 2022-07-04: 3038 smluv
2022-07-03: 70 smluv
2022-07-02: 1688 smluv
DB
Elastic cluster Menší problémy Num. of nodes:15, 16 expected.
Elastic nodes disk space V pořádku Num. of nodes:15, 16 expected. Total available 4 477GB from 6 079GB.
SQL server V pořádku Response time 2 ms.
VMs
Proxmox 100.100 Menší problémy VM 'NewDC' is running
VM 'SQL' is running
VM 'Webserver' doesn't exists
VM 'Elastic7-5' is running
VM 'Zabbix' doesn't exists
Other running VMs: Webserver2022,SQL2019
Proxmox 100.101 Menší problémy VM 'SecondaryDC' is running
VM 'OpenDataProcessor' is running
VM 'docker05' doesn't exists
VM 'elastic-2' is running
VM 'elastic-3' is running
VM 'Elastic7-1' is running
Other running VMs: Docker147,docker146
Proxmox 100.102 Menší problémy VM 'Elastic7-10' is running
VM 'Elastic7-4' is running
VM 'Classification' doesn't exists
VM 'elastic-kibana' is running
Other running VMs: docker145
Proxmox pve-hs-01-r540 (02.161) Menší problémy VM 'docker2' is running
VM 'docker3' doesn't exists
VM 'proxmox-backup' is running
VM 'minio' doesn't exists
Other running VMs: minio-es-backup,docker5
Proxmox pve-nic-168 (02.168) Menší problémy VM 'OCR-187' is running
VM 'OCR-186' is stopped
VM 'OCR-188' is running
VM 'docker01' doesn't exists
Other running VMs: docker200,Docker203,hs-lecs
Proxmox pve-hs-02-r720xd (02.167) V pořádku VM 'elastic-19' is running
VM 'elastic-13' is running
VM 'elastic-15' is running
VM 'elastic-16' is running
VM 'elastic-17' is running
VM 'elastic-18' is running
VM 'Monitoring-Kibana' is running
Other running VMs: miniocache
Cache
Couchbase V pořádku Nodes
Node0: healthy
Node1: healthy
Stats
913195 záznamů
2 763 MB RAM
26,00 op/s

OCR cloud
OCR queues V pořádku Velikost fronty:
Dataset:čeká 0
Insolvence:čeká 0
Smlouva:čeká 0
VerejnaZakazka:čeká 0
OCR servers V pořádku OCR in 24 hours
140124 souborů, z toho 47229 OCR obrázků.
4 běžících OCRServerů
10 běžících OCR Minions (3796 OCR za 24 hod)
Web server
Cache disk V pořádku Free space: 3 207 728MB, 33,63 % of total
Open TCP ports V pořádku Internal Established:228

Internal Time_Wait:220

External Established:14

External Time_Wait:48

SMTP V pořádku Response time 4 ms.
System disk V pořádku Free space: 18 397MB, 13,91 % of total
Web server využitá pamět V pořádku Allocated megabytes in memory: 1503 mb