+ 1j^RIt^RIt^RIt^RIt^RIt^RIt^RIt^RIt^RIt^RI t ^RI H t ^RI H t ^RI H t ^RIHt^RIHt^RIHt^RIHt^R IHtHt^R IHt^R IHt^R IHt^R IH t Rt!!RR]4t"R#)N)datetime)ThreadPoolExecutor)getpass)Path)quote) SoSCleaner)SosNode) ClusterOption str_to_bool) SoSComponent)bold) __version__) SoSUploadz/etc/sos/groups.dc.aa]tRt^(toRtRt/RRbRRbRRbRRbRRbR R bR RbR .bR RbRR bR.bR.bR.bRRbRRbRRbRRb/RRbRRbR.bR^bR^bR.bRRbR RbR!RbR"RbR#^bR$RbR%R&bR'RbR(RbR)RbR*.bC/R+RbR,RbR-RbR.RbR/RbR0.bR1RbR2RbR3.bR4RbR5RbR6RbR7RbR8RbR9RbR:RbR;RbC/R<.bR=.bR>.bR?RbR@^bRARBbRCRDbRERFbRGR bRHRIbRJRbRK.bRLRbRMRbRNRbRORbRPRbCRQR RRRRSR RTRRURRVRRWRRXRRYRRZR/ CtV3R[ltR\t] R]4t ] R^4t ] R_4t R`t ] Ra4t] Rb4tRRcltRdtRetRftRgtRhtRitRjtRktRltRmtRntRotRptRqtRrtRst Rtt!Rut"Rvt#Rwt$Rxt%Ryt&Rzt'R{t(R|t)R}t*R~t+Rt,Rt-Rt.Rt/Rt0Vt1V;t2#) SoSCollectorat sos collect, or SoS Collector, is the formerly standalone sos-collector project, brought into sos natively in 4.0 and later. It is meant to collect sos reports from an arbitrary number of remote nodes, as well as the localhost, at the same time. These nodes may be either user defined, defined by some clustering software, or both. For cluster defined lists of nodes, cluster profiles exist that not only define how these node lists are generated but may also influence the sos report command run on nodes depending upon their role within the cluster. Nodes are connected to via a 'transport' which defaults to the use of OpenSSH's Control Persist feature. Other transport types are available, and may be specifically linked to use with a certain cluster profile (or, at minimum, a node within a certain cluster type even if that profile is not used). sos collect may be run from either a node within the cluster that is capable of enumerating/discovering the other cluster nodes, or may be run from a user's workstation and instructed to first connect to such a node via the --primary option. If run in the latter manner, users will likely want to use the --no-local option, as by default sos collect will also collect an sos report locally. Users should expect this command to result in a tarball containing one or more sos report archives on the system that sos collect was executed on. z8Collect an sos report from multiple nodes simultaneouslyall_logsF alloptionsallow_system_changes become_rootcase_idchrootautocleancluster_options cluster_typeNcontainer_runtimedomainsdisable_parsersenable_plugins encrypt_key encrypt_passgroupimageinherit_config_fileforce_pull_imageTskip_cleaning_filesjobs journal_sizekeywords keyword_filekeep_binary_fileslabel list_optionslog_size low_prioritymap_file /etc/sos/cleaner/default_mappingprimary namespacesnode_config_filenodes no_env_varsno_local nopasswd_sudo no_pkg_check no_update only_pluginspasswordpassword_per_nodeplugoptsplugin_timeout cmd_timeoutpreset registry_userregistry_passwordregistry_authfile save_groupsince skip_commands skip_files skip_pluginsssh_keyssh_portssh_userroot sudo_binarysudotimeoutiX transporttreat_certificates obfuscateverify usernamesupload upload_urlupload_directory upload_user upload_pass upload_methodupload_no_ssl_verifyupload_protocolupload_s3_endpointupload_s3_regionupload_s3_bucketupload_s3_access_keyupload_s3_secret_keyupload_s3_object_prefix upload_targetc<\SV`WV4\P!^?4.Vn.VnRVn^VnRVnRVn VPPPR4VPPPVnVPPRR4VPP!R4\#VP$RR4\&P(!4Vn\-\&P.!\&P(!4R4Uu0uFqD^,^,kK up4VnVP74VP94VnVP$P<'gVP?4VPA4VPCR R PER \FPH44 24VPCR VP:PK4 24VPM4R#R#uupi \2dTP5R4R .TnELi;i \NdTPQR^4R#i;i)?Ncollectrnone node_listsudo_pwr!zkCould not get a list of IP addresses from this hostnamne. This may indicate a DNS issue in your environmentz 127.0.0.1z Executing  c3$"TFqxK R#5iN).0ss& 8/usr/lib/python3/dist-packages/sos/collector/__init__.py (SoSCollector.__init__..s4I1QzFound cluster profiles: Exiting on user cancel))super__init__osumask client_listrjr3 retrievedclusterrmanifest components add_sectionrh collect_md add_fieldadd_listsetattroptssocket gethostnamehostnamelist getaddrinfoip_addrs Exception log_error_parse_options load_clustersclustersr.parse_node_stringsparse_cluster_options log_debugjoinsysargvkeysverify_cluster_optionsKeyboardInterruptexit)selfparser parsed_args cmdline_argsi __class__s&&&& rrrxSoSCollector.__init__s l;       ,,Y7--22:: !!.&9   -  9b)**,  * !'!3!3F4F4F4H$!O"!OA!Q!O"DM **, yy%%% 9'')**,CHH4I4I,I+JKL.t}}/A/A/C.DEG++-&" * NND )MDM **% 9 2C8 9s71H96H4 H9BI$4H99$I! I!$JJc ^RIpVPPp/pVPVR4pVF%pV^,!VP4W5^,&K' V#)z]Loads all cluster types supported by the local installation for future comparison and/or use Nr)sos.collector.clusters collectorr _load_modulescommons)rsospackagesupported_clustersrr}s& rrrSoSCollector.load_clusterssX &--((%%gz:G-4QZ -E qz * !!c .pVPFJp\PPV4'gK*VP VP WB44KL V#)z'Helper to import cluster and host types)__path__rypathisdirextend_find_modules_in_path)clsrsubmodmodulesrs&&& rrrSoSCollector._load_modulessJ$$Dww}}T""s88FG%rc v.p\PPV4'd\\P!V44FnpVP R4'gKRV9dK%\PP V4wrVRV RV 2pVPVPV44Kp V#)a(Given a path and a module name, find everything that can be imported and then import it path - the filesystem path of the package modulename - the name of the module in the package E.G. a path of 'clusters', and a modulename of 'ovirt' equates to importing sos.collector.clusters.ovirt z.py__zsos.collector..) ryrexistssortedlistdirendswithsplitextr_import_modules)rr modulenamerpyfilefname_modnames&&& rrr"SoSCollector._find_modules_in_paths 77>>$   D!12u--6>77++F3*:,aw?s227;<3rc VPR4^,p\V\4\4V.4p\P!T\P4pTP4F$pT^,R9gKTPT4K& T# \d-p\ RT RTP P 24ThRp?ii;i)z/Import and return all found classes in a modulerz"Error while trying to load module z: N)SosHostCluster) split __import__globalslocals ImportErrorprintr__name__inspect getmembersisclasscopyremove)rrmod_short_namemoduleermods&& rrrSoSCollector._import_moduless!s+A. FH~>NOF $$VW__=<<>C1v//s#"  6wi@kk**+- .G sB C#'C  Cc >VPP'gR#.p\VPP\4'g'VPP.VPnVPPFp\ V4UUu.uFwr4VR8XgKVNK pppVP \ V44^p^pVFfpTpW&Vp \P!\P!V 44RV 9d RV 9dKDVP V PR44TpKh V\ V48wgKVP W'^,R4K WPnR#uuppi \PdKi;i)aJParses the given --nodes option(s) to properly format the regex list that we use. We cannot blindly split on ',' chars since it is a valid regex character, so we need to scan along the given strings and check at each comma if we should use the preceeding string by itself or not, based on if there is a valid regex at that index. N,[]) rr6 isinstancer enumerateappendlenrecompileescapelstriperror) rr6nodermidxsstartposidxregs & rrrSoSCollector.parse_node_stringss6yy $))//400#yy/DIIOIIOOD"+D/>/$!Q#XAA/D> KKD "EC CS/CJJryy~.czcn LLC1Ec$i Ta%&\*%$& %?xxs$ E=(E=>F"FFFc  VPRR4pVPRRRRR7VPRRRR7VPR RR R R 7VPR R.RORR7VPRRRR7VPRRRRR7VPR\^RR7VPRRRRRR R!7VPR"^\R#R$7VPR%RR R&R 7VPR'R(RR)R7VPR*R+R.R,R 7VPR-R.R/R7VPR0RR R1R 7VPR2\R.R3R7VPR4\R.R5R7VPR6R.R7R7VPR8.RR9R:R;7VPR<.RR=R>R;7VPR?RR@R7VPRARB4pVPRCRDRRERFR!7VPRGRHRI7VPRJR RRKRL7VPRM\R.RNR7VPRORPRI7VPRQRRRSRTRURV7VPRWR.RXR7VPRYRRZR7VPR[R\RI7VPR]R^R_R\R`Ra7VPRbR.RcR7VPRdR.ReR7VPRfR.RgR7VPRhRiRjRI7VPRkRl^\RmR$7VPRnRoRRpR7VPRqRrRI7VPRsRtRuRvRRwRx7VPRyRRzR7VPR{RTR|R7VPR}RR~R7VPRRRR7VPRR\RR7VPRRR RR 7VPRRR RR 7VPRRR RR7VPRRRI7VPRR\RR$7VPR\R RR7VPRR\RR$7VPRRR RR 7VPRR.RR7VPRR.RR7VPRR.RR7VPRR.RR7VPRR.RORR7VPRR RRRL7VPRR.RR7VPRR.RR7VPRR.RR7VPRR.RR7VPRR.RR7VPRR.RR7VPRR.RORR7VPRR4pVPRRRRR RRR7VPRR RRRR;7VPRR.RRR7VPRR.RRR7VPRRR.RRR7VPRR.RRR7VPRR.RRR7VPRRR RRR7VPRRRRRx7VPRR.RRR7VPRR.RORRR7R.#)zReport Passthru Optionsz0These options control how report is run on nodesz-az --alloptions store_truezEnable all sos report options)actionhelpz --all-logszCollect logs regardless of sizez--allow-system-changesFz  T>,"A  C\,"C  E5l%*$8  : Z%@"G  I 2F#L  M T#5h"J  L-C"E  GT#4l$,:"J  L \13#:  ; -l%*1N  PT#3H"6  8T#3H%'":  < ^T#C  D _\%*"J  L /c4"G  I_3"H  JY$>  @ .8"1"A  C ^R".">  @ Z "N  P //  <    z,&3&G ! I   3H I  !8%(4'M ! N   !5C)-'@ ! A   !1&I ! K  '9&7(> ! @   D&H ! J  &M ! O  (? ! A   !5x)-}&1'F ! G   !2D'K ! L   !6'K ! L   !6'M ! N   {9M N  x&M ! O  '7 &K ! M  &F ! H  k>&/'4 ! 5   !2<&F ! H  8(L ! N   !1,(? ! A   l&N ! P  |#&F ! H  l).&J ! L   !6|).&I ! K   R%&C ! E  &I ! K  &s&K ! M  3&L ! N  S&J ! L  L).'1 ! 2   &N ! P  !5t&L ! N  $&E ! G  $&E ! G  !2F)@&H ! J   !95(4&O ! #   !7&K ! M  !5t&@ ! B  !5t&J ! L  !94&D ! F  !94&D ! F  !8z<40z<30F)newlineN) set_titleadd_text__doc__itemsr )rsection hsectionshsecvalues&& rr display_helpSoSCollector.display_helps56%  A ')G "K +-M   G %??,KD   r(4:c*5+6  -rc VP'dVPP4V'dVPV4VP4V^8wdVP4V'g\ P!V4R#\P!V4R# \dTP R4Lmi;i)a`Used to terminate and ensure all cleanup is done, setting the exit code as specified if required. :param msg: Log the provided message as an error :type msg: ``str`` :param error: The exit code to use when terminating :type error: ``int`` :param force: Use os.exit() to break out of nested threads if needed :type force: ``bool`` z/Warning: Failed to close all remote connectionsN) r}cleanuprclose_all_connectionsrlog_warnrrry_exit)rmsgrforces&&&&rrrSoSCollector.exit)s <<< LL "  NN3  M  & & ( C< LLN HHUO HHUO M MMK L MsB&&CCc  RVPRVPPR8gRVPR\\ VPP 4\ VP 44RVP/VnR#)zhFrom commandline options, defaults, etc... build a set of commons to hand to other collector mechanisms cmdlineopts need_sudorNtmpdirhostlenpolicyN) rrMr maxrr3rr"rrs&rrrSoSCollector._parse_optionsGs` 499 ++v5 dkk s3tyy0013t}}3EF dkk   rc .p\VPP\4'g'VPP.VPnVPP'dVPPFpVP R4^,pVP R4^,P R4^,pVP R4^,P 4^,pVP \WEVPV44K WPnR# \ dRpLKi;i)r=TrueN) rrrrr IndexErrorrr r)rroptionr}namers& rrr"SoSCollector.parse_cluster_optionsSs$))33T::)-)B)B(CDII % 99 $ $ $))33 ,,s+A.||C(+11#6q9##LL-a0668;E  !$uH4%) !"#"E#s-D88 EEc VPP'dVPPFpRpVPP4Fawr4VPFLpVP VP 8XgK VP V8XgK3RpVPWQ4VnK_ Kc K X'g/VPRXP RVP 2^4R#R#R#)z+Verify that requested cluster options existFTz!Unknown cluster option provided: rN) rrrroptionsr+r}_validate_optionrr)roptmatchclustrr*s& rrr#SoSCollector.verify_cluster_optionshs 99 $ $ $yy00$(MM$7$7$9LE"'--88v{{2s{{e7K$(E(,(=(=f(JCI! #0%:1 = [[M388*678: %rc VP\8XgcVPVP8Xg<RpVPW2PVPVP3,^4VP#VPP 4pVR9d%RpVPW2P,^4VR9#)aChecks to make sure that the option given on the CLI is valid. Valid in this sense means that the type of value given matches what a cluster profile expects (str for str, bool for bool, etc). For bool options, this will also convert the string equivalent to an actual boolean value z.Invalid option type for %s. Expected %s got %szUInvalid value for %s. Accepted values are: 'true', 'false', 'on', 'off', 'yes', 'no'.)trueonyesfalseoffno)r5r6r7)opt_typeboolrr+rlower)rrclirvals&&& rrr/SoSCollector._validate_optionws4'##s||3F #7+;+;S\\ JJAN99 iioo A A8C IIcHHna (+++rc <VPPV4R#)z.Log info messages to both console and log fileN)sosloginforrs&&rrlog_infoSoSCollector.log_infos rc <VPPV4R#)z.Log warn messages to both console and log fileN)rBwarningrDs&&rrrSoSCollector.log_warns C rc <VPPV4R#)z/Log error messages to both console and log fileN)rBrrDs&&rrrSoSCollector.log_errors #rc \P!4^,^,pRV RV 2pVPPV4R#)z.Log debug message to both console and log filez[sos_collector:z] N)rstackrBdebug)rrcallers&& rrrSoSCollector.log_debugs;#A&xr#/ #rc  a\PPR4\PPR4\VP4FFp\PPRVR RVPV,P R R24KH /oVPP 4Fwr#VPFpVPS9dVSVP&K%VPFSpVSVP,P9gK'SVP,PPV4KU K K \PPR4\PPRRR RR R RR R RRR RRR R2 4\SV3RlR7FpSV,pRRPR\VP444R RVPR RVPPR R\VP4R RVP R R2 p\PPV4K \PPR4R#)z&Display options for available clustersz; The following clusters are supported by this installation z@Use the short name with --cluster-type or cluster options (-c) rlz<1530 z/ The following cluster options are available: r25z Option Name15Typez<10Default10 Description+SoSCollector.list_options..sa0@0@rkeyz z, c3$"TFqxK R#5irnro)rpcs& rrrs,SoSCollector.list_options..s>*=Qq*=ruzh Options take the form of cluster.name=value E.G. "ovirt.no-database=True" or "pacemaker.offline=False" N)rstdoutwriterr cluster_namerr.r+r}rrr;rrr description) rr}rrr0r2_optoptlnr]s & @rrr.SoSCollector.list_optionss * + , -dmm,G JJ  GC=$--"8"E"Eb!IL -  ++-HA}}885(&)E#((O!$ chh(?(??!#((O33::5A"- %. MN  "~Q}R0&QynAQr # 5&@AD+CTYY>&*=>>rB!88B-q!6!6s ;1syy>#&a'.s"I1v}}V%5%566s13) rr-rrstrftimenowrvascii_lowercaserw NameErrorrrrange)rnstrdterrrands& rr_get_archive_nameSoSCollector._get_archive_names 99??? a () )D 99    a ))*+ +D   x||~z : H%55F wwIaIIqAdV$$  H NN@F G G Hs&C** D5DDc VP4VnRpVPR,VP,R,V,#)zfReturns the path, including filename, of the tarball we build that contains the collected sos reports gz/z.tar.)rarc_namer )rcomprs& rr_get_archive_pathSoSCollector._get_archive_paths;..0 {{S 4==07:UBBrc  VPPpV\PP \ P !4RV 24\PP \V4.pRpVF,p\PPV4'gK*TpM Vf\RV 24hVPRV 24\VRRR7;_uu_4p\P!V4pRFNpWg,'gKVPRV R Wg, R 24\VPWvV,4KP VR ,'dIVPR VR , R 24VPPP!VR ,4RRR4R# +'giR#;i)ah Attempts to load the host group specified on the command line. Host groups are defined via JSON files, typically saved under /etc/sos/groups.d/, although users can specify a full filepath on the commandline to point to one existing anywhere on the system Host groups define a list of nodes and/or regexes and optionally the primary and cluster-type options. z.config/sos/groups.d/Nzno group definition for zLoading host group rutf-8encodingzSetting option 'z' to 'z'per host groupr6zAdding to node list)r3r)rr#ryrrrhomeCOLLECTOR_CONFIG_DIRrOSErrorropenjsonloadrr6r)rgrppathsrrhf_groupras& rr_load_group_configSoSCollector._load_group_configs]iioo  GGLL(=cU&C D GGLL-s 3  Dww~~d## =4SE:; ; ,UG45 %w / /2YYr]F2;;NN%5cU& N4$45DIIs3K8 3 g(9GH &&vg70 / / /s"'F.A F.AF.. F? c  RVPPRVPPRVPP^,R\ VP 4/p\P!4^8wdM\PP\P!4R4p\P!VRR7M\p\PPW!R,4p\VRR R 7;_uu_4p\ P"!W4R R R 4\P$!VR 4V# +'giL);i) z Saves the results of this run of sos collect to a host group file on the system so it can be used later on. The host group will save the options primary, cluster_type, and nodes as determined by sos collect prior to execution of sos reports. r+r3rr6z.config/sos/groups.dT)exist_okwrrNi)rrFr3r}rrrjrygetuidrrrrmakedirsrrrdumpchmod)rcfg group_pathrrs& rrwrite_host_groupSoSCollector.write_host_group s DII(( tyy(( DLL55a8 T$..)   99;! diik3IJJ KK T 2-J ZV5 %w / /2 IIc 0  0 /s E E c@VPPVP4VPP'gZVPP 'g>VP R4RpVPPVPV44VPP'g9VPP 'dVPP'dcVPP'gGVP R4RVPP R2p\VR7VPnVPR,'dVPP'gVPP'gVPP'gdVPP 'gHVP R4RVPP R 2p\VR7VPnMAVPP'g&VPPVPnVPP$'dVPPR 8XgVPP'dR pVP#V^4VP R 4RVPP R2p\VR7VPnRVPR&M"VP)R4RVPnVPP*'dVP-4VPP14VPP'd$VP34RVPnEMRpRpRpVPP4'g\6P8!4^8wdVPP'gVPP'gFRp\V4pVR8Xd1VPPV4RpRVPnRpM.VPPV4RpRVPn\;RVPVVR7Vn VP<P?RVPP@4VP<PCR4VP<PDPCVPP@4VPPG\IVP<PDVPP@44VPPJ'dVPPJR8XdVPLR ,Vn'MGVPLVPPJ,Vn'VPPJVn%VPVPNn MVPQ4VPNf2VPPD'gR!pVP#V^4MZVPNfMVPPD'd1VP)R"4VPLR ,Vn'RVn%VP<P?R#VPJ4VPN'EdVPNVPn'VPPRR$8Xd*VPNPU4VPn)VPNPW4VPNPX'dkVPPZ'gOVP R%VPNPX R&24VPNPXVPn-VP]4VPP^'dAVPP^pVPa4pVP)R'V R(V 24R#R# \ dTP#R ^4EL_i;i \.d:pRTPP* RT 2pTP#T^4Rp?ELRp?ii;i \ dTP#R^4ELi;i \.d2pTP RT 24TP#R^4Rp?ELRp?ii;i \.d#pTPcR)T RT 24Rp?R#Rp?ii;i)*z)password not specified, assuming SSH keyszgsos collect ASSUMES that SSH keys are installed on all nodes unless the --password option is provided. z&password specified, not using SSH keysz"Provide the SSH password for user : )promptrz3non-root user specified, will request sudo passwordz=A non-root user has been provided. Provide sudo password for z on remote nodes: z Exiting on user cancel rNzkCannot become root without obtaining root password. Do not use --batch if you need to become root remotely.z,non-root user asking to become root remotelyzUser z5 will attempt to become root. Provide root password: FzSOption to become root but ssh user is root. Ignoring request to change user on nodezCould not load specified group NExiting on user cancel TzLocal sos report generation forcibly skipped due to lack of root privileges. Either use --nopasswd-sudo, run as root, or do not use --batch so that you will be prompted for a password z8Enter local sudo password to generate local sos report: r! localhost) local_sudo load_factsz(Unable to determine local installation: zsUnable to determine local installation. Use the --no-local option if localhost should not be included. Aborting... r3r6rijbonzFCluster type could not be determined and no nodes provided Aborting...zCluster type could not be determined, but --nodes is provided. Attempting to continue using JBON cluster type and the node listrrzUpdating SSH key to z per clusterz Wrote group 'z' to zCould not save group )2r" set_commonsrrr=r>rui_logrC_fmt_msgr3batchrMrr9rkrrr root_passwordrEr#rrpre_workconnect_to_primaryr8ryrr rraddressrr6set_node_manifestgetattrrrr}determine_clusterrRset_transport_typesetupcluster_ssh_keyrK get_nodesrFrr)rrr can_run_localrskip_local_msggnamers& rrprepSoSCollector.prep#s   - """ +++ NNF GGC KK  T]]3/ 0 9### (C(C(C(, (9(9(9 IIOOOGH;)),,-R1%,C%8 "k**4993J3J3J IIOOOyy)))$))2M2M2MNN$34++/99+=+=*>?%%C)0s(;DII%99222,0II,>,> ) 99 99%%/99???6CIIc1%MNtyy112377*1*= ',1 [) IJ(- % 99??? "'')  7 KK " 99     # # %!%DII  9 $ ! 0  *** q0@04 0G0G0G99??? .%,S\ %+ KK,,^<,1M15DII.)-J ((8(- -1 *&{DLL2<2? A  !!)T\\-A-AB ##G, ))$,,*>*>? &&wt/D/D/3||/C/C(E F 99 ! ! !yy%%/#}}V4 #}}TYY-C-CD $(II$:$:!#'<%b"c0d !d1,5d1"d1>Bd17'e0"cc d .dd  d.-d.1 e-<&e((e-0 f;ffc VPPR4VP'g/VPP'gVP R^4VPPR4VPP'dVPP eVPP'dVPP'gdVPP'gHVPPRVPP RVPR, 2 24\VP4F6pVPPRVRVPR, 2 24K8 VPPR4VPP'g*\R4VPPR4R#R# \ dTP R ^4R#\"d'pTP \%T4^4Rp?R#Rp?ii;i) zePrints a list of nodes to collect from, if available. If no nodes are discovered or provided, abort. r!zGNo nodes were detected, or nodes do not have sos installed. Aborting...z1The following is a list of nodes to collect from:N rZr!zC Press ENTER to continue with these nodes, or press CTRL-C to quit rv)rrCrjr3 connectedrrlocalrr8r}strict_node_listrrrinputrrrepr)rrrs& rr display_nodesSoSCollector.display_nodess ~~~dll&<&<&< II012 4 LM << ! ! !dll&;&;&G\\'''DII,>,>,>||444   ..qi1H0I.IJK4>>*D KK  r$qi)@(A&A!BC D+ yy &)*   $  % 9 2C8 & $q'1%% &s$ &G77II I!IIc \Rp/pVPP'd#\VPP4VR&VPP'dRVR&VPP'dRVR&VPP 'dRVR&VPP 'd,\\VPP 44VR&VPP'd#\VPP4VR&VPP'd#\VPP4VR &VPPR 8wd#\VPP4VR &VP4Fwr4VR V R V R 2, pK VP4pVPRV 24RVPR&W PR&VPP!RV4R#)z:Configures the sos report command that is run on the nodeszsosreport --batch zcase-idr!rzall-logsrUzlog-sizesysrootrrzcompression-typez--rlzInitial sos cmd set to sos_cmd sos_optionsinitial_sos_cmdN)rrrrrrUr/rrrcompression_typerrstriprrrr)rrrkvs& rrconfigure_sos_cmdSoSCollector.configure_sos_cmds& 99   %*499+<+<%=K " 99   (*K % 99   &(K # 99   $&K ! 99   &+C 0B0B,C&DK # 99   %*499+<+<%=K " 99   $)$))*:*:$;K ! 99 % % /.3DII4N4N.OK* +%%'DA A3as!} $G(.." 0 :;"6 Y&1 ]# !!"3W=rc J\VPPVP4VnVPP RVPP R24R# \ d2pTPRT 24TPR^4Rp?R#Rp?ii;i)zWIf run with --primary, we will run cluster checks again that instead of the localhost. z Connected to z, determining cluster type...z#Failed to connect to primary node: z.Could not connect to primary node. Aborting...N) r rr3rrrCrrr)rrs& rrrSoSCollector.connect_to_primarys K"499#4#4dllCDL KK  }TYY->->,?@// 0 K NN@D E IIF J J KsA"A&& B"1&BB"c  R\VPP44pVPP4EFdpVPV4VPVnVP 4'gK>VP PpVPRV R24VFp\VP VP 4'gK+VP PpVPRV R24VPVnVP 4'gKVPRV RV R24TpM W n VP4Vn VPVPR&VPPR VP 24R # R #) aThis sets the cluster type and loads that cluster's cluster. If no cluster type is matched and no list of nodes is provided by the user, then we abort. If a list of nodes is given, this is not run, however the cluster can still be run if the user sets a --cluster-type manually zInstallation matches z, checking for layered profileszLayered profile z found. Checking installationz*Installation matches both layered profile z and base profile z), setting cluster type to layered profiler}zCluster type set to N)rrvaluesrr3 check_enabledrrr issubclassr}r+rrrrC)rchecksr}cname remainingrnames& rrrSoSCollector.determine_clusterstdmm**,-}}++-G MM' ""llGO$$&&))22!6ug>2 23!'I!)"5"5w7H7HII ) 3 3 < <)9%A?(?@,0LL )$2244 NN,66;W'0G!"( ' $+LLN!*.,, Y'   *4+<+<*=>@3.rc VP'd1VPP4pVPRV 24V#.#)z>Collects the list of nodes from the determined cluster clusterz Node list: )rr} _get_nodesr)rr6s& rrget_nodes_from_cluster#SoSCollector.get_nodes_from_cluster(s=    LL++-E NN[0 1L rc fVPVP9dBVPP'd&VPP VP4VP P 'gAVPF0pWP9gKVPP V4K2 VPe}VP P 'gaVPFPpW PPVPP39gK5VPP V4KR \\RVP444VnVPRVP 24VPPRVP4R#)zKReduce duplicate entries of the localhost and/or primary node if applicableNc38"TFq'gK VxK R#5irnro)rpns& rrrs0SoSCollector.reduce_node_list..?s!A^q!!^s  zNode list reduced to rj)rrjrr8rr}rrr3rsetrrr)rrrs& rrreduce_node_listSoSCollector.reduce_node_list0s MMT^^ + 0B0B0B NN ! !$-- 0||,,,]]&NN))!,# << #DLL,I,I,I^^.. 0A0ABBNN))!,$c!AT^^!AAB .t~~.>?@   dnn=rc (VPPF9p\P!V4p\P !W!4'dR#K; R# \P d'pRpTPYAY#3,4Rp?KuRp?ii;i)zCompares a discovered node name to a provided list of nodes from the user. If there is not a match, the node is removed from the listTz0Error comparing %s to provided node regex %s: %sNF)rr6fnmatch translaterr1rr)rrregexrrs&& rrcompare_node_to_regex"SoSCollector.compare_node_to_regexCsyYY__E 9))%088E(()%88 9HsE%7788 9s2AB+B  Bc aVP'g'VP'gRpVPV^4VP4pVPP 'd?VF7oVP S4'gKVPPS4K9 MW nVPP 'dVPP Fo\;QJdV3RlR 4F 'gK RM RM!V3RlR 44'dKESVP9gKXVPR S R 24VPPS4K VP'gVPPR 4^,pVPF=oVSPR 4^,8XgK"VPPS4K? VPP'g&VPPVP4VP!4\#\%VP\"R 74p\%WPP&R,4VP&R&R# \dpTPRT 24TPR4TPP TnTPF`o\;QJdT3RlR4F 'gK RM RM!T3RlR44'gKETPPS4Kb Rp?ELRp?ii;i \(\*3d pTPRT 24Rp?R#Rp?ii;i)z3Sets the list of nodes to collect sos reports from zaCould not determine a cluster type and no list of nodes or primary node was provided. Aborting...zError parsing node list: z#Setting node list to --nodes optionc3,<"TF qS9xK R#5irnrorprrs& rrrs)SoSCollector.get_nodes..esJ*IQDy*ITFNc3,<"TF qS9xK R#5irnrors& rrrsrks6+QDy+rz*\?()/[]z Force adding rrr`r!zCould not set UI spacing: )*\?()r)r3r}rrrr6rrjrrranyrrrrrrr#r TypeError ValueError)rrr6rhost _node_maxrrs& @rrrSoSCollector.get_nodesPsm|||DLLLFC IIc1  0//1Eyy!D11$77--d3""' 99??? 36+63336+666t~~-NN]4& #FGNN))$/ (|||==&&s+A.D4::c?1--NN))$/'<<000%%dmm4  ?CC89I&))\\)5L&MDLL #9 0 NN6qc: ; NN@ A!YY__DN3J*IJ333J*IJJJNN))$/'  0::& ? NN7u= > > ?sO+J 'J J %J =A M MA.M M (M  MN&NNc \V^,VPV^,R7pVPVP4VP'dVP P V4VPPPV^,4VP\VPPV^,44R#VP4R# \dR#i;i)zTry to connect to the node, and if we can add to the client list to run sos report on Positional arguments node - a tuple specifying (address, password). If no password, set to None )r=N)r r set_clusterr}rr{rrr6rrr disconnectr)rrclients&& rr_connect_to_nodeSoSCollector._connect_to_nodes T!WdllT!WEF   t|| ,  ''/%%11$q':((1F1F15a*:;!!#   sCC&C&& C54C5c RpVPPR\ R24VPWP,4pVPPV4RpVP P 'g*\V4VPPR4R#R# \dTPR^4R#\dpTPT^4Rp?R#Rp?ii;i)z]Print the intro message and prompts for a case ID if one is not provided on the command line ahThis utility is used to collect sos reports from multiple nodes simultaneously. Remote connections are made and/or maintained to those nodes via well-known transport protocols such as SSH. An archive of sos report tarballs collected from the nodes will be generated in %s and may be provided to an appropriate support representative. The generated archive may contain data considered sensitive and its content should be reviewed by the originating organization before being passed to any third party. No configuration changes will be made to the system running this utility or remote systems that it connects to. z sos collect (version z) z, Press ENTER to continue, or CTRL-C to quit r!rvN) rrCrrr rrrrrr)r disclaimer intro_msgrrs& rrintroSoSCollector.intros  2;-sCDMM*{{":;  #Ayy f    $% 9 2C8  !Q s$&B++C2 C2C2C--C2cVPP'd!VP4VP4VP4VPP'd/VPP 'dVPR^4VP 4VP4VP4VP4Vn VPVPR7VPP4VnVPPRR4VP!4VP4R#)z sos-collector was called with incompatible options --batch and --password. If you need to use --password, please omit batch mode. )r+sos_logsiN)rr.rrrr=rrrr archive_name setup_archivearchiveget_archive_path archive_pathrrhr$s&rrexecuteSoSCollector.executes 99 ! ! !     IIK 99???tyy111 II-       224  1 12 LL99; j%0  rc  \VPPVPP.4pVPP'dlVP \VP 44'gVPP'g&VPPVP4VPPR4VP Uu.uFq"V9gK VR3NK ppVPP'dW.pVFLpRVPP RV^, R2p\!V4pVPV^,V34KN Tp\#VPP$4pVP'VP(V^R7VP+RR7VPP,'d>VP^,PR 8XdVPP/^4\1VP4VnVP2^8XdVP5R ^4MEVP2^8Xd5VP^,PR 8XdVP5R ^4VPPR VP2 R VPP$ R24\#VPP$4p V P'VP6VP^R7V P+RR7\#VPP$4pVP'VP8VP^R7VP+RR7\?VPR4'dYVPPR4VPPA4p V 'dVPPCV 4RpVPEW`PFVP23,4VPI4VPF^8dVPK4Vn&MRpVP5V^4VPPN'gVPPP'dRVPRRVPTRVPVRVPRVPX/p \[VP\VP^VP`RV VPLR7p V Pc4VPPR4R#R#uupi \:dTP5R^RR7EL\<d%p RT 2pTP5T^RR7Rp ? ELRp ? ii;i \<d*p TPPeRT 24Rp ? R#Rp ? ii;i)zPFor each node, start a collection thread and then tar all collected sos reports z Connecting to nodes...NzPlease enter the password for @r) chunksizeT)waitrzNo nodes connected. Aborting...zCollection would only gather from localhost due to failure to either enumerate or connect to cluster nodes. Assuming single collection from localhost is not desired. Aborting...z* Beginning collection of sos reports from z nodes, collecting a maximum of z concurrently r)rzCould not connect to nodes: run_extra_cmdz/Collecting additional data from primary node...z+ Successfully captured %s of %s sos reportsz4No sos reports were collected, nothing to archive...r"r sys_tmpr.r~)rargscmdlinein_place hook_commonsrzUploaded archive successfullyzUpload attempt failed: )3rr3rrr intersectionrjr}rr{rrrCrr>rMrrr(mapr shutdownr8popr report_numr_finalize_sos_cmd_collectrrhasattr_run_extra_cmdcollect_extra_cmdrEr|rcreate_cluster_archiverrWr_r"r rr~rrrr rr)rfiltersrr6_nodesrrnode_pwdpoolnpoolrfilesr"uploaders& rrrhSoSCollector.collectst||++T\\-B-BCD << ! ! !%%c$..&9::\\222    # #DLL 1 34$(NNGNqw6F!TNG 99 & & &F7 8J8J7K1q'"&"3< tAw12  E& *%diinn5D HHT**EQH ? MMtM $ """$$Q'//;>  $$Q'!$"2"23DO!# ;Q?A%##A&..+=II&()  KK  J $01##'99>>"2/C D'tyy~~6E IId,,d.>.>!I L NNN %%diinn5D HHT]]D$4$4H B MMtM $ 4<< 1 1 KK  N OLL//1E ..u5< c^^T__==> ""$ >>A  779DMHC IIc1  99    ,,, Cdkkdkkt||tyy   %DKK*.))-1\\.22>-1]] <   "   !@A!-EHZ! C II0#TI B *06C IIc1DI ) ) *H C !!$;C5"ABB CsJ&U3U0HU4B"V2V/V/ V/ V**V/2 W&=W!!W&c VP4R# \d-pTPRTP RT 24Rp?R#Rp?ii;i)zyCalls finalize_sos_cmd() on each node so that we have the final command before we thread out the actual execution of sos z#Could not finalize sos command for rN)finalize_sos_cmdrrrrrrs&& rrr(SoSCollector._finalize_sos_cmd7sL 7  # # % 7 NN@$nn-Ru6 7 7 7s A !AA c ZVP'gVP4M,VPP'gVP4VP'dV;P^, unR#R# \ d pTP RT 24Rp?R#Rp?ii;i)zRuns sos report on each nodezError running sos report: N)r sosreportrr8r|rrr8s&& rrr)SoSCollector._collectAs~ ?<<<  "yy)))$$&!#  ? NN7u= > > ?s(B,B!B#B B* B%%B*c VPFEpVP'gKVPRVP 24VP 4KG R#)zClose all sessions for nodeszClosing connection to N)r{rrrr)rrs& rrr"SoSCollector.close_all_connectionsNsC&&F!77GHI!!#'rc  @ Rp.pVPF'pVPFpVPV4K K) RpVPP'dRVP RVP RVPRVPRVP/pVPPR4\R VR 7pVPVP 4VP4wrR pVP!R 4VFpVP#R 4R",p V'dXP%V 4p \&P(P+VP V4p VP,P/WR7V'gKXP1V4p V 'gK\&P(P+RVP#R 4R",4p V R, p VP,P3W4K VP,P/VP4\&P(P+RR4R7VP,P/VP6\&P(P+RR4R7VPe0VP,P9VPP:4VP=4V'd\&P(P+VP VP,P>4p XPA\&P(P+V RR44VPA\&P(P+V RR44VPA\&P(P+V RR44VP,PCRR7p \&P(P+VP\&P(PEV 44pV'd"XP%VPGRR44p\&PH!W4V'd{XP%\&P(P+VPVPJ R244p\&PH!W4VPPRV 24VPLPRV 24VPPR4VPPRV R24V# \d*pTPPR T 24Rp?ELkRp?ii;i \d0pRT R TPN 2pTPQT^4Rp?R!#Rp?ii;i)#z[Calls for creation of tar archive then cleans up the temporary files created by sos collectNFr"r rr.r~r!T)r!r"z$ERROR: unable to obfuscate reports: z"Creating archive of sos reports...r)r checksumsz.sha256rzsos.logzui.log sos_reportsz manifest.json)methodz.tarz-obfuscated.tar _private_mapz2A mapping of obfuscated elements is available at zArchive created as zP The following archive has been created. Please provide it to your support team.rrSzCould not finalize archive: z. Data may still be available uncompressed at z Archive error))r{ file_listrrrr"r rr~rrCrset_target_pathrrrrErobfuscate_stringryrrradd_fileget_new_checksum add_string sos_log_filesos_ui_log_fileadd_final_manifest_datar_obfuscate_upload_passwords_nameobfuscate_filefinalizebasenamereplacerenamerrBrr)rr1 arc_pathsrrdo_cleanr"cleanerrrr+checksum_dirr final_namemap_namers& rrr-#SoSCollector.create_cluster_archiveUsp $$D  '(% 99???$++$++4<<499DMM L P   $$d2>@'' 4&-oo&7#B # MM> ?"{{3'+"33D9Dww||DKK7 %%d%68&77>Hx!ww||KS9I"9MN ) //?# LL ! !$"3"3')ww||J 'J " L LL ! !$"6"6')ww||J'I " K}}( 44II..  , , .ww||DKK1C1CD&& T:yA&&GGLLz8<&&GGLL}oF||,,D,9HdllBGG4D4DX4NOJ$55&&v/@A  IIh +#33GGLL$($5$5#6l!CE (-   "44<:"?@ KK  2:,? @ KK  G H KK  r*R0 1  P !!$H"NOO P@ #1#70040A0A/BDC IIc1 "  #sMAT,1BU#U##D 2?O@ dAOB DCOD EOF uGOH EIOJ KOL MON UOOP QOR ESOT UUOV BWOX $YOZ t[O\ "]O^ _O` TaOb TcOd beOf gOh iOj bkOl mOn 2oOp BqOr FsOt vuOv 3wOx VyOz k{O| %}O~ RO@ %AOB dCOD DEOF tGOH tIOJ 6dDD!4]OLb09d ",   Bi1i1V&<  )* :,*! &8P#%"C$8L4SGj&@>> K#J>& .?`, B6cCJ7 ?$^#^#rr)#rrrryrtrrvrrmrrconcurrent.futuresrrpathlibrshlexr sos.cleanerrsos.collector.sosnoder sos.optionsr r sos.componentr sos.utilitiesr rr sos.uploadrrrrorrrrps] 1")2& *K#<K#r