-- Logs begin at Sat 2022-01-15 20:01:13 UTC, end at Sat 2022-01-15 22:13:02 UTC. --
Jan 15 20:39:33.864280 ncdv-master-1 systemd[1]: Started Devstack devstack@c-bak.service.
Jan 15 20:39:37.200968 ncdv-master-1 cinder-backup[122193]: INFO cinder.cmd.backup [-] Backup running with 1 processes.
Jan 15 20:39:37.202573 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=122193) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}}
Jan 15 20:39:37.203108 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=122193) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}}
Jan 15 20:39:37.380889 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_db.sqlalchemy.engines [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122193) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}}
Jan 15 20:39:37.666587 ncdv-master-1 cinder-backup[122193]: INFO cinder.rpc [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] Automatically selected cinder-backup objects version 1.39 as minimum service version.
Jan 15 20:39:37.671799 ncdv-master-1 cinder-backup[122193]: INFO cinder.rpc [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] Automatically selected cinder-backup RPC version 2.2 as minimum service version.
Jan 15 20:39:37.676136 ncdv-master-1 cinder-backup[122193]: INFO cinder.rpc [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version.
Jan 15 20:39:37.680865 ncdv-master-1 cinder-backup[122193]: INFO cinder.rpc [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] Automatically selected cinder-volume RPC version 3.16 as minimum service version.
Jan 15 20:39:37.686813 ncdv-master-1 cinder-backup[122193]: INFO cinder.rpc [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Jan 15 20:39:37.693421 ncdv-master-1 cinder-backup[122193]: INFO cinder.rpc [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Jan 15 20:39:37.755985 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_db.sqlalchemy.engines [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122193) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}}
Jan 15 20:39:37.772747 ncdv-master-1 cinder-backup[122193]: INFO oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] Starting 1 workers
Jan 15 20:39:37.778031 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] Started child 122641 {{(pid=122193) _start_child /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:575}}
Jan 15 20:39:37.779207 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] Full set of CONF: {{(pid=122193) wait /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:649}}
Jan 15 20:39:37.779579 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] ******************************************************************************** {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}}
Jan 15 20:39:37.780292 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] Configuration options gathered from: {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}}
Jan 15 20:39:37.780696 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}}
Jan 15 20:39:37.781779 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}}
Jan 15 20:39:37.782067 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] ================================================================================ {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}}
Jan 15 20:39:37.782876 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] allow_availability_zone_fallback = False {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jan 15 20:39:37.783289 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] allow_compression_on_image_upload = False {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jan 15 20:39:37.783833 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] allowed_direct_url_schemes     = [] {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jan 15 20:39:37.784261 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] api_rate_limit                 = True {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jan 15 20:39:37.784701 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] auth_strategy                  = keystone {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jan 15 20:39:37.785126 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] backend_availability_zone      = None {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jan 15 20:39:37.786134 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] backup_api_class               = cinder.backup.api.API {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jan 15 20:39:37.786827 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] backup_ceph_chunk_size         = 134217728 {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jan 15 20:39:37.787314 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] backup_ceph_conf               = /etc/ceph/ceph.conf {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jan 15 20:39:37.787713 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] backup_ceph_image_journals     = False {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jan 15 20:39:37.788071 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] backup_ceph_pool               = backups {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jan 15 20:39:37.788485 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] backup_ceph_stripe_count       = 0 {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jan 15 20:39:37.788897 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] backup_ceph_stripe_unit        = 0 {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jan 15 20:39:37.790061 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] backup_ceph_user               = cinder-bak {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jan 15 20:39:37.790061 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] backup_driver                  = cinder.backup.drivers.ceph.CephBackupDriver {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jan 15 20:39:37.790508 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] backup_driver_init_check_interval = 60 {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jan 15 20:39:37.790911 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] backup_driver_stats_polling_interval = 60 {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jan 15 20:39:37.791353 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jan 15 20:39:37.791756 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] backup_max_operations          = 15 {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jan 15 20:39:37.792124 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] backup_metadata_version        = 2 {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jan 15 20:39:37.792517 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] backup_name_template           = backup-%s {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jan 15 20:39:37.793130 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] backup_native_threads_pool_size = 60 {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jan 15 20:39:37.793553 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] backup_object_number_per_notification = 10 {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jan 15 20:39:37.793916 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] backup_service_inithost_offload = True {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jan 15 20:39:37.794277 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] backup_timer_interval          = 120 {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jan 15 20:39:37.794711 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] backup_use_same_host           = False {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jan 15 20:39:37.795128 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] backup_use_temp_snapshot       = False {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jan 15 20:39:37.795548 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] backup_workers                 = 1 {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jan 15 20:39:37.795926 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] chap_password                  = **** {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jan 15 20:39:37.796270 ncdv-master-1 cinder-backup[122641]: INFO cinder.service [-] Starting cinder-backup node (version 19.1.0)
Jan 15 20:39:37.797054 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] chap_username                  =  {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jan 15 20:39:37.797054 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jan 15 20:39:37.797184 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] cinder_internal_tenant_project_id = c028267a87b54c0c8cac54caaf0e08da {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jan 15 20:39:37.797665 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] cinder_internal_tenant_user_id = 2936309c4f4047e1b1ffe956cf428ff0 {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jan 15 20:39:37.797879 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] compression_format             = gzip {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jan 15 20:39:37.798263 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] config_dir                     = [] {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jan 15 20:39:37.798602 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jan 15 20:39:37.799016 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] config_source                  = [] {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jan 15 20:39:37.800992 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jan 15 20:39:37.800992 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] control_exchange               = openstack {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jan 15 20:39:37.800992 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] debug                          = True {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jan 15 20:39:37.800992 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] default_availability_zone      = None {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jan 15 20:39:37.800992 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] default_group_type             = None {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jan 15 20:39:37.801599 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'swiftclient=WARN', 'botocore=WARN'] {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jan 15 20:39:37.803896 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] default_volume_type            = ceph {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jan 15 20:39:37.804528 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] driver_client_cert             = None {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jan 15 20:39:37.805172 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] driver_client_cert_key         = None {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jan 15 20:39:37.805788 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] driver_data_namespace          = None {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jan 15 20:39:37.806364 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] driver_ssl_cert_path           = None {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jan 15 20:39:37.807018 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] driver_ssl_cert_verify         = False {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jan 15 20:39:37.807648 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] driver_use_ssl                 = False {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jan 15 20:39:37.808071 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] enable_new_services            = True {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jan 15 20:39:37.808461 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] enable_unsupported_driver      = False {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jan 15 20:39:37.808939 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] enabled_backends               = ['ceph'] {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jan 15 20:39:37.809358 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] enforce_multipath_for_image_xfer = False {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jan 15 20:39:37.809717 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] filter_function                = None {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jan 15 20:39:37.812814 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] glance_api_insecure            = False {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jan 15 20:39:37.812814 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] glance_api_servers             = ['http://10.222.0.46/image'] {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jan 15 20:39:37.812814 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] glance_api_ssl_compression     = False {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jan 15 20:39:37.812814 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] glance_ca_certificates_file    = None {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jan 15 20:39:37.812814 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] glance_catalog_info            = image:glance:publicURL {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jan 15 20:39:37.812814 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] glance_certfile                = None {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jan 15 20:39:37.813265 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jan 15 20:39:37.813265 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] glance_keyfile                 = None {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jan 15 20:39:37.813265 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] glance_num_retries             = 3 {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jan 15 20:39:37.813609 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] glance_request_timeout         = None {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jan 15 20:39:37.813895 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] goodness_function              = None {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jan 15 20:39:37.814274 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] graceful_shutdown_timeout      = 5 {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jan 15 20:39:37.814676 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] group_api_class                = cinder.group.api.API {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jan 15 20:39:37.815036 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] host                           = ncdv-master-1 {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jan 15 20:39:37.815436 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] iet_conf                       = /etc/iet/ietd.conf {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jan 15 20:39:37.815871 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] image_compress_on_upload       = True {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jan 15 20:39:37.816237 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] image_conversion_address_space_limit = 1 {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jan 15 20:39:37.816586 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] image_conversion_cpu_limit     = 60 {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jan 15 20:39:37.817815 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jan 15 20:39:37.818419 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] image_upload_use_cinder_backend = False {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jan 15 20:39:37.818713 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] image_upload_use_internal_tenant = False {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jan 15 20:39:37.819140 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] image_volume_cache_enabled     = False {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jan 15 20:39:37.819682 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] image_volume_cache_max_count   = 0 {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jan 15 20:39:37.819848 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] image_volume_cache_max_size_gb = 0 {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jan 15 20:39:37.824861 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] instance_format                = [instance: %(uuid)s]  {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jan 15 20:39:37.824861 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jan 15 20:39:37.824861 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] iscsi_iotype                   = fileio {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jan 15 20:39:37.824861 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] iscsi_secondary_ip_addresses   = [] {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jan 15 20:39:37.824861 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] iscsi_target_flags             =  {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jan 15 20:39:37.824861 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] iscsi_write_cache              = on {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jan 15 20:39:37.824861 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] iser_helper                    = tgtadm {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jan 15 20:39:37.825391 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] iser_ip_address                = 10.222.0.46 {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jan 15 20:39:37.825391 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] iser_port                      = 3260 {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jan 15 20:39:37.825391 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jan 15 20:39:37.825391 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] log_config_append              = None {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jan 15 20:39:37.825391 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jan 15 20:39:37.825690 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] log_dir                        = None {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jan 15 20:39:37.826081 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] log_file                       = None {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jan 15 20:39:37.826374 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] log_options                    = True {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jan 15 20:39:37.826722 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] log_rotate_interval            = 1 {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jan 15 20:39:37.827175 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] log_rotate_interval_type       = days {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jan 15 20:39:37.827551 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] log_rotation_type              = none {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jan 15 20:39:37.827842 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jan 15 20:39:37.828212 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jan 15 20:39:37.828573 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jan 15 20:39:37.828991 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jan 15 20:39:37.829368 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] logging_user_identity_format   = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jan 15 20:39:37.829752 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] max_age                        = 0 {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jan 15 20:39:37.830092 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] max_logfile_count              = 30 {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jan 15 20:39:37.830485 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] max_logfile_size_mb            = 200 {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jan 15 20:39:37.830868 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] max_over_subscription_ratio    = 20.0 {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jan 15 20:39:37.833435 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] message_reap_interval          = 86400 {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jan 15 20:39:37.833435 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] message_ttl                    = 2592000 {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jan 15 20:39:37.833435 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] monkey_patch                   = False {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jan 15 20:39:37.833435 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] monkey_patch_modules           = [] {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jan 15 20:39:37.833435 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] my_ip                          = 10.222.0.46 {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jan 15 20:39:37.834199 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] no_snapshot_gb_quota           = False {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jan 15 20:39:37.834341 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] num_iser_scan_tries            = 3 {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jan 15 20:39:37.836138 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] num_shell_tries                = 3 {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jan 15 20:39:37.836138 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] num_volume_device_scan_tries   = 3 {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jan 15 20:39:37.836138 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] nvmet_ns_id                    = 10 {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jan 15 20:39:37.836686 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] nvmet_port_id                  = 1 {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jan 15 20:39:37.837168 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] osapi_max_limit                = 1000 {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jan 15 20:39:37.837848 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] osapi_volume_ext_list          = [] {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jan 15 20:39:37.838512 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jan 15 20:39:37.839059 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] osapi_volume_listen            = 0.0.0.0 {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jan 15 20:39:37.839648 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] osapi_volume_listen_port       = 8776 {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jan 15 20:39:37.840170 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] osapi_volume_use_ssl           = False {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jan 15 20:39:37.840718 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] osapi_volume_workers           = 2 {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jan 15 20:39:37.841512 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] per_volume_size_limit          = -1 {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jan 15 20:39:37.842191 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] periodic_fuzzy_delay           = 60 {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jan 15 20:39:37.842895 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] periodic_interval              = 60 {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jan 15 20:39:37.843557 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] public_endpoint                = None {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jan 15 20:39:37.844148 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] publish_errors                 = False {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jan 15 20:39:37.844750 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] quota_backup_gigabytes         = 1000 {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jan 15 20:39:37.845421 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] quota_backups                  = 10 {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jan 15 20:39:37.846159 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] quota_consistencygroups        = 10 {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jan 15 20:39:37.846797 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jan 15 20:39:37.847149 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] quota_gigabytes                = 1000 {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jan 15 20:39:37.847553 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] quota_groups                   = 10 {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jan 15 20:39:37.848568 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] quota_snapshots                = 10 {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jan 15 20:39:37.849511 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] quota_volumes                  = 10 {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jan 15 20:39:37.849511 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] rate_limit_burst               = 0 {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jan 15 20:39:37.849739 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] rate_limit_except_level        = CRITICAL {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jan 15 20:39:37.850046 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] rate_limit_interval            = 0 {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jan 15 20:39:37.850366 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] replication_device             = **** {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jan 15 20:39:37.850821 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] report_discard_supported       = False {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jan 15 20:39:37.851893 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] report_interval                = 10 {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jan 15 20:39:37.852336 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] reservation_clean_interval     = 86400 {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jan 15 20:39:37.856876 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] reservation_expire             = 86400 {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jan 15 20:39:37.856876 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] reserved_percentage            = 0 {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jan 15 20:39:37.856876 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jan 15 20:39:37.856876 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] restore_discard_excess_bytes   = True {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jan 15 20:39:37.856876 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jan 15 20:39:37.856876 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] rpc_response_timeout           = 120 {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jan 15 20:39:37.857444 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] run_external_periodic_tasks    = True {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jan 15 20:39:37.857520 ncdv-master-1 cinder-backup[122641]: DEBUG oslo_concurrency.lockutils [None req-af61f93e-22ef-49e6-9def-07cbcb4c6835 None None] Lock "cleanup_incomplete_backups_122193" acquired by "cinder.backup.manager.BackupManager._cleanup_incomplete_backup_operations" :: waited 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}}
Jan 15 20:39:37.857520 ncdv-master-1 cinder-backup[122641]: INFO cinder.backup.manager [None req-af61f93e-22ef-49e6-9def-07cbcb4c6835 None None] Cleaning up incomplete backup operations.
Jan 15 20:39:37.857690 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jan 15 20:39:37.857690 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] scst_target_driver             = iscsi {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jan 15 20:39:37.858026 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] scst_target_iqn_name           = None {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jan 15 20:39:37.858326 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] service_down_time              = 60 {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jan 15 20:39:37.858757 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] snapshot_name_template         = snapshot-%s {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jan 15 20:39:37.859368 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] split_loggers                  = False {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jan 15 20:39:37.859733 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] state_path                     = /opt/stack/data/cinder {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jan 15 20:39:37.860353 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] storage_availability_zone      = nova {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jan 15 20:39:37.860790 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] storage_protocol               = iscsi {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jan 15 20:39:37.861294 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] syslog_log_facility            = LOG_USER {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jan 15 20:39:37.866939 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] target_helper                  = lioadm {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jan 15 20:39:37.867453 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] target_ip_address              = 10.222.0.46 {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jan 15 20:39:37.867873 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] target_port                    = 3260 {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jan 15 20:39:37.868246 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jan 15 20:39:37.868620 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] target_protocol                = iscsi {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jan 15 20:39:37.869094 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] trace_flags                    = None {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jan 15 20:39:37.869460 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] transfer_api_class             = cinder.transfer.api.API {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jan 15 20:39:37.869837 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] transport_url                  = **** {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jan 15 20:39:37.870196 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] until_refresh                  = 0 {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jan 15 20:39:37.870548 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] use_chap_auth                  = False {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jan 15 20:39:37.870909 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] use_default_quota_class        = True {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jan 15 20:39:37.871249 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] use_eventlog                   = False {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jan 15 20:39:37.871587 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] use_journal                    = False {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jan 15 20:39:37.872329 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] use_json                       = False {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jan 15 20:39:37.872329 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] use_multipath_for_image_xfer   = False {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jan 15 20:39:37.872860 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] use_stderr                     = False {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jan 15 20:39:37.873020 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] use_syslog                     = False {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jan 15 20:39:37.876157 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] verify_glance_signatures       = enabled {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jan 15 20:39:37.876157 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] volume_api_class               = cinder.volume.api.API {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jan 15 20:39:37.876157 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] volume_backend_name            = None {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jan 15 20:39:37.876157 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] volume_clear                   = zero {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jan 15 20:39:37.876586 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] volume_clear_ionice            = None {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jan 15 20:39:37.876776 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] volume_clear_size              = 0 {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jan 15 20:39:37.877169 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jan 15 20:39:37.877518 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] volume_copy_bps_limit          = 0 {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jan 15 20:39:37.878146 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] volume_dd_blocksize            = 1M {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jan 15 20:39:37.878522 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jan 15 20:39:37.878884 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] volume_name_template           = volume-%s {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jan 15 20:39:37.879266 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] volume_usage_audit_period      = month {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jan 15 20:39:37.879705 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jan 15 20:39:37.880049 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] watch_log_file                 = False {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jan 15 20:39:37.880527 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jan 15 20:39:37.880948 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jan 15 20:39:37.881394 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] oslo_policy.enforce_new_defaults = False {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jan 15 20:39:37.881773 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] oslo_policy.enforce_scope      = False {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jan 15 20:39:37.882191 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] oslo_policy.policy_default_rule = default {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jan 15 20:39:37.882611 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jan 15 20:39:37.883007 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] oslo_policy.policy_file        = policy.yaml {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jan 15 20:39:37.883413 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jan 15 20:39:37.883767 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jan 15 20:39:37.888794 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jan 15 20:39:37.888794 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jan 15 20:39:37.888794 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jan 15 20:39:37.888794 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] oslo_concurrency.disable_process_locking = False {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jan 15 20:39:37.888794 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jan 15 20:39:37.888794 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] keystone_authtoken.admin_password = **** {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jan 15 20:39:37.889325 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jan 15 20:39:37.889325 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] keystone_authtoken.admin_token = **** {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jan 15 20:39:37.889325 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] keystone_authtoken.admin_user  = None {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jan 15 20:39:37.889325 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] keystone_authtoken.auth_admin_prefix =  {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jan 15 20:39:37.889325 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] keystone_authtoken.auth_host   = 127.0.0.1 {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jan 15 20:39:37.889325 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] keystone_authtoken.auth_port   = 35357 {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jan 15 20:39:37.889325 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] keystone_authtoken.auth_protocol = https {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jan 15 20:39:37.889833 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] keystone_authtoken.auth_section = None {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jan 15 20:39:37.889833 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] keystone_authtoken.auth_type   = password {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jan 15 20:39:37.889833 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] keystone_authtoken.auth_uri    = None {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jan 15 20:39:37.890054 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] keystone_authtoken.auth_version = None {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jan 15 20:39:37.890234 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] keystone_authtoken.cache       = None {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jan 15 20:39:37.890591 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jan 15 20:39:37.890937 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] keystone_authtoken.certfile    = None {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jan 15 20:39:37.891276 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] keystone_authtoken.delay_auth_decision = False {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jan 15 20:39:37.891676 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jan 15 20:39:37.892121 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] keystone_authtoken.http_connect_timeout = None {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jan 15 20:39:37.892468 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jan 15 20:39:37.892801 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] keystone_authtoken.identity_uri = None {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jan 15 20:39:37.893160 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] keystone_authtoken.include_service_catalog = True {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jan 15 20:39:37.893495 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] keystone_authtoken.insecure    = False {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jan 15 20:39:37.894138 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] keystone_authtoken.interface   = public {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jan 15 20:39:37.894497 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] keystone_authtoken.keyfile     = None {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jan 15 20:39:37.895637 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jan 15 20:39:37.895842 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jan 15 20:39:37.896047 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jan 15 20:39:37.896477 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jan 15 20:39:37.896817 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jan 15 20:39:37.897176 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jan 15 20:39:37.897534 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jan 15 20:39:37.897870 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jan 15 20:39:37.898333 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jan 15 20:39:37.898676 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] keystone_authtoken.region_name = None {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jan 15 20:39:37.899084 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jan 15 20:39:37.899427 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] keystone_authtoken.service_token_roles_required = False {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jan 15 20:39:37.899759 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] keystone_authtoken.service_type = None {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jan 15 20:39:37.900119 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] keystone_authtoken.token_cache_time = 300 {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jan 15 20:39:37.900507 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] keystone_authtoken.www_authenticate_uri = None {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jan 15 20:39:37.900977 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] cache.backend                  = dogpile.cache.null {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jan 15 20:39:37.901357 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] cache.backend_argument         = **** {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jan 15 20:39:37.901708 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] cache.config_prefix            = cache.oslo {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jan 15 20:39:37.902064 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] cache.debug_cache_backend      = False {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jan 15 20:39:37.902396 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] cache.enabled                  = False {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jan 15 20:39:37.902773 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] cache.expiration_time          = 600 {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jan 15 20:39:37.903128 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] cache.memcache_dead_retry      = 300 {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jan 15 20:39:37.903481 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jan 15 20:39:37.903825 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jan 15 20:39:37.904512 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] cache.memcache_pool_maxsize    = 10 {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jan 15 20:39:37.904512 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jan 15 20:39:37.904885 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jan 15 20:39:37.908862 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] cache.memcache_socket_timeout  = 1.0 {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jan 15 20:39:37.908862 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] cache.proxies                  = [] {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jan 15 20:39:37.908862 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] cache.tls_allowed_ciphers      = None {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jan 15 20:39:37.908862 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] cache.tls_cafile               = None {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jan 15 20:39:37.908862 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] cache.tls_certfile             = None {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jan 15 20:39:37.908862 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] cache.tls_enabled              = False {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jan 15 20:39:37.908862 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] cache.tls_keyfile              = None {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jan 15 20:39:37.909421 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] coordination.backend_url       = etcd3+http://10.222.0.46:2379 {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jan 15 20:39:37.909421 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] database.backend               = sqlalchemy {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jan 15 20:39:37.909421 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] database.connection            = **** {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jan 15 20:39:37.909421 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] database.connection_debug      = 0 {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jan 15 20:39:37.909421 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] database.connection_parameters =  {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jan 15 20:39:37.909757 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] database.connection_recycle_time = 3600 {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jan 15 20:39:37.909892 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] database.connection_trace      = False {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jan 15 20:39:37.910228 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] database.db_inc_retry_interval = True {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jan 15 20:39:37.911287 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] database.db_max_retries        = 20 {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jan 15 20:39:37.911785 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] database.db_max_retry_interval = 10 {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jan 15 20:39:37.912114 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] database.db_retry_interval     = 1 {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jan 15 20:39:37.912465 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] database.max_overflow          = 50 {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jan 15 20:39:37.912813 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] database.max_pool_size         = 5 {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jan 15 20:39:37.913182 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] database.max_retries           = 10 {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jan 15 20:39:37.913526 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] database.mysql_enable_ndb      = False {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jan 15 20:39:37.913875 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jan 15 20:39:37.914265 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] database.pool_timeout          = None {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jan 15 20:39:37.914645 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] database.retry_interval        = 10 {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jan 15 20:39:37.914995 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] database.slave_connection      = **** {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jan 15 20:39:37.915392 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] database.sqlite_synchronous    = True {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jan 15 20:39:37.915750 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] database.use_db_reconnect      = False {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jan 15 20:39:37.916128 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jan 15 20:39:37.916495 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jan 15 20:39:37.916852 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jan 15 20:39:37.917205 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jan 15 20:39:37.917545 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jan 15 20:39:37.918520 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] profiler.connection_string     = messaging:// {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jan 15 20:39:37.918813 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] profiler.enabled               = False {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jan 15 20:39:37.919259 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] profiler.es_doc_type           = notification {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jan 15 20:39:37.919614 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] profiler.es_scroll_size        = 10000 {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jan 15 20:39:37.921275 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] profiler.es_scroll_time        = 2m {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jan 15 20:39:37.921275 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] profiler.filter_error_trace    = False {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jan 15 20:39:37.921275 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] profiler.hmac_keys             = SECRET_KEY {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jan 15 20:39:37.921275 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] profiler.sentinel_service_name = mymaster {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jan 15 20:39:37.921567 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] profiler.socket_timeout        = 0.1 {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jan 15 20:39:37.921881 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] profiler.trace_sqlalchemy      = False {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jan 15 20:39:37.922288 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] privsep_osbrick.capabilities   = [21] {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jan 15 20:39:37.925697 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] privsep_osbrick.group          = None {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jan 15 20:39:37.925697 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] privsep_osbrick.helper_command = None {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jan 15 20:39:37.925697 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] privsep_osbrick.logger_name    = oslo_privsep.daemon {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jan 15 20:39:37.925697 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jan 15 20:39:37.925697 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] privsep_osbrick.user           = None {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jan 15 20:39:37.925697 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jan 15 20:39:37.925697 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] cinder_sys_admin.group         = None {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jan 15 20:39:37.926709 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] cinder_sys_admin.helper_command = None {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jan 15 20:39:37.926709 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jan 15 20:39:37.926709 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jan 15 20:39:37.926709 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] cinder_sys_admin.user          = None {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jan 15 20:39:37.926709 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] service_user.auth_section      = None {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jan 15 20:39:37.927346 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] service_user.auth_type         = None {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jan 15 20:39:37.927439 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] service_user.cafile            = None {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jan 15 20:39:37.927713 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] service_user.certfile          = None {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jan 15 20:39:37.928065 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] service_user.collect_timing    = False {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jan 15 20:39:37.928587 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] service_user.insecure          = False {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jan 15 20:39:37.929179 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] service_user.keyfile           = None {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jan 15 20:39:37.929321 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] service_user.send_service_user_token = False {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jan 15 20:39:37.930359 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] service_user.split_loggers     = False {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jan 15 20:39:37.930938 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] service_user.timeout           = None {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jan 15 20:39:37.931531 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] backend_defaults.backend_availability_zone = None {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jan 15 20:39:37.932132 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] backend_defaults.chap_password = **** {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jan 15 20:39:37.932632 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] backend_defaults.chap_username =  {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jan 15 20:39:37.933204 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jan 15 20:39:37.933925 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] backend_defaults.deferred_deletion_delay = 0 {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jan 15 20:39:37.934422 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] backend_defaults.deferred_deletion_purge_interval = 60 {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jan 15 20:39:37.934904 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] backend_defaults.driver_client_cert = None {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jan 15 20:39:37.935380 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] backend_defaults.driver_client_cert_key = None {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jan 15 20:39:37.935988 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] backend_defaults.driver_data_namespace = None {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jan 15 20:39:37.936483 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jan 15 20:39:37.937121 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jan 15 20:39:37.937901 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] backend_defaults.driver_use_ssl = False {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jan 15 20:39:37.938486 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] backend_defaults.enable_deferred_deletion = False {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jan 15 20:39:37.938974 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] backend_defaults.enable_unsupported_driver = False {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jan 15 20:39:37.939542 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jan 15 20:39:37.940641 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] backend_defaults.filter_function = None {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jan 15 20:39:37.941306 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] backend_defaults.goodness_function = None {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jan 15 20:39:37.942054 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] backend_defaults.iet_conf      = /etc/iet/ietd.conf {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jan 15 20:39:37.942548 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jan 15 20:39:37.943050 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jan 15 20:39:37.943573 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jan 15 20:39:37.944223 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jan 15 20:39:37.944716 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jan 15 20:39:37.945239 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] backend_defaults.iscsi_iotype  = fileio {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jan 15 20:39:37.945734 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] backend_defaults.iscsi_secondary_ip_addresses = [] {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jan 15 20:39:37.946300 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] backend_defaults.iscsi_target_flags =  {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jan 15 20:39:37.946807 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] backend_defaults.iscsi_write_cache = on {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jan 15 20:39:37.947347 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] backend_defaults.iser_helper   = tgtadm {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jan 15 20:39:37.948033 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] backend_defaults.iser_ip_address = 10.222.0.46 {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jan 15 20:39:37.948521 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] backend_defaults.iser_port     = 3260 {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jan 15 20:39:37.949061 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jan 15 20:39:37.949575 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jan 15 20:39:37.950059 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jan 15 20:39:37.950555 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] backend_defaults.num_shell_tries = 3 {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jan 15 20:39:37.951041 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jan 15 20:39:37.951524 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jan 15 20:39:37.952023 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] backend_defaults.nvmet_port_id = 1 {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jan 15 20:39:37.952540 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] backend_defaults.rados_connect_timeout = -1 {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jan 15 20:39:37.953362 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] backend_defaults.rados_connection_interval = 5 {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jan 15 20:39:37.953900 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] backend_defaults.rados_connection_retries = 3 {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jan 15 20:39:37.954392 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] backend_defaults.rbd_ceph_conf =  {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jan 15 20:39:37.954920 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] backend_defaults.rbd_cluster_name = ceph {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jan 15 20:39:37.955419 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] backend_defaults.rbd_exclusive_cinder_pool = True {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jan 15 20:39:37.955898 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] backend_defaults.rbd_flatten_volume_from_snapshot = False {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jan 15 20:39:37.956446 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] backend_defaults.rbd_max_clone_depth = 5 {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jan 15 20:39:37.956982 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] backend_defaults.rbd_pool      = rbd {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jan 15 20:39:37.958010 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] backend_defaults.rbd_secret_uuid = None {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jan 15 20:39:37.958533 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] backend_defaults.rbd_store_chunk_size = 4 {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jan 15 20:39:37.959029 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] backend_defaults.rbd_user      = None {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jan 15 20:39:37.959525 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] backend_defaults.replication_connect_timeout = 5 {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jan 15 20:39:37.960003 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] backend_defaults.replication_device = **** {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jan 15 20:39:37.960497 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] backend_defaults.report_discard_supported = False {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jan 15 20:39:37.961028 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] backend_defaults.report_dynamic_total_capacity = True {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jan 15 20:39:37.961528 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] backend_defaults.reserved_percentage = 0 {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jan 15 20:39:37.962034 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] backend_defaults.scst_target_driver = iscsi {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jan 15 20:39:37.962519 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] backend_defaults.scst_target_iqn_name = None {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jan 15 20:39:37.963068 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] backend_defaults.storage_protocol = iscsi {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jan 15 20:39:37.963590 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] backend_defaults.target_helper = tgtadm {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jan 15 20:39:37.964183 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] backend_defaults.target_ip_address = 10.222.0.46 {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jan 15 20:39:37.964667 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] backend_defaults.target_port   = 3260 {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jan 15 20:39:37.965196 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jan 15 20:39:37.965693 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] backend_defaults.target_protocol = iscsi {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jan 15 20:39:37.966185 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] backend_defaults.trace_flags   = None {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jan 15 20:39:37.966698 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] backend_defaults.unique_fqdn_network = True {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jan 15 20:39:37.967188 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] backend_defaults.use_chap_auth = False {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jan 15 20:39:37.967673 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jan 15 20:39:37.968160 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] backend_defaults.volume_backend_name = None {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jan 15 20:39:37.968661 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] backend_defaults.volume_clear  = zero {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jan 15 20:39:37.969272 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] backend_defaults.volume_clear_ionice = None {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jan 15 20:39:37.969760 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] backend_defaults.volume_clear_size = 0 {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jan 15 20:39:37.970271 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jan 15 20:39:37.970757 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jan 15 20:39:37.971249 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jan 15 20:39:37.971911 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jan 15 20:39:37.972428 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] oslo_reports.file_event_handler = None {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jan 15 20:39:37.973005 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jan 15 20:39:37.973584 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] oslo_reports.log_dir           = None {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jan 15 20:39:37.974147 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jan 15 20:39:37.974648 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jan 15 20:39:37.975168 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jan 15 20:39:37.975672 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jan 15 20:39:37.976169 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jan 15 20:39:37.976657 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jan 15 20:39:37.977189 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jan 15 20:39:37.977693 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jan 15 20:39:37.978176 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jan 15 20:39:37.978691 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jan 15 20:39:37.979208 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jan 15 20:39:37.979735 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jan 15 20:39:37.980266 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jan 15 20:39:37.980785 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jan 15 20:39:37.981312 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jan 15 20:39:37.981829 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jan 15 20:39:37.982309 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jan 15 20:39:37.982804 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jan 15 20:39:37.983285 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jan 15 20:39:37.983782 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jan 15 20:39:37.984295 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jan 15 20:39:37.984831 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] oslo_messaging_rabbit.ssl      = False {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jan 15 20:39:37.985379 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jan 15 20:39:37.985945 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jan 15 20:39:37.986442 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jan 15 20:39:37.986946 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jan 15 20:39:37.987496 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] oslo_messaging_notifications.driver = [] {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jan 15 20:39:37.988002 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] oslo_messaging_notifications.retry = -1 {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jan 15 20:39:37.989299 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jan 15 20:39:37.989785 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] oslo_messaging_notifications.transport_url = **** {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jan 15 20:39:37.990350 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jan 15 20:39:37.990917 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jan 15 20:39:37.991393 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] barbican.barbican_api_version  = None {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jan 15 20:39:37.991899 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] barbican.barbican_endpoint     = None {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jan 15 20:39:37.992432 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] barbican.barbican_endpoint_type = public {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jan 15 20:39:37.992975 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] barbican.barbican_region_name  = None {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jan 15 20:39:37.993469 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] barbican.cafile                = None {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jan 15 20:39:37.993953 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] barbican.certfile              = None {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jan 15 20:39:37.994449 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] barbican.collect_timing        = False {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jan 15 20:39:37.995228 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] barbican.insecure              = False {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jan 15 20:39:37.995700 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] barbican.keyfile               = None {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jan 15 20:39:37.996238 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] barbican.number_of_retries     = 60 {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jan 15 20:39:37.996727 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] barbican.retry_delay           = 1 {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jan 15 20:39:37.997354 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] barbican.send_service_user_token = False {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jan 15 20:39:37.997857 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] barbican.split_loggers         = False {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jan 15 20:39:37.998332 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] barbican.timeout               = None {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jan 15 20:39:37.998816 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] barbican.verify_ssl            = True {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jan 15 20:39:37.999289 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] barbican.verify_ssl_path       = None {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jan 15 20:39:37.999798 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] barbican_service_user.auth_section = None {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jan 15 20:39:38.000289 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] barbican_service_user.auth_type = None {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jan 15 20:39:38.000765 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] barbican_service_user.cafile   = None {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jan 15 20:39:38.001266 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] barbican_service_user.certfile = None {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jan 15 20:39:38.001747 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] barbican_service_user.collect_timing = False {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jan 15 20:39:38.002226 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] barbican_service_user.insecure = False {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jan 15 20:39:38.002716 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] barbican_service_user.keyfile  = None {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jan 15 20:39:38.003282 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] barbican_service_user.split_loggers = False {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jan 15 20:39:38.003765 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] barbican_service_user.timeout  = None {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jan 15 20:39:38.004351 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] vault.approle_role_id          = None {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jan 15 20:39:38.004859 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] vault.approle_secret_id        = None {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jan 15 20:39:38.005333 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] vault.cafile                   = None {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jan 15 20:39:38.005835 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] vault.certfile                 = None {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jan 15 20:39:38.006377 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] vault.collect_timing           = False {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jan 15 20:39:38.006867 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] vault.insecure                 = False {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jan 15 20:39:38.007342 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] vault.keyfile                  = None {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jan 15 20:39:38.007835 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] vault.kv_mountpoint            = secret {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jan 15 20:39:38.008322 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] vault.kv_version               = 2 {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jan 15 20:39:38.008823 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] vault.namespace                = None {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jan 15 20:39:38.009318 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] vault.root_token_id            = None {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jan 15 20:39:38.009809 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] vault.split_loggers            = False {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jan 15 20:39:38.010299 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] vault.ssl_ca_crt_file          = None {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jan 15 20:39:38.010809 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] vault.timeout                  = None {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jan 15 20:39:38.011302 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] vault.use_ssl                  = False {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jan 15 20:39:38.011962 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jan 15 20:39:38.012390 ncdv-master-1 cinder-backup[122193]: DEBUG oslo_service.service [None req-87d75d84-550b-4a53-a626-2ac02047d465 None None] ******************************************************************************** {{(pid=122193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}}
Jan 15 20:39:38.074158 ncdv-master-1 cinder-backup[122641]: DEBUG oslo_db.sqlalchemy.engines [None req-af61f93e-22ef-49e6-9def-07cbcb4c6835 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122641) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}}
Jan 15 20:39:38.102741 ncdv-master-1 cinder-backup[122641]: DEBUG oslo_concurrency.lockutils [None req-af61f93e-22ef-49e6-9def-07cbcb4c6835 None None] Lock "cleanup_incomplete_backups_122193" "released" by "cinder.backup.manager.BackupManager._cleanup_incomplete_backup_operations" :: held 0.247s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}}
Jan 15 20:39:38.112106 ncdv-master-1 cinder-backup[122641]: DEBUG oslo_db.sqlalchemy.engines [None req-af61f93e-22ef-49e6-9def-07cbcb4c6835 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122641) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}}
Jan 15 20:39:38.119459 ncdv-master-1 cinder-backup[122641]: DEBUG cinder.manager [None req-af61f93e-22ef-49e6-9def-07cbcb4c6835 None None] Notifying Schedulers of capabilities ... {{(pid=122641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jan 15 20:39:38.145914 ncdv-master-1 cinder-backup[122641]: INFO cinder.keymgr.migration [None req-3ef514b8-53b7-44a3-aa54-aa62373f476d None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Jan 15 20:39:38.166981 ncdv-master-1 cinder-backup[122641]: DEBUG cinder.service [None req-af61f93e-22ef-49e6-9def-07cbcb4c6835 None None] Creating RPC server for service cinder-backup {{(pid=122641) start /opt/stack/cinder/cinder/service.py:231}}
Jan 15 20:39:38.175196 ncdv-master-1 cinder-backup[122641]: DEBUG cinder.service [None req-af61f93e-22ef-49e6-9def-07cbcb4c6835 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=122641) start /opt/stack/cinder/cinder/service.py:237}}
Jan 15 20:41:11.210691 ncdv-master-1 cinder-backup[122641]: DEBUG oslo_service.periodic_task [None req-880577f5-cbba-4bc0-b820-8647ffc48ae5 None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=122641) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Jan 15 20:41:11.211396 ncdv-master-1 cinder-backup[122641]: DEBUG cinder.manager [None req-880577f5-cbba-4bc0-b820-8647ffc48ae5 None None] Notifying Schedulers of capabilities ... {{(pid=122641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jan 15 20:42:11.206226 ncdv-master-1 cinder-backup[122641]: DEBUG oslo_service.periodic_task [None req-880577f5-cbba-4bc0-b820-8647ffc48ae5 None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=122641) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Jan 15 20:42:11.206977 ncdv-master-1 cinder-backup[122641]: DEBUG cinder.manager [None req-880577f5-cbba-4bc0-b820-8647ffc48ae5 None None] Notifying Schedulers of capabilities ... {{(pid=122641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jan 15 20:43:11.211471 ncdv-master-1 cinder-backup[122641]: DEBUG oslo_service.periodic_task [None req-880577f5-cbba-4bc0-b820-8647ffc48ae5 None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=122641) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Jan 15 20:43:11.212080 ncdv-master-1 cinder-backup[122641]: DEBUG cinder.manager [None req-880577f5-cbba-4bc0-b820-8647ffc48ae5 None None] Notifying Schedulers of capabilities ... {{(pid=122641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jan 15 20:44:11.216371 ncdv-master-1 cinder-backup[122641]: DEBUG oslo_service.periodic_task [None req-880577f5-cbba-4bc0-b820-8647ffc48ae5 None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=122641) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Jan 15 20:44:11.216999 ncdv-master-1 cinder-backup[122641]: DEBUG cinder.manager [None req-880577f5-cbba-4bc0-b820-8647ffc48ae5 None None] Notifying Schedulers of capabilities ... {{(pid=122641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jan 15 20:45:11.221829 ncdv-master-1 cinder-backup[122641]: DEBUG oslo_service.periodic_task [None req-880577f5-cbba-4bc0-b820-8647ffc48ae5 None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=122641) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Jan 15 20:45:11.222437 ncdv-master-1 cinder-backup[122641]: DEBUG cinder.manager [None req-880577f5-cbba-4bc0-b820-8647ffc48ae5 None None] Notifying Schedulers of capabilities ... {{(pid=122641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jan 15 20:46:11.226480 ncdv-master-1 cinder-backup[122641]: DEBUG oslo_service.periodic_task [None req-880577f5-cbba-4bc0-b820-8647ffc48ae5 None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=122641) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Jan 15 20:46:11.227075 ncdv-master-1 cinder-backup[122641]: DEBUG cinder.manager [None req-880577f5-cbba-4bc0-b820-8647ffc48ae5 None None] Notifying Schedulers of capabilities ... {{(pid=122641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jan 15 20:47:11.230797 ncdv-master-1 cinder-backup[122641]: DEBUG oslo_service.periodic_task [None req-880577f5-cbba-4bc0-b820-8647ffc48ae5 None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=122641) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Jan 15 20:47:11.231367 ncdv-master-1 cinder-backup[122641]: DEBUG cinder.manager [None req-880577f5-cbba-4bc0-b820-8647ffc48ae5 None None] Notifying Schedulers of capabilities ... {{(pid=122641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jan 15 20:48:11.235871 ncdv-master-1 cinder-backup[122641]: DEBUG oslo_service.periodic_task [None req-880577f5-cbba-4bc0-b820-8647ffc48ae5 None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=122641) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Jan 15 20:48:11.236487 ncdv-master-1 cinder-backup[122641]: DEBUG cinder.manager [None req-880577f5-cbba-4bc0-b820-8647ffc48ae5 None None] Notifying Schedulers of capabilities ... {{(pid=122641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jan 15 20:49:11.241442 ncdv-master-1 cinder-backup[122641]: DEBUG oslo_service.periodic_task [None req-880577f5-cbba-4bc0-b820-8647ffc48ae5 None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=122641) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Jan 15 20:49:11.242063 ncdv-master-1 cinder-backup[122641]: DEBUG cinder.manager [None req-880577f5-cbba-4bc0-b820-8647ffc48ae5 None None] Notifying Schedulers of capabilities ... {{(pid=122641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jan 15 20:50:11.238686 ncdv-master-1 cinder-backup[122641]: DEBUG oslo_service.periodic_task [None req-880577f5-cbba-4bc0-b820-8647ffc48ae5 None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=122641) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Jan 15 20:50:11.239284 ncdv-master-1 cinder-backup[122641]: DEBUG cinder.manager [None req-880577f5-cbba-4bc0-b820-8647ffc48ae5 None None] Notifying Schedulers of capabilities ... {{(pid=122641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jan 15 20:51:11.234958 ncdv-master-1 cinder-backup[122641]: DEBUG oslo_service.periodic_task [None req-880577f5-cbba-4bc0-b820-8647ffc48ae5 None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=122641) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Jan 15 20:51:11.236044 ncdv-master-1 cinder-backup[122641]: DEBUG cinder.manager [None req-880577f5-cbba-4bc0-b820-8647ffc48ae5 None None] Notifying Schedulers of capabilities ... {{(pid=122641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jan 15 20:52:11.239677 ncdv-master-1 cinder-backup[122641]: DEBUG oslo_service.periodic_task [None req-880577f5-cbba-4bc0-b820-8647ffc48ae5 None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=122641) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Jan 15 20:52:11.240873 ncdv-master-1 cinder-backup[122641]: DEBUG cinder.manager [None req-880577f5-cbba-4bc0-b820-8647ffc48ae5 None None] Notifying Schedulers of capabilities ... {{(pid=122641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jan 15 20:53:11.236263 ncdv-master-1 cinder-backup[122641]: DEBUG oslo_service.periodic_task [None req-880577f5-cbba-4bc0-b820-8647ffc48ae5 None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=122641) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Jan 15 20:53:11.237450 ncdv-master-1 cinder-backup[122641]: DEBUG cinder.manager [None req-880577f5-cbba-4bc0-b820-8647ffc48ae5 None None] Notifying Schedulers of capabilities ... {{(pid=122641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jan 15 20:54:11.233473 ncdv-master-1 cinder-backup[122641]: DEBUG oslo_service.periodic_task [None req-880577f5-cbba-4bc0-b820-8647ffc48ae5 None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=122641) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Jan 15 20:54:11.234095 ncdv-master-1 cinder-backup[122641]: DEBUG cinder.manager [None req-880577f5-cbba-4bc0-b820-8647ffc48ae5 None None] Notifying Schedulers of capabilities ... {{(pid=122641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jan 15 20:55:11.232310 ncdv-master-1 cinder-backup[122641]: DEBUG oslo_service.periodic_task [None req-880577f5-cbba-4bc0-b820-8647ffc48ae5 None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=122641) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Jan 15 20:55:11.233855 ncdv-master-1 cinder-backup[122641]: DEBUG cinder.manager [None req-880577f5-cbba-4bc0-b820-8647ffc48ae5 None None] Notifying Schedulers of capabilities ... {{(pid=122641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jan 15 20:56:11.229932 ncdv-master-1 cinder-backup[122641]: DEBUG oslo_service.periodic_task [None req-880577f5-cbba-4bc0-b820-8647ffc48ae5 None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=122641) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Jan 15 20:56:11.230813 ncdv-master-1 cinder-backup[122641]: DEBUG cinder.manager [None req-880577f5-cbba-4bc0-b820-8647ffc48ae5 None None] Notifying Schedulers of capabilities ... {{(pid=122641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jan 15 20:57:11.226253 ncdv-master-1 cinder-backup[122641]: DEBUG oslo_service.periodic_task [None req-880577f5-cbba-4bc0-b820-8647ffc48ae5 None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=122641) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Jan 15 20:57:11.226845 ncdv-master-1 cinder-backup[122641]: DEBUG cinder.manager [None req-880577f5-cbba-4bc0-b820-8647ffc48ae5 None None] Notifying Schedulers of capabilities ... {{(pid=122641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jan 15 20:58:11.229450 ncdv-master-1 cinder-backup[122641]: DEBUG oslo_service.periodic_task [None req-880577f5-cbba-4bc0-b820-8647ffc48ae5 None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=122641) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Jan 15 20:58:11.230631 ncdv-master-1 cinder-backup[122641]: DEBUG cinder.manager [None req-880577f5-cbba-4bc0-b820-8647ffc48ae5 None None] Notifying Schedulers of capabilities ... {{(pid=122641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jan 15 20:59:11.227463 ncdv-master-1 cinder-backup[122641]: DEBUG oslo_service.periodic_task [None req-880577f5-cbba-4bc0-b820-8647ffc48ae5 None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=122641) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Jan 15 20:59:11.228533 ncdv-master-1 cinder-backup[122641]: DEBUG cinder.manager [None req-880577f5-cbba-4bc0-b820-8647ffc48ae5 None None] Notifying Schedulers of capabilities ... {{(pid=122641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jan 15 21:00:11.233423 ncdv-master-1 cinder-backup[122641]: DEBUG oslo_service.periodic_task [None req-880577f5-cbba-4bc0-b820-8647ffc48ae5 None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=122641) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Jan 15 21:00:11.234079 ncdv-master-1 cinder-backup[122641]: DEBUG cinder.manager [None req-880577f5-cbba-4bc0-b820-8647ffc48ae5 None None] Notifying Schedulers of capabilities ... {{(pid=122641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jan 15 21:01:11.234206 ncdv-master-1 cinder-backup[122641]: DEBUG oslo_service.periodic_task [None req-880577f5-cbba-4bc0-b820-8647ffc48ae5 None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=122641) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Jan 15 21:01:11.236815 ncdv-master-1 cinder-backup[122641]: DEBUG cinder.manager [None req-880577f5-cbba-4bc0-b820-8647ffc48ae5 None None] Notifying Schedulers of capabilities ... {{(pid=122641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jan 15 21:02:11.236662 ncdv-master-1 cinder-backup[122641]: DEBUG oslo_service.periodic_task [None req-880577f5-cbba-4bc0-b820-8647ffc48ae5 None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=122641) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Jan 15 21:02:11.236662 ncdv-master-1 cinder-backup[122641]: DEBUG cinder.manager [None req-880577f5-cbba-4bc0-b820-8647ffc48ae5 None None] Notifying Schedulers of capabilities ... {{(pid=122641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jan 15 21:03:11.232645 ncdv-master-1 cinder-backup[122641]: DEBUG oslo_service.periodic_task [None req-880577f5-cbba-4bc0-b820-8647ffc48ae5 None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=122641) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Jan 15 21:03:11.233910 ncdv-master-1 cinder-backup[122641]: DEBUG cinder.manager [None req-880577f5-cbba-4bc0-b820-8647ffc48ae5 None None] Notifying Schedulers of capabilities ... {{(pid=122641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jan 15 21:04:11.232701 ncdv-master-1 cinder-backup[122641]: DEBUG oslo_service.periodic_task [None req-880577f5-cbba-4bc0-b820-8647ffc48ae5 None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=122641) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Jan 15 21:04:11.233349 ncdv-master-1 cinder-backup[122641]: DEBUG cinder.manager [None req-880577f5-cbba-4bc0-b820-8647ffc48ae5 None None] Notifying Schedulers of capabilities ... {{(pid=122641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jan 15 21:05:11.232018 ncdv-master-1 cinder-backup[122641]: DEBUG oslo_service.periodic_task [None req-880577f5-cbba-4bc0-b820-8647ffc48ae5 None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=122641) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Jan 15 21:05:11.233058 ncdv-master-1 cinder-backup[122641]: DEBUG cinder.manager [None req-880577f5-cbba-4bc0-b820-8647ffc48ae5 None None] Notifying Schedulers of capabilities ... {{(pid=122641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jan 15 21:06:11.229162 ncdv-master-1 cinder-backup[122641]: DEBUG oslo_service.periodic_task [None req-880577f5-cbba-4bc0-b820-8647ffc48ae5 None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=122641) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Jan 15 21:06:11.229868 ncdv-master-1 cinder-backup[122641]: DEBUG cinder.manager [None req-880577f5-cbba-4bc0-b820-8647ffc48ae5 None None] Notifying Schedulers of capabilities ... {{(pid=122641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jan 15 21:06:18.489622 ncdv-master-1 cinder-backup[122641]: INFO cinder.backup.manager [None req-23a160c1-b802-47bd-91b9-ed7b599a9976 tempest-VolumesBackupsAdminTest-678024116 None] Create backup started, backup: 98d8d09d-e78c-4488-9025-62f226b85792 volume: e5de2672-7637-4bb0-9bdd-119ea1ef7019.
Jan 15 21:06:18.503190 ncdv-master-1 cinder-backup[122641]: DEBUG os_brick.utils [None req-23a160c1-b802-47bd-91b9-ed7b599a9976 tempest-VolumesBackupsAdminTest-678024116 None] ==> get_connector_properties: call "{'root_helper': 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf', 'my_ip': '10.222.0.46', 'multipath': False, 'enforce_multipath': False, 'host': None, 'execute': None}" {{(pid=122641) trace_logging_wrapper /usr/local/lib/python3.8/dist-packages/os_brick/utils.py:157}}
Jan 15 21:06:18.507308 ncdv-master-1 cinder-backup[122641]: INFO oslo.privsep.daemon [None req-23a160c1-b802-47bd-91b9-ed7b599a9976 tempest-VolumesBackupsAdminTest-678024116 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'os_brick.privileged.default', '--privsep_sock_path', '/tmp/tmp16hmsb4h/privsep.sock']
Jan 15 21:06:18.760175 ncdv-master-1 sudo[147251]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context os_brick.privileged.default --privsep_sock_path /tmp/tmp16hmsb4h/privsep.sock
Jan 15 21:06:18.865127 ncdv-master-1 sudo[147251]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 15 21:06:23.293486 ncdv-master-1 sudo[147251]: pam_unix(sudo:session): session closed for user root
Jan 15 21:06:23.297921 ncdv-master-1 cinder-backup[122641]: INFO oslo.privsep.daemon [None req-23a160c1-b802-47bd-91b9-ed7b599a9976 tempest-VolumesBackupsAdminTest-678024116 None] Spawned new privsep daemon via rootwrap
Jan 15 21:06:23.298593 ncdv-master-1 cinder-backup[122641]: DEBUG oslo.privsep.daemon [None req-23a160c1-b802-47bd-91b9-ed7b599a9976 tempest-VolumesBackupsAdminTest-678024116 None] Accepted privsep connection to /tmp/tmp16hmsb4h/privsep.sock {{(pid=122641) __init__ /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:363}}
Jan 15 21:06:23.300074 ncdv-master-1 cinder-backup[122641]: INFO oslo.privsep.daemon [-] privsep daemon starting
Jan 15 21:06:23.300406 ncdv-master-1 cinder-backup[122641]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Jan 15 21:06:23.300755 ncdv-master-1 cinder-backup[122641]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_SYS_ADMIN/CAP_SYS_ADMIN/none
Jan 15 21:06:23.301111 ncdv-master-1 cinder-backup[122641]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 147257
Jan 15 21:06:23.302762 ncdv-master-1 cinder-backup[122641]: DEBUG oslo.privsep.daemon [-] privsep: reply[d62653d4-b925-4e2b-a697-4624cf87d573]: (2,) {{(pid=147257) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:502}}
Jan 15 21:06:23.639243 ncdv-master-1 cinder-backup[122641]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=147257) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 15 21:06:23.660945 ncdv-master-1 cinder-backup[122641]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.022s {{(pid=147257) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Jan 15 21:06:23.661284 ncdv-master-1 cinder-backup[122641]: DEBUG oslo.privsep.daemon [-] privsep: reply[aeb87b92-792c-4bfd-ab0b-d761d6914283]: (4, ('## DO NOT EDIT OR REMOVE THIS FILE!\n## If you remove this file, the iSCSI daemon will not start.\n## If you change the InitiatorName, existing access control lists\n## may reject this initiator.  The InitiatorName must be unique\n## for each iSCSI initiator.  Do NOT duplicate iSCSI InitiatorNames.\nInitiatorName=iqn.1993-08.org.debian:01:b3cf3389e31a\n', '')) {{(pid=147257) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:502}}
Jan 15 21:06:23.663161 ncdv-master-1 cinder-backup[122641]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): systool -c fc_host -v {{(pid=147257) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 15 21:06:23.671483 ncdv-master-1 cinder-backup[122641]: DEBUG oslo_concurrency.processutils [-] 'systool -c fc_host -v' failed. Not Retrying. {{(pid=147257) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:473}}
Jan 15 21:06:23.698442 ncdv-master-1 cinder-backup[122641]: DEBUG oslo.privsep.daemon [-] privsep: Exception during request[7a45b3d0-8823-4bef-aff8-f7ae267248ad]: [Errno 2] No such file or directory: 'systool' {{(pid=147257) _process_cmd /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:480}}
Jan 15 21:06:23.698442 ncdv-master-1 cinder-backup[122641]: Traceback (most recent call last):
Jan 15 21:06:23.698442 ncdv-master-1 cinder-backup[122641]:   File "/usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py", line 477, in _process_cmd
Jan 15 21:06:23.698442 ncdv-master-1 cinder-backup[122641]:     ret = func(*f_args, **f_kwargs)
Jan 15 21:06:23.698442 ncdv-master-1 cinder-backup[122641]:   File "/usr/local/lib/python3.8/dist-packages/oslo_privsep/priv_context.py", line 274, in _wrap
Jan 15 21:06:23.698442 ncdv-master-1 cinder-backup[122641]:     return func(*args, **kwargs)
Jan 15 21:06:23.698442 ncdv-master-1 cinder-backup[122641]:   File "/usr/local/lib/python3.8/dist-packages/os_brick/privileged/rootwrap.py", line 197, in execute_root
Jan 15 21:06:23.698442 ncdv-master-1 cinder-backup[122641]:     return custom_execute(*cmd, shell=False, run_as_root=False, **kwargs)
Jan 15 21:06:23.698442 ncdv-master-1 cinder-backup[122641]:   File "/usr/local/lib/python3.8/dist-packages/os_brick/privileged/rootwrap.py", line 145, in custom_execute
Jan 15 21:06:23.698442 ncdv-master-1 cinder-backup[122641]:     return putils.execute(on_execute=on_execute,
Jan 15 21:06:23.698442 ncdv-master-1 cinder-backup[122641]:   File "/usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py", line 395, in execute
Jan 15 21:06:23.698442 ncdv-master-1 cinder-backup[122641]:     obj = subprocess.Popen(cmd,
Jan 15 21:06:23.698442 ncdv-master-1 cinder-backup[122641]:   File "/usr/lib/python3.8/subprocess.py", line 858, in __init__
Jan 15 21:06:23.698442 ncdv-master-1 cinder-backup[122641]:     self._execute_child(args, executable, preexec_fn, close_fds,
Jan 15 21:06:23.698442 ncdv-master-1 cinder-backup[122641]:   File "/usr/lib/python3.8/subprocess.py", line 1704, in _execute_child
Jan 15 21:06:23.698442 ncdv-master-1 cinder-backup[122641]:     raise child_exception_type(errno_num, err_msg, err_filename)
Jan 15 21:06:23.698442 ncdv-master-1 cinder-backup[122641]: FileNotFoundError: [Errno 2] No such file or directory: 'systool'
Jan 15 21:06:23.700008 ncdv-master-1 cinder-backup[122641]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a45b3d0-8823-4bef-aff8-f7ae267248ad]: (5, 'builtins.FileNotFoundError', (2, 'No such file or directory')) {{(pid=147257) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:502}}
Jan 15 21:06:23.700891 ncdv-master-1 cinder-backup[122641]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): systool -c fc_host -v {{(pid=147257) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 15 21:06:23.708458 ncdv-master-1 cinder-backup[122641]: DEBUG oslo_concurrency.processutils [-] 'systool -c fc_host -v' failed. Not Retrying. {{(pid=147257) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:473}}
Jan 15 21:06:23.708939 ncdv-master-1 cinder-backup[122641]: DEBUG oslo.privsep.daemon [-] privsep: Exception during request[b4ccd282-7f59-4923-a4dd-abde64675a52]: [Errno 2] No such file or directory: 'systool' {{(pid=147257) _process_cmd /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:480}}
Jan 15 21:06:23.708939 ncdv-master-1 cinder-backup[122641]: Traceback (most recent call last):
Jan 15 21:06:23.708939 ncdv-master-1 cinder-backup[122641]:   File "/usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py", line 477, in _process_cmd
Jan 15 21:06:23.708939 ncdv-master-1 cinder-backup[122641]:     ret = func(*f_args, **f_kwargs)
Jan 15 21:06:23.708939 ncdv-master-1 cinder-backup[122641]:   File "/usr/local/lib/python3.8/dist-packages/oslo_privsep/priv_context.py", line 274, in _wrap
Jan 15 21:06:23.708939 ncdv-master-1 cinder-backup[122641]:     return func(*args, **kwargs)
Jan 15 21:06:23.708939 ncdv-master-1 cinder-backup[122641]:   File "/usr/local/lib/python3.8/dist-packages/os_brick/privileged/rootwrap.py", line 197, in execute_root
Jan 15 21:06:23.708939 ncdv-master-1 cinder-backup[122641]:     return custom_execute(*cmd, shell=False, run_as_root=False, **kwargs)
Jan 15 21:06:23.708939 ncdv-master-1 cinder-backup[122641]:   File "/usr/local/lib/python3.8/dist-packages/os_brick/privileged/rootwrap.py", line 145, in custom_execute
Jan 15 21:06:23.708939 ncdv-master-1 cinder-backup[122641]:     return putils.execute(on_execute=on_execute,
Jan 15 21:06:23.708939 ncdv-master-1 cinder-backup[122641]:   File "/usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py", line 395, in execute
Jan 15 21:06:23.708939 ncdv-master-1 cinder-backup[122641]:     obj = subprocess.Popen(cmd,
Jan 15 21:06:23.708939 ncdv-master-1 cinder-backup[122641]:   File "/usr/lib/python3.8/subprocess.py", line 858, in __init__
Jan 15 21:06:23.708939 ncdv-master-1 cinder-backup[122641]:     self._execute_child(args, executable, preexec_fn, close_fds,
Jan 15 21:06:23.708939 ncdv-master-1 cinder-backup[122641]:   File "/usr/lib/python3.8/subprocess.py", line 1704, in _execute_child
Jan 15 21:06:23.708939 ncdv-master-1 cinder-backup[122641]:     raise child_exception_type(errno_num, err_msg, err_filename)
Jan 15 21:06:23.708939 ncdv-master-1 cinder-backup[122641]: FileNotFoundError: [Errno 2] No such file or directory: 'systool'
Jan 15 21:06:23.710282 ncdv-master-1 cinder-backup[122641]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4ccd282-7f59-4923-a4dd-abde64675a52]: (5, 'builtins.FileNotFoundError', (2, 'No such file or directory')) {{(pid=147257) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:502}}
Jan 15 21:06:23.712037 ncdv-master-1 cinder-backup[122641]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=147257) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 15 21:06:23.753900 ncdv-master-1 cinder-backup[122641]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.042s {{(pid=147257) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Jan 15 21:06:23.754960 ncdv-master-1 cinder-backup[122641]: DEBUG oslo.privsep.daemon [-] privsep: reply[30436eef-88fc-4781-b2e3-06af218f6a1a]: (4, ('/dev/sda1\n', '')) {{(pid=147257) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:502}}
Jan 15 21:06:23.756190 ncdv-master-1 cinder-backup[122641]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/sda1 -s UUID -o value {{(pid=147257) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 15 21:06:23.817179 ncdv-master-1 cinder-backup[122641]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/sda1 -s UUID -o value" returned: 0 in 0.060s {{(pid=147257) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Jan 15 21:06:23.817588 ncdv-master-1 cinder-backup[122641]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc24c0a4-0b7d-4486-b787-bf1808196c0c]: (4, ('02bb033c-a191-40c0-94fb-bb025c724b13\n', '')) {{(pid=147257) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:502}}
Jan 15 21:06:23.819453 ncdv-master-1 cinder-backup[122641]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /sys/class/dmi/id/product_uuid {{(pid=147257) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 15 21:06:23.838231 ncdv-master-1 cinder-backup[122641]: DEBUG oslo_concurrency.processutils [-] CMD "cat /sys/class/dmi/id/product_uuid" returned: 0 in 0.018s {{(pid=147257) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Jan 15 21:06:23.838988 ncdv-master-1 cinder-backup[122641]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf4325ad-f7d3-4c2f-a431-10294298a4a9]: (4, ('1b06c783-92a7-1942-a345-69784a0224b6\n', '')) {{(pid=147257) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:502}}
Jan 15 21:06:23.840147 ncdv-master-1 cinder-backup[122641]: DEBUG oslo_concurrency.processutils [None req-23a160c1-b802-47bd-91b9-ed7b599a9976 tempest-VolumesBackupsAdminTest-678024116 None] Running cmd (subprocess): nvme version {{(pid=122641) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 15 21:06:23.882997 ncdv-master-1 cinder-backup[122641]: DEBUG oslo_concurrency.processutils [None req-23a160c1-b802-47bd-91b9-ed7b599a9976 tempest-VolumesBackupsAdminTest-678024116 None] CMD "nvme version" returned: 0 in 0.043s {{(pid=122641) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Jan 15 21:06:23.895432 ncdv-master-1 cinder-backup[122641]: DEBUG os_brick.utils [None req-23a160c1-b802-47bd-91b9-ed7b599a9976 tempest-VolumesBackupsAdminTest-678024116 None] <== get_connector_properties: return (5390ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.222.0.46', 'host': 'ncdv-master-1', 'multipath': False, 'initiator': 'iqn.1993-08.org.debian:01:b3cf3389e31a', 'do_local_attach': False, 'uuid': '02bb033c-a191-40c0-94fb-bb025c724b13', 'system uuid': '1b06c783-92a7-1942-a345-69784a0224b6', 'nqn': 'nqn.2014-08.org.nvmexpress:uuid:2f801fe5-9757-4764-9681-7ba5df13a96f'} {{(pid=122641) trace_logging_wrapper /usr/local/lib/python3.8/dist-packages/os_brick/utils.py:184}}
Jan 15 21:06:24.653752 ncdv-master-1 cinder-backup[122641]: DEBUG os_brick.initiator.connector [None req-23a160c1-b802-47bd-91b9-ed7b599a9976 tempest-VolumesBackupsAdminTest-678024116 None] Factory for rbd on None {{(pid=122641) factory /usr/local/lib/python3.8/dist-packages/os_brick/initiator/connector.py:281}}
Jan 15 21:06:24.655926 ncdv-master-1 cinder-backup[122641]: DEBUG os_brick.initiator.connectors.rbd [None req-23a160c1-b802-47bd-91b9-ed7b599a9976 tempest-VolumesBackupsAdminTest-678024116 None] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.rbd.RBDConnector object at 0x7f1b0002f520>, 'connection_properties': {'name': 'volumes/volume-e5de2672-7637-4bb0-9bdd-119ea1ef7019', 'hosts': ['10.222.0.46'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '***', 'volume_id': 'e5de2672-7637-4bb0-9bdd-119ea1ef7019', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}}" {{(pid=122641) trace_logging_wrapper /usr/local/lib/python3.8/dist-packages/os_brick/utils.py:157}}
Jan 15 21:06:24.657449 ncdv-master-1 cinder-backup[122641]: DEBUG os_brick.initiator.linuxrbd [None req-23a160c1-b802-47bd-91b9-ed7b599a9976 tempest-VolumesBackupsAdminTest-678024116 None] opening connection to ceph cluster (timeout=-1). {{(pid=122641) connect /usr/local/lib/python3.8/dist-packages/os_brick/initiator/linuxrbd.py:70}}
Jan 15 21:06:24.720360 ncdv-master-1 cinder-backup[122641]: DEBUG os_brick.initiator.connectors.rbd [None req-23a160c1-b802-47bd-91b9-ed7b599a9976 tempest-VolumesBackupsAdminTest-678024116 None] <== connect_volume: return (63ms) {'path': <os_brick.initiator.linuxrbd.RBDVolumeIOWrapper object at 0x7f1af4760280>} {{(pid=122641) trace_logging_wrapper /usr/local/lib/python3.8/dist-packages/os_brick/utils.py:184}}
Jan 15 21:06:24.728619 ncdv-master-1 cinder-backup[122641]: DEBUG oslo_db.sqlalchemy.engines [None req-23a160c1-b802-47bd-91b9-ed7b599a9976 tempest-VolumesBackupsAdminTest-678024116 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122641) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}}
Jan 15 21:06:24.748818 ncdv-master-1 cinder-backup[122641]: DEBUG cinder.backup.drivers.ceph [None req-23a160c1-b802-47bd-91b9-ed7b599a9976 tempest-VolumesBackupsAdminTest-678024116 None] Starting backup of volume='e5de2672-7637-4bb0-9bdd-119ea1ef7019'. {{(pid=122641) backup /opt/stack/cinder/cinder/backup/drivers/ceph.py:974}}
Jan 15 21:06:24.749774 ncdv-master-1 cinder-backup[122641]: DEBUG cinder.backup.drivers.ceph [None req-23a160c1-b802-47bd-91b9-ed7b599a9976 tempest-VolumesBackupsAdminTest-678024116 None] Volume file is RBD: attempting optimized backup {{(pid=122641) backup /opt/stack/cinder/cinder/backup/drivers/ceph.py:985}}
Jan 15 21:06:24.777682 ncdv-master-1 cinder-backup[122641]: DEBUG cinder.backup.drivers.ceph [None req-23a160c1-b802-47bd-91b9-ed7b599a9976 tempest-VolumesBackupsAdminTest-678024116 None] Creating base image 'volume-e5de2672-7637-4bb0-9bdd-119ea1ef7019.backup.98d8d09d-e78c-4488-9025-62f226b85792' {{(pid=122641) _create_base_image /opt/stack/cinder/cinder/backup/drivers/ceph.py:444}}
Jan 15 21:06:24.778194 ncdv-master-1 cinder-backup[122641]: DEBUG cinder.backup.drivers.ceph [None req-23a160c1-b802-47bd-91b9-ed7b599a9976 tempest-VolumesBackupsAdminTest-678024116 None] RBD also supports fast-diff, enabling it together with exclusive-lock and object-map {{(pid=122641) _get_rbd_support /opt/stack/cinder/cinder/backup/drivers/ceph.py:272}}
Jan 15 21:06:26.243436 ncdv-master-1 cinder-backup[122641]: DEBUG cinder.backup.drivers.ceph [None req-23a160c1-b802-47bd-91b9-ed7b599a9976 tempest-VolumesBackupsAdminTest-678024116 None] Using --from-snap 'None' for incremental backup of volume e5de2672-7637-4bb0-9bdd-119ea1ef7019. {{(pid=122641) _backup_rbd /opt/stack/cinder/cinder/backup/drivers/ceph.py:764}}
Jan 15 21:06:26.244112 ncdv-master-1 cinder-backup[122641]: DEBUG cinder.backup.drivers.ceph [None req-23a160c1-b802-47bd-91b9-ed7b599a9976 tempest-VolumesBackupsAdminTest-678024116 None] Creating backup snapshot='backup.98d8d09d-e78c-4488-9025-62f226b85792.snap.1642280786.2434547' {{(pid=122641) _backup_rbd /opt/stack/cinder/cinder/backup/drivers/ceph.py:770}}
Jan 15 21:06:27.222208 ncdv-master-1 cinder-backup[122641]: DEBUG cinder.backup.drivers.ceph [None req-23a160c1-b802-47bd-91b9-ed7b599a9976 tempest-VolumesBackupsAdminTest-678024116 None] Performing differential transfer from 'volume-e5de2672-7637-4bb0-9bdd-119ea1ef7019' to 'volume-e5de2672-7637-4bb0-9bdd-119ea1ef7019.backup.98d8d09d-e78c-4488-9025-62f226b85792' {{(pid=122641) _rbd_diff_transfer /opt/stack/cinder/cinder/backup/drivers/ceph.py:624}}
Jan 15 21:06:27.223026 ncdv-master-1 cinder-backup[122641]: DEBUG cinder.backup.drivers.ceph [None req-23a160c1-b802-47bd-91b9-ed7b599a9976 tempest-VolumesBackupsAdminTest-678024116 None] Piping cmd1='rbd export-diff --id cinder --conf /tmp/brickrbd__29aet3k --pool volumes volumes/volume-e5de2672-7637-4bb0-9bdd-119ea1ef7019@backup.98d8d09d-e78c-4488-9025-62f226b85792.snap.1642280786.2434547 -' into... {{(pid=122641) _piped_execute /opt/stack/cinder/cinder/backup/drivers/ceph.py:585}}
Jan 15 21:06:27.223409 ncdv-master-1 cinder-backup[122641]: DEBUG cinder.backup.drivers.ceph [None req-23a160c1-b802-47bd-91b9-ed7b599a9976 tempest-VolumesBackupsAdminTest-678024116 None] cmd2='rbd import-diff --id cinder-bak --conf /etc/ceph/ceph.conf --pool backups - backups/volume-e5de2672-7637-4bb0-9bdd-119ea1ef7019.backup.98d8d09d-e78c-4488-9025-62f226b85792' {{(pid=122641) _piped_execute /opt/stack/cinder/cinder/backup/drivers/ceph.py:586}}
Jan 15 21:06:28.280321 ncdv-master-1 cinder-backup[122641]: DEBUG cinder.backup.drivers.ceph [None req-23a160c1-b802-47bd-91b9-ed7b599a9976 tempest-VolumesBackupsAdminTest-678024116 None] Differential backup transfer completed in 1.0567s {{(pid=122641) _backup_rbd /opt/stack/cinder/cinder/backup/drivers/ceph.py:790}}
Jan 15 21:06:28.282009 ncdv-master-1 cinder-backup[122641]: DEBUG cinder.backup.driver [None req-23a160c1-b802-47bd-91b9-ed7b599a9976 tempest-VolumesBackupsAdminTest-678024116 None] Getting metadata type 'volume-base-metadata' {{(pid=122641) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:79}}
Jan 15 21:06:28.308003 ncdv-master-1 cinder-backup[122641]: DEBUG cinder.backup.driver [None req-23a160c1-b802-47bd-91b9-ed7b599a9976 tempest-VolumesBackupsAdminTest-678024116 None] Completed fetching metadata type 'volume-base-metadata' {{(pid=122641) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:98}}
Jan 15 21:06:28.313561 ncdv-master-1 cinder-backup[122641]: DEBUG cinder.backup.driver [None req-23a160c1-b802-47bd-91b9-ed7b599a9976 tempest-VolumesBackupsAdminTest-678024116 None] Getting metadata type 'volume-metadata' {{(pid=122641) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:109}}
Jan 15 21:06:28.336111 ncdv-master-1 cinder-backup[122641]: DEBUG cinder.backup.driver [None req-23a160c1-b802-47bd-91b9-ed7b599a9976 tempest-VolumesBackupsAdminTest-678024116 None] No metadata type 'volume-metadata' available {{(pid=122641) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:123}}
Jan 15 21:06:28.337096 ncdv-master-1 cinder-backup[122641]: DEBUG cinder.backup.driver [None req-23a160c1-b802-47bd-91b9-ed7b599a9976 tempest-VolumesBackupsAdminTest-678024116 None] Getting metadata type 'volume-glance-metadata' {{(pid=122641) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:132}}
Jan 15 21:06:28.350167 ncdv-master-1 cinder-backup[122641]: DEBUG cinder.backup.driver [None req-23a160c1-b802-47bd-91b9-ed7b599a9976 tempest-VolumesBackupsAdminTest-678024116 None] No metadata type 'volume-glance-metadata' available {{(pid=122641) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:147}}
Jan 15 21:06:28.351004 ncdv-master-1 cinder-backup[122641]: DEBUG cinder.backup.drivers.ceph [None req-23a160c1-b802-47bd-91b9-ed7b599a9976 tempest-VolumesBackupsAdminTest-678024116 None] Backing up metadata for volume e5de2672-7637-4bb0-9bdd-119ea1ef7019. {{(pid=122641) _backup_metadata /opt/stack/cinder/cinder/backup/drivers/ceph.py:951}}
Jan 15 21:06:28.447551 ncdv-master-1 cinder-backup[122641]: DEBUG cinder.backup.drivers.ceph [None req-23a160c1-b802-47bd-91b9-ed7b599a9976 tempest-VolumesBackupsAdminTest-678024116 None] Backup '98d8d09d-e78c-4488-9025-62f226b85792' of volume e5de2672-7637-4bb0-9bdd-119ea1ef7019 finished. {{(pid=122641) backup /opt/stack/cinder/cinder/backup/drivers/ceph.py:1015}}
Jan 15 21:06:28.449484 ncdv-master-1 cinder-backup[122641]: DEBUG os_brick.initiator.connectors.rbd [None req-23a160c1-b802-47bd-91b9-ed7b599a9976 tempest-VolumesBackupsAdminTest-678024116 None] ==> disconnect_volume: call "{'self': <os_brick.initiator.connectors.rbd.RBDConnector object at 0x7f1b0002f520>, 'connection_properties': {'name': 'volumes/volume-e5de2672-7637-4bb0-9bdd-119ea1ef7019', 'hosts': ['10.222.0.46'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '***', 'volume_id': 'e5de2672-7637-4bb0-9bdd-119ea1ef7019', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'device_info': {'path': <os_brick.initiator.linuxrbd.RBDVolumeIOWrapper object at 0x7f1af4760280>}, 'force': True, 'ignore_errors': True}" {{(pid=122641) trace_logging_wrapper /usr/local/lib/python3.8/dist-packages/os_brick/utils.py:157}}
Jan 15 21:06:28.492661 ncdv-master-1 cinder-backup[122641]: DEBUG os_brick.initiator.connectors.rbd [None req-23a160c1-b802-47bd-91b9-ed7b599a9976 tempest-VolumesBackupsAdminTest-678024116 None] <== disconnect_volume: return (41ms) None {{(pid=122641) trace_logging_wrapper /usr/local/lib/python3.8/dist-packages/os_brick/utils.py:184}}
Jan 15 21:06:28.585464 ncdv-master-1 cinder-backup[122641]: INFO cinder.backup.manager [None req-23a160c1-b802-47bd-91b9-ed7b599a9976 tempest-VolumesBackupsAdminTest-678024116 None] Create backup finished. backup: 98d8d09d-e78c-4488-9025-62f226b85792.
Jan 15 21:06:29.192632 ncdv-master-1 cinder-backup[122641]: INFO cinder.backup.manager [None req-9e9bd547-e7c4-4325-b461-263bca00858f tempest-VolumesBackupsAdminTest-1232056558 None] Export record started, backup: 98d8d09d-e78c-4488-9025-62f226b85792.
Jan 15 21:06:29.197606 ncdv-master-1 cinder-backup[122641]: INFO cinder.backup.manager [None req-9e9bd547-e7c4-4325-b461-263bca00858f tempest-VolumesBackupsAdminTest-1232056558 None] Export record finished, backup 98d8d09d-e78c-4488-9025-62f226b85792 exported.
Jan 15 21:06:29.407951 ncdv-master-1 cinder-backup[122641]: INFO cinder.backup.manager [None req-132612f2-8b19-404f-80e6-d3d8c754150a tempest-VolumesBackupsAdminTest-1232056558 None] Import record started, backup_url: eyJkcml2ZXJfaW5mbyI6IHt9LCAiaWQiOiAiOTAyYjM4YjUtMDczZi00OTcwLWFhYTQtZDNlMjQzMjkxMDIyIiwgInVzZXJfaWQiOiAiMzM0MDIyMDZjNjNjNDM0YjlhNmU0YWZmYTdkYjFhZTYiLCAicHJvamVjdF9pZCI6ICIxMTFmZTFiOTRhNzA0ZDhhODZmOTk0NjA4NjVkODkxYSIsICJ2b2x1bWVfaWQiOiAiZTVkZTI2NzItNzYzNy00YmIwLTliZGQtMTE5ZWExZWY3MDE5IiwgImhvc3QiOiAibmNkdi1tYXN0ZXItMSIsICJhdmFpbGFiaWxpdHlfem9uZSI6IG51bGwsICJjb250YWluZXIiOiAiYmFja3VwcyIsICJwYXJlbnRfaWQiOiBudWxsLCAic3RhdHVzIjogImF2YWlsYWJsZSIsICJmYWlsX3JlYXNvbiI6IG51bGwsICJzaXplIjogMSwgImRpc3BsYXlfbmFtZSI6ICJ0ZW1wZXN0LVZvbHVtZXNCYWNrdXBzQWRtaW5UZXN0LUJhY2t1cC0xMTAxOTUzOTUzIiwgImRpc3BsYXlfZGVzY3JpcHRpb24iOiBudWxsLCAic2VydmljZV9tZXRhZGF0YSI6ICJ7XCJiYXNlXCI6IFwidm9sdW1lLWU1ZGUyNjcyLTc2MzctNGJiMC05YmRkLTExOWVhMWVmNzAxOS5iYWNrdXAuOThkOGQwOWQtZTc4Yy00NDg4LTkwMjUtNjJmMjI2Yjg1NzkyXCJ9IiwgInNlcnZpY2UiOiAiY2luZGVyLmJhY2t1cC5kcml2ZXJzLmNlcGguQ2VwaEJhY2t1cERyaXZlciIsICJvYmplY3RfY291bnQiOiAwLCAidGVtcF92b2x1bWVfaWQiOiBudWxsLCAidGVtcF9zbmFwc2hvdF9pZCI6IG51bGwsICJudW1fZGVwZW5kZW50X2JhY2t1cHMiOiAwLCAic25hcHNob3RfaWQiOiBudWxsLCAiZGF0YV90aW1lc3RhbXAiOiAiMjAyMi0wMS0xNVQyMTowNjoxOFoiLCAicmVzdG9yZV92b2x1bWVfaWQiOiBudWxsLCAibWV0YWRhdGEiOiB7fSwgImVuY3J5cHRpb25fa2V5X2lkIjogbnVsbCwgImNyZWF0ZWRfYXQiOiAiMjAyMi0wMS0xNVQyMTowNjoxOFoiLCAidXBkYXRlZF9hdCI6ICIyMDIyLTAxLTE1VDIxOjA2OjI5WiIsICJkZWxldGVkX2F0IjogbnVsbCwgImRlbGV0ZWQiOiBmYWxzZX0=.
Jan 15 21:06:29.418140 ncdv-master-1 cinder-backup[122641]: DEBUG oslo_db.sqlalchemy.engines [None req-132612f2-8b19-404f-80e6-d3d8c754150a tempest-VolumesBackupsAdminTest-1232056558 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122641) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}}
Jan 15 21:06:29.488241 ncdv-master-1 cinder-backup[122641]: INFO cinder.backup.manager [None req-132612f2-8b19-404f-80e6-d3d8c754150a tempest-VolumesBackupsAdminTest-1232056558 None] Import record id 902b38b5-073f-4970-aaa4-d3e243291022 metadata from driver finished.
Jan 15 21:06:32.010808 ncdv-master-1 cinder-backup[122641]: INFO cinder.backup.manager [None req-428e14d4-145f-41a7-9911-9a1e71650bf9 tempest-VolumesBackupsAdminTest-678024116 None] Restore backup started, backup: 98d8d09d-e78c-4488-9025-62f226b85792 volume: abd3a57e-51e6-4369-840b-787555ee0c83.
Jan 15 21:06:32.035754 ncdv-master-1 cinder-backup[122641]: DEBUG os_brick.utils [None req-428e14d4-145f-41a7-9911-9a1e71650bf9 tempest-VolumesBackupsAdminTest-678024116 None] ==> get_connector_properties: call "{'root_helper': 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf', 'my_ip': '10.222.0.46', 'multipath': False, 'enforce_multipath': False, 'host': None, 'execute': None}" {{(pid=122641) trace_logging_wrapper /usr/local/lib/python3.8/dist-packages/os_brick/utils.py:157}}
Jan 15 21:06:32.040147 ncdv-master-1 cinder-backup[122641]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=147257) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 15 21:06:32.050468 ncdv-master-1 cinder-backup[122641]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=147257) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Jan 15 21:06:32.051285 ncdv-master-1 cinder-backup[122641]: DEBUG oslo.privsep.daemon [-] privsep: reply[a78fde9d-2ae1-4328-91fe-e0241dcb0dcf]: (4, ('## DO NOT EDIT OR REMOVE THIS FILE!\n## If you remove this file, the iSCSI daemon will not start.\n## If you change the InitiatorName, existing access control lists\n## may reject this initiator.  The InitiatorName must be unique\n## for each iSCSI initiator.  Do NOT duplicate iSCSI InitiatorNames.\nInitiatorName=iqn.1993-08.org.debian:01:b3cf3389e31a\n', '')) {{(pid=147257) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:502}}
Jan 15 21:06:32.055442 ncdv-master-1 cinder-backup[122641]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): systool -c fc_host -v {{(pid=147257) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 15 21:06:32.067032 ncdv-master-1 cinder-backup[122641]: DEBUG oslo_concurrency.processutils [-] 'systool -c fc_host -v' failed. Not Retrying. {{(pid=147257) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:473}}
Jan 15 21:06:32.071904 ncdv-master-1 cinder-backup[122641]: DEBUG oslo.privsep.daemon [-] privsep: Exception during request[61eec0d1-de39-45c3-ad79-377e6b90df00]: [Errno 2] No such file or directory: 'systool' {{(pid=147257) _process_cmd /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:480}}
Jan 15 21:06:32.071904 ncdv-master-1 cinder-backup[122641]: Traceback (most recent call last):
Jan 15 21:06:32.071904 ncdv-master-1 cinder-backup[122641]:   File "/usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py", line 477, in _process_cmd
Jan 15 21:06:32.071904 ncdv-master-1 cinder-backup[122641]:     ret = func(*f_args, **f_kwargs)
Jan 15 21:06:32.071904 ncdv-master-1 cinder-backup[122641]:   File "/usr/local/lib/python3.8/dist-packages/oslo_privsep/priv_context.py", line 274, in _wrap
Jan 15 21:06:32.071904 ncdv-master-1 cinder-backup[122641]:     return func(*args, **kwargs)
Jan 15 21:06:32.071904 ncdv-master-1 cinder-backup[122641]:   File "/usr/local/lib/python3.8/dist-packages/os_brick/privileged/rootwrap.py", line 197, in execute_root
Jan 15 21:06:32.071904 ncdv-master-1 cinder-backup[122641]:     return custom_execute(*cmd, shell=False, run_as_root=False, **kwargs)
Jan 15 21:06:32.071904 ncdv-master-1 cinder-backup[122641]:   File "/usr/local/lib/python3.8/dist-packages/os_brick/privileged/rootwrap.py", line 145, in custom_execute
Jan 15 21:06:32.071904 ncdv-master-1 cinder-backup[122641]:     return putils.execute(on_execute=on_execute,
Jan 15 21:06:32.071904 ncdv-master-1 cinder-backup[122641]:   File "/usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py", line 395, in execute
Jan 15 21:06:32.071904 ncdv-master-1 cinder-backup[122641]:     obj = subprocess.Popen(cmd,
Jan 15 21:06:32.071904 ncdv-master-1 cinder-backup[122641]:   File "/usr/lib/python3.8/subprocess.py", line 858, in __init__
Jan 15 21:06:32.071904 ncdv-master-1 cinder-backup[122641]:     self._execute_child(args, executable, preexec_fn, close_fds,
Jan 15 21:06:32.071904 ncdv-master-1 cinder-backup[122641]:   File "/usr/lib/python3.8/subprocess.py", line 1704, in _execute_child
Jan 15 21:06:32.071904 ncdv-master-1 cinder-backup[122641]:     raise child_exception_type(errno_num, err_msg, err_filename)
Jan 15 21:06:32.071904 ncdv-master-1 cinder-backup[122641]: FileNotFoundError: [Errno 2] No such file or directory: 'systool'
Jan 15 21:06:32.073912 ncdv-master-1 cinder-backup[122641]: DEBUG oslo.privsep.daemon [-] privsep: reply[61eec0d1-de39-45c3-ad79-377e6b90df00]: (5, 'builtins.FileNotFoundError', (2, 'No such file or directory')) {{(pid=147257) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:502}}
Jan 15 21:06:32.075335 ncdv-master-1 cinder-backup[122641]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): systool -c fc_host -v {{(pid=147257) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 15 21:06:32.085220 ncdv-master-1 cinder-backup[122641]: DEBUG oslo_concurrency.processutils [-] 'systool -c fc_host -v' failed. Not Retrying. {{(pid=147257) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:473}}
Jan 15 21:06:32.086050 ncdv-master-1 cinder-backup[122641]: DEBUG oslo.privsep.daemon [-] privsep: Exception during request[093dc1f4-6dae-42d9-a7b0-d4f42c262a90]: [Errno 2] No such file or directory: 'systool' {{(pid=147257) _process_cmd /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:480}}
Jan 15 21:06:32.086050 ncdv-master-1 cinder-backup[122641]: Traceback (most recent call last):
Jan 15 21:06:32.086050 ncdv-master-1 cinder-backup[122641]:   File "/usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py", line 477, in _process_cmd
Jan 15 21:06:32.086050 ncdv-master-1 cinder-backup[122641]:     ret = func(*f_args, **f_kwargs)
Jan 15 21:06:32.086050 ncdv-master-1 cinder-backup[122641]:   File "/usr/local/lib/python3.8/dist-packages/oslo_privsep/priv_context.py", line 274, in _wrap
Jan 15 21:06:32.086050 ncdv-master-1 cinder-backup[122641]:     return func(*args, **kwargs)
Jan 15 21:06:32.086050 ncdv-master-1 cinder-backup[122641]:   File "/usr/local/lib/python3.8/dist-packages/os_brick/privileged/rootwrap.py", line 197, in execute_root
Jan 15 21:06:32.086050 ncdv-master-1 cinder-backup[122641]:     return custom_execute(*cmd, shell=False, run_as_root=False, **kwargs)
Jan 15 21:06:32.086050 ncdv-master-1 cinder-backup[122641]:   File "/usr/local/lib/python3.8/dist-packages/os_brick/privileged/rootwrap.py", line 145, in custom_execute
Jan 15 21:06:32.086050 ncdv-master-1 cinder-backup[122641]:     return putils.execute(on_execute=on_execute,
Jan 15 21:06:32.086050 ncdv-master-1 cinder-backup[122641]:   File "/usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py", line 395, in execute
Jan 15 21:06:32.086050 ncdv-master-1 cinder-backup[122641]:     obj = subprocess.Popen(cmd,
Jan 15 21:06:32.086050 ncdv-master-1 cinder-backup[122641]:   File "/usr/lib/python3.8/subprocess.py", line 858, in __init__
Jan 15 21:06:32.086050 ncdv-master-1 cinder-backup[122641]:     self._execute_child(args, executable, preexec_fn, close_fds,
Jan 15 21:06:32.086050 ncdv-master-1 cinder-backup[122641]:   File "/usr/lib/python3.8/subprocess.py", line 1704, in _execute_child
Jan 15 21:06:32.086050 ncdv-master-1 cinder-backup[122641]:     raise child_exception_type(errno_num, err_msg, err_filename)
Jan 15 21:06:32.086050 ncdv-master-1 cinder-backup[122641]: FileNotFoundError: [Errno 2] No such file or directory: 'systool'
Jan 15 21:06:32.093342 ncdv-master-1 cinder-backup[122641]: DEBUG oslo.privsep.daemon [-] privsep: reply[093dc1f4-6dae-42d9-a7b0-d4f42c262a90]: (5, 'builtins.FileNotFoundError', (2, 'No such file or directory')) {{(pid=147257) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:502}}
Jan 15 21:06:32.096384 ncdv-master-1 cinder-backup[122641]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=147257) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 15 21:06:32.118887 ncdv-master-1 cinder-backup[122641]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.022s {{(pid=147257) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Jan 15 21:06:32.119546 ncdv-master-1 cinder-backup[122641]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9b59dee-a836-43a5-a03f-fb944406ecbe]: (4, ('/dev/sda1\n', '')) {{(pid=147257) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:502}}
Jan 15 21:06:32.121778 ncdv-master-1 cinder-backup[122641]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/sda1 -s UUID -o value {{(pid=147257) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 15 21:06:32.133114 ncdv-master-1 cinder-backup[122641]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/sda1 -s UUID -o value" returned: 0 in 0.010s {{(pid=147257) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Jan 15 21:06:32.133826 ncdv-master-1 cinder-backup[122641]: DEBUG oslo.privsep.daemon [-] privsep: reply[5443ca2b-0bbb-440d-acfb-c2a657ba8d52]: (4, ('02bb033c-a191-40c0-94fb-bb025c724b13\n', '')) {{(pid=147257) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:502}}
Jan 15 21:06:32.137838 ncdv-master-1 cinder-backup[122641]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /sys/class/dmi/id/product_uuid {{(pid=147257) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 15 21:06:32.151674 ncdv-master-1 cinder-backup[122641]: DEBUG oslo_concurrency.processutils [-] CMD "cat /sys/class/dmi/id/product_uuid" returned: 0 in 0.016s {{(pid=147257) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Jan 15 21:06:32.152306 ncdv-master-1 cinder-backup[122641]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3d09d26-d230-4e42-8571-634e7b1bcf29]: (4, ('1b06c783-92a7-1942-a345-69784a0224b6\n', '')) {{(pid=147257) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:502}}
Jan 15 21:06:32.153332 ncdv-master-1 cinder-backup[122641]: DEBUG oslo_concurrency.processutils [None req-428e14d4-145f-41a7-9911-9a1e71650bf9 tempest-VolumesBackupsAdminTest-678024116 None] Running cmd (subprocess): nvme version {{(pid=122641) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 15 21:06:32.191537 ncdv-master-1 cinder-backup[122641]: DEBUG oslo_concurrency.processutils [None req-428e14d4-145f-41a7-9911-9a1e71650bf9 tempest-VolumesBackupsAdminTest-678024116 None] CMD "nvme version" returned: 0 in 0.038s {{(pid=122641) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Jan 15 21:06:32.192780 ncdv-master-1 cinder-backup[122641]: DEBUG os_brick.utils [None req-428e14d4-145f-41a7-9911-9a1e71650bf9 tempest-VolumesBackupsAdminTest-678024116 None] <== get_connector_properties: return (156ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.222.0.46', 'host': 'ncdv-master-1', 'multipath': False, 'initiator': 'iqn.1993-08.org.debian:01:b3cf3389e31a', 'do_local_attach': False, 'uuid': '02bb033c-a191-40c0-94fb-bb025c724b13', 'system uuid': '1b06c783-92a7-1942-a345-69784a0224b6', 'nqn': 'nqn.2014-08.org.nvmexpress:uuid:2f801fe5-9757-4764-9681-7ba5df13a96f'} {{(pid=122641) trace_logging_wrapper /usr/local/lib/python3.8/dist-packages/os_brick/utils.py:184}}
Jan 15 21:06:33.162208 ncdv-master-1 cinder-backup[122641]: DEBUG os_brick.initiator.connector [None req-428e14d4-145f-41a7-9911-9a1e71650bf9 tempest-VolumesBackupsAdminTest-678024116 None] Factory for rbd on None {{(pid=122641) factory /usr/local/lib/python3.8/dist-packages/os_brick/initiator/connector.py:281}}
Jan 15 21:06:33.164560 ncdv-master-1 cinder-backup[122641]: DEBUG os_brick.initiator.connectors.rbd [None req-428e14d4-145f-41a7-9911-9a1e71650bf9 tempest-VolumesBackupsAdminTest-678024116 None] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.rbd.RBDConnector object at 0x7f1af475bfd0>, 'connection_properties': {'name': 'volumes/volume-abd3a57e-51e6-4369-840b-787555ee0c83', 'hosts': ['10.222.0.46'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '***', 'volume_id': 'abd3a57e-51e6-4369-840b-787555ee0c83', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}}" {{(pid=122641) trace_logging_wrapper /usr/local/lib/python3.8/dist-packages/os_brick/utils.py:157}}
Jan 15 21:06:33.165799 ncdv-master-1 cinder-backup[122641]: DEBUG os_brick.initiator.linuxrbd [None req-428e14d4-145f-41a7-9911-9a1e71650bf9 tempest-VolumesBackupsAdminTest-678024116 None] opening connection to ceph cluster (timeout=-1). {{(pid=122641) connect /usr/local/lib/python3.8/dist-packages/os_brick/initiator/linuxrbd.py:70}}
Jan 15 21:06:33.268880 ncdv-master-1 cinder-backup[122641]: DEBUG os_brick.initiator.connectors.rbd [None req-428e14d4-145f-41a7-9911-9a1e71650bf9 tempest-VolumesBackupsAdminTest-678024116 None] <== connect_volume: return (103ms) {'path': <os_brick.initiator.linuxrbd.RBDVolumeIOWrapper object at 0x7f1af4678370>} {{(pid=122641) trace_logging_wrapper /usr/local/lib/python3.8/dist-packages/os_brick/utils.py:184}}
Jan 15 21:06:33.283122 ncdv-master-1 cinder-backup[122641]: DEBUG oslo_db.sqlalchemy.engines [None req-428e14d4-145f-41a7-9911-9a1e71650bf9 tempest-VolumesBackupsAdminTest-678024116 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122641) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}}
Jan 15 21:06:33.303597 ncdv-master-1 cinder-backup[122641]: DEBUG cinder.backup.drivers.ceph [None req-428e14d4-145f-41a7-9911-9a1e71650bf9 tempest-VolumesBackupsAdminTest-678024116 None] Starting restore from Ceph backup=98d8d09d-e78c-4488-9025-62f226b85792 to volume=volume-abd3a57e-51e6-4369-840b-787555ee0c83 {{(pid=122641) restore /opt/stack/cinder/cinder/backup/drivers/ceph.py:1274}}
Jan 15 21:06:33.448421 ncdv-master-1 cinder-backup[122641]: DEBUG cinder.backup.drivers.ceph [None req-428e14d4-145f-41a7-9911-9a1e71650bf9 tempest-VolumesBackupsAdminTest-678024116 None] Looking for snapshot of backup base 'volume-e5de2672-7637-4bb0-9bdd-119ea1ef7019.backup.98d8d09d-e78c-4488-9025-62f226b85792' {{(pid=122641) _get_backup_snap_name /opt/stack/cinder/cinder/backup/drivers/ceph.py:905}}
Jan 15 21:06:33.449135 ncdv-master-1 cinder-backup[122641]: DEBUG cinder.backup.drivers.ceph [None req-428e14d4-145f-41a7-9911-9a1e71650bf9 tempest-VolumesBackupsAdminTest-678024116 None] Found snapshot 'backup.98d8d09d-e78c-4488-9025-62f226b85792.snap.1642280786.2434547' {{(pid=122641) _get_backup_snap_name /opt/stack/cinder/cinder/backup/drivers/ceph.py:924}}
Jan 15 21:06:33.457530 ncdv-master-1 cinder-backup[122641]: DEBUG cinder.backup.drivers.ceph [None req-428e14d4-145f-41a7-9911-9a1e71650bf9 tempest-VolumesBackupsAdminTest-678024116 None] Volume file is RBD. {{(pid=122641) _diff_restore_allowed /opt/stack/cinder/cinder/backup/drivers/ceph.py:1184}}
Jan 15 21:06:33.542210 ncdv-master-1 cinder-backup[122641]: DEBUG cinder.backup.drivers.ceph [None req-428e14d4-145f-41a7-9911-9a1e71650bf9 tempest-VolumesBackupsAdminTest-678024116 None] Attempting differential restore. {{(pid=122641) _restore_volume /opt/stack/cinder/cinder/backup/drivers/ceph.py:1234}}
Jan 15 21:06:33.543046 ncdv-master-1 cinder-backup[122641]: DEBUG cinder.backup.drivers.ceph [None req-428e14d4-145f-41a7-9911-9a1e71650bf9 tempest-VolumesBackupsAdminTest-678024116 None] Attempting incremental restore from base='volume-e5de2672-7637-4bb0-9bdd-119ea1ef7019.backup.98d8d09d-e78c-4488-9025-62f226b85792' snap='backup.98d8d09d-e78c-4488-9025-62f226b85792.snap.1642280786.2434547' {{(pid=122641) _diff_restore_rbd /opt/stack/cinder/cinder/backup/drivers/ceph.py:1089}}
Jan 15 21:06:33.543682 ncdv-master-1 cinder-backup[122641]: DEBUG cinder.backup.drivers.ceph [None req-428e14d4-145f-41a7-9911-9a1e71650bf9 tempest-VolumesBackupsAdminTest-678024116 None] Performing differential transfer from 'volume-e5de2672-7637-4bb0-9bdd-119ea1ef7019.backup.98d8d09d-e78c-4488-9025-62f226b85792' to 'volume-abd3a57e-51e6-4369-840b-787555ee0c83' {{(pid=122641) _rbd_diff_transfer /opt/stack/cinder/cinder/backup/drivers/ceph.py:624}}
Jan 15 21:06:33.544395 ncdv-master-1 cinder-backup[122641]: DEBUG cinder.backup.drivers.ceph [None req-428e14d4-145f-41a7-9911-9a1e71650bf9 tempest-VolumesBackupsAdminTest-678024116 None] Piping cmd1='rbd export-diff --id cinder-bak --conf /etc/ceph/ceph.conf --pool backups backups/volume-e5de2672-7637-4bb0-9bdd-119ea1ef7019.backup.98d8d09d-e78c-4488-9025-62f226b85792@backup.98d8d09d-e78c-4488-9025-62f226b85792.snap.1642280786.2434547 -' into... {{(pid=122641) _piped_execute /opt/stack/cinder/cinder/backup/drivers/ceph.py:585}}
Jan 15 21:06:33.544733 ncdv-master-1 cinder-backup[122641]: DEBUG cinder.backup.drivers.ceph [None req-428e14d4-145f-41a7-9911-9a1e71650bf9 tempest-VolumesBackupsAdminTest-678024116 None] cmd2='rbd import-diff --id cinder --conf /tmp/brickrbd_lo9jtop6 --pool volumes - volumes/volume-abd3a57e-51e6-4369-840b-787555ee0c83' {{(pid=122641) _piped_execute /opt/stack/cinder/cinder/backup/drivers/ceph.py:586}}
Jan 15 21:06:34.955135 ncdv-master-1 cinder-backup[122641]: DEBUG cinder.backup.drivers.ceph [None req-428e14d4-145f-41a7-9911-9a1e71650bf9 tempest-VolumesBackupsAdminTest-678024116 None] Restore transfer completed in 1.4108s {{(pid=122641) _diff_restore_rbd /opt/stack/cinder/cinder/backup/drivers/ceph.py:1111}}
Jan 15 21:06:34.956336 ncdv-master-1 cinder-backup[122641]: DEBUG cinder.backup.drivers.ceph [None req-428e14d4-145f-41a7-9911-9a1e71650bf9 tempest-VolumesBackupsAdminTest-678024116 None] Restore target I/O object does not support fileno() - skipping call to fsync(). {{(pid=122641) restore /opt/stack/cinder/cinder/backup/drivers/ceph.py:1285}}
Jan 15 21:06:35.032430 ncdv-master-1 cinder-backup[122641]: DEBUG cinder.backup.driver [None req-428e14d4-145f-41a7-9911-9a1e71650bf9 tempest-VolumesBackupsAdminTest-678024116 None] Restoring volume base metadata {{(pid=122641) _restore_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:177}}
Jan 15 21:06:35.071365 ncdv-master-1 cinder-backup[122641]: DEBUG cinder.backup.driver [None req-428e14d4-145f-41a7-9911-9a1e71650bf9 tempest-VolumesBackupsAdminTest-678024116 None] No metadata of type 'volume-metadata' to restore {{(pid=122641) put /opt/stack/cinder/cinder/backup/driver.py:345}}
Jan 15 21:06:35.071962 ncdv-master-1 cinder-backup[122641]: DEBUG cinder.backup.driver [None req-428e14d4-145f-41a7-9911-9a1e71650bf9 tempest-VolumesBackupsAdminTest-678024116 None] No metadata of type 'volume-glance-metadata' to restore {{(pid=122641) put /opt/stack/cinder/cinder/backup/driver.py:345}}
Jan 15 21:06:35.086288 ncdv-master-1 cinder-backup[122641]: DEBUG cinder.backup.drivers.ceph [None req-428e14d4-145f-41a7-9911-9a1e71650bf9 tempest-VolumesBackupsAdminTest-678024116 None] Restore to volume abd3a57e-51e6-4369-840b-787555ee0c83 finished successfully. {{(pid=122641) restore /opt/stack/cinder/cinder/backup/drivers/ceph.py:1292}}
Jan 15 21:06:35.088049 ncdv-master-1 cinder-backup[122641]: DEBUG os_brick.initiator.connectors.rbd [None req-428e14d4-145f-41a7-9911-9a1e71650bf9 tempest-VolumesBackupsAdminTest-678024116 None] ==> disconnect_volume: call "{'self': <os_brick.initiator.connectors.rbd.RBDConnector object at 0x7f1af475bfd0>, 'connection_properties': {'name': 'volumes/volume-abd3a57e-51e6-4369-840b-787555ee0c83', 'hosts': ['10.222.0.46'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '***', 'volume_id': 'abd3a57e-51e6-4369-840b-787555ee0c83', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'device_info': {'path': <os_brick.initiator.linuxrbd.RBDVolumeIOWrapper object at 0x7f1af4678370>}, 'force': True, 'ignore_errors': False}" {{(pid=122641) trace_logging_wrapper /usr/local/lib/python3.8/dist-packages/os_brick/utils.py:157}}
Jan 15 21:06:35.105629 ncdv-master-1 cinder-backup[122641]: DEBUG os_brick.initiator.connectors.rbd [None req-428e14d4-145f-41a7-9911-9a1e71650bf9 tempest-VolumesBackupsAdminTest-678024116 None] <== disconnect_volume: return (16ms) None {{(pid=122641) trace_logging_wrapper /usr/local/lib/python3.8/dist-packages/os_brick/utils.py:184}}
Jan 15 21:06:35.211878 ncdv-master-1 cinder-backup[122641]: DEBUG cinder.backup.manager [None req-428e14d4-145f-41a7-9911-9a1e71650bf9 tempest-VolumesBackupsAdminTest-678024116 None] Encryption key ID for volume abd3a57e-51e6-4369-840b-787555ee0c83 already matches encryption key ID in backup 98d8d09d-e78c-4488-9025-62f226b85792. {{(pid=122641) _run_restore /opt/stack/cinder/cinder/backup/manager.py:801}}
Jan 15 21:06:35.291952 ncdv-master-1 cinder-backup[122641]: INFO cinder.backup.manager [None req-428e14d4-145f-41a7-9911-9a1e71650bf9 tempest-VolumesBackupsAdminTest-678024116 None] Finished restoring backup 98d8d09d-e78c-4488-9025-62f226b85792 to volume abd3a57e-51e6-4369-840b-787555ee0c83.
Jan 15 21:06:36.609628 ncdv-master-1 cinder-backup[122641]: INFO cinder.backup.manager [None req-256a0a5d-7a7b-422e-b0fe-61279a2616b1 tempest-VolumesBackupsAdminTest-1232056558 None] Delete backup started, backup: 902b38b5-073f-4970-aaa4-d3e243291022.
Jan 15 21:06:36.613351 ncdv-master-1 cinder-backup[122641]: DEBUG cinder.backup.drivers.ceph [None req-256a0a5d-7a7b-422e-b0fe-61279a2616b1 tempest-VolumesBackupsAdminTest-1232056558 None] Delete started for backup=902b38b5-073f-4970-aaa4-d3e243291022 {{(pid=122641) delete_backup /opt/stack/cinder/cinder/backup/drivers/ceph.py:1301}}
Jan 15 21:06:36.613792 ncdv-master-1 cinder-backup[122641]: DEBUG cinder.backup.drivers.ceph [None req-256a0a5d-7a7b-422e-b0fe-61279a2616b1 tempest-VolumesBackupsAdminTest-1232056558 None] Trying diff format basename='volume-e5de2672-7637-4bb0-9bdd-119ea1ef7019.backup.98d8d09d-e78c-4488-9025-62f226b85792' for backup base image of volume e5de2672-7637-4bb0-9bdd-119ea1ef7019. {{(pid=122641) _try_delete_base_image /opt/stack/cinder/cinder/backup/drivers/ceph.py:513}}
Jan 15 21:06:36.721787 ncdv-master-1 cinder-backup[122641]: DEBUG cinder.backup.drivers.ceph [None req-256a0a5d-7a7b-422e-b0fe-61279a2616b1 tempest-VolumesBackupsAdminTest-1232056558 None] Looking for snapshot of backup base 'volume-e5de2672-7637-4bb0-9bdd-119ea1ef7019.backup.98d8d09d-e78c-4488-9025-62f226b85792' {{(pid=122641) _get_backup_snap_name /opt/stack/cinder/cinder/backup/drivers/ceph.py:905}}
Jan 15 21:06:36.723398 ncdv-master-1 cinder-backup[122641]: DEBUG cinder.backup.drivers.ceph [None req-256a0a5d-7a7b-422e-b0fe-61279a2616b1 tempest-VolumesBackupsAdminTest-1232056558 None] Backup '902b38b5-073f-4970-aaa4-d3e243291022' has no snapshot {{(pid=122641) _get_backup_snap_name /opt/stack/cinder/cinder/backup/drivers/ceph.py:915}}
Jan 15 21:06:36.723961 ncdv-master-1 cinder-backup[122641]: DEBUG cinder.backup.drivers.ceph [None req-256a0a5d-7a7b-422e-b0fe-61279a2616b1 tempest-VolumesBackupsAdminTest-1232056558 None] No backup snapshot to delete {{(pid=122641) _delete_backup_snapshot /opt/stack/cinder/cinder/backup/drivers/ceph.py:476}}
Jan 15 21:06:36.733407 ncdv-master-1 cinder-backup[122641]: INFO cinder.backup.drivers.ceph [None req-256a0a5d-7a7b-422e-b0fe-61279a2616b1 tempest-VolumesBackupsAdminTest-1232056558 None] Backup base image of volume e5de2672-7637-4bb0-9bdd-119ea1ef7019 still has 1 snapshots so skipping base image delete.
Jan 15 21:06:36.839332 ncdv-master-1 cinder-backup[122641]: DEBUG cinder.backup.drivers.ceph [None req-256a0a5d-7a7b-422e-b0fe-61279a2616b1 tempest-VolumesBackupsAdminTest-1232056558 None] Metadata backup object 'backup.902b38b5-073f-4970-aaa4-d3e243291022.meta' not found - ignoring {{(pid=122641) remove_if_exists /opt/stack/cinder/cinder/backup/drivers/ceph.py:160}}
Jan 15 21:06:36.844593 ncdv-master-1 cinder-backup[122641]: DEBUG cinder.backup.drivers.ceph [None req-256a0a5d-7a7b-422e-b0fe-61279a2616b1 tempest-VolumesBackupsAdminTest-1232056558 None] Delete of backup '902b38b5-073f-4970-aaa4-d3e243291022' for volume 'e5de2672-7637-4bb0-9bdd-119ea1ef7019' finished. {{(pid=122641) delete_backup /opt/stack/cinder/cinder/backup/drivers/ceph.py:1329}}
Jan 15 21:06:36.859467 ncdv-master-1 cinder-backup[122641]: DEBUG oslo_db.sqlalchemy.engines [None req-256a0a5d-7a7b-422e-b0fe-61279a2616b1 tempest-VolumesBackupsAdminTest-1232056558 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122641) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}}
Jan 15 21:06:36.891702 ncdv-master-1 cinder-backup[122641]: WARNING cinder.quota [None req-256a0a5d-7a7b-422e-b0fe-61279a2616b1 tempest-VolumesBackupsAdminTest-1232056558 None] Deprecated: Default quota for resource: backups is set by the default quota flag: quota_backups, it is now deprecated. Please use the default quota class for default quota.
Jan 15 21:06:36.893879 ncdv-master-1 cinder-backup[122641]: WARNING cinder.quota [None req-256a0a5d-7a7b-422e-b0fe-61279a2616b1 tempest-VolumesBackupsAdminTest-1232056558 None] Deprecated: Default quota for resource: backup_gigabytes is set by the default quota flag: quota_backup_gigabytes, it is now deprecated. Please use the default quota class for default quota.
Jan 15 21:06:36.934383 ncdv-master-1 cinder-backup[122641]: DEBUG cinder.quota [None req-256a0a5d-7a7b-422e-b0fe-61279a2616b1 tempest-VolumesBackupsAdminTest-1232056558 None] Created reservations ['48e1cdca-ee4f-4fde-b6ec-b0f4d9eaa2ba', 'b88640f5-0722-451b-89df-2cda9ec5d6c0'] {{(pid=122641) reserve /opt/stack/cinder/cinder/quota.py:755}}
Jan 15 21:06:36.998387 ncdv-master-1 cinder-backup[122641]: INFO cinder.backup.manager [None req-256a0a5d-7a7b-422e-b0fe-61279a2616b1 tempest-VolumesBackupsAdminTest-1232056558 None] Delete backup finished, backup 902b38b5-073f-4970-aaa4-d3e243291022 deleted.
Jan 15 21:06:37.772069 ncdv-master-1 cinder-backup[122641]: INFO cinder.backup.manager [None req-4347b3d8-35d4-4950-8240-9bbda1af8131 tempest-VolumesBackupsAdminTest-678024116 None] Delete backup started, backup: 98d8d09d-e78c-4488-9025-62f226b85792.
Jan 15 21:06:37.774318 ncdv-master-1 cinder-backup[122641]: DEBUG cinder.backup.drivers.ceph [None req-4347b3d8-35d4-4950-8240-9bbda1af8131 tempest-VolumesBackupsAdminTest-678024116 None] Delete started for backup=98d8d09d-e78c-4488-9025-62f226b85792 {{(pid=122641) delete_backup /opt/stack/cinder/cinder/backup/drivers/ceph.py:1301}}
Jan 15 21:06:37.774838 ncdv-master-1 cinder-backup[122641]: DEBUG cinder.backup.drivers.ceph [None req-4347b3d8-35d4-4950-8240-9bbda1af8131 tempest-VolumesBackupsAdminTest-678024116 None] Trying diff format basename='volume-e5de2672-7637-4bb0-9bdd-119ea1ef7019.backup.98d8d09d-e78c-4488-9025-62f226b85792' for backup base image of volume e5de2672-7637-4bb0-9bdd-119ea1ef7019. {{(pid=122641) _try_delete_base_image /opt/stack/cinder/cinder/backup/drivers/ceph.py:513}}
Jan 15 21:06:37.858280 ncdv-master-1 cinder-backup[122641]: DEBUG cinder.backup.drivers.ceph [None req-4347b3d8-35d4-4950-8240-9bbda1af8131 tempest-VolumesBackupsAdminTest-678024116 None] Looking for snapshot of backup base 'volume-e5de2672-7637-4bb0-9bdd-119ea1ef7019.backup.98d8d09d-e78c-4488-9025-62f226b85792' {{(pid=122641) _get_backup_snap_name /opt/stack/cinder/cinder/backup/drivers/ceph.py:905}}
Jan 15 21:06:37.859024 ncdv-master-1 cinder-backup[122641]: DEBUG cinder.backup.drivers.ceph [None req-4347b3d8-35d4-4950-8240-9bbda1af8131 tempest-VolumesBackupsAdminTest-678024116 None] Found snapshot 'backup.98d8d09d-e78c-4488-9025-62f226b85792.snap.1642280786.2434547' {{(pid=122641) _get_backup_snap_name /opt/stack/cinder/cinder/backup/drivers/ceph.py:924}}
Jan 15 21:06:37.859560 ncdv-master-1 cinder-backup[122641]: DEBUG cinder.backup.drivers.ceph [None req-4347b3d8-35d4-4950-8240-9bbda1af8131 tempest-VolumesBackupsAdminTest-678024116 None] Deleting backup snapshot='backup.98d8d09d-e78c-4488-9025-62f226b85792.snap.1642280786.2434547' {{(pid=122641) _delete_backup_snapshot /opt/stack/cinder/cinder/backup/drivers/ceph.py:473}}
Jan 15 21:06:38.497883 ncdv-master-1 cinder-backup[122641]: DEBUG oslo_db.sqlalchemy.engines [None req-cda43372-e9c8-4414-b3aa-7cf812823c29 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122641) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}}
Jan 15 21:06:38.964024 ncdv-master-1 cinder-backup[122641]: INFO cinder.backup.drivers.ceph [None req-4347b3d8-35d4-4950-8240-9bbda1af8131 tempest-VolumesBackupsAdminTest-678024116 None] Deleting backup base image='volume-e5de2672-7637-4bb0-9bdd-119ea1ef7019.backup.98d8d09d-e78c-4488-9025-62f226b85792' of volume e5de2672-7637-4bb0-9bdd-119ea1ef7019.
Jan 15 21:06:39.321642 ncdv-master-1 cinder-backup[122641]: DEBUG cinder.backup.drivers.ceph [None req-4347b3d8-35d4-4950-8240-9bbda1af8131 tempest-VolumesBackupsAdminTest-678024116 None] Base backup image='volume-e5de2672-7637-4bb0-9bdd-119ea1ef7019.backup.98d8d09d-e78c-4488-9025-62f226b85792' of volume e5de2672-7637-4bb0-9bdd-119ea1ef7019 deleted. {{(pid=122641) _try_delete_base_image /opt/stack/cinder/cinder/backup/drivers/ceph.py:561}}
Jan 15 21:06:39.388123 ncdv-master-1 cinder-backup[122641]: DEBUG cinder.backup.drivers.ceph [None req-4347b3d8-35d4-4950-8240-9bbda1af8131 tempest-VolumesBackupsAdminTest-678024116 None] Delete of backup '98d8d09d-e78c-4488-9025-62f226b85792' for volume 'e5de2672-7637-4bb0-9bdd-119ea1ef7019' finished. {{(pid=122641) delete_backup /opt/stack/cinder/cinder/backup/drivers/ceph.py:1329}}
Jan 15 21:06:39.440757 ncdv-master-1 cinder-backup[122641]: DEBUG cinder.quota [None req-4347b3d8-35d4-4950-8240-9bbda1af8131 tempest-VolumesBackupsAdminTest-678024116 None] Created reservations ['5604d296-dddb-4e96-a6ea-b6f4f66ee09b', '3b0983d9-7d09-409c-97f3-8f8383601e95'] {{(pid=122641) reserve /opt/stack/cinder/cinder/quota.py:755}}
Jan 15 21:06:39.498429 ncdv-master-1 cinder-backup[122641]: INFO cinder.backup.manager [None req-4347b3d8-35d4-4950-8240-9bbda1af8131 tempest-VolumesBackupsAdminTest-678024116 None] Delete backup finished, backup 98d8d09d-e78c-4488-9025-62f226b85792 deleted.
Jan 15 21:06:41.707519 ncdv-master-1 cinder-backup[122641]: INFO cinder.backup.manager [None req-106464ea-f064-4dc9-af22-84e04390a98b tempest-VolumesBackupsAdminTest-678024116 None] Create backup started, backup: b994603c-241f-4007-9366-62ac06788dde volume: c44cffd2-194b-406a-bbec-b2a2b48d795b.
Jan 15 21:06:41.726482 ncdv-master-1 cinder-backup[122641]: DEBUG os_brick.utils [None req-106464ea-f064-4dc9-af22-84e04390a98b tempest-VolumesBackupsAdminTest-678024116 None] ==> get_connector_properties: call "{'root_helper': 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf', 'my_ip': '10.222.0.46', 'multipath': False, 'enforce_multipath': False, 'host': None, 'execute': None}" {{(pid=122641) trace_logging_wrapper /usr/local/lib/python3.8/dist-packages/os_brick/utils.py:157}}
Jan 15 21:06:41.728483 ncdv-master-1 cinder-backup[122641]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=147257) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 15 21:06:41.749820 ncdv-master-1 cinder-backup[122641]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.022s {{(pid=147257) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Jan 15 21:06:41.750140 ncdv-master-1 cinder-backup[122641]: DEBUG oslo.privsep.daemon [-] privsep: reply[80241a2e-8ba1-46f3-9c1c-30c77a0c28ff]: (4, ('## DO NOT EDIT OR REMOVE THIS FILE!\n## If you remove this file, the iSCSI daemon will not start.\n## If you change the InitiatorName, existing access control lists\n## may reject this initiator.  The InitiatorName must be unique\n## for each iSCSI initiator.  Do NOT duplicate iSCSI InitiatorNames.\nInitiatorName=iqn.1993-08.org.debian:01:b3cf3389e31a\n', '')) {{(pid=147257) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:502}}
Jan 15 21:06:41.753876 ncdv-master-1 cinder-backup[122641]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): systool -c fc_host -v {{(pid=147257) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 15 21:06:41.764248 ncdv-master-1 cinder-backup[122641]: DEBUG oslo_concurrency.processutils [-] 'systool -c fc_host -v' failed. Not Retrying. {{(pid=147257) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:473}}
Jan 15 21:06:41.764881 ncdv-master-1 cinder-backup[122641]: DEBUG oslo.privsep.daemon [-] privsep: Exception during request[ef8c33fe-8efd-4fb7-98e5-fa8230717314]: [Errno 2] No such file or directory: 'systool' {{(pid=147257) _process_cmd /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:480}}
Jan 15 21:06:41.764881 ncdv-master-1 cinder-backup[122641]: Traceback (most recent call last):
Jan 15 21:06:41.764881 ncdv-master-1 cinder-backup[122641]:   File "/usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py", line 477, in _process_cmd
Jan 15 21:06:41.764881 ncdv-master-1 cinder-backup[122641]:     ret = func(*f_args, **f_kwargs)
Jan 15 21:06:41.764881 ncdv-master-1 cinder-backup[122641]:   File "/usr/local/lib/python3.8/dist-packages/oslo_privsep/priv_context.py", line 274, in _wrap
Jan 15 21:06:41.764881 ncdv-master-1 cinder-backup[122641]:     return func(*args, **kwargs)
Jan 15 21:06:41.764881 ncdv-master-1 cinder-backup[122641]:   File "/usr/local/lib/python3.8/dist-packages/os_brick/privileged/rootwrap.py", line 197, in execute_root
Jan 15 21:06:41.764881 ncdv-master-1 cinder-backup[122641]:     return custom_execute(*cmd, shell=False, run_as_root=False, **kwargs)
Jan 15 21:06:41.764881 ncdv-master-1 cinder-backup[122641]:   File "/usr/local/lib/python3.8/dist-packages/os_brick/privileged/rootwrap.py", line 145, in custom_execute
Jan 15 21:06:41.764881 ncdv-master-1 cinder-backup[122641]:     return putils.execute(on_execute=on_execute,
Jan 15 21:06:41.764881 ncdv-master-1 cinder-backup[122641]:   File "/usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py", line 395, in execute
Jan 15 21:06:41.764881 ncdv-master-1 cinder-backup[122641]:     obj = subprocess.Popen(cmd,
Jan 15 21:06:41.764881 ncdv-master-1 cinder-backup[122641]:   File "/usr/lib/python3.8/subprocess.py", line 858, in __init__
Jan 15 21:06:41.764881 ncdv-master-1 cinder-backup[122641]:     self._execute_child(args, executable, preexec_fn, close_fds,
Jan 15 21:06:41.764881 ncdv-master-1 cinder-backup[122641]:   File "/usr/lib/python3.8/subprocess.py", line 1704, in _execute_child
Jan 15 21:06:41.764881 ncdv-master-1 cinder-backup[122641]:     raise child_exception_type(errno_num, err_msg, err_filename)
Jan 15 21:06:41.764881 ncdv-master-1 cinder-backup[122641]: FileNotFoundError: [Errno 2] No such file or directory: 'systool'
Jan 15 21:06:41.766615 ncdv-master-1 cinder-backup[122641]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef8c33fe-8efd-4fb7-98e5-fa8230717314]: (5, 'builtins.FileNotFoundError', (2, 'No such file or directory')) {{(pid=147257) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:502}}
Jan 15 21:06:41.769779 ncdv-master-1 cinder-backup[122641]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): systool -c fc_host -v {{(pid=147257) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 15 21:06:41.775877 ncdv-master-1 cinder-backup[122641]: DEBUG oslo_concurrency.processutils [-] 'systool -c fc_host -v' failed. Not Retrying. {{(pid=147257) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:473}}
Jan 15 21:06:41.776743 ncdv-master-1 cinder-backup[122641]: DEBUG oslo.privsep.daemon [-] privsep: Exception during request[3015e517-ed41-4d81-8068-cfa78df96661]: [Errno 2] No such file or directory: 'systool' {{(pid=147257) _process_cmd /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:480}}
Jan 15 21:06:41.776743 ncdv-master-1 cinder-backup[122641]: Traceback (most recent call last):
Jan 15 21:06:41.776743 ncdv-master-1 cinder-backup[122641]:   File "/usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py", line 477, in _process_cmd
Jan 15 21:06:41.776743 ncdv-master-1 cinder-backup[122641]:     ret = func(*f_args, **f_kwargs)
Jan 15 21:06:41.776743 ncdv-master-1 cinder-backup[122641]:   File "/usr/local/lib/python3.8/dist-packages/oslo_privsep/priv_context.py", line 274, in _wrap
Jan 15 21:06:41.776743 ncdv-master-1 cinder-backup[122641]:     return func(*args, **kwargs)
Jan 15 21:06:41.776743 ncdv-master-1 cinder-backup[122641]:   File "/usr/local/lib/python3.8/dist-packages/os_brick/privileged/rootwrap.py", line 197, in execute_root
Jan 15 21:06:41.776743 ncdv-master-1 cinder-backup[122641]:     return custom_execute(*cmd, shell=False, run_as_root=False, **kwargs)
Jan 15 21:06:41.776743 ncdv-master-1 cinder-backup[122641]:   File "/usr/local/lib/python3.8/dist-packages/os_brick/privileged/rootwrap.py", line 145, in custom_execute
Jan 15 21:06:41.776743 ncdv-master-1 cinder-backup[122641]:     return putils.execute(on_execute=on_execute,
Jan 15 21:06:41.776743 ncdv-master-1 cinder-backup[122641]:   File "/usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py", line 395, in execute
Jan 15 21:06:41.776743 ncdv-master-1 cinder-backup[122641]:     obj = subprocess.Popen(cmd,
Jan 15 21:06:41.776743 ncdv-master-1 cinder-backup[122641]:   File "/usr/lib/python3.8/subprocess.py", line 858, in __init__
Jan 15 21:06:41.776743 ncdv-master-1 cinder-backup[122641]:     self._execute_child(args, executable, preexec_fn, close_fds,
Jan 15 21:06:41.776743 ncdv-master-1 cinder-backup[122641]:   File "/usr/lib/python3.8/subprocess.py", line 1704, in _execute_child
Jan 15 21:06:41.776743 ncdv-master-1 cinder-backup[122641]:     raise child_exception_type(errno_num, err_msg, err_filename)
Jan 15 21:06:41.776743 ncdv-master-1 cinder-backup[122641]: FileNotFoundError: [Errno 2] No such file or directory: 'systool'
Jan 15 21:06:41.778372 ncdv-master-1 cinder-backup[122641]: DEBUG oslo.privsep.daemon [-] privsep: reply[3015e517-ed41-4d81-8068-cfa78df96661]: (5, 'builtins.FileNotFoundError', (2, 'No such file or directory')) {{(pid=147257) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:502}}
Jan 15 21:06:41.780397 ncdv-master-1 cinder-backup[122641]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=147257) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 15 21:06:41.798444 ncdv-master-1 cinder-backup[122641]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=147257) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Jan 15 21:06:41.798724 ncdv-master-1 cinder-backup[122641]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2be8891-3339-4d5b-90fe-11c834bf2d03]: (4, ('/dev/sda1\n', '')) {{(pid=147257) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:502}}
Jan 15 21:06:41.800815 ncdv-master-1 cinder-backup[122641]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/sda1 -s UUID -o value {{(pid=147257) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 15 21:06:41.814605 ncdv-master-1 cinder-backup[122641]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/sda1 -s UUID -o value" returned: 0 in 0.014s {{(pid=147257) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Jan 15 21:06:41.814940 ncdv-master-1 cinder-backup[122641]: DEBUG oslo.privsep.daemon [-] privsep: reply[86823bbf-5f68-400d-8ac7-cf8f7e895035]: (4, ('02bb033c-a191-40c0-94fb-bb025c724b13\n', '')) {{(pid=147257) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:502}}
Jan 15 21:06:41.818160 ncdv-master-1 cinder-backup[122641]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /sys/class/dmi/id/product_uuid {{(pid=147257) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 15 21:06:41.838856 ncdv-master-1 cinder-backup[122641]: DEBUG oslo_concurrency.processutils [-] CMD "cat /sys/class/dmi/id/product_uuid" returned: 0 in 0.022s {{(pid=147257) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Jan 15 21:06:41.839923 ncdv-master-1 cinder-backup[122641]: DEBUG oslo.privsep.daemon [-] privsep: reply[77cfa84b-0ffc-425a-b7b0-a4b638eb64ae]: (4, ('1b06c783-92a7-1942-a345-69784a0224b6\n', '')) {{(pid=147257) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:502}}
Jan 15 21:06:41.841119 ncdv-master-1 cinder-backup[122641]: DEBUG oslo_concurrency.processutils [None req-106464ea-f064-4dc9-af22-84e04390a98b tempest-VolumesBackupsAdminTest-678024116 None] Running cmd (subprocess): nvme version {{(pid=122641) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 15 21:06:41.873198 ncdv-master-1 cinder-backup[122641]: DEBUG oslo_concurrency.processutils [None req-106464ea-f064-4dc9-af22-84e04390a98b tempest-VolumesBackupsAdminTest-678024116 None] CMD "nvme version" returned: 0 in 0.032s {{(pid=122641) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Jan 15 21:06:41.874576 ncdv-master-1 cinder-backup[122641]: DEBUG os_brick.utils [None req-106464ea-f064-4dc9-af22-84e04390a98b tempest-VolumesBackupsAdminTest-678024116 None] <== get_connector_properties: return (147ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.222.0.46', 'host': 'ncdv-master-1', 'multipath': False, 'initiator': 'iqn.1993-08.org.debian:01:b3cf3389e31a', 'do_local_attach': False, 'uuid': '02bb033c-a191-40c0-94fb-bb025c724b13', 'system uuid': '1b06c783-92a7-1942-a345-69784a0224b6', 'nqn': 'nqn.2014-08.org.nvmexpress:uuid:2f801fe5-9757-4764-9681-7ba5df13a96f'} {{(pid=122641) trace_logging_wrapper /usr/local/lib/python3.8/dist-packages/os_brick/utils.py:184}}
Jan 15 21:06:42.910964 ncdv-master-1 cinder-backup[122641]: DEBUG os_brick.initiator.connector [None req-106464ea-f064-4dc9-af22-84e04390a98b tempest-VolumesBackupsAdminTest-678024116 None] Factory for rbd on None {{(pid=122641) factory /usr/local/lib/python3.8/dist-packages/os_brick/initiator/connector.py:281}}
Jan 15 21:06:42.912544 ncdv-master-1 cinder-backup[122641]: DEBUG os_brick.initiator.connectors.rbd [None req-106464ea-f064-4dc9-af22-84e04390a98b tempest-VolumesBackupsAdminTest-678024116 None] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.rbd.RBDConnector object at 0x7f1af4572580>, 'connection_properties': {'name': 'volumes/volume-c44cffd2-194b-406a-bbec-b2a2b48d795b', 'hosts': ['10.222.0.46'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '***', 'volume_id': 'c44cffd2-194b-406a-bbec-b2a2b48d795b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}}" {{(pid=122641) trace_logging_wrapper /usr/local/lib/python3.8/dist-packages/os_brick/utils.py:157}}
Jan 15 21:06:42.914331 ncdv-master-1 cinder-backup[122641]: DEBUG os_brick.initiator.linuxrbd [None req-106464ea-f064-4dc9-af22-84e04390a98b tempest-VolumesBackupsAdminTest-678024116 None] opening connection to ceph cluster (timeout=-1). {{(pid=122641) connect /usr/local/lib/python3.8/dist-packages/os_brick/initiator/linuxrbd.py:70}}
Jan 15 21:06:43.000417 ncdv-master-1 cinder-backup[122641]: DEBUG os_brick.initiator.connectors.rbd [None req-106464ea-f064-4dc9-af22-84e04390a98b tempest-VolumesBackupsAdminTest-678024116 None] <== connect_volume: return (87ms) {'path': <os_brick.initiator.linuxrbd.RBDVolumeIOWrapper object at 0x7f1af4572520>} {{(pid=122641) trace_logging_wrapper /usr/local/lib/python3.8/dist-packages/os_brick/utils.py:184}}
Jan 15 21:06:43.009106 ncdv-master-1 cinder-backup[122641]: DEBUG oslo_db.sqlalchemy.engines [None req-106464ea-f064-4dc9-af22-84e04390a98b tempest-VolumesBackupsAdminTest-678024116 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122641) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}}
Jan 15 21:06:43.032652 ncdv-master-1 cinder-backup[122641]: DEBUG cinder.backup.drivers.ceph [None req-106464ea-f064-4dc9-af22-84e04390a98b tempest-VolumesBackupsAdminTest-678024116 None] Starting backup of volume='c44cffd2-194b-406a-bbec-b2a2b48d795b'. {{(pid=122641) backup /opt/stack/cinder/cinder/backup/drivers/ceph.py:974}}
Jan 15 21:06:43.034796 ncdv-master-1 cinder-backup[122641]: DEBUG cinder.backup.drivers.ceph [None req-106464ea-f064-4dc9-af22-84e04390a98b tempest-VolumesBackupsAdminTest-678024116 None] Volume file is RBD: attempting optimized backup {{(pid=122641) backup /opt/stack/cinder/cinder/backup/drivers/ceph.py:985}}
Jan 15 21:06:43.078704 ncdv-master-1 cinder-backup[122641]: DEBUG cinder.backup.drivers.ceph [None req-106464ea-f064-4dc9-af22-84e04390a98b tempest-VolumesBackupsAdminTest-678024116 None] Creating base image 'volume-c44cffd2-194b-406a-bbec-b2a2b48d795b.backup.b994603c-241f-4007-9366-62ac06788dde' {{(pid=122641) _create_base_image /opt/stack/cinder/cinder/backup/drivers/ceph.py:444}}
Jan 15 21:06:43.079288 ncdv-master-1 cinder-backup[122641]: DEBUG cinder.backup.drivers.ceph [None req-106464ea-f064-4dc9-af22-84e04390a98b tempest-VolumesBackupsAdminTest-678024116 None] RBD also supports fast-diff, enabling it together with exclusive-lock and object-map {{(pid=122641) _get_rbd_support /opt/stack/cinder/cinder/backup/drivers/ceph.py:272}}
Jan 15 21:06:43.115137 ncdv-master-1 cinder-backup[122641]: DEBUG cinder.backup.drivers.ceph [None req-106464ea-f064-4dc9-af22-84e04390a98b tempest-VolumesBackupsAdminTest-678024116 None] Using --from-snap 'None' for incremental backup of volume c44cffd2-194b-406a-bbec-b2a2b48d795b. {{(pid=122641) _backup_rbd /opt/stack/cinder/cinder/backup/drivers/ceph.py:764}}
Jan 15 21:06:43.115693 ncdv-master-1 cinder-backup[122641]: DEBUG cinder.backup.drivers.ceph [None req-106464ea-f064-4dc9-af22-84e04390a98b tempest-VolumesBackupsAdminTest-678024116 None] Creating backup snapshot='backup.b994603c-241f-4007-9366-62ac06788dde.snap.1642280803.1151624' {{(pid=122641) _backup_rbd /opt/stack/cinder/cinder/backup/drivers/ceph.py:770}}
Jan 15 21:06:43.171349 ncdv-master-1 cinder-backup[122641]: DEBUG cinder.backup.drivers.ceph [None req-106464ea-f064-4dc9-af22-84e04390a98b tempest-VolumesBackupsAdminTest-678024116 None] Performing differential transfer from 'volume-c44cffd2-194b-406a-bbec-b2a2b48d795b' to 'volume-c44cffd2-194b-406a-bbec-b2a2b48d795b.backup.b994603c-241f-4007-9366-62ac06788dde' {{(pid=122641) _rbd_diff_transfer /opt/stack/cinder/cinder/backup/drivers/ceph.py:624}}
Jan 15 21:06:43.171915 ncdv-master-1 cinder-backup[122641]: DEBUG cinder.backup.drivers.ceph [None req-106464ea-f064-4dc9-af22-84e04390a98b tempest-VolumesBackupsAdminTest-678024116 None] Piping cmd1='rbd export-diff --id cinder --conf /tmp/brickrbd__jva8v7u --pool volumes volumes/volume-c44cffd2-194b-406a-bbec-b2a2b48d795b@backup.b994603c-241f-4007-9366-62ac06788dde.snap.1642280803.1151624 -' into... {{(pid=122641) _piped_execute /opt/stack/cinder/cinder/backup/drivers/ceph.py:585}}
Jan 15 21:06:43.172413 ncdv-master-1 cinder-backup[122641]: DEBUG cinder.backup.drivers.ceph [None req-106464ea-f064-4dc9-af22-84e04390a98b tempest-VolumesBackupsAdminTest-678024116 None] cmd2='rbd import-diff --id cinder-bak --conf /etc/ceph/ceph.conf --pool backups - backups/volume-c44cffd2-194b-406a-bbec-b2a2b48d795b.backup.b994603c-241f-4007-9366-62ac06788dde' {{(pid=122641) _piped_execute /opt/stack/cinder/cinder/backup/drivers/ceph.py:586}}
Jan 15 21:06:43.842292 ncdv-master-1 cinder-backup[122641]: DEBUG cinder.backup.drivers.ceph [None req-106464ea-f064-4dc9-af22-84e04390a98b tempest-VolumesBackupsAdminTest-678024116 None] Differential backup transfer completed in 0.6705s {{(pid=122641) _backup_rbd /opt/stack/cinder/cinder/backup/drivers/ceph.py:790}}
Jan 15 21:06:43.843316 ncdv-master-1 cinder-backup[122641]: DEBUG cinder.backup.driver [None req-106464ea-f064-4dc9-af22-84e04390a98b tempest-VolumesBackupsAdminTest-678024116 None] Getting metadata type 'volume-base-metadata' {{(pid=122641) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:79}}
Jan 15 21:06:43.860618 ncdv-master-1 cinder-backup[122641]: DEBUG cinder.backup.driver [None req-106464ea-f064-4dc9-af22-84e04390a98b tempest-VolumesBackupsAdminTest-678024116 None] Completed fetching metadata type 'volume-base-metadata' {{(pid=122641) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:98}}
Jan 15 21:06:43.861995 ncdv-master-1 cinder-backup[122641]: DEBUG cinder.backup.driver [None req-106464ea-f064-4dc9-af22-84e04390a98b tempest-VolumesBackupsAdminTest-678024116 None] Getting metadata type 'volume-metadata' {{(pid=122641) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:109}}
Jan 15 21:06:43.869793 ncdv-master-1 cinder-backup[122641]: DEBUG cinder.backup.driver [None req-106464ea-f064-4dc9-af22-84e04390a98b tempest-VolumesBackupsAdminTest-678024116 None] No metadata type 'volume-metadata' available {{(pid=122641) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:123}}
Jan 15 21:06:43.870417 ncdv-master-1 cinder-backup[122641]: DEBUG cinder.backup.driver [None req-106464ea-f064-4dc9-af22-84e04390a98b tempest-VolumesBackupsAdminTest-678024116 None] Getting metadata type 'volume-glance-metadata' {{(pid=122641) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:132}}
Jan 15 21:06:43.876402 ncdv-master-1 cinder-backup[122641]: DEBUG cinder.backup.driver [None req-106464ea-f064-4dc9-af22-84e04390a98b tempest-VolumesBackupsAdminTest-678024116 None] No metadata type 'volume-glance-metadata' available {{(pid=122641) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:147}}
Jan 15 21:06:43.877004 ncdv-master-1 cinder-backup[122641]: DEBUG cinder.backup.drivers.ceph [None req-106464ea-f064-4dc9-af22-84e04390a98b tempest-VolumesBackupsAdminTest-678024116 None] Backing up metadata for volume c44cffd2-194b-406a-bbec-b2a2b48d795b. {{(pid=122641) _backup_metadata /opt/stack/cinder/cinder/backup/drivers/ceph.py:951}}
Jan 15 21:06:43.918657 ncdv-master-1 cinder-backup[122641]: DEBUG cinder.backup.drivers.ceph [None req-106464ea-f064-4dc9-af22-84e04390a98b tempest-VolumesBackupsAdminTest-678024116 None] Backup 'b994603c-241f-4007-9366-62ac06788dde' of volume c44cffd2-194b-406a-bbec-b2a2b48d795b finished. {{(pid=122641) backup /opt/stack/cinder/cinder/backup/drivers/ceph.py:1015}}
Jan 15 21:06:43.920477 ncdv-master-1 cinder-backup[122641]: DEBUG os_brick.initiator.connectors.rbd [None req-106464ea-f064-4dc9-af22-84e04390a98b tempest-VolumesBackupsAdminTest-678024116 None] ==> disconnect_volume: call "{'self': <os_brick.initiator.connectors.rbd.RBDConnector object at 0x7f1af4572580>, 'connection_properties': {'name': 'volumes/volume-c44cffd2-194b-406a-bbec-b2a2b48d795b', 'hosts': ['10.222.0.46'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '***', 'volume_id': 'c44cffd2-194b-406a-bbec-b2a2b48d795b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'device_info': {'path': <os_brick.initiator.linuxrbd.RBDVolumeIOWrapper object at 0x7f1af4572520>}, 'force': True, 'ignore_errors': True}" {{(pid=122641) trace_logging_wrapper /usr/local/lib/python3.8/dist-packages/os_brick/utils.py:157}}
Jan 15 21:06:43.948749 ncdv-master-1 cinder-backup[122641]: DEBUG os_brick.initiator.connectors.rbd [None req-106464ea-f064-4dc9-af22-84e04390a98b tempest-VolumesBackupsAdminTest-678024116 None] <== disconnect_volume: return (27ms) None {{(pid=122641) trace_logging_wrapper /usr/local/lib/python3.8/dist-packages/os_brick/utils.py:184}}
Jan 15 21:06:44.042238 ncdv-master-1 cinder-backup[122641]: INFO cinder.backup.manager [None req-106464ea-f064-4dc9-af22-84e04390a98b tempest-VolumesBackupsAdminTest-678024116 None] Create backup finished. backup: b994603c-241f-4007-9366-62ac06788dde.
Jan 15 21:06:44.878534 ncdv-master-1 cinder-backup[122641]: INFO cinder.backup.manager [None req-329da614-e135-405e-9557-ee92cb0e7231 tempest-VolumesBackupsAdminTest-1232056558 None] Reset backup status started, backup_id: b994603c-241f-4007-9366-62ac06788dde, status: error.
Jan 15 21:06:44.878800 ncdv-master-1 cinder-backup[122641]: INFO cinder.backup.manager [None req-329da614-e135-405e-9557-ee92cb0e7231 tempest-VolumesBackupsAdminTest-1232056558 None] Backup service: cinder.backup.drivers.ceph.CephBackupDriver.
Jan 15 21:06:46.034670 ncdv-master-1 cinder-backup[122641]: INFO cinder.backup.manager [None req-5710bf21-e565-4f49-a80a-9fbabe84367d tempest-VolumesBackupsAdminTest-678024116 None] Delete backup started, backup: b994603c-241f-4007-9366-62ac06788dde.
Jan 15 21:06:46.038416 ncdv-master-1 cinder-backup[122641]: DEBUG cinder.backup.drivers.ceph [None req-5710bf21-e565-4f49-a80a-9fbabe84367d tempest-VolumesBackupsAdminTest-678024116 None] Delete started for backup=b994603c-241f-4007-9366-62ac06788dde {{(pid=122641) delete_backup /opt/stack/cinder/cinder/backup/drivers/ceph.py:1301}}
Jan 15 21:06:46.038993 ncdv-master-1 cinder-backup[122641]: DEBUG cinder.backup.drivers.ceph [None req-5710bf21-e565-4f49-a80a-9fbabe84367d tempest-VolumesBackupsAdminTest-678024116 None] Trying diff format basename='volume-c44cffd2-194b-406a-bbec-b2a2b48d795b.backup.b994603c-241f-4007-9366-62ac06788dde' for backup base image of volume c44cffd2-194b-406a-bbec-b2a2b48d795b. {{(pid=122641) _try_delete_base_image /opt/stack/cinder/cinder/backup/drivers/ceph.py:513}}
Jan 15 21:06:46.128935 ncdv-master-1 cinder-backup[122641]: DEBUG cinder.backup.drivers.ceph [None req-5710bf21-e565-4f49-a80a-9fbabe84367d tempest-VolumesBackupsAdminTest-678024116 None] Looking for snapshot of backup base 'volume-c44cffd2-194b-406a-bbec-b2a2b48d795b.backup.b994603c-241f-4007-9366-62ac06788dde' {{(pid=122641) _get_backup_snap_name /opt/stack/cinder/cinder/backup/drivers/ceph.py:905}}
Jan 15 21:06:46.129434 ncdv-master-1 cinder-backup[122641]: DEBUG cinder.backup.drivers.ceph [None req-5710bf21-e565-4f49-a80a-9fbabe84367d tempest-VolumesBackupsAdminTest-678024116 None] Found snapshot 'backup.b994603c-241f-4007-9366-62ac06788dde.snap.1642280803.1151624' {{(pid=122641) _get_backup_snap_name /opt/stack/cinder/cinder/backup/drivers/ceph.py:924}}
Jan 15 21:06:46.129913 ncdv-master-1 cinder-backup[122641]: DEBUG cinder.backup.drivers.ceph [None req-5710bf21-e565-4f49-a80a-9fbabe84367d tempest-VolumesBackupsAdminTest-678024116 None] Deleting backup snapshot='backup.b994603c-241f-4007-9366-62ac06788dde.snap.1642280803.1151624' {{(pid=122641) _delete_backup_snapshot /opt/stack/cinder/cinder/backup/drivers/ceph.py:473}}
Jan 15 21:06:46.319298 ncdv-master-1 cinder-backup[122641]: INFO cinder.backup.drivers.ceph [None req-5710bf21-e565-4f49-a80a-9fbabe84367d tempest-VolumesBackupsAdminTest-678024116 None] Deleting backup base image='volume-c44cffd2-194b-406a-bbec-b2a2b48d795b.backup.b994603c-241f-4007-9366-62ac06788dde' of volume c44cffd2-194b-406a-bbec-b2a2b48d795b.
Jan 15 21:06:46.643612 ncdv-master-1 cinder-backup[122641]: DEBUG cinder.backup.drivers.ceph [None req-5710bf21-e565-4f49-a80a-9fbabe84367d tempest-VolumesBackupsAdminTest-678024116 None] Base backup image='volume-c44cffd2-194b-406a-bbec-b2a2b48d795b.backup.b994603c-241f-4007-9366-62ac06788dde' of volume c44cffd2-194b-406a-bbec-b2a2b48d795b deleted. {{(pid=122641) _try_delete_base_image /opt/stack/cinder/cinder/backup/drivers/ceph.py:561}}
Jan 15 21:06:46.726976 ncdv-master-1 cinder-backup[122641]: DEBUG cinder.backup.drivers.ceph [None req-5710bf21-e565-4f49-a80a-9fbabe84367d tempest-VolumesBackupsAdminTest-678024116 None] Delete of backup 'b994603c-241f-4007-9366-62ac06788dde' for volume 'c44cffd2-194b-406a-bbec-b2a2b48d795b' finished. {{(pid=122641) delete_backup /opt/stack/cinder/cinder/backup/drivers/ceph.py:1329}}
Jan 15 21:06:46.738170 ncdv-master-1 cinder-backup[122641]: DEBUG oslo_db.sqlalchemy.engines [None req-5710bf21-e565-4f49-a80a-9fbabe84367d tempest-VolumesBackupsAdminTest-678024116 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122641) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}}
Jan 15 21:06:46.805196 ncdv-master-1 cinder-backup[122641]: DEBUG cinder.quota [None req-5710bf21-e565-4f49-a80a-9fbabe84367d tempest-VolumesBackupsAdminTest-678024116 None] Created reservations ['5688e4a6-2cae-471a-b63f-6d6025547e8a', 'd3c45b93-c925-4d57-a092-430b350b5586'] {{(pid=122641) reserve /opt/stack/cinder/cinder/quota.py:755}}
Jan 15 21:06:46.852751 ncdv-master-1 cinder-backup[122641]: INFO cinder.backup.manager [None req-5710bf21-e565-4f49-a80a-9fbabe84367d tempest-VolumesBackupsAdminTest-678024116 None] Delete backup finished, backup b994603c-241f-4007-9366-62ac06788dde deleted.
Jan 15 21:07:11.225412 ncdv-master-1 cinder-backup[122641]: DEBUG oslo_service.periodic_task [None req-880577f5-cbba-4bc0-b820-8647ffc48ae5 None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=122641) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Jan 15 21:07:11.226173 ncdv-master-1 cinder-backup[122641]: DEBUG cinder.manager [None req-880577f5-cbba-4bc0-b820-8647ffc48ae5 None None] Notifying Schedulers of capabilities ... {{(pid=122641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jan 15 21:07:42.345224 ncdv-master-1 cinder-backup[122641]: INFO cinder.backup.manager [None req-9f49605b-c4e8-490d-9c70-aefb1e4ed40e tempest-VolumesSnapshotTestJSON-711254379 None] Create backup started, backup: ce60397d-8149-4646-a6dc-8aa91ec1dda7 volume: 54e36e7f-6e75-428b-97f3-c673d414e0e9 snapshot: 83fca79f-1c91-4238-a0ac-c224626f75a2.
Jan 15 21:07:42.375479 ncdv-master-1 cinder-backup[122641]: DEBUG os_brick.utils [None req-9f49605b-c4e8-490d-9c70-aefb1e4ed40e tempest-VolumesSnapshotTestJSON-711254379 None] ==> get_connector_properties: call "{'root_helper': 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf', 'my_ip': '10.222.0.46', 'multipath': False, 'enforce_multipath': False, 'host': None, 'execute': None}" {{(pid=122641) trace_logging_wrapper /usr/local/lib/python3.8/dist-packages/os_brick/utils.py:157}}
Jan 15 21:07:42.380874 ncdv-master-1 cinder-backup[122641]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=147257) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 15 21:07:42.406756 ncdv-master-1 cinder-backup[122641]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.027s {{(pid=147257) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Jan 15 21:07:42.407235 ncdv-master-1 cinder-backup[122641]: DEBUG oslo.privsep.daemon [-] privsep: reply[af66ebcf-4cf4-47b6-8777-d78c0afa6cbf]: (4, ('## DO NOT EDIT OR REMOVE THIS FILE!\n## If you remove this file, the iSCSI daemon will not start.\n## If you change the InitiatorName, existing access control lists\n## may reject this initiator.  The InitiatorName must be unique\n## for each iSCSI initiator.  Do NOT duplicate iSCSI InitiatorNames.\nInitiatorName=iqn.1993-08.org.debian:01:b3cf3389e31a\n', '')) {{(pid=147257) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:502}}
Jan 15 21:07:42.408675 ncdv-master-1 cinder-backup[122641]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): systool -c fc_host -v {{(pid=147257) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 15 21:07:42.421368 ncdv-master-1 cinder-backup[122641]: DEBUG oslo_concurrency.processutils [-] 'systool -c fc_host -v' failed. Not Retrying. {{(pid=147257) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:473}}
Jan 15 21:07:42.422123 ncdv-master-1 cinder-backup[122641]: DEBUG oslo.privsep.daemon [-] privsep: Exception during request[76e8a754-460d-4e99-9f3f-279309f95996]: [Errno 2] No such file or directory: 'systool' {{(pid=147257) _process_cmd /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:480}}
Jan 15 21:07:42.422123 ncdv-master-1 cinder-backup[122641]: Traceback (most recent call last):
Jan 15 21:07:42.422123 ncdv-master-1 cinder-backup[122641]:   File "/usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py", line 477, in _process_cmd
Jan 15 21:07:42.422123 ncdv-master-1 cinder-backup[122641]:     ret = func(*f_args, **f_kwargs)
Jan 15 21:07:42.422123 ncdv-master-1 cinder-backup[122641]:   File "/usr/local/lib/python3.8/dist-packages/oslo_privsep/priv_context.py", line 274, in _wrap
Jan 15 21:07:42.422123 ncdv-master-1 cinder-backup[122641]:     return func(*args, **kwargs)
Jan 15 21:07:42.422123 ncdv-master-1 cinder-backup[122641]:   File "/usr/local/lib/python3.8/dist-packages/os_brick/privileged/rootwrap.py", line 197, in execute_root
Jan 15 21:07:42.422123 ncdv-master-1 cinder-backup[122641]:     return custom_execute(*cmd, shell=False, run_as_root=False, **kwargs)
Jan 15 21:07:42.422123 ncdv-master-1 cinder-backup[122641]:   File "/usr/local/lib/python3.8/dist-packages/os_brick/privileged/rootwrap.py", line 145, in custom_execute
Jan 15 21:07:42.422123 ncdv-master-1 cinder-backup[122641]:     return putils.execute(on_execute=on_execute,
Jan 15 21:07:42.422123 ncdv-master-1 cinder-backup[122641]:   File "/usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py", line 395, in execute
Jan 15 21:07:42.422123 ncdv-master-1 cinder-backup[122641]:     obj = subprocess.Popen(cmd,
Jan 15 21:07:42.422123 ncdv-master-1 cinder-backup[122641]:   File "/usr/lib/python3.8/subprocess.py", line 858, in __init__
Jan 15 21:07:42.422123 ncdv-master-1 cinder-backup[122641]:     self._execute_child(args, executable, preexec_fn, close_fds,
Jan 15 21:07:42.422123 ncdv-master-1 cinder-backup[122641]:   File "/usr/lib/python3.8/subprocess.py", line 1704, in _execute_child
Jan 15 21:07:42.422123 ncdv-master-1 cinder-backup[122641]:     raise child_exception_type(errno_num, err_msg, err_filename)
Jan 15 21:07:42.422123 ncdv-master-1 cinder-backup[122641]: FileNotFoundError: [Errno 2] No such file or directory: 'systool'
Jan 15 21:07:42.423571 ncdv-master-1 cinder-backup[122641]: DEBUG oslo.privsep.daemon [-] privsep: reply[76e8a754-460d-4e99-9f3f-279309f95996]: (5, 'builtins.FileNotFoundError', (2, 'No such file or directory')) {{(pid=147257) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:502}}
Jan 15 21:07:42.424935 ncdv-master-1 cinder-backup[122641]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): systool -c fc_host -v {{(pid=147257) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 15 21:07:42.435059 ncdv-master-1 cinder-backup[122641]: DEBUG oslo_concurrency.processutils [-] 'systool -c fc_host -v' failed. Not Retrying. {{(pid=147257) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:473}}
Jan 15 21:07:42.435795 ncdv-master-1 cinder-backup[122641]: DEBUG oslo.privsep.daemon [-] privsep: Exception during request[fd7d8728-6dbc-4e1c-90fd-7c7fe8b4c58a]: [Errno 2] No such file or directory: 'systool' {{(pid=147257) _process_cmd /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:480}}
Jan 15 21:07:42.435795 ncdv-master-1 cinder-backup[122641]: Traceback (most recent call last):
Jan 15 21:07:42.435795 ncdv-master-1 cinder-backup[122641]:   File "/usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py", line 477, in _process_cmd
Jan 15 21:07:42.435795 ncdv-master-1 cinder-backup[122641]:     ret = func(*f_args, **f_kwargs)
Jan 15 21:07:42.435795 ncdv-master-1 cinder-backup[122641]:   File "/usr/local/lib/python3.8/dist-packages/oslo_privsep/priv_context.py", line 274, in _wrap
Jan 15 21:07:42.435795 ncdv-master-1 cinder-backup[122641]:     return func(*args, **kwargs)
Jan 15 21:07:42.435795 ncdv-master-1 cinder-backup[122641]:   File "/usr/local/lib/python3.8/dist-packages/os_brick/privileged/rootwrap.py", line 197, in execute_root
Jan 15 21:07:42.435795 ncdv-master-1 cinder-backup[122641]:     return custom_execute(*cmd, shell=False, run_as_root=False, **kwargs)
Jan 15 21:07:42.435795 ncdv-master-1 cinder-backup[122641]:   File "/usr/local/lib/python3.8/dist-packages/os_brick/privileged/rootwrap.py", line 145, in custom_execute
Jan 15 21:07:42.435795 ncdv-master-1 cinder-backup[122641]:     return putils.execute(on_execute=on_execute,
Jan 15 21:07:42.435795 ncdv-master-1 cinder-backup[122641]:   File "/usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py", line 395, in execute
Jan 15 21:07:42.435795 ncdv-master-1 cinder-backup[122641]:     obj = subprocess.Popen(cmd,
Jan 15 21:07:42.435795 ncdv-master-1 cinder-backup[122641]:   File "/usr/lib/python3.8/subprocess.py", line 858, in __init__
Jan 15 21:07:42.435795 ncdv-master-1 cinder-backup[122641]:     self._execute_child(args, executable, preexec_fn, close_fds,
Jan 15 21:07:42.435795 ncdv-master-1 cinder-backup[122641]:   File "/usr/lib/python3.8/subprocess.py", line 1704, in _execute_child
Jan 15 21:07:42.435795 ncdv-master-1 cinder-backup[122641]:     raise child_exception_type(errno_num, err_msg, err_filename)
Jan 15 21:07:42.435795 ncdv-master-1 cinder-backup[122641]: FileNotFoundError: [Errno 2] No such file or directory: 'systool'
Jan 15 21:07:42.437402 ncdv-master-1 cinder-backup[122641]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd7d8728-6dbc-4e1c-90fd-7c7fe8b4c58a]: (5, 'builtins.FileNotFoundError', (2, 'No such file or directory')) {{(pid=147257) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:502}}
Jan 15 21:07:42.438798 ncdv-master-1 cinder-backup[122641]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=147257) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 15 21:07:42.467072 ncdv-master-1 cinder-backup[122641]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.028s {{(pid=147257) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Jan 15 21:07:42.467460 ncdv-master-1 cinder-backup[122641]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f9ef85a-f0c3-4be2-8713-ccdd67dc18ba]: (4, ('/dev/sda1\n', '')) {{(pid=147257) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:502}}
Jan 15 21:07:42.468873 ncdv-master-1 cinder-backup[122641]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/sda1 -s UUID -o value {{(pid=147257) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 15 21:07:42.491476 ncdv-master-1 cinder-backup[122641]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/sda1 -s UUID -o value" returned: 0 in 0.021s {{(pid=147257) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Jan 15 21:07:42.492456 ncdv-master-1 cinder-backup[122641]: DEBUG oslo.privsep.daemon [-] privsep: reply[d93a9291-6e09-4a42-af32-238ad8aedd25]: (4, ('02bb033c-a191-40c0-94fb-bb025c724b13\n', '')) {{(pid=147257) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:502}}
Jan 15 21:07:42.494250 ncdv-master-1 cinder-backup[122641]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /sys/class/dmi/id/product_uuid {{(pid=147257) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 15 21:07:42.506532 ncdv-master-1 cinder-backup[122641]: DEBUG oslo_concurrency.processutils [-] CMD "cat /sys/class/dmi/id/product_uuid" returned: 0 in 0.012s {{(pid=147257) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Jan 15 21:07:42.507593 ncdv-master-1 cinder-backup[122641]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d523133-5062-45d8-b614-04f7c9705379]: (4, ('1b06c783-92a7-1942-a345-69784a0224b6\n', '')) {{(pid=147257) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:502}}
Jan 15 21:07:42.508822 ncdv-master-1 cinder-backup[122641]: DEBUG oslo_concurrency.processutils [None req-9f49605b-c4e8-490d-9c70-aefb1e4ed40e tempest-VolumesSnapshotTestJSON-711254379 None] Running cmd (subprocess): nvme version {{(pid=122641) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 15 21:07:42.559429 ncdv-master-1 cinder-backup[122641]: DEBUG oslo_concurrency.processutils [None req-9f49605b-c4e8-490d-9c70-aefb1e4ed40e tempest-VolumesSnapshotTestJSON-711254379 None] CMD "nvme version" returned: 0 in 0.050s {{(pid=122641) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Jan 15 21:07:42.560708 ncdv-master-1 cinder-backup[122641]: DEBUG os_brick.utils [None req-9f49605b-c4e8-490d-9c70-aefb1e4ed40e tempest-VolumesSnapshotTestJSON-711254379 None] <== get_connector_properties: return (184ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.222.0.46', 'host': 'ncdv-master-1', 'multipath': False, 'initiator': 'iqn.1993-08.org.debian:01:b3cf3389e31a', 'do_local_attach': False, 'uuid': '02bb033c-a191-40c0-94fb-bb025c724b13', 'system uuid': '1b06c783-92a7-1942-a345-69784a0224b6', 'nqn': 'nqn.2014-08.org.nvmexpress:uuid:2f801fe5-9757-4764-9681-7ba5df13a96f'} {{(pid=122641) trace_logging_wrapper /usr/local/lib/python3.8/dist-packages/os_brick/utils.py:184}}
Jan 15 21:07:43.840993 ncdv-master-1 cinder-backup[122641]: DEBUG os_brick.initiator.connector [None req-9f49605b-c4e8-490d-9c70-aefb1e4ed40e tempest-VolumesSnapshotTestJSON-711254379 None] Factory for rbd on None {{(pid=122641) factory /usr/local/lib/python3.8/dist-packages/os_brick/initiator/connector.py:281}}
Jan 15 21:07:43.849958 ncdv-master-1 cinder-backup[122641]: DEBUG os_brick.initiator.connectors.rbd [None req-9f49605b-c4e8-490d-9c70-aefb1e4ed40e tempest-VolumesSnapshotTestJSON-711254379 None] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.rbd.RBDConnector object at 0x7f1af4572460>, 'connection_properties': {'name': 'volumes/volume-36d57237-7f3c-49f3-b497-9bd3e60acad2', 'hosts': ['10.222.0.46'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '***', 'volume_id': '36d57237-7f3c-49f3-b497-9bd3e60acad2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}}" {{(pid=122641) trace_logging_wrapper /usr/local/lib/python3.8/dist-packages/os_brick/utils.py:157}}
Jan 15 21:07:43.851167 ncdv-master-1 cinder-backup[122641]: DEBUG os_brick.initiator.linuxrbd [None req-9f49605b-c4e8-490d-9c70-aefb1e4ed40e tempest-VolumesSnapshotTestJSON-711254379 None] opening connection to ceph cluster (timeout=-1). {{(pid=122641) connect /usr/local/lib/python3.8/dist-packages/os_brick/initiator/linuxrbd.py:70}}
Jan 15 21:07:43.959636 ncdv-master-1 cinder-backup[122641]: DEBUG os_brick.initiator.connectors.rbd [None req-9f49605b-c4e8-490d-9c70-aefb1e4ed40e tempest-VolumesSnapshotTestJSON-711254379 None] <== connect_volume: return (109ms) {'path': <os_brick.initiator.linuxrbd.RBDVolumeIOWrapper object at 0x7f1af461cbb0>} {{(pid=122641) trace_logging_wrapper /usr/local/lib/python3.8/dist-packages/os_brick/utils.py:184}}
Jan 15 21:07:43.967999 ncdv-master-1 cinder-backup[122641]: DEBUG oslo_db.sqlalchemy.engines [None req-9f49605b-c4e8-490d-9c70-aefb1e4ed40e tempest-VolumesSnapshotTestJSON-711254379 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122641) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}}
Jan 15 21:07:44.006433 ncdv-master-1 cinder-backup[122641]: DEBUG cinder.backup.drivers.ceph [None req-9f49605b-c4e8-490d-9c70-aefb1e4ed40e tempest-VolumesSnapshotTestJSON-711254379 None] Starting backup of volume='54e36e7f-6e75-428b-97f3-c673d414e0e9'. {{(pid=122641) backup /opt/stack/cinder/cinder/backup/drivers/ceph.py:974}}
Jan 15 21:07:44.086969 ncdv-master-1 cinder-backup[122641]: DEBUG cinder.backup.drivers.ceph [None req-9f49605b-c4e8-490d-9c70-aefb1e4ed40e tempest-VolumesSnapshotTestJSON-711254379 None] RBD also supports fast-diff, enabling it together with exclusive-lock and object-map {{(pid=122641) _get_rbd_support /opt/stack/cinder/cinder/backup/drivers/ceph.py:272}}
Jan 15 21:07:44.090240 ncdv-master-1 cinder-backup[122641]: DEBUG cinder.backup.drivers.ceph [None req-9f49605b-c4e8-490d-9c70-aefb1e4ed40e tempest-VolumesSnapshotTestJSON-711254379 None] Creating backup base image='volume-54e36e7f-6e75-428b-97f3-c673d414e0e9.backup.base' for volume 54e36e7f-6e75-428b-97f3-c673d414e0e9. {{(pid=122641) _full_backup /opt/stack/cinder/cinder/backup/drivers/ceph.py:830}}
Jan 15 21:07:44.155858 ncdv-master-1 cinder-backup[122641]: DEBUG cinder.backup.drivers.ceph [None req-9f49605b-c4e8-490d-9c70-aefb1e4ed40e tempest-VolumesSnapshotTestJSON-711254379 None] Copying data from volume 54e36e7f-6e75-428b-97f3-c673d414e0e9. {{(pid=122641) _full_backup /opt/stack/cinder/cinder/backup/drivers/ceph.py:842}}
Jan 15 21:07:44.183062 ncdv-master-1 cinder-backup[122641]: DEBUG cinder.backup.drivers.ceph [None req-9f49605b-c4e8-490d-9c70-aefb1e4ed40e tempest-VolumesSnapshotTestJSON-711254379 None] Transferring data between 'volume-54e36e7f-6e75-428b-97f3-c673d414e0e9' and 'volume-54e36e7f-6e75-428b-97f3-c673d414e0e9.backup.base' {{(pid=122641) _transfer_data /opt/stack/cinder/cinder/backup/drivers/ceph.py:399}}
Jan 15 21:07:44.183582 ncdv-master-1 cinder-backup[122641]: DEBUG cinder.backup.drivers.ceph [None req-9f49605b-c4e8-490d-9c70-aefb1e4ed40e tempest-VolumesSnapshotTestJSON-711254379 None] 8 chunks of 134217728 bytes to be transferred {{(pid=122641) _transfer_data /opt/stack/cinder/cinder/backup/drivers/ceph.py:403}}
Jan 15 21:07:45.935395 ncdv-master-1 cinder-backup[122641]: DEBUG cinder.backup.drivers.ceph [None req-9f49605b-c4e8-490d-9c70-aefb1e4ed40e tempest-VolumesSnapshotTestJSON-711254379 None] Transferred chunk 1 of 8 (74847K/s) {{(pid=122641) _transfer_data /opt/stack/cinder/cinder/backup/drivers/ceph.py:422}}
Jan 15 21:07:47.921215 ncdv-master-1 cinder-backup[122641]: DEBUG cinder.backup.drivers.ceph [None req-9f49605b-c4e8-490d-9c70-aefb1e4ed40e tempest-VolumesSnapshotTestJSON-711254379 None] Transferred chunk 2 of 8 (66024K/s) {{(pid=122641) _transfer_data /opt/stack/cinder/cinder/backup/drivers/ceph.py:422}}
Jan 15 21:07:49.668724 ncdv-master-1 cinder-backup[122641]: DEBUG cinder.backup.drivers.ceph [None req-9f49605b-c4e8-490d-9c70-aefb1e4ed40e tempest-VolumesSnapshotTestJSON-711254379 None] Transferred chunk 3 of 8 (75031K/s) {{(pid=122641) _transfer_data /opt/stack/cinder/cinder/backup/drivers/ceph.py:422}}
Jan 15 21:07:51.095490 ncdv-master-1 cinder-backup[122641]: DEBUG cinder.backup.drivers.ceph [None req-9f49605b-c4e8-490d-9c70-aefb1e4ed40e tempest-VolumesSnapshotTestJSON-711254379 None] Transferred chunk 4 of 8 (91958K/s) {{(pid=122641) _transfer_data /opt/stack/cinder/cinder/backup/drivers/ceph.py:422}}
Jan 15 21:07:52.475025 ncdv-master-1 cinder-backup[122641]: DEBUG cinder.backup.drivers.ceph [None req-9f49605b-c4e8-490d-9c70-aefb1e4ed40e tempest-VolumesSnapshotTestJSON-711254379 None] Transferred chunk 5 of 8 (95253K/s) {{(pid=122641) _transfer_data /opt/stack/cinder/cinder/backup/drivers/ceph.py:422}}
Jan 15 21:07:53.805740 ncdv-master-1 cinder-backup[122641]: DEBUG cinder.backup.drivers.ceph [None req-9f49605b-c4e8-490d-9c70-aefb1e4ed40e tempest-VolumesSnapshotTestJSON-711254379 None] Transferred chunk 6 of 8 (98374K/s) {{(pid=122641) _transfer_data /opt/stack/cinder/cinder/backup/drivers/ceph.py:422}}
Jan 15 21:07:55.130326 ncdv-master-1 cinder-backup[122641]: DEBUG cinder.backup.drivers.ceph [None req-9f49605b-c4e8-490d-9c70-aefb1e4ed40e tempest-VolumesSnapshotTestJSON-711254379 None] Transferred chunk 7 of 8 (99126K/s) {{(pid=122641) _transfer_data /opt/stack/cinder/cinder/backup/drivers/ceph.py:422}}
Jan 15 21:07:56.575111 ncdv-master-1 cinder-backup[122641]: DEBUG cinder.backup.drivers.ceph [None req-9f49605b-c4e8-490d-9c70-aefb1e4ed40e tempest-VolumesSnapshotTestJSON-711254379 None] Transferred chunk 8 of 8 (90650K/s) {{(pid=122641) _transfer_data /opt/stack/cinder/cinder/backup/drivers/ceph.py:422}}
Jan 15 21:07:56.643309 ncdv-master-1 cinder-backup[122641]: DEBUG cinder.backup.driver [None req-9f49605b-c4e8-490d-9c70-aefb1e4ed40e tempest-VolumesSnapshotTestJSON-711254379 None] Getting metadata type 'volume-base-metadata' {{(pid=122641) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:79}}
Jan 15 21:07:56.657904 ncdv-master-1 cinder-backup[122641]: DEBUG cinder.backup.driver [None req-9f49605b-c4e8-490d-9c70-aefb1e4ed40e tempest-VolumesSnapshotTestJSON-711254379 None] Completed fetching metadata type 'volume-base-metadata' {{(pid=122641) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:98}}
Jan 15 21:07:56.661203 ncdv-master-1 cinder-backup[122641]: DEBUG cinder.backup.driver [None req-9f49605b-c4e8-490d-9c70-aefb1e4ed40e tempest-VolumesSnapshotTestJSON-711254379 None] Getting metadata type 'volume-metadata' {{(pid=122641) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:109}}
Jan 15 21:07:56.679000 ncdv-master-1 cinder-backup[122641]: DEBUG cinder.backup.driver [None req-9f49605b-c4e8-490d-9c70-aefb1e4ed40e tempest-VolumesSnapshotTestJSON-711254379 None] No metadata type 'volume-metadata' available {{(pid=122641) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:123}}
Jan 15 21:07:56.679623 ncdv-master-1 cinder-backup[122641]: DEBUG cinder.backup.driver [None req-9f49605b-c4e8-490d-9c70-aefb1e4ed40e tempest-VolumesSnapshotTestJSON-711254379 None] Getting metadata type 'volume-glance-metadata' {{(pid=122641) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:132}}
Jan 15 21:07:56.687113 ncdv-master-1 cinder-backup[122641]: DEBUG cinder.backup.driver [None req-9f49605b-c4e8-490d-9c70-aefb1e4ed40e tempest-VolumesSnapshotTestJSON-711254379 None] No metadata type 'volume-glance-metadata' available {{(pid=122641) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:147}}
Jan 15 21:07:56.690074 ncdv-master-1 cinder-backup[122641]: DEBUG cinder.backup.drivers.ceph [None req-9f49605b-c4e8-490d-9c70-aefb1e4ed40e tempest-VolumesSnapshotTestJSON-711254379 None] Backing up metadata for volume 54e36e7f-6e75-428b-97f3-c673d414e0e9. {{(pid=122641) _backup_metadata /opt/stack/cinder/cinder/backup/drivers/ceph.py:951}}
Jan 15 21:07:56.790951 ncdv-master-1 cinder-backup[122641]: DEBUG cinder.backup.drivers.ceph [None req-9f49605b-c4e8-490d-9c70-aefb1e4ed40e tempest-VolumesSnapshotTestJSON-711254379 None] Backup 'ce60397d-8149-4646-a6dc-8aa91ec1dda7' of volume 54e36e7f-6e75-428b-97f3-c673d414e0e9 finished. {{(pid=122641) backup /opt/stack/cinder/cinder/backup/drivers/ceph.py:1015}}
Jan 15 21:07:56.793253 ncdv-master-1 cinder-backup[122641]: DEBUG os_brick.initiator.connectors.rbd [None req-9f49605b-c4e8-490d-9c70-aefb1e4ed40e tempest-VolumesSnapshotTestJSON-711254379 None] ==> disconnect_volume: call "{'self': <os_brick.initiator.connectors.rbd.RBDConnector object at 0x7f1af4572460>, 'connection_properties': {'name': 'volumes/volume-36d57237-7f3c-49f3-b497-9bd3e60acad2', 'hosts': ['10.222.0.46'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '***', 'volume_id': '36d57237-7f3c-49f3-b497-9bd3e60acad2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'device_info': {'path': <os_brick.initiator.linuxrbd.RBDVolumeIOWrapper object at 0x7f1af461cbb0>}, 'force': True, 'ignore_errors': True}" {{(pid=122641) trace_logging_wrapper /usr/local/lib/python3.8/dist-packages/os_brick/utils.py:157}}
Jan 15 21:07:56.817367 ncdv-master-1 cinder-backup[122641]: DEBUG os_brick.initiator.connectors.rbd [None req-9f49605b-c4e8-490d-9c70-aefb1e4ed40e tempest-VolumesSnapshotTestJSON-711254379 None] <== disconnect_volume: return (22ms) None {{(pid=122641) trace_logging_wrapper /usr/local/lib/python3.8/dist-packages/os_brick/utils.py:184}}
Jan 15 21:07:57.108969 ncdv-master-1 cinder-backup[122641]: INFO cinder.backup.manager [None req-9f49605b-c4e8-490d-9c70-aefb1e4ed40e tempest-VolumesSnapshotTestJSON-711254379 None] Create backup finished. backup: ce60397d-8149-4646-a6dc-8aa91ec1dda7.
Jan 15 21:07:58.184512 ncdv-master-1 cinder-backup[122641]: INFO cinder.backup.manager [None req-14d7def2-a2be-4645-9fc4-ce52ca5279b1 tempest-VolumesSnapshotTestJSON-711254379 None] Delete backup started, backup: ce60397d-8149-4646-a6dc-8aa91ec1dda7.
Jan 15 21:07:58.187483 ncdv-master-1 cinder-backup[122641]: DEBUG cinder.backup.drivers.ceph [None req-14d7def2-a2be-4645-9fc4-ce52ca5279b1 tempest-VolumesSnapshotTestJSON-711254379 None] Delete started for backup=ce60397d-8149-4646-a6dc-8aa91ec1dda7 {{(pid=122641) delete_backup /opt/stack/cinder/cinder/backup/drivers/ceph.py:1301}}
Jan 15 21:07:58.187914 ncdv-master-1 cinder-backup[122641]: DEBUG cinder.backup.drivers.ceph [None req-14d7def2-a2be-4645-9fc4-ce52ca5279b1 tempest-VolumesSnapshotTestJSON-711254379 None] Trying diff format basename='volume-54e36e7f-6e75-428b-97f3-c673d414e0e9.backup.ce60397d-8149-4646-a6dc-8aa91ec1dda7' for backup base image of volume 54e36e7f-6e75-428b-97f3-c673d414e0e9. {{(pid=122641) _try_delete_base_image /opt/stack/cinder/cinder/backup/drivers/ceph.py:513}}
Jan 15 21:07:58.237259 ncdv-master-1 cinder-backup[122641]: DEBUG cinder.backup.drivers.ceph [None req-14d7def2-a2be-4645-9fc4-ce52ca5279b1 tempest-VolumesSnapshotTestJSON-711254379 None] Image 'volume-54e36e7f-6e75-428b-97f3-c673d414e0e9.backup.ce60397d-8149-4646-a6dc-8aa91ec1dda7' not found - trying diff format name {{(pid=122641) _rbd_image_exists /opt/stack/cinder/cinder/backup/drivers/ceph.py:661}}
Jan 15 21:07:58.262978 ncdv-master-1 cinder-backup[122641]: DEBUG cinder.backup.drivers.ceph [None req-14d7def2-a2be-4645-9fc4-ce52ca5279b1 tempest-VolumesSnapshotTestJSON-711254379 None] Looking for snapshot of backup base 'volume-54e36e7f-6e75-428b-97f3-c673d414e0e9.backup.base' {{(pid=122641) _get_backup_snap_name /opt/stack/cinder/cinder/backup/drivers/ceph.py:905}}
Jan 15 21:07:58.263812 ncdv-master-1 cinder-backup[122641]: DEBUG cinder.backup.drivers.ceph [None req-14d7def2-a2be-4645-9fc4-ce52ca5279b1 tempest-VolumesSnapshotTestJSON-711254379 None] Backup base 'volume-54e36e7f-6e75-428b-97f3-c673d414e0e9.backup.base' has no snapshots {{(pid=122641) _get_backup_snap_name /opt/stack/cinder/cinder/backup/drivers/ceph.py:908}}
Jan 15 21:07:58.264360 ncdv-master-1 cinder-backup[122641]: DEBUG cinder.backup.drivers.ceph [None req-14d7def2-a2be-4645-9fc4-ce52ca5279b1 tempest-VolumesSnapshotTestJSON-711254379 None] No backup snapshot to delete {{(pid=122641) _delete_backup_snapshot /opt/stack/cinder/cinder/backup/drivers/ceph.py:476}}
Jan 15 21:07:58.286088 ncdv-master-1 cinder-backup[122641]: INFO cinder.backup.drivers.ceph [None req-14d7def2-a2be-4645-9fc4-ce52ca5279b1 tempest-VolumesSnapshotTestJSON-711254379 None] Deleting backup base image='volume-54e36e7f-6e75-428b-97f3-c673d414e0e9.backup.base' of volume 54e36e7f-6e75-428b-97f3-c673d414e0e9.
Jan 15 21:07:58.514528 ncdv-master-1 cinder-backup[122641]: DEBUG oslo_db.sqlalchemy.engines [None req-cda43372-e9c8-4414-b3aa-7cf812823c29 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122641) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}}
Jan 15 21:07:59.311929 ncdv-master-1 cinder-backup[122641]: DEBUG cinder.backup.drivers.ceph [None req-14d7def2-a2be-4645-9fc4-ce52ca5279b1 tempest-VolumesSnapshotTestJSON-711254379 None] Base backup image='volume-54e36e7f-6e75-428b-97f3-c673d414e0e9.backup.base' of volume 54e36e7f-6e75-428b-97f3-c673d414e0e9 deleted. {{(pid=122641) _try_delete_base_image /opt/stack/cinder/cinder/backup/drivers/ceph.py:561}}
Jan 15 21:07:59.429365 ncdv-master-1 cinder-backup[122641]: DEBUG cinder.backup.drivers.ceph [None req-14d7def2-a2be-4645-9fc4-ce52ca5279b1 tempest-VolumesSnapshotTestJSON-711254379 None] Delete of backup 'ce60397d-8149-4646-a6dc-8aa91ec1dda7' for volume '54e36e7f-6e75-428b-97f3-c673d414e0e9' finished. {{(pid=122641) delete_backup /opt/stack/cinder/cinder/backup/drivers/ceph.py:1329}}
Jan 15 21:07:59.498780 ncdv-master-1 cinder-backup[122641]: DEBUG cinder.quota [None req-14d7def2-a2be-4645-9fc4-ce52ca5279b1 tempest-VolumesSnapshotTestJSON-711254379 None] Created reservations ['08377095-0972-4c7d-8d87-798329ba52e0', '5fc56bc6-2d69-45a7-89ef-043d3e2e335e'] {{(pid=122641) reserve /opt/stack/cinder/cinder/quota.py:755}}
Jan 15 21:07:59.571423 ncdv-master-1 cinder-backup[122641]: INFO cinder.backup.manager [None req-14d7def2-a2be-4645-9fc4-ce52ca5279b1 tempest-VolumesSnapshotTestJSON-711254379 None] Delete backup finished, backup ce60397d-8149-4646-a6dc-8aa91ec1dda7 deleted.
Jan 15 21:08:11.221713 ncdv-master-1 cinder-backup[122641]: DEBUG oslo_service.periodic_task [None req-880577f5-cbba-4bc0-b820-8647ffc48ae5 None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=122641) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Jan 15 21:08:11.222962 ncdv-master-1 cinder-backup[122641]: DEBUG cinder.manager [None req-880577f5-cbba-4bc0-b820-8647ffc48ae5 None None] Notifying Schedulers of capabilities ... {{(pid=122641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jan 15 21:09:11.221639 ncdv-master-1 cinder-backup[122641]: DEBUG oslo_service.periodic_task [None req-880577f5-cbba-4bc0-b820-8647ffc48ae5 None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=122641) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Jan 15 21:09:11.222333 ncdv-master-1 cinder-backup[122641]: DEBUG cinder.manager [None req-880577f5-cbba-4bc0-b820-8647ffc48ae5 None None] Notifying Schedulers of capabilities ... {{(pid=122641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jan 15 21:11:11.218898 ncdv-master-1 cinder-backup[122641]: DEBUG oslo_service.periodic_task [None req-880577f5-cbba-4bc0-b820-8647ffc48ae5 None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=122641) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Jan 15 21:11:11.219513 ncdv-master-1 cinder-backup[122641]: DEBUG cinder.manager [None req-880577f5-cbba-4bc0-b820-8647ffc48ae5 None None] Notifying Schedulers of capabilities ... {{(pid=122641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jan 15 21:11:35.588387 ncdv-master-1 cinder-backup[122641]: INFO cinder.backup.manager [None req-f27268df-7eef-4d34-8e1e-2d52683d451b tempest-VolumesBackupsTest-197440665 None] Create backup started, backup: 3f505e22-b613-4ee1-a442-a919a6e175d3 volume: c02f8a1d-b762-40be-9f64-e353ef1c9a98.
Jan 15 21:11:35.601691 ncdv-master-1 cinder-backup[122641]: DEBUG os_brick.utils [None req-f27268df-7eef-4d34-8e1e-2d52683d451b tempest-VolumesBackupsTest-197440665 None] ==> get_connector_properties: call "{'root_helper': 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf', 'my_ip': '10.222.0.46', 'multipath': False, 'enforce_multipath': False, 'host': None, 'execute': None}" {{(pid=122641) trace_logging_wrapper /usr/local/lib/python3.8/dist-packages/os_brick/utils.py:157}}
Jan 15 21:11:35.605613 ncdv-master-1 cinder-backup[122641]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=147257) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 15 21:11:35.639591 ncdv-master-1 cinder-backup[122641]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.036s {{(pid=147257) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Jan 15 21:11:35.639591 ncdv-master-1 cinder-backup[122641]: DEBUG oslo.privsep.daemon [-] privsep: reply[b83c887f-8679-416a-94ce-e8e3dd0313c8]: (4, ('## DO NOT EDIT OR REMOVE THIS FILE!\n## If you remove this file, the iSCSI daemon will not start.\n## If you change the InitiatorName, existing access control lists\n## may reject this initiator.  The InitiatorName must be unique\n## for each iSCSI initiator.  Do NOT duplicate iSCSI InitiatorNames.\nInitiatorName=iqn.1993-08.org.debian:01:b3cf3389e31a\n', '')) {{(pid=147257) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:502}}
Jan 15 21:11:35.641290 ncdv-master-1 cinder-backup[122641]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): systool -c fc_host -v {{(pid=147257) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 15 21:11:35.651276 ncdv-master-1 cinder-backup[122641]: DEBUG oslo_concurrency.processutils [-] 'systool -c fc_host -v' failed. Not Retrying. {{(pid=147257) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:473}}
Jan 15 21:11:35.651687 ncdv-master-1 cinder-backup[122641]: DEBUG oslo.privsep.daemon [-] privsep: Exception during request[8a2a83f2-ee5c-465b-8aa4-4bcca6614766]: [Errno 2] No such file or directory: 'systool' {{(pid=147257) _process_cmd /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:480}}
Jan 15 21:11:35.651687 ncdv-master-1 cinder-backup[122641]: Traceback (most recent call last):
Jan 15 21:11:35.651687 ncdv-master-1 cinder-backup[122641]:   File "/usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py", line 477, in _process_cmd
Jan 15 21:11:35.651687 ncdv-master-1 cinder-backup[122641]:     ret = func(*f_args, **f_kwargs)
Jan 15 21:11:35.651687 ncdv-master-1 cinder-backup[122641]:   File "/usr/local/lib/python3.8/dist-packages/oslo_privsep/priv_context.py", line 274, in _wrap
Jan 15 21:11:35.651687 ncdv-master-1 cinder-backup[122641]:     return func(*args, **kwargs)
Jan 15 21:11:35.651687 ncdv-master-1 cinder-backup[122641]:   File "/usr/local/lib/python3.8/dist-packages/os_brick/privileged/rootwrap.py", line 197, in execute_root
Jan 15 21:11:35.651687 ncdv-master-1 cinder-backup[122641]:     return custom_execute(*cmd, shell=False, run_as_root=False, **kwargs)
Jan 15 21:11:35.651687 ncdv-master-1 cinder-backup[122641]:   File "/usr/local/lib/python3.8/dist-packages/os_brick/privileged/rootwrap.py", line 145, in custom_execute
Jan 15 21:11:35.651687 ncdv-master-1 cinder-backup[122641]:     return putils.execute(on_execute=on_execute,
Jan 15 21:11:35.651687 ncdv-master-1 cinder-backup[122641]:   File "/usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py", line 395, in execute
Jan 15 21:11:35.651687 ncdv-master-1 cinder-backup[122641]:     obj = subprocess.Popen(cmd,
Jan 15 21:11:35.651687 ncdv-master-1 cinder-backup[122641]:   File "/usr/lib/python3.8/subprocess.py", line 858, in __init__
Jan 15 21:11:35.651687 ncdv-master-1 cinder-backup[122641]:     self._execute_child(args, executable, preexec_fn, close_fds,
Jan 15 21:11:35.651687 ncdv-master-1 cinder-backup[122641]:   File "/usr/lib/python3.8/subprocess.py", line 1704, in _execute_child
Jan 15 21:11:35.651687 ncdv-master-1 cinder-backup[122641]:     raise child_exception_type(errno_num, err_msg, err_filename)
Jan 15 21:11:35.651687 ncdv-master-1 cinder-backup[122641]: FileNotFoundError: [Errno 2] No such file or directory: 'systool'
Jan 15 21:11:35.652959 ncdv-master-1 cinder-backup[122641]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a2a83f2-ee5c-465b-8aa4-4bcca6614766]: (5, 'builtins.FileNotFoundError', (2, 'No such file or directory')) {{(pid=147257) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:502}}
Jan 15 21:11:35.655612 ncdv-master-1 cinder-backup[122641]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): systool -c fc_host -v {{(pid=147257) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 15 21:11:35.662637 ncdv-master-1 cinder-backup[122641]: DEBUG oslo_concurrency.processutils [-] 'systool -c fc_host -v' failed. Not Retrying. {{(pid=147257) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:473}}
Jan 15 21:11:35.662930 ncdv-master-1 cinder-backup[122641]: DEBUG oslo.privsep.daemon [-] privsep: Exception during request[e269756a-21a4-4956-b9e7-194a29b1d13a]: [Errno 2] No such file or directory: 'systool' {{(pid=147257) _process_cmd /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:480}}
Jan 15 21:11:35.662930 ncdv-master-1 cinder-backup[122641]: Traceback (most recent call last):
Jan 15 21:11:35.662930 ncdv-master-1 cinder-backup[122641]:   File "/usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py", line 477, in _process_cmd
Jan 15 21:11:35.662930 ncdv-master-1 cinder-backup[122641]:     ret = func(*f_args, **f_kwargs)
Jan 15 21:11:35.662930 ncdv-master-1 cinder-backup[122641]:   File "/usr/local/lib/python3.8/dist-packages/oslo_privsep/priv_context.py", line 274, in _wrap
Jan 15 21:11:35.662930 ncdv-master-1 cinder-backup[122641]:     return func(*args, **kwargs)
Jan 15 21:11:35.662930 ncdv-master-1 cinder-backup[122641]:   File "/usr/local/lib/python3.8/dist-packages/os_brick/privileged/rootwrap.py", line 197, in execute_root
Jan 15 21:11:35.662930 ncdv-master-1 cinder-backup[122641]:     return custom_execute(*cmd, shell=False, run_as_root=False, **kwargs)
Jan 15 21:11:35.662930 ncdv-master-1 cinder-backup[122641]:   File "/usr/local/lib/python3.8/dist-packages/os_brick/privileged/rootwrap.py", line 145, in custom_execute
Jan 15 21:11:35.662930 ncdv-master-1 cinder-backup[122641]:     return putils.execute(on_execute=on_execute,
Jan 15 21:11:35.662930 ncdv-master-1 cinder-backup[122641]:   File "/usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py", line 395, in execute
Jan 15 21:11:35.662930 ncdv-master-1 cinder-backup[122641]:     obj = subprocess.Popen(cmd,
Jan 15 21:11:35.662930 ncdv-master-1 cinder-backup[122641]:   File "/usr/lib/python3.8/subprocess.py", line 858, in __init__
Jan 15 21:11:35.662930 ncdv-master-1 cinder-backup[122641]:     self._execute_child(args, executable, preexec_fn, close_fds,
Jan 15 21:11:35.662930 ncdv-master-1 cinder-backup[122641]:   File "/usr/lib/python3.8/subprocess.py", line 1704, in _execute_child
Jan 15 21:11:35.662930 ncdv-master-1 cinder-backup[122641]:     raise child_exception_type(errno_num, err_msg, err_filename)
Jan 15 21:11:35.662930 ncdv-master-1 cinder-backup[122641]: FileNotFoundError: [Errno 2] No such file or directory: 'systool'
Jan 15 21:11:35.663953 ncdv-master-1 cinder-backup[122641]: DEBUG oslo.privsep.daemon [-] privsep: reply[e269756a-21a4-4956-b9e7-194a29b1d13a]: (5, 'builtins.FileNotFoundError', (2, 'No such file or directory')) {{(pid=147257) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:502}}
Jan 15 21:11:35.668208 ncdv-master-1 cinder-backup[122641]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=147257) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 15 21:11:35.692259 ncdv-master-1 cinder-backup[122641]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.025s {{(pid=147257) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Jan 15 21:11:35.692768 ncdv-master-1 cinder-backup[122641]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bec062d-b540-465b-93b2-78d7b795c7d6]: (4, ('/dev/sda1\n', '')) {{(pid=147257) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:502}}
Jan 15 21:11:35.694847 ncdv-master-1 cinder-backup[122641]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/sda1 -s UUID -o value {{(pid=147257) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 15 21:11:35.744108 ncdv-master-1 cinder-backup[122641]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/sda1 -s UUID -o value" returned: 0 in 0.049s {{(pid=147257) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Jan 15 21:11:35.744436 ncdv-master-1 cinder-backup[122641]: DEBUG oslo.privsep.daemon [-] privsep: reply[65e9df08-91e4-460e-b5bb-1751d6e5475e]: (4, ('02bb033c-a191-40c0-94fb-bb025c724b13\n', '')) {{(pid=147257) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:502}}
Jan 15 21:11:35.746403 ncdv-master-1 cinder-backup[122641]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /sys/class/dmi/id/product_uuid {{(pid=147257) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 15 21:11:35.772374 ncdv-master-1 cinder-backup[122641]: DEBUG oslo_concurrency.processutils [-] CMD "cat /sys/class/dmi/id/product_uuid" returned: 0 in 0.026s {{(pid=147257) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Jan 15 21:11:35.772702 ncdv-master-1 cinder-backup[122641]: DEBUG oslo.privsep.daemon [-] privsep: reply[da123284-9a4c-4dc4-a5b1-e00236e2bddd]: (4, ('1b06c783-92a7-1942-a345-69784a0224b6\n', '')) {{(pid=147257) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:502}}
Jan 15 21:11:35.773456 ncdv-master-1 cinder-backup[122641]: DEBUG oslo_concurrency.processutils [None req-f27268df-7eef-4d34-8e1e-2d52683d451b tempest-VolumesBackupsTest-197440665 None] Running cmd (subprocess): nvme version {{(pid=122641) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 15 21:11:35.840272 ncdv-master-1 cinder-backup[122641]: DEBUG oslo_concurrency.processutils [None req-f27268df-7eef-4d34-8e1e-2d52683d451b tempest-VolumesBackupsTest-197440665 None] CMD "nvme version" returned: 0 in 0.066s {{(pid=122641) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Jan 15 21:11:35.841767 ncdv-master-1 cinder-backup[122641]: DEBUG os_brick.utils [None req-f27268df-7eef-4d34-8e1e-2d52683d451b tempest-VolumesBackupsTest-197440665 None] <== get_connector_properties: return (239ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.222.0.46', 'host': 'ncdv-master-1', 'multipath': False, 'initiator': 'iqn.1993-08.org.debian:01:b3cf3389e31a', 'do_local_attach': False, 'uuid': '02bb033c-a191-40c0-94fb-bb025c724b13', 'system uuid': '1b06c783-92a7-1942-a345-69784a0224b6', 'nqn': 'nqn.2014-08.org.nvmexpress:uuid:2f801fe5-9757-4764-9681-7ba5df13a96f'} {{(pid=122641) trace_logging_wrapper /usr/local/lib/python3.8/dist-packages/os_brick/utils.py:184}}
Jan 15 21:11:37.212118 ncdv-master-1 cinder-backup[122641]: DEBUG os_brick.initiator.connector [None req-f27268df-7eef-4d34-8e1e-2d52683d451b tempest-VolumesBackupsTest-197440665 None] Factory for rbd on None {{(pid=122641) factory /usr/local/lib/python3.8/dist-packages/os_brick/initiator/connector.py:281}}
Jan 15 21:11:37.215582 ncdv-master-1 cinder-backup[122641]: DEBUG os_brick.initiator.connectors.rbd [None req-f27268df-7eef-4d34-8e1e-2d52683d451b tempest-VolumesBackupsTest-197440665 None] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.rbd.RBDConnector object at 0x7f1af4939880>, 'connection_properties': {'name': 'volumes/volume-c02f8a1d-b762-40be-9f64-e353ef1c9a98', 'hosts': ['10.222.0.46'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '***', 'volume_id': 'c02f8a1d-b762-40be-9f64-e353ef1c9a98', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}}" {{(pid=122641) trace_logging_wrapper /usr/local/lib/python3.8/dist-packages/os_brick/utils.py:157}}
Jan 15 21:11:37.216988 ncdv-master-1 cinder-backup[122641]: DEBUG os_brick.initiator.linuxrbd [None req-f27268df-7eef-4d34-8e1e-2d52683d451b tempest-VolumesBackupsTest-197440665 None] opening connection to ceph cluster (timeout=-1). {{(pid=122641) connect /usr/local/lib/python3.8/dist-packages/os_brick/initiator/linuxrbd.py:70}}
Jan 15 21:11:37.295473 ncdv-master-1 cinder-backup[122641]: DEBUG os_brick.initiator.connectors.rbd [None req-f27268df-7eef-4d34-8e1e-2d52683d451b tempest-VolumesBackupsTest-197440665 None] <== connect_volume: return (79ms) {'path': <os_brick.initiator.linuxrbd.RBDVolumeIOWrapper object at 0x7f1af458d5b0>} {{(pid=122641) trace_logging_wrapper /usr/local/lib/python3.8/dist-packages/os_brick/utils.py:184}}
Jan 15 21:11:37.303570 ncdv-master-1 cinder-backup[122641]: DEBUG oslo_db.sqlalchemy.engines [None req-f27268df-7eef-4d34-8e1e-2d52683d451b tempest-VolumesBackupsTest-197440665 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122641) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}}
Jan 15 21:11:37.343730 ncdv-master-1 cinder-backup[122641]: DEBUG cinder.backup.drivers.ceph [None req-f27268df-7eef-4d34-8e1e-2d52683d451b tempest-VolumesBackupsTest-197440665 None] Starting backup of volume='c02f8a1d-b762-40be-9f64-e353ef1c9a98'. {{(pid=122641) backup /opt/stack/cinder/cinder/backup/drivers/ceph.py:974}}
Jan 15 21:11:37.344598 ncdv-master-1 cinder-backup[122641]: DEBUG cinder.backup.drivers.ceph [None req-f27268df-7eef-4d34-8e1e-2d52683d451b tempest-VolumesBackupsTest-197440665 None] Volume file is RBD: attempting optimized backup {{(pid=122641) backup /opt/stack/cinder/cinder/backup/drivers/ceph.py:985}}
Jan 15 21:11:37.428879 ncdv-master-1 cinder-backup[122641]: DEBUG cinder.backup.drivers.ceph [None req-f27268df-7eef-4d34-8e1e-2d52683d451b tempest-VolumesBackupsTest-197440665 None] Creating base image 'volume-c02f8a1d-b762-40be-9f64-e353ef1c9a98.backup.3f505e22-b613-4ee1-a442-a919a6e175d3' {{(pid=122641) _create_base_image /opt/stack/cinder/cinder/backup/drivers/ceph.py:444}}
Jan 15 21:11:37.429877 ncdv-master-1 cinder-backup[122641]: DEBUG cinder.backup.drivers.ceph [None req-f27268df-7eef-4d34-8e1e-2d52683d451b tempest-VolumesBackupsTest-197440665 None] RBD also supports fast-diff, enabling it together with exclusive-lock and object-map {{(pid=122641) _get_rbd_support /opt/stack/cinder/cinder/backup/drivers/ceph.py:272}}
Jan 15 21:11:37.506885 ncdv-master-1 cinder-backup[122641]: DEBUG cinder.backup.drivers.ceph [None req-f27268df-7eef-4d34-8e1e-2d52683d451b tempest-VolumesBackupsTest-197440665 None] Using --from-snap 'None' for incremental backup of volume c02f8a1d-b762-40be-9f64-e353ef1c9a98. {{(pid=122641) _backup_rbd /opt/stack/cinder/cinder/backup/drivers/ceph.py:764}}
Jan 15 21:11:37.507399 ncdv-master-1 cinder-backup[122641]: DEBUG cinder.backup.drivers.ceph [None req-f27268df-7eef-4d34-8e1e-2d52683d451b tempest-VolumesBackupsTest-197440665 None] Creating backup snapshot='backup.3f505e22-b613-4ee1-a442-a919a6e175d3.snap.1642281097.5069044' {{(pid=122641) _backup_rbd /opt/stack/cinder/cinder/backup/drivers/ceph.py:770}}
Jan 15 21:11:38.121291 ncdv-master-1 cinder-backup[122641]: DEBUG cinder.backup.drivers.ceph [None req-f27268df-7eef-4d34-8e1e-2d52683d451b tempest-VolumesBackupsTest-197440665 None] Performing differential transfer from 'volume-c02f8a1d-b762-40be-9f64-e353ef1c9a98' to 'volume-c02f8a1d-b762-40be-9f64-e353ef1c9a98.backup.3f505e22-b613-4ee1-a442-a919a6e175d3' {{(pid=122641) _rbd_diff_transfer /opt/stack/cinder/cinder/backup/drivers/ceph.py:624}}
Jan 15 21:11:38.125318 ncdv-master-1 cinder-backup[122641]: DEBUG cinder.backup.drivers.ceph [None req-f27268df-7eef-4d34-8e1e-2d52683d451b tempest-VolumesBackupsTest-197440665 None] Piping cmd1='rbd export-diff --id cinder --conf /tmp/brickrbd_5h6v_b3b --pool volumes volumes/volume-c02f8a1d-b762-40be-9f64-e353ef1c9a98@backup.3f505e22-b613-4ee1-a442-a919a6e175d3.snap.1642281097.5069044 -' into... {{(pid=122641) _piped_execute /opt/stack/cinder/cinder/backup/drivers/ceph.py:585}}
Jan 15 21:11:38.129222 ncdv-master-1 cinder-backup[122641]: DEBUG cinder.backup.drivers.ceph [None req-f27268df-7eef-4d34-8e1e-2d52683d451b tempest-VolumesBackupsTest-197440665 None] cmd2='rbd import-diff --id cinder-bak --conf /etc/ceph/ceph.conf --pool backups - backups/volume-c02f8a1d-b762-40be-9f64-e353ef1c9a98.backup.3f505e22-b613-4ee1-a442-a919a6e175d3' {{(pid=122641) _piped_execute /opt/stack/cinder/cinder/backup/drivers/ceph.py:586}}
Jan 15 21:11:39.186909 ncdv-master-1 cinder-backup[122641]: DEBUG cinder.backup.drivers.ceph [None req-f27268df-7eef-4d34-8e1e-2d52683d451b tempest-VolumesBackupsTest-197440665 None] Differential backup transfer completed in 1.0695s {{(pid=122641) _backup_rbd /opt/stack/cinder/cinder/backup/drivers/ceph.py:790}}
Jan 15 21:11:39.188254 ncdv-master-1 cinder-backup[122641]: DEBUG cinder.backup.driver [None req-f27268df-7eef-4d34-8e1e-2d52683d451b tempest-VolumesBackupsTest-197440665 None] Getting metadata type 'volume-base-metadata' {{(pid=122641) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:79}}
Jan 15 21:11:39.217828 ncdv-master-1 cinder-backup[122641]: DEBUG cinder.backup.driver [None req-f27268df-7eef-4d34-8e1e-2d52683d451b tempest-VolumesBackupsTest-197440665 None] Completed fetching metadata type 'volume-base-metadata' {{(pid=122641) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:98}}
Jan 15 21:11:39.219106 ncdv-master-1 cinder-backup[122641]: DEBUG cinder.backup.driver [None req-f27268df-7eef-4d34-8e1e-2d52683d451b tempest-VolumesBackupsTest-197440665 None] Getting metadata type 'volume-metadata' {{(pid=122641) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:109}}
Jan 15 21:11:39.250581 ncdv-master-1 cinder-backup[122641]: DEBUG cinder.backup.driver [None req-f27268df-7eef-4d34-8e1e-2d52683d451b tempest-VolumesBackupsTest-197440665 None] No metadata type 'volume-metadata' available {{(pid=122641) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:123}}
Jan 15 21:11:39.251561 ncdv-master-1 cinder-backup[122641]: DEBUG cinder.backup.driver [None req-f27268df-7eef-4d34-8e1e-2d52683d451b tempest-VolumesBackupsTest-197440665 None] Getting metadata type 'volume-glance-metadata' {{(pid=122641) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:132}}
Jan 15 21:11:39.269875 ncdv-master-1 cinder-backup[122641]: DEBUG cinder.backup.driver [None req-f27268df-7eef-4d34-8e1e-2d52683d451b tempest-VolumesBackupsTest-197440665 None] No metadata type 'volume-glance-metadata' available {{(pid=122641) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:147}}
Jan 15 21:11:39.271954 ncdv-master-1 cinder-backup[122641]: DEBUG cinder.backup.drivers.ceph [None req-f27268df-7eef-4d34-8e1e-2d52683d451b tempest-VolumesBackupsTest-197440665 None] Backing up metadata for volume c02f8a1d-b762-40be-9f64-e353ef1c9a98. {{(pid=122641) _backup_metadata /opt/stack/cinder/cinder/backup/drivers/ceph.py:951}}
Jan 15 21:11:39.350184 ncdv-master-1 cinder-backup[122641]: DEBUG cinder.backup.drivers.ceph [None req-f27268df-7eef-4d34-8e1e-2d52683d451b tempest-VolumesBackupsTest-197440665 None] Backup '3f505e22-b613-4ee1-a442-a919a6e175d3' of volume c02f8a1d-b762-40be-9f64-e353ef1c9a98 finished. {{(pid=122641) backup /opt/stack/cinder/cinder/backup/drivers/ceph.py:1015}}
Jan 15 21:11:39.352353 ncdv-master-1 cinder-backup[122641]: DEBUG os_brick.initiator.connectors.rbd [None req-f27268df-7eef-4d34-8e1e-2d52683d451b tempest-VolumesBackupsTest-197440665 None] ==> disconnect_volume: call "{'self': <os_brick.initiator.connectors.rbd.RBDConnector object at 0x7f1af4939880>, 'connection_properties': {'name': 'volumes/volume-c02f8a1d-b762-40be-9f64-e353ef1c9a98', 'hosts': ['10.222.0.46'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '***', 'volume_id': 'c02f8a1d-b762-40be-9f64-e353ef1c9a98', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'device_info': {'path': <os_brick.initiator.linuxrbd.RBDVolumeIOWrapper object at 0x7f1af458d5b0>}, 'force': True, 'ignore_errors': True}" {{(pid=122641) trace_logging_wrapper /usr/local/lib/python3.8/dist-packages/os_brick/utils.py:157}}
Jan 15 21:11:39.381075 ncdv-master-1 cinder-backup[122641]: DEBUG os_brick.initiator.connectors.rbd [None req-f27268df-7eef-4d34-8e1e-2d52683d451b tempest-VolumesBackupsTest-197440665 None] <== disconnect_volume: return (27ms) None {{(pid=122641) trace_logging_wrapper /usr/local/lib/python3.8/dist-packages/os_brick/utils.py:184}}
Jan 15 21:11:39.555677 ncdv-master-1 cinder-backup[122641]: INFO cinder.backup.manager [None req-f27268df-7eef-4d34-8e1e-2d52683d451b tempest-VolumesBackupsTest-197440665 None] Create backup finished. backup: 3f505e22-b613-4ee1-a442-a919a6e175d3.
Jan 15 21:11:39.923656 ncdv-master-1 cinder-backup[122641]: INFO cinder.backup.manager [None req-59c690af-b86c-4f31-b194-b0e763f51197 tempest-VolumesBackupsTest-197440665 None] Delete backup started, backup: 3f505e22-b613-4ee1-a442-a919a6e175d3.
Jan 15 21:11:39.926926 ncdv-master-1 cinder-backup[122641]: DEBUG cinder.backup.drivers.ceph [None req-59c690af-b86c-4f31-b194-b0e763f51197 tempest-VolumesBackupsTest-197440665 None] Delete started for backup=3f505e22-b613-4ee1-a442-a919a6e175d3 {{(pid=122641) delete_backup /opt/stack/cinder/cinder/backup/drivers/ceph.py:1301}}
Jan 15 21:11:39.933524 ncdv-master-1 cinder-backup[122641]: DEBUG cinder.backup.drivers.ceph [None req-59c690af-b86c-4f31-b194-b0e763f51197 tempest-VolumesBackupsTest-197440665 None] Trying diff format basename='volume-c02f8a1d-b762-40be-9f64-e353ef1c9a98.backup.3f505e22-b613-4ee1-a442-a919a6e175d3' for backup base image of volume c02f8a1d-b762-40be-9f64-e353ef1c9a98. {{(pid=122641) _try_delete_base_image /opt/stack/cinder/cinder/backup/drivers/ceph.py:513}}
Jan 15 21:11:40.042919 ncdv-master-1 cinder-backup[122641]: DEBUG cinder.backup.drivers.ceph [None req-59c690af-b86c-4f31-b194-b0e763f51197 tempest-VolumesBackupsTest-197440665 None] Looking for snapshot of backup base 'volume-c02f8a1d-b762-40be-9f64-e353ef1c9a98.backup.3f505e22-b613-4ee1-a442-a919a6e175d3' {{(pid=122641) _get_backup_snap_name /opt/stack/cinder/cinder/backup/drivers/ceph.py:905}}
Jan 15 21:11:40.043681 ncdv-master-1 cinder-backup[122641]: DEBUG cinder.backup.drivers.ceph [None req-59c690af-b86c-4f31-b194-b0e763f51197 tempest-VolumesBackupsTest-197440665 None] Found snapshot 'backup.3f505e22-b613-4ee1-a442-a919a6e175d3.snap.1642281097.5069044' {{(pid=122641) _get_backup_snap_name /opt/stack/cinder/cinder/backup/drivers/ceph.py:924}}
Jan 15 21:11:40.044362 ncdv-master-1 cinder-backup[122641]: DEBUG cinder.backup.drivers.ceph [None req-59c690af-b86c-4f31-b194-b0e763f51197 tempest-VolumesBackupsTest-197440665 None] Deleting backup snapshot='backup.3f505e22-b613-4ee1-a442-a919a6e175d3.snap.1642281097.5069044' {{(pid=122641) _delete_backup_snapshot /opt/stack/cinder/cinder/backup/drivers/ceph.py:473}}
Jan 15 21:11:41.168763 ncdv-master-1 cinder-backup[122641]: INFO cinder.backup.drivers.ceph [None req-59c690af-b86c-4f31-b194-b0e763f51197 tempest-VolumesBackupsTest-197440665 None] Deleting backup base image='volume-c02f8a1d-b762-40be-9f64-e353ef1c9a98.backup.3f505e22-b613-4ee1-a442-a919a6e175d3' of volume c02f8a1d-b762-40be-9f64-e353ef1c9a98.
Jan 15 21:11:41.509839 ncdv-master-1 cinder-backup[122641]: DEBUG cinder.backup.drivers.ceph [None req-59c690af-b86c-4f31-b194-b0e763f51197 tempest-VolumesBackupsTest-197440665 None] Base backup image='volume-c02f8a1d-b762-40be-9f64-e353ef1c9a98.backup.3f505e22-b613-4ee1-a442-a919a6e175d3' of volume c02f8a1d-b762-40be-9f64-e353ef1c9a98 deleted. {{(pid=122641) _try_delete_base_image /opt/stack/cinder/cinder/backup/drivers/ceph.py:561}}
Jan 15 21:11:41.565870 ncdv-master-1 cinder-backup[122641]: DEBUG cinder.backup.drivers.ceph [None req-59c690af-b86c-4f31-b194-b0e763f51197 tempest-VolumesBackupsTest-197440665 None] Delete of backup '3f505e22-b613-4ee1-a442-a919a6e175d3' for volume 'c02f8a1d-b762-40be-9f64-e353ef1c9a98' finished. {{(pid=122641) delete_backup /opt/stack/cinder/cinder/backup/drivers/ceph.py:1329}}
Jan 15 21:11:41.572454 ncdv-master-1 cinder-backup[122641]: DEBUG oslo_db.sqlalchemy.engines [None req-59c690af-b86c-4f31-b194-b0e763f51197 tempest-VolumesBackupsTest-197440665 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122641) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}}
Jan 15 21:11:41.602269 ncdv-master-1 cinder-backup[122641]: DEBUG cinder.quota [None req-59c690af-b86c-4f31-b194-b0e763f51197 tempest-VolumesBackupsTest-197440665 None] Created reservations ['fe661c12-7f25-435e-bae1-e0bc05fbaff1', '09cc20ed-67e7-4908-a402-ac18c064ec22'] {{(pid=122641) reserve /opt/stack/cinder/cinder/quota.py:755}}
Jan 15 21:11:41.648224 ncdv-master-1 cinder-backup[122641]: INFO cinder.backup.manager [None req-59c690af-b86c-4f31-b194-b0e763f51197 tempest-VolumesBackupsTest-197440665 None] Delete backup finished, backup 3f505e22-b613-4ee1-a442-a919a6e175d3 deleted.
Jan 15 21:11:53.149093 ncdv-master-1 cinder-backup[122641]: INFO cinder.backup.manager [None req-f8ae25b6-7a99-4cac-bab9-0e3b76e68c4a tempest-VolumesBackupsTest-197440665 None] Create backup started, backup: 2ad47dfe-18ff-4c2b-a6db-4842f546a610 volume: 730ab34e-1940-4999-811d-3fd7a179af20.
Jan 15 21:11:53.158605 ncdv-master-1 cinder-backup[122641]: DEBUG os_brick.utils [None req-f8ae25b6-7a99-4cac-bab9-0e3b76e68c4a tempest-VolumesBackupsTest-197440665 None] ==> get_connector_properties: call "{'root_helper': 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf', 'my_ip': '10.222.0.46', 'multipath': False, 'enforce_multipath': False, 'host': None, 'execute': None}" {{(pid=122641) trace_logging_wrapper /usr/local/lib/python3.8/dist-packages/os_brick/utils.py:157}}
Jan 15 21:11:53.163044 ncdv-master-1 cinder-backup[122641]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=147257) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 15 21:11:53.171912 ncdv-master-1 cinder-backup[122641]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.011s {{(pid=147257) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Jan 15 21:11:53.172492 ncdv-master-1 cinder-backup[122641]: DEBUG oslo.privsep.daemon [-] privsep: reply[22846afe-3bda-4d84-91da-3a90e23c9b08]: (4, ('## DO NOT EDIT OR REMOVE THIS FILE!\n## If you remove this file, the iSCSI daemon will not start.\n## If you change the InitiatorName, existing access control lists\n## may reject this initiator.  The InitiatorName must be unique\n## for each iSCSI initiator.  Do NOT duplicate iSCSI InitiatorNames.\nInitiatorName=iqn.1993-08.org.debian:01:b3cf3389e31a\n', '')) {{(pid=147257) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:502}}
Jan 15 21:11:53.174240 ncdv-master-1 cinder-backup[122641]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): systool -c fc_host -v {{(pid=147257) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 15 21:11:53.183921 ncdv-master-1 cinder-backup[122641]: DEBUG oslo_concurrency.processutils [-] 'systool -c fc_host -v' failed. Not Retrying. {{(pid=147257) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:473}}
Jan 15 21:11:53.184331 ncdv-master-1 cinder-backup[122641]: DEBUG oslo.privsep.daemon [-] privsep: Exception during request[bc9c82b0-3bfd-45e3-b851-3b5854b2b90e]: [Errno 2] No such file or directory: 'systool' {{(pid=147257) _process_cmd /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:480}}
Jan 15 21:11:53.184331 ncdv-master-1 cinder-backup[122641]: Traceback (most recent call last):
Jan 15 21:11:53.184331 ncdv-master-1 cinder-backup[122641]:   File "/usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py", line 477, in _process_cmd
Jan 15 21:11:53.184331 ncdv-master-1 cinder-backup[122641]:     ret = func(*f_args, **f_kwargs)
Jan 15 21:11:53.184331 ncdv-master-1 cinder-backup[122641]:   File "/usr/local/lib/python3.8/dist-packages/oslo_privsep/priv_context.py", line 274, in _wrap
Jan 15 21:11:53.184331 ncdv-master-1 cinder-backup[122641]:     return func(*args, **kwargs)
Jan 15 21:11:53.184331 ncdv-master-1 cinder-backup[122641]:   File "/usr/local/lib/python3.8/dist-packages/os_brick/privileged/rootwrap.py", line 197, in execute_root
Jan 15 21:11:53.184331 ncdv-master-1 cinder-backup[122641]:     return custom_execute(*cmd, shell=False, run_as_root=False, **kwargs)
Jan 15 21:11:53.184331 ncdv-master-1 cinder-backup[122641]:   File "/usr/local/lib/python3.8/dist-packages/os_brick/privileged/rootwrap.py", line 145, in custom_execute
Jan 15 21:11:53.184331 ncdv-master-1 cinder-backup[122641]:     return putils.execute(on_execute=on_execute,
Jan 15 21:11:53.184331 ncdv-master-1 cinder-backup[122641]:   File "/usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py", line 395, in execute
Jan 15 21:11:53.184331 ncdv-master-1 cinder-backup[122641]:     obj = subprocess.Popen(cmd,
Jan 15 21:11:53.184331 ncdv-master-1 cinder-backup[122641]:   File "/usr/lib/python3.8/subprocess.py", line 858, in __init__
Jan 15 21:11:53.184331 ncdv-master-1 cinder-backup[122641]:     self._execute_child(args, executable, preexec_fn, close_fds,
Jan 15 21:11:53.184331 ncdv-master-1 cinder-backup[122641]:   File "/usr/lib/python3.8/subprocess.py", line 1704, in _execute_child
Jan 15 21:11:53.184331 ncdv-master-1 cinder-backup[122641]:     raise child_exception_type(errno_num, err_msg, err_filename)
Jan 15 21:11:53.184331 ncdv-master-1 cinder-backup[122641]: FileNotFoundError: [Errno 2] No such file or directory: 'systool'
Jan 15 21:11:53.185460 ncdv-master-1 cinder-backup[122641]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc9c82b0-3bfd-45e3-b851-3b5854b2b90e]: (5, 'builtins.FileNotFoundError', (2, 'No such file or directory')) {{(pid=147257) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:502}}
Jan 15 21:11:53.188945 ncdv-master-1 cinder-backup[122641]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): systool -c fc_host -v {{(pid=147257) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 15 21:11:53.196031 ncdv-master-1 cinder-backup[122641]: DEBUG oslo_concurrency.processutils [-] 'systool -c fc_host -v' failed. Not Retrying. {{(pid=147257) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:473}}
Jan 15 21:11:53.196409 ncdv-master-1 cinder-backup[122641]: DEBUG oslo.privsep.daemon [-] privsep: Exception during request[e16ead8e-c8c1-4402-ae35-52da48d42f61]: [Errno 2] No such file or directory: 'systool' {{(pid=147257) _process_cmd /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:480}}
Jan 15 21:11:53.196409 ncdv-master-1 cinder-backup[122641]: Traceback (most recent call last):
Jan 15 21:11:53.196409 ncdv-master-1 cinder-backup[122641]:   File "/usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py", line 477, in _process_cmd
Jan 15 21:11:53.196409 ncdv-master-1 cinder-backup[122641]:     ret = func(*f_args, **f_kwargs)
Jan 15 21:11:53.196409 ncdv-master-1 cinder-backup[122641]:   File "/usr/local/lib/python3.8/dist-packages/oslo_privsep/priv_context.py", line 274, in _wrap
Jan 15 21:11:53.196409 ncdv-master-1 cinder-backup[122641]:     return func(*args, **kwargs)
Jan 15 21:11:53.196409 ncdv-master-1 cinder-backup[122641]:   File "/usr/local/lib/python3.8/dist-packages/os_brick/privileged/rootwrap.py", line 197, in execute_root
Jan 15 21:11:53.196409 ncdv-master-1 cinder-backup[122641]:     return custom_execute(*cmd, shell=False, run_as_root=False, **kwargs)
Jan 15 21:11:53.196409 ncdv-master-1 cinder-backup[122641]:   File "/usr/local/lib/python3.8/dist-packages/os_brick/privileged/rootwrap.py", line 145, in custom_execute
Jan 15 21:11:53.196409 ncdv-master-1 cinder-backup[122641]:     return putils.execute(on_execute=on_execute,
Jan 15 21:11:53.196409 ncdv-master-1 cinder-backup[122641]:   File "/usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py", line 395, in execute
Jan 15 21:11:53.196409 ncdv-master-1 cinder-backup[122641]:     obj = subprocess.Popen(cmd,
Jan 15 21:11:53.196409 ncdv-master-1 cinder-backup[122641]:   File "/usr/lib/python3.8/subprocess.py", line 858, in __init__
Jan 15 21:11:53.196409 ncdv-master-1 cinder-backup[122641]:     self._execute_child(args, executable, preexec_fn, close_fds,
Jan 15 21:11:53.196409 ncdv-master-1 cinder-backup[122641]:   File "/usr/lib/python3.8/subprocess.py", line 1704, in _execute_child
Jan 15 21:11:53.196409 ncdv-master-1 cinder-backup[122641]:     raise child_exception_type(errno_num, err_msg, err_filename)
Jan 15 21:11:53.196409 ncdv-master-1 cinder-backup[122641]: FileNotFoundError: [Errno 2] No such file or directory: 'systool'
Jan 15 21:11:53.198009 ncdv-master-1 cinder-backup[122641]: DEBUG oslo.privsep.daemon [-] privsep: reply[e16ead8e-c8c1-4402-ae35-52da48d42f61]: (5, 'builtins.FileNotFoundError', (2, 'No such file or directory')) {{(pid=147257) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:502}}
Jan 15 21:11:53.201873 ncdv-master-1 cinder-backup[122641]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=147257) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 15 21:11:53.209243 ncdv-master-1 cinder-backup[122641]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.009s {{(pid=147257) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Jan 15 21:11:53.209614 ncdv-master-1 cinder-backup[122641]: DEBUG oslo.privsep.daemon [-] privsep: reply[91b1f0b7-8a89-4ab6-b6b9-2bb1f3771696]: (4, ('/dev/sda1\n', '')) {{(pid=147257) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:502}}
Jan 15 21:11:53.212625 ncdv-master-1 cinder-backup[122641]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/sda1 -s UUID -o value {{(pid=147257) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 15 21:11:53.230852 ncdv-master-1 cinder-backup[122641]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/sda1 -s UUID -o value" returned: 0 in 0.018s {{(pid=147257) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Jan 15 21:11:53.231184 ncdv-master-1 cinder-backup[122641]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2d0062f-b89e-451d-9ee8-9c065f07ba0d]: (4, ('02bb033c-a191-40c0-94fb-bb025c724b13\n', '')) {{(pid=147257) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:502}}
Jan 15 21:11:53.233530 ncdv-master-1 cinder-backup[122641]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /sys/class/dmi/id/product_uuid {{(pid=147257) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 15 21:11:53.250662 ncdv-master-1 cinder-backup[122641]: DEBUG oslo_concurrency.processutils [-] CMD "cat /sys/class/dmi/id/product_uuid" returned: 0 in 0.017s {{(pid=147257) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Jan 15 21:11:53.252918 ncdv-master-1 cinder-backup[122641]: DEBUG oslo.privsep.daemon [-] privsep: reply[0926b3de-d2e0-40cf-9c67-bab72b560b45]: (4, ('1b06c783-92a7-1942-a345-69784a0224b6\n', '')) {{(pid=147257) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:502}}
Jan 15 21:11:53.254279 ncdv-master-1 cinder-backup[122641]: DEBUG oslo_concurrency.processutils [None req-f8ae25b6-7a99-4cac-bab9-0e3b76e68c4a tempest-VolumesBackupsTest-197440665 None] Running cmd (subprocess): nvme version {{(pid=122641) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 15 21:11:53.310265 ncdv-master-1 cinder-backup[122641]: DEBUG oslo_concurrency.processutils [None req-f8ae25b6-7a99-4cac-bab9-0e3b76e68c4a tempest-VolumesBackupsTest-197440665 None] CMD "nvme version" returned: 0 in 0.056s {{(pid=122641) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Jan 15 21:11:53.311873 ncdv-master-1 cinder-backup[122641]: DEBUG os_brick.utils [None req-f8ae25b6-7a99-4cac-bab9-0e3b76e68c4a tempest-VolumesBackupsTest-197440665 None] <== get_connector_properties: return (152ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.222.0.46', 'host': 'ncdv-master-1', 'multipath': False, 'initiator': 'iqn.1993-08.org.debian:01:b3cf3389e31a', 'do_local_attach': False, 'uuid': '02bb033c-a191-40c0-94fb-bb025c724b13', 'system uuid': '1b06c783-92a7-1942-a345-69784a0224b6', 'nqn': 'nqn.2014-08.org.nvmexpress:uuid:2f801fe5-9757-4764-9681-7ba5df13a96f'} {{(pid=122641) trace_logging_wrapper /usr/local/lib/python3.8/dist-packages/os_brick/utils.py:184}}
Jan 15 21:11:54.126963 ncdv-master-1 cinder-backup[122641]: DEBUG os_brick.initiator.connector [None req-f8ae25b6-7a99-4cac-bab9-0e3b76e68c4a tempest-VolumesBackupsTest-197440665 None] Factory for rbd on None {{(pid=122641) factory /usr/local/lib/python3.8/dist-packages/os_brick/initiator/connector.py:281}}
Jan 15 21:11:54.128366 ncdv-master-1 cinder-backup[122641]: DEBUG os_brick.initiator.connectors.rbd [None req-f8ae25b6-7a99-4cac-bab9-0e3b76e68c4a tempest-VolumesBackupsTest-197440665 None] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.rbd.RBDConnector object at 0x7f1af46f9ee0>, 'connection_properties': {'name': 'volumes/volume-730ab34e-1940-4999-811d-3fd7a179af20', 'hosts': ['10.222.0.46'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '***', 'volume_id': '730ab34e-1940-4999-811d-3fd7a179af20', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}}" {{(pid=122641) trace_logging_wrapper /usr/local/lib/python3.8/dist-packages/os_brick/utils.py:157}}
Jan 15 21:11:54.129483 ncdv-master-1 cinder-backup[122641]: DEBUG os_brick.initiator.linuxrbd [None req-f8ae25b6-7a99-4cac-bab9-0e3b76e68c4a tempest-VolumesBackupsTest-197440665 None] opening connection to ceph cluster (timeout=-1). {{(pid=122641) connect /usr/local/lib/python3.8/dist-packages/os_brick/initiator/linuxrbd.py:70}}
Jan 15 21:11:54.263195 ncdv-master-1 cinder-backup[122641]: DEBUG os_brick.initiator.connectors.rbd [None req-f8ae25b6-7a99-4cac-bab9-0e3b76e68c4a tempest-VolumesBackupsTest-197440665 None] <== connect_volume: return (134ms) {'path': <os_brick.initiator.linuxrbd.RBDVolumeIOWrapper object at 0x7f1af461de50>} {{(pid=122641) trace_logging_wrapper /usr/local/lib/python3.8/dist-packages/os_brick/utils.py:184}}
Jan 15 21:11:54.272222 ncdv-master-1 cinder-backup[122641]: DEBUG oslo_db.sqlalchemy.engines [None req-f8ae25b6-7a99-4cac-bab9-0e3b76e68c4a tempest-VolumesBackupsTest-197440665 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122641) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}}
Jan 15 21:11:54.292657 ncdv-master-1 cinder-backup[122641]: DEBUG cinder.backup.drivers.ceph [None req-f8ae25b6-7a99-4cac-bab9-0e3b76e68c4a tempest-VolumesBackupsTest-197440665 None] Starting backup of volume='730ab34e-1940-4999-811d-3fd7a179af20'. {{(pid=122641) backup /opt/stack/cinder/cinder/backup/drivers/ceph.py:974}}
Jan 15 21:11:54.294209 ncdv-master-1 cinder-backup[122641]: DEBUG cinder.backup.drivers.ceph [None req-f8ae25b6-7a99-4cac-bab9-0e3b76e68c4a tempest-VolumesBackupsTest-197440665 None] Volume file is RBD: attempting optimized backup {{(pid=122641) backup /opt/stack/cinder/cinder/backup/drivers/ceph.py:985}}
Jan 15 21:11:54.339020 ncdv-master-1 cinder-backup[122641]: DEBUG cinder.backup.drivers.ceph [None req-f8ae25b6-7a99-4cac-bab9-0e3b76e68c4a tempest-VolumesBackupsTest-197440665 None] Creating base image 'volume-730ab34e-1940-4999-811d-3fd7a179af20.backup.2ad47dfe-18ff-4c2b-a6db-4842f546a610' {{(pid=122641) _create_base_image /opt/stack/cinder/cinder/backup/drivers/ceph.py:444}}
Jan 15 21:11:54.339465 ncdv-master-1 cinder-backup[122641]: DEBUG cinder.backup.drivers.ceph [None req-f8ae25b6-7a99-4cac-bab9-0e3b76e68c4a tempest-VolumesBackupsTest-197440665 None] RBD also supports fast-diff, enabling it together with exclusive-lock and object-map {{(pid=122641) _get_rbd_support /opt/stack/cinder/cinder/backup/drivers/ceph.py:272}}
Jan 15 21:11:54.379607 ncdv-master-1 cinder-backup[122641]: DEBUG cinder.backup.drivers.ceph [None req-f8ae25b6-7a99-4cac-bab9-0e3b76e68c4a tempest-VolumesBackupsTest-197440665 None] Using --from-snap 'None' for incremental backup of volume 730ab34e-1940-4999-811d-3fd7a179af20. {{(pid=122641) _backup_rbd /opt/stack/cinder/cinder/backup/drivers/ceph.py:764}}
Jan 15 21:11:54.380014 ncdv-master-1 cinder-backup[122641]: DEBUG cinder.backup.drivers.ceph [None req-f8ae25b6-7a99-4cac-bab9-0e3b76e68c4a tempest-VolumesBackupsTest-197440665 None] Creating backup snapshot='backup.2ad47dfe-18ff-4c2b-a6db-4842f546a610.snap.1642281114.3796341' {{(pid=122641) _backup_rbd /opt/stack/cinder/cinder/backup/drivers/ceph.py:770}}
Jan 15 21:11:55.252137 ncdv-master-1 cinder-backup[122641]: DEBUG cinder.backup.drivers.ceph [None req-f8ae25b6-7a99-4cac-bab9-0e3b76e68c4a tempest-VolumesBackupsTest-197440665 None] Performing differential transfer from 'volume-730ab34e-1940-4999-811d-3fd7a179af20' to 'volume-730ab34e-1940-4999-811d-3fd7a179af20.backup.2ad47dfe-18ff-4c2b-a6db-4842f546a610' {{(pid=122641) _rbd_diff_transfer /opt/stack/cinder/cinder/backup/drivers/ceph.py:624}}
Jan 15 21:11:55.252777 ncdv-master-1 cinder-backup[122641]: DEBUG cinder.backup.drivers.ceph [None req-f8ae25b6-7a99-4cac-bab9-0e3b76e68c4a tempest-VolumesBackupsTest-197440665 None] Piping cmd1='rbd export-diff --id cinder --conf /tmp/brickrbd_lzo_miq7 --pool volumes volumes/volume-730ab34e-1940-4999-811d-3fd7a179af20@backup.2ad47dfe-18ff-4c2b-a6db-4842f546a610.snap.1642281114.3796341 -' into... {{(pid=122641) _piped_execute /opt/stack/cinder/cinder/backup/drivers/ceph.py:585}}
Jan 15 21:11:55.253176 ncdv-master-1 cinder-backup[122641]: DEBUG cinder.backup.drivers.ceph [None req-f8ae25b6-7a99-4cac-bab9-0e3b76e68c4a tempest-VolumesBackupsTest-197440665 None] cmd2='rbd import-diff --id cinder-bak --conf /etc/ceph/ceph.conf --pool backups - backups/volume-730ab34e-1940-4999-811d-3fd7a179af20.backup.2ad47dfe-18ff-4c2b-a6db-4842f546a610' {{(pid=122641) _piped_execute /opt/stack/cinder/cinder/backup/drivers/ceph.py:586}}
Jan 15 21:12:02.657894 ncdv-master-1 cinder-backup[122641]: DEBUG cinder.backup.drivers.ceph [None req-f8ae25b6-7a99-4cac-bab9-0e3b76e68c4a tempest-VolumesBackupsTest-197440665 None] Differential backup transfer completed in 7.4055s {{(pid=122641) _backup_rbd /opt/stack/cinder/cinder/backup/drivers/ceph.py:790}}
Jan 15 21:12:02.658592 ncdv-master-1 cinder-backup[122641]: DEBUG cinder.backup.driver [None req-f8ae25b6-7a99-4cac-bab9-0e3b76e68c4a tempest-VolumesBackupsTest-197440665 None] Getting metadata type 'volume-base-metadata' {{(pid=122641) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:79}}
Jan 15 21:12:02.671735 ncdv-master-1 cinder-backup[122641]: DEBUG cinder.backup.driver [None req-f8ae25b6-7a99-4cac-bab9-0e3b76e68c4a tempest-VolumesBackupsTest-197440665 None] Completed fetching metadata type 'volume-base-metadata' {{(pid=122641) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:98}}
Jan 15 21:12:02.672466 ncdv-master-1 cinder-backup[122641]: DEBUG cinder.backup.driver [None req-f8ae25b6-7a99-4cac-bab9-0e3b76e68c4a tempest-VolumesBackupsTest-197440665 None] Getting metadata type 'volume-metadata' {{(pid=122641) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:109}}
Jan 15 21:12:02.693684 ncdv-master-1 cinder-backup[122641]: DEBUG cinder.backup.driver [None req-f8ae25b6-7a99-4cac-bab9-0e3b76e68c4a tempest-VolumesBackupsTest-197440665 None] No metadata type 'volume-metadata' available {{(pid=122641) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:123}}
Jan 15 21:12:02.697535 ncdv-master-1 cinder-backup[122641]: DEBUG cinder.backup.driver [None req-f8ae25b6-7a99-4cac-bab9-0e3b76e68c4a tempest-VolumesBackupsTest-197440665 None] Getting metadata type 'volume-glance-metadata' {{(pid=122641) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:132}}
Jan 15 21:12:02.709159 ncdv-master-1 cinder-backup[122641]: DEBUG cinder.backup.driver [None req-f8ae25b6-7a99-4cac-bab9-0e3b76e68c4a tempest-VolumesBackupsTest-197440665 None] Completed fetching metadata type 'volume-glance-metadata' {{(pid=122641) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:145}}
Jan 15 21:12:02.711414 ncdv-master-1 cinder-backup[122641]: DEBUG cinder.backup.drivers.ceph [None req-f8ae25b6-7a99-4cac-bab9-0e3b76e68c4a tempest-VolumesBackupsTest-197440665 None] Backing up metadata for volume 730ab34e-1940-4999-811d-3fd7a179af20. {{(pid=122641) _backup_metadata /opt/stack/cinder/cinder/backup/drivers/ceph.py:951}}
Jan 15 21:12:02.784656 ncdv-master-1 cinder-backup[122641]: DEBUG cinder.backup.drivers.ceph [None req-f8ae25b6-7a99-4cac-bab9-0e3b76e68c4a tempest-VolumesBackupsTest-197440665 None] Backup '2ad47dfe-18ff-4c2b-a6db-4842f546a610' of volume 730ab34e-1940-4999-811d-3fd7a179af20 finished. {{(pid=122641) backup /opt/stack/cinder/cinder/backup/drivers/ceph.py:1015}}
Jan 15 21:12:02.786368 ncdv-master-1 cinder-backup[122641]: DEBUG os_brick.initiator.connectors.rbd [None req-f8ae25b6-7a99-4cac-bab9-0e3b76e68c4a tempest-VolumesBackupsTest-197440665 None] ==> disconnect_volume: call "{'self': <os_brick.initiator.connectors.rbd.RBDConnector object at 0x7f1af46f9ee0>, 'connection_properties': {'name': 'volumes/volume-730ab34e-1940-4999-811d-3fd7a179af20', 'hosts': ['10.222.0.46'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '***', 'volume_id': '730ab34e-1940-4999-811d-3fd7a179af20', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'device_info': {'path': <os_brick.initiator.linuxrbd.RBDVolumeIOWrapper object at 0x7f1af461de50>}, 'force': True, 'ignore_errors': True}" {{(pid=122641) trace_logging_wrapper /usr/local/lib/python3.8/dist-packages/os_brick/utils.py:157}}
Jan 15 21:12:02.818119 ncdv-master-1 cinder-backup[122641]: DEBUG os_brick.initiator.connectors.rbd [None req-f8ae25b6-7a99-4cac-bab9-0e3b76e68c4a tempest-VolumesBackupsTest-197440665 None] <== disconnect_volume: return (30ms) None {{(pid=122641) trace_logging_wrapper /usr/local/lib/python3.8/dist-packages/os_brick/utils.py:184}}
Jan 15 21:12:02.910639 ncdv-master-1 cinder-backup[122641]: INFO cinder.backup.manager [None req-f8ae25b6-7a99-4cac-bab9-0e3b76e68c4a tempest-VolumesBackupsTest-197440665 None] Create backup finished. backup: 2ad47dfe-18ff-4c2b-a6db-4842f546a610.
Jan 15 21:12:04.998805 ncdv-master-1 cinder-backup[122641]: INFO cinder.backup.manager [None req-223f25c0-ee9d-4240-a260-bf9c346f1c9f tempest-VolumesBackupsTest-197440665 None] Restore backup started, backup: 2ad47dfe-18ff-4c2b-a6db-4842f546a610 volume: 3b97ba69-58fd-4c51-a8ae-7ab354daf8ec.
Jan 15 21:12:05.024229 ncdv-master-1 cinder-backup[122641]: DEBUG os_brick.utils [None req-223f25c0-ee9d-4240-a260-bf9c346f1c9f tempest-VolumesBackupsTest-197440665 None] ==> get_connector_properties: call "{'root_helper': 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf', 'my_ip': '10.222.0.46', 'multipath': False, 'enforce_multipath': False, 'host': None, 'execute': None}" {{(pid=122641) trace_logging_wrapper /usr/local/lib/python3.8/dist-packages/os_brick/utils.py:157}}
Jan 15 21:12:05.027512 ncdv-master-1 cinder-backup[122641]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=147257) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 15 21:12:05.059771 ncdv-master-1 cinder-backup[122641]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.032s {{(pid=147257) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Jan 15 21:12:05.060108 ncdv-master-1 cinder-backup[122641]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f7b4c8a-98f7-48b0-85b2-dd2e70199528]: (4, ('## DO NOT EDIT OR REMOVE THIS FILE!\n## If you remove this file, the iSCSI daemon will not start.\n## If you change the InitiatorName, existing access control lists\n## may reject this initiator.  The InitiatorName must be unique\n## for each iSCSI initiator.  Do NOT duplicate iSCSI InitiatorNames.\nInitiatorName=iqn.1993-08.org.debian:01:b3cf3389e31a\n', '')) {{(pid=147257) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:502}}
Jan 15 21:12:05.062412 ncdv-master-1 cinder-backup[122641]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): systool -c fc_host -v {{(pid=147257) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 15 21:12:05.084760 ncdv-master-1 cinder-backup[122641]: DEBUG oslo_concurrency.processutils [-] 'systool -c fc_host -v' failed. Not Retrying. {{(pid=147257) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:473}}
Jan 15 21:12:05.085356 ncdv-master-1 cinder-backup[122641]: DEBUG oslo.privsep.daemon [-] privsep: Exception during request[e48bd3f5-1159-4990-ae13-2a01749cb79b]: [Errno 2] No such file or directory: 'systool' {{(pid=147257) _process_cmd /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:480}}
Jan 15 21:12:05.085356 ncdv-master-1 cinder-backup[122641]: Traceback (most recent call last):
Jan 15 21:12:05.085356 ncdv-master-1 cinder-backup[122641]:   File "/usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py", line 477, in _process_cmd
Jan 15 21:12:05.085356 ncdv-master-1 cinder-backup[122641]:     ret = func(*f_args, **f_kwargs)
Jan 15 21:12:05.085356 ncdv-master-1 cinder-backup[122641]:   File "/usr/local/lib/python3.8/dist-packages/oslo_privsep/priv_context.py", line 274, in _wrap
Jan 15 21:12:05.085356 ncdv-master-1 cinder-backup[122641]:     return func(*args, **kwargs)
Jan 15 21:12:05.085356 ncdv-master-1 cinder-backup[122641]:   File "/usr/local/lib/python3.8/dist-packages/os_brick/privileged/rootwrap.py", line 197, in execute_root
Jan 15 21:12:05.085356 ncdv-master-1 cinder-backup[122641]:     return custom_execute(*cmd, shell=False, run_as_root=False, **kwargs)
Jan 15 21:12:05.085356 ncdv-master-1 cinder-backup[122641]:   File "/usr/local/lib/python3.8/dist-packages/os_brick/privileged/rootwrap.py", line 145, in custom_execute
Jan 15 21:12:05.085356 ncdv-master-1 cinder-backup[122641]:     return putils.execute(on_execute=on_execute,
Jan 15 21:12:05.085356 ncdv-master-1 cinder-backup[122641]:   File "/usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py", line 395, in execute
Jan 15 21:12:05.085356 ncdv-master-1 cinder-backup[122641]:     obj = subprocess.Popen(cmd,
Jan 15 21:12:05.085356 ncdv-master-1 cinder-backup[122641]:   File "/usr/lib/python3.8/subprocess.py", line 858, in __init__
Jan 15 21:12:05.085356 ncdv-master-1 cinder-backup[122641]:     self._execute_child(args, executable, preexec_fn, close_fds,
Jan 15 21:12:05.085356 ncdv-master-1 cinder-backup[122641]:   File "/usr/lib/python3.8/subprocess.py", line 1704, in _execute_child
Jan 15 21:12:05.085356 ncdv-master-1 cinder-backup[122641]:     raise child_exception_type(errno_num, err_msg, err_filename)
Jan 15 21:12:05.085356 ncdv-master-1 cinder-backup[122641]: FileNotFoundError: [Errno 2] No such file or directory: 'systool'
Jan 15 21:12:05.086987 ncdv-master-1 cinder-backup[122641]: DEBUG oslo.privsep.daemon [-] privsep: reply[e48bd3f5-1159-4990-ae13-2a01749cb79b]: (5, 'builtins.FileNotFoundError', (2, 'No such file or directory')) {{(pid=147257) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:502}}
Jan 15 21:12:05.088799 ncdv-master-1 cinder-backup[122641]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): systool -c fc_host -v {{(pid=147257) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 15 21:12:05.110145 ncdv-master-1 cinder-backup[122641]: DEBUG oslo_concurrency.processutils [-] 'systool -c fc_host -v' failed. Not Retrying. {{(pid=147257) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:473}}
Jan 15 21:12:05.112244 ncdv-master-1 cinder-backup[122641]: DEBUG oslo.privsep.daemon [-] privsep: Exception during request[895997b7-517d-4975-bb71-96c637bb8508]: [Errno 2] No such file or directory: 'systool' {{(pid=147257) _process_cmd /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:480}}
Jan 15 21:12:05.112244 ncdv-master-1 cinder-backup[122641]: Traceback (most recent call last):
Jan 15 21:12:05.112244 ncdv-master-1 cinder-backup[122641]:   File "/usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py", line 477, in _process_cmd
Jan 15 21:12:05.112244 ncdv-master-1 cinder-backup[122641]:     ret = func(*f_args, **f_kwargs)
Jan 15 21:12:05.112244 ncdv-master-1 cinder-backup[122641]:   File "/usr/local/lib/python3.8/dist-packages/oslo_privsep/priv_context.py", line 274, in _wrap
Jan 15 21:12:05.112244 ncdv-master-1 cinder-backup[122641]:     return func(*args, **kwargs)
Jan 15 21:12:05.112244 ncdv-master-1 cinder-backup[122641]:   File "/usr/local/lib/python3.8/dist-packages/os_brick/privileged/rootwrap.py", line 197, in execute_root
Jan 15 21:12:05.112244 ncdv-master-1 cinder-backup[122641]:     return custom_execute(*cmd, shell=False, run_as_root=False, **kwargs)
Jan 15 21:12:05.112244 ncdv-master-1 cinder-backup[122641]:   File "/usr/local/lib/python3.8/dist-packages/os_brick/privileged/rootwrap.py", line 145, in custom_execute
Jan 15 21:12:05.112244 ncdv-master-1 cinder-backup[122641]:     return putils.execute(on_execute=on_execute,
Jan 15 21:12:05.112244 ncdv-master-1 cinder-backup[122641]:   File "/usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py", line 395, in execute
Jan 15 21:12:05.112244 ncdv-master-1 cinder-backup[122641]:     obj = subprocess.Popen(cmd,
Jan 15 21:12:05.112244 ncdv-master-1 cinder-backup[122641]:   File "/usr/lib/python3.8/subprocess.py", line 858, in __init__
Jan 15 21:12:05.112244 ncdv-master-1 cinder-backup[122641]:     self._execute_child(args, executable, preexec_fn, close_fds,
Jan 15 21:12:05.112244 ncdv-master-1 cinder-backup[122641]:   File "/usr/lib/python3.8/subprocess.py", line 1704, in _execute_child
Jan 15 21:12:05.112244 ncdv-master-1 cinder-backup[122641]:     raise child_exception_type(errno_num, err_msg, err_filename)
Jan 15 21:12:05.112244 ncdv-master-1 cinder-backup[122641]: FileNotFoundError: [Errno 2] No such file or directory: 'systool'
Jan 15 21:12:05.113840 ncdv-master-1 cinder-backup[122641]: DEBUG oslo.privsep.daemon [-] privsep: reply[895997b7-517d-4975-bb71-96c637bb8508]: (5, 'builtins.FileNotFoundError', (2, 'No such file or directory')) {{(pid=147257) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:502}}
Jan 15 21:12:05.117922 ncdv-master-1 cinder-backup[122641]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=147257) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 15 21:12:05.154238 ncdv-master-1 cinder-backup[122641]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.038s {{(pid=147257) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Jan 15 21:12:05.155605 ncdv-master-1 cinder-backup[122641]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd8d8e52-35ea-4e54-ba91-b70a77b9175f]: (4, ('/dev/sda1\n', '')) {{(pid=147257) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:502}}
Jan 15 21:12:05.160062 ncdv-master-1 cinder-backup[122641]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/sda1 -s UUID -o value {{(pid=147257) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 15 21:12:05.190980 ncdv-master-1 cinder-backup[122641]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/sda1 -s UUID -o value" returned: 0 in 0.033s {{(pid=147257) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Jan 15 21:12:05.191549 ncdv-master-1 cinder-backup[122641]: DEBUG oslo.privsep.daemon [-] privsep: reply[64049340-866f-455e-bc9b-255effaa81a4]: (4, ('02bb033c-a191-40c0-94fb-bb025c724b13\n', '')) {{(pid=147257) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:502}}
Jan 15 21:12:05.193003 ncdv-master-1 cinder-backup[122641]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /sys/class/dmi/id/product_uuid {{(pid=147257) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 15 21:12:05.223494 ncdv-master-1 cinder-backup[122641]: DEBUG oslo_concurrency.processutils [-] CMD "cat /sys/class/dmi/id/product_uuid" returned: 0 in 0.030s {{(pid=147257) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Jan 15 21:12:05.223764 ncdv-master-1 cinder-backup[122641]: DEBUG oslo.privsep.daemon [-] privsep: reply[86491470-5376-49c8-966e-1ed7e66586ad]: (4, ('1b06c783-92a7-1942-a345-69784a0224b6\n', '')) {{(pid=147257) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:502}}
Jan 15 21:12:05.224808 ncdv-master-1 cinder-backup[122641]: DEBUG oslo_concurrency.processutils [None req-223f25c0-ee9d-4240-a260-bf9c346f1c9f tempest-VolumesBackupsTest-197440665 None] Running cmd (subprocess): nvme version {{(pid=122641) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 15 21:12:05.267044 ncdv-master-1 cinder-backup[122641]: DEBUG oslo_concurrency.processutils [None req-223f25c0-ee9d-4240-a260-bf9c346f1c9f tempest-VolumesBackupsTest-197440665 None] CMD "nvme version" returned: 0 in 0.040s {{(pid=122641) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Jan 15 21:12:05.268447 ncdv-master-1 cinder-backup[122641]: DEBUG os_brick.utils [None req-223f25c0-ee9d-4240-a260-bf9c346f1c9f tempest-VolumesBackupsTest-197440665 None] <== get_connector_properties: return (243ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.222.0.46', 'host': 'ncdv-master-1', 'multipath': False, 'initiator': 'iqn.1993-08.org.debian:01:b3cf3389e31a', 'do_local_attach': False, 'uuid': '02bb033c-a191-40c0-94fb-bb025c724b13', 'system uuid': '1b06c783-92a7-1942-a345-69784a0224b6', 'nqn': 'nqn.2014-08.org.nvmexpress:uuid:2f801fe5-9757-4764-9681-7ba5df13a96f'} {{(pid=122641) trace_logging_wrapper /usr/local/lib/python3.8/dist-packages/os_brick/utils.py:184}}
Jan 15 21:12:06.182373 ncdv-master-1 cinder-backup[122641]: DEBUG os_brick.initiator.connector [None req-223f25c0-ee9d-4240-a260-bf9c346f1c9f tempest-VolumesBackupsTest-197440665 None] Factory for rbd on None {{(pid=122641) factory /usr/local/lib/python3.8/dist-packages/os_brick/initiator/connector.py:281}}
Jan 15 21:12:06.183814 ncdv-master-1 cinder-backup[122641]: DEBUG os_brick.initiator.connectors.rbd [None req-223f25c0-ee9d-4240-a260-bf9c346f1c9f tempest-VolumesBackupsTest-197440665 None] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.rbd.RBDConnector object at 0x7f1af458db50>, 'connection_properties': {'name': 'volumes/volume-3b97ba69-58fd-4c51-a8ae-7ab354daf8ec', 'hosts': ['10.222.0.46'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '***', 'volume_id': '3b97ba69-58fd-4c51-a8ae-7ab354daf8ec', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}}" {{(pid=122641) trace_logging_wrapper /usr/local/lib/python3.8/dist-packages/os_brick/utils.py:157}}
Jan 15 21:12:06.184881 ncdv-master-1 cinder-backup[122641]: DEBUG os_brick.initiator.linuxrbd [None req-223f25c0-ee9d-4240-a260-bf9c346f1c9f tempest-VolumesBackupsTest-197440665 None] opening connection to ceph cluster (timeout=-1). {{(pid=122641) connect /usr/local/lib/python3.8/dist-packages/os_brick/initiator/linuxrbd.py:70}}
Jan 15 21:12:06.263922 ncdv-master-1 cinder-backup[122641]: DEBUG os_brick.initiator.connectors.rbd [None req-223f25c0-ee9d-4240-a260-bf9c346f1c9f tempest-VolumesBackupsTest-197440665 None] <== connect_volume: return (79ms) {'path': <os_brick.initiator.linuxrbd.RBDVolumeIOWrapper object at 0x7f1af4736130>} {{(pid=122641) trace_logging_wrapper /usr/local/lib/python3.8/dist-packages/os_brick/utils.py:184}}
Jan 15 21:12:06.272515 ncdv-master-1 cinder-backup[122641]: DEBUG oslo_db.sqlalchemy.engines [None req-223f25c0-ee9d-4240-a260-bf9c346f1c9f tempest-VolumesBackupsTest-197440665 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122641) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}}
Jan 15 21:12:06.285389 ncdv-master-1 cinder-backup[122641]: DEBUG cinder.backup.drivers.ceph [None req-223f25c0-ee9d-4240-a260-bf9c346f1c9f tempest-VolumesBackupsTest-197440665 None] Starting restore from Ceph backup=2ad47dfe-18ff-4c2b-a6db-4842f546a610 to volume=volume-3b97ba69-58fd-4c51-a8ae-7ab354daf8ec {{(pid=122641) restore /opt/stack/cinder/cinder/backup/drivers/ceph.py:1274}}
Jan 15 21:12:06.391992 ncdv-master-1 cinder-backup[122641]: DEBUG cinder.backup.drivers.ceph [None req-223f25c0-ee9d-4240-a260-bf9c346f1c9f tempest-VolumesBackupsTest-197440665 None] Looking for snapshot of backup base 'volume-730ab34e-1940-4999-811d-3fd7a179af20.backup.2ad47dfe-18ff-4c2b-a6db-4842f546a610' {{(pid=122641) _get_backup_snap_name /opt/stack/cinder/cinder/backup/drivers/ceph.py:905}}
Jan 15 21:12:06.392450 ncdv-master-1 cinder-backup[122641]: DEBUG cinder.backup.drivers.ceph [None req-223f25c0-ee9d-4240-a260-bf9c346f1c9f tempest-VolumesBackupsTest-197440665 None] Found snapshot 'backup.2ad47dfe-18ff-4c2b-a6db-4842f546a610.snap.1642281114.3796341' {{(pid=122641) _get_backup_snap_name /opt/stack/cinder/cinder/backup/drivers/ceph.py:924}}
Jan 15 21:12:06.407242 ncdv-master-1 cinder-backup[122641]: DEBUG cinder.backup.drivers.ceph [None req-223f25c0-ee9d-4240-a260-bf9c346f1c9f tempest-VolumesBackupsTest-197440665 None] Volume file is RBD. {{(pid=122641) _diff_restore_allowed /opt/stack/cinder/cinder/backup/drivers/ceph.py:1184}}
Jan 15 21:12:06.489226 ncdv-master-1 cinder-backup[122641]: DEBUG cinder.backup.drivers.ceph [None req-223f25c0-ee9d-4240-a260-bf9c346f1c9f tempest-VolumesBackupsTest-197440665 None] Attempting differential restore. {{(pid=122641) _restore_volume /opt/stack/cinder/cinder/backup/drivers/ceph.py:1234}}
Jan 15 21:12:06.489684 ncdv-master-1 cinder-backup[122641]: DEBUG cinder.backup.drivers.ceph [None req-223f25c0-ee9d-4240-a260-bf9c346f1c9f tempest-VolumesBackupsTest-197440665 None] Attempting incremental restore from base='volume-730ab34e-1940-4999-811d-3fd7a179af20.backup.2ad47dfe-18ff-4c2b-a6db-4842f546a610' snap='backup.2ad47dfe-18ff-4c2b-a6db-4842f546a610.snap.1642281114.3796341' {{(pid=122641) _diff_restore_rbd /opt/stack/cinder/cinder/backup/drivers/ceph.py:1089}}
Jan 15 21:12:06.490088 ncdv-master-1 cinder-backup[122641]: DEBUG cinder.backup.drivers.ceph [None req-223f25c0-ee9d-4240-a260-bf9c346f1c9f tempest-VolumesBackupsTest-197440665 None] Performing differential transfer from 'volume-730ab34e-1940-4999-811d-3fd7a179af20.backup.2ad47dfe-18ff-4c2b-a6db-4842f546a610' to 'volume-3b97ba69-58fd-4c51-a8ae-7ab354daf8ec' {{(pid=122641) _rbd_diff_transfer /opt/stack/cinder/cinder/backup/drivers/ceph.py:624}}
Jan 15 21:12:06.490885 ncdv-master-1 cinder-backup[122641]: DEBUG cinder.backup.drivers.ceph [None req-223f25c0-ee9d-4240-a260-bf9c346f1c9f tempest-VolumesBackupsTest-197440665 None] Piping cmd1='rbd export-diff --id cinder-bak --conf /etc/ceph/ceph.conf --pool backups backups/volume-730ab34e-1940-4999-811d-3fd7a179af20.backup.2ad47dfe-18ff-4c2b-a6db-4842f546a610@backup.2ad47dfe-18ff-4c2b-a6db-4842f546a610.snap.1642281114.3796341 -' into... {{(pid=122641) _piped_execute /opt/stack/cinder/cinder/backup/drivers/ceph.py:585}}
Jan 15 21:12:06.491113 ncdv-master-1 cinder-backup[122641]: DEBUG cinder.backup.drivers.ceph [None req-223f25c0-ee9d-4240-a260-bf9c346f1c9f tempest-VolumesBackupsTest-197440665 None] cmd2='rbd import-diff --id cinder --conf /tmp/brickrbd_g6ks27qd --pool volumes - volumes/volume-3b97ba69-58fd-4c51-a8ae-7ab354daf8ec' {{(pid=122641) _piped_execute /opt/stack/cinder/cinder/backup/drivers/ceph.py:586}}
Jan 15 21:12:11.224340 ncdv-master-1 cinder-backup[122641]: DEBUG oslo_service.periodic_task [None req-880577f5-cbba-4bc0-b820-8647ffc48ae5 None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=122641) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Jan 15 21:12:11.225181 ncdv-master-1 cinder-backup[122641]: DEBUG cinder.manager [None req-880577f5-cbba-4bc0-b820-8647ffc48ae5 None None] Notifying Schedulers of capabilities ... {{(pid=122641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jan 15 21:12:11.646609 ncdv-master-1 cinder-backup[122641]: DEBUG cinder.backup.drivers.ceph [None req-223f25c0-ee9d-4240-a260-bf9c346f1c9f tempest-VolumesBackupsTest-197440665 None] Restore transfer completed in 5.1562s {{(pid=122641) _diff_restore_rbd /opt/stack/cinder/cinder/backup/drivers/ceph.py:1111}}
Jan 15 21:12:11.647659 ncdv-master-1 cinder-backup[122641]: DEBUG cinder.backup.drivers.ceph [None req-223f25c0-ee9d-4240-a260-bf9c346f1c9f tempest-VolumesBackupsTest-197440665 None] Restore target I/O object does not support fileno() - skipping call to fsync(). {{(pid=122641) restore /opt/stack/cinder/cinder/backup/drivers/ceph.py:1285}}
Jan 15 21:12:11.716513 ncdv-master-1 cinder-backup[122641]: DEBUG cinder.backup.driver [None req-223f25c0-ee9d-4240-a260-bf9c346f1c9f tempest-VolumesBackupsTest-197440665 None] Restoring volume base metadata {{(pid=122641) _restore_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:177}}
Jan 15 21:12:11.738407 ncdv-master-1 cinder-backup[122641]: DEBUG cinder.backup.driver [None req-223f25c0-ee9d-4240-a260-bf9c346f1c9f tempest-VolumesBackupsTest-197440665 None] No metadata of type 'volume-metadata' to restore {{(pid=122641) put /opt/stack/cinder/cinder/backup/driver.py:345}}
Jan 15 21:12:11.739028 ncdv-master-1 cinder-backup[122641]: DEBUG cinder.backup.driver [None req-223f25c0-ee9d-4240-a260-bf9c346f1c9f tempest-VolumesBackupsTest-197440665 None] Restoring volume glance metadata {{(pid=122641) _restore_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:258}}
Jan 15 21:12:11.954962 ncdv-master-1 cinder-backup[122641]: DEBUG cinder.backup.drivers.ceph [None req-223f25c0-ee9d-4240-a260-bf9c346f1c9f tempest-VolumesBackupsTest-197440665 None] Restore to volume 3b97ba69-58fd-4c51-a8ae-7ab354daf8ec finished successfully. {{(pid=122641) restore /opt/stack/cinder/cinder/backup/drivers/ceph.py:1292}}
Jan 15 21:12:11.956741 ncdv-master-1 cinder-backup[122641]: DEBUG os_brick.initiator.connectors.rbd [None req-223f25c0-ee9d-4240-a260-bf9c346f1c9f tempest-VolumesBackupsTest-197440665 None] ==> disconnect_volume: call "{'self': <os_brick.initiator.connectors.rbd.RBDConnector object at 0x7f1af458db50>, 'connection_properties': {'name': 'volumes/volume-3b97ba69-58fd-4c51-a8ae-7ab354daf8ec', 'hosts': ['10.222.0.46'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '***', 'volume_id': '3b97ba69-58fd-4c51-a8ae-7ab354daf8ec', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'device_info': {'path': <os_brick.initiator.linuxrbd.RBDVolumeIOWrapper object at 0x7f1af4736130>}, 'force': True, 'ignore_errors': False}" {{(pid=122641) trace_logging_wrapper /usr/local/lib/python3.8/dist-packages/os_brick/utils.py:157}}
Jan 15 21:12:11.970468 ncdv-master-1 cinder-backup[122641]: DEBUG os_brick.initiator.connectors.rbd [None req-223f25c0-ee9d-4240-a260-bf9c346f1c9f tempest-VolumesBackupsTest-197440665 None] <== disconnect_volume: return (13ms) None {{(pid=122641) trace_logging_wrapper /usr/local/lib/python3.8/dist-packages/os_brick/utils.py:184}}
Jan 15 21:12:12.044241 ncdv-master-1 cinder-backup[122641]: DEBUG cinder.backup.manager [None req-223f25c0-ee9d-4240-a260-bf9c346f1c9f tempest-VolumesBackupsTest-197440665 None] Encryption key ID for volume 3b97ba69-58fd-4c51-a8ae-7ab354daf8ec already matches encryption key ID in backup 2ad47dfe-18ff-4c2b-a6db-4842f546a610. {{(pid=122641) _run_restore /opt/stack/cinder/cinder/backup/manager.py:801}}
Jan 15 21:12:12.084699 ncdv-master-1 cinder-backup[122641]: INFO cinder.backup.manager [None req-223f25c0-ee9d-4240-a260-bf9c346f1c9f tempest-VolumesBackupsTest-197440665 None] Finished restoring backup 2ad47dfe-18ff-4c2b-a6db-4842f546a610 to volume 3b97ba69-58fd-4c51-a8ae-7ab354daf8ec.
Jan 15 21:12:15.008201 ncdv-master-1 cinder-backup[122641]: INFO cinder.backup.manager [None req-af182ab9-905a-4f49-8e50-1806e8a0b987 tempest-VolumesBackupsTest-197440665 None] Delete backup started, backup: 2ad47dfe-18ff-4c2b-a6db-4842f546a610.
Jan 15 21:12:15.013689 ncdv-master-1 cinder-backup[122641]: DEBUG cinder.backup.drivers.ceph [None req-af182ab9-905a-4f49-8e50-1806e8a0b987 tempest-VolumesBackupsTest-197440665 None] Delete started for backup=2ad47dfe-18ff-4c2b-a6db-4842f546a610 {{(pid=122641) delete_backup /opt/stack/cinder/cinder/backup/drivers/ceph.py:1301}}
Jan 15 21:12:15.014439 ncdv-master-1 cinder-backup[122641]: DEBUG cinder.backup.drivers.ceph [None req-af182ab9-905a-4f49-8e50-1806e8a0b987 tempest-VolumesBackupsTest-197440665 None] Trying diff format basename='volume-730ab34e-1940-4999-811d-3fd7a179af20.backup.2ad47dfe-18ff-4c2b-a6db-4842f546a610' for backup base image of volume 730ab34e-1940-4999-811d-3fd7a179af20. {{(pid=122641) _try_delete_base_image /opt/stack/cinder/cinder/backup/drivers/ceph.py:513}}
Jan 15 21:12:15.149749 ncdv-master-1 cinder-backup[122641]: DEBUG cinder.backup.drivers.ceph [None req-af182ab9-905a-4f49-8e50-1806e8a0b987 tempest-VolumesBackupsTest-197440665 None] Looking for snapshot of backup base 'volume-730ab34e-1940-4999-811d-3fd7a179af20.backup.2ad47dfe-18ff-4c2b-a6db-4842f546a610' {{(pid=122641) _get_backup_snap_name /opt/stack/cinder/cinder/backup/drivers/ceph.py:905}}
Jan 15 21:12:15.151493 ncdv-master-1 cinder-backup[122641]: DEBUG cinder.backup.drivers.ceph [None req-af182ab9-905a-4f49-8e50-1806e8a0b987 tempest-VolumesBackupsTest-197440665 None] Found snapshot 'backup.2ad47dfe-18ff-4c2b-a6db-4842f546a610.snap.1642281114.3796341' {{(pid=122641) _get_backup_snap_name /opt/stack/cinder/cinder/backup/drivers/ceph.py:924}}
Jan 15 21:12:15.152266 ncdv-master-1 cinder-backup[122641]: DEBUG cinder.backup.drivers.ceph [None req-af182ab9-905a-4f49-8e50-1806e8a0b987 tempest-VolumesBackupsTest-197440665 None] Deleting backup snapshot='backup.2ad47dfe-18ff-4c2b-a6db-4842f546a610.snap.1642281114.3796341' {{(pid=122641) _delete_backup_snapshot /opt/stack/cinder/cinder/backup/drivers/ceph.py:473}}
Jan 15 21:12:15.594705 ncdv-master-1 cinder-backup[122641]: INFO cinder.backup.drivers.ceph [None req-af182ab9-905a-4f49-8e50-1806e8a0b987 tempest-VolumesBackupsTest-197440665 None] Deleting backup base image='volume-730ab34e-1940-4999-811d-3fd7a179af20.backup.2ad47dfe-18ff-4c2b-a6db-4842f546a610' of volume 730ab34e-1940-4999-811d-3fd7a179af20.
Jan 15 21:12:16.339349 ncdv-master-1 cinder-backup[122641]: DEBUG cinder.backup.drivers.ceph [None req-af182ab9-905a-4f49-8e50-1806e8a0b987 tempest-VolumesBackupsTest-197440665 None] Base backup image='volume-730ab34e-1940-4999-811d-3fd7a179af20.backup.2ad47dfe-18ff-4c2b-a6db-4842f546a610' of volume 730ab34e-1940-4999-811d-3fd7a179af20 deleted. {{(pid=122641) _try_delete_base_image /opt/stack/cinder/cinder/backup/drivers/ceph.py:561}}
Jan 15 21:12:16.446244 ncdv-master-1 cinder-backup[122641]: DEBUG cinder.backup.drivers.ceph [None req-af182ab9-905a-4f49-8e50-1806e8a0b987 tempest-VolumesBackupsTest-197440665 None] Delete of backup '2ad47dfe-18ff-4c2b-a6db-4842f546a610' for volume '730ab34e-1940-4999-811d-3fd7a179af20' finished. {{(pid=122641) delete_backup /opt/stack/cinder/cinder/backup/drivers/ceph.py:1329}}
Jan 15 21:12:16.453017 ncdv-master-1 cinder-backup[122641]: DEBUG oslo_db.sqlalchemy.engines [None req-af182ab9-905a-4f49-8e50-1806e8a0b987 tempest-VolumesBackupsTest-197440665 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122641) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}}
Jan 15 21:12:16.507324 ncdv-master-1 cinder-backup[122641]: DEBUG cinder.quota [None req-af182ab9-905a-4f49-8e50-1806e8a0b987 tempest-VolumesBackupsTest-197440665 None] Created reservations ['ce6e67ff-024b-4f04-9ce4-5bedfdbfa4ab', '64b2bb36-68d3-49cc-9a52-035e4a16d6a3'] {{(pid=122641) reserve /opt/stack/cinder/cinder/quota.py:755}}
Jan 15 21:12:16.556295 ncdv-master-1 cinder-backup[122641]: INFO cinder.backup.manager [None req-af182ab9-905a-4f49-8e50-1806e8a0b987 tempest-VolumesBackupsTest-197440665 None] Delete backup finished, backup 2ad47dfe-18ff-4c2b-a6db-4842f546a610 deleted.
Jan 15 21:13:11.220163 ncdv-master-1 cinder-backup[122641]: DEBUG oslo_service.periodic_task [None req-880577f5-cbba-4bc0-b820-8647ffc48ae5 None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=122641) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Jan 15 21:13:11.220942 ncdv-master-1 cinder-backup[122641]: DEBUG cinder.manager [None req-880577f5-cbba-4bc0-b820-8647ffc48ae5 None None] Notifying Schedulers of capabilities ... {{(pid=122641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jan 15 21:14:11.218168 ncdv-master-1 cinder-backup[122641]: DEBUG oslo_service.periodic_task [None req-880577f5-cbba-4bc0-b820-8647ffc48ae5 None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=122641) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Jan 15 21:14:11.220050 ncdv-master-1 cinder-backup[122641]: DEBUG cinder.manager [None req-880577f5-cbba-4bc0-b820-8647ffc48ae5 None None] Notifying Schedulers of capabilities ... {{(pid=122641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jan 15 21:15:11.223035 ncdv-master-1 cinder-backup[122641]: DEBUG oslo_service.periodic_task [None req-880577f5-cbba-4bc0-b820-8647ffc48ae5 None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=122641) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Jan 15 21:15:11.223634 ncdv-master-1 cinder-backup[122641]: DEBUG cinder.manager [None req-880577f5-cbba-4bc0-b820-8647ffc48ae5 None None] Notifying Schedulers of capabilities ... {{(pid=122641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jan 15 21:16:11.227417 ncdv-master-1 cinder-backup[122641]: DEBUG oslo_service.periodic_task [None req-880577f5-cbba-4bc0-b820-8647ffc48ae5 None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=122641) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Jan 15 21:16:11.228170 ncdv-master-1 cinder-backup[122641]: DEBUG cinder.manager [None req-880577f5-cbba-4bc0-b820-8647ffc48ae5 None None] Notifying Schedulers of capabilities ... {{(pid=122641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jan 15 21:17:11.233013 ncdv-master-1 cinder-backup[122641]: DEBUG oslo_service.periodic_task [None req-880577f5-cbba-4bc0-b820-8647ffc48ae5 None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=122641) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Jan 15 21:17:11.234174 ncdv-master-1 cinder-backup[122641]: DEBUG cinder.manager [None req-880577f5-cbba-4bc0-b820-8647ffc48ae5 None None] Notifying Schedulers of capabilities ... {{(pid=122641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jan 15 21:18:11.230314 ncdv-master-1 cinder-backup[122641]: DEBUG oslo_service.periodic_task [None req-880577f5-cbba-4bc0-b820-8647ffc48ae5 None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=122641) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Jan 15 21:18:11.231172 ncdv-master-1 cinder-backup[122641]: DEBUG cinder.manager [None req-880577f5-cbba-4bc0-b820-8647ffc48ae5 None None] Notifying Schedulers of capabilities ... {{(pid=122641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jan 15 21:19:11.227061 ncdv-master-1 cinder-backup[122641]: DEBUG oslo_service.periodic_task [None req-880577f5-cbba-4bc0-b820-8647ffc48ae5 None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=122641) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Jan 15 21:19:11.227773 ncdv-master-1 cinder-backup[122641]: DEBUG cinder.manager [None req-880577f5-cbba-4bc0-b820-8647ffc48ae5 None None] Notifying Schedulers of capabilities ... {{(pid=122641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jan 15 21:19:31.557902 ncdv-master-1 cinder-backup[122641]: INFO cinder.backup.manager [None req-6e3b1ce9-80de-41d3-828e-c084939cc30e tempest-VolumesBackupsV39Test-1693006658 None] Create backup started, backup: 5dd9c52d-5ba4-4c61-959c-3e8db4fbb3b3 volume: 9d62692a-94e4-40f2-aee4-6e224e251c3c.
Jan 15 21:19:31.573198 ncdv-master-1 cinder-backup[122641]: DEBUG os_brick.utils [None req-6e3b1ce9-80de-41d3-828e-c084939cc30e tempest-VolumesBackupsV39Test-1693006658 None] ==> get_connector_properties: call "{'root_helper': 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf', 'my_ip': '10.222.0.46', 'multipath': False, 'enforce_multipath': False, 'host': None, 'execute': None}" {{(pid=122641) trace_logging_wrapper /usr/local/lib/python3.8/dist-packages/os_brick/utils.py:157}}
Jan 15 21:19:31.575411 ncdv-master-1 cinder-backup[122641]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=147257) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 15 21:19:31.590302 ncdv-master-1 cinder-backup[122641]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=147257) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Jan 15 21:19:31.590611 ncdv-master-1 cinder-backup[122641]: DEBUG oslo.privsep.daemon [-] privsep: reply[1287558e-9444-425d-91a1-28d264451190]: (4, ('## DO NOT EDIT OR REMOVE THIS FILE!\n## If you remove this file, the iSCSI daemon will not start.\n## If you change the InitiatorName, existing access control lists\n## may reject this initiator.  The InitiatorName must be unique\n## for each iSCSI initiator.  Do NOT duplicate iSCSI InitiatorNames.\nInitiatorName=iqn.1993-08.org.debian:01:b3cf3389e31a\n', '')) {{(pid=147257) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:502}}
Jan 15 21:19:31.591947 ncdv-master-1 cinder-backup[122641]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): systool -c fc_host -v {{(pid=147257) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 15 21:19:31.605218 ncdv-master-1 cinder-backup[122641]: DEBUG oslo_concurrency.processutils [-] 'systool -c fc_host -v' failed. Not Retrying. {{(pid=147257) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:473}}
Jan 15 21:19:31.606053 ncdv-master-1 cinder-backup[122641]: DEBUG oslo.privsep.daemon [-] privsep: Exception during request[58b8ca4d-b935-4eb4-b481-1261f508360d]: [Errno 2] No such file or directory: 'systool' {{(pid=147257) _process_cmd /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:480}}
Jan 15 21:19:31.606053 ncdv-master-1 cinder-backup[122641]: Traceback (most recent call last):
Jan 15 21:19:31.606053 ncdv-master-1 cinder-backup[122641]:   File "/usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py", line 477, in _process_cmd
Jan 15 21:19:31.606053 ncdv-master-1 cinder-backup[122641]:     ret = func(*f_args, **f_kwargs)
Jan 15 21:19:31.606053 ncdv-master-1 cinder-backup[122641]:   File "/usr/local/lib/python3.8/dist-packages/oslo_privsep/priv_context.py", line 274, in _wrap
Jan 15 21:19:31.606053 ncdv-master-1 cinder-backup[122641]:     return func(*args, **kwargs)
Jan 15 21:19:31.606053 ncdv-master-1 cinder-backup[122641]:   File "/usr/local/lib/python3.8/dist-packages/os_brick/privileged/rootwrap.py", line 197, in execute_root
Jan 15 21:19:31.606053 ncdv-master-1 cinder-backup[122641]:     return custom_execute(*cmd, shell=False, run_as_root=False, **kwargs)
Jan 15 21:19:31.606053 ncdv-master-1 cinder-backup[122641]:   File "/usr/local/lib/python3.8/dist-packages/os_brick/privileged/rootwrap.py", line 145, in custom_execute
Jan 15 21:19:31.606053 ncdv-master-1 cinder-backup[122641]:     return putils.execute(on_execute=on_execute,
Jan 15 21:19:31.606053 ncdv-master-1 cinder-backup[122641]:   File "/usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py", line 395, in execute
Jan 15 21:19:31.606053 ncdv-master-1 cinder-backup[122641]:     obj = subprocess.Popen(cmd,
Jan 15 21:19:31.606053 ncdv-master-1 cinder-backup[122641]:   File "/usr/lib/python3.8/subprocess.py", line 858, in __init__
Jan 15 21:19:31.606053 ncdv-master-1 cinder-backup[122641]:     self._execute_child(args, executable, preexec_fn, close_fds,
Jan 15 21:19:31.606053 ncdv-master-1 cinder-backup[122641]:   File "/usr/lib/python3.8/subprocess.py", line 1704, in _execute_child
Jan 15 21:19:31.606053 ncdv-master-1 cinder-backup[122641]:     raise child_exception_type(errno_num, err_msg, err_filename)
Jan 15 21:19:31.606053 ncdv-master-1 cinder-backup[122641]: FileNotFoundError: [Errno 2] No such file or directory: 'systool'
Jan 15 21:19:31.607600 ncdv-master-1 cinder-backup[122641]: DEBUG oslo.privsep.daemon [-] privsep: reply[58b8ca4d-b935-4eb4-b481-1261f508360d]: (5, 'builtins.FileNotFoundError', (2, 'No such file or directory')) {{(pid=147257) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:502}}
Jan 15 21:19:31.609256 ncdv-master-1 cinder-backup[122641]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): systool -c fc_host -v {{(pid=147257) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 15 21:19:31.618606 ncdv-master-1 cinder-backup[122641]: DEBUG oslo_concurrency.processutils [-] 'systool -c fc_host -v' failed. Not Retrying. {{(pid=147257) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:473}}
Jan 15 21:19:31.619581 ncdv-master-1 cinder-backup[122641]: DEBUG oslo.privsep.daemon [-] privsep: Exception during request[210892ad-0f07-4da2-a734-2e8b91ab9883]: [Errno 2] No such file or directory: 'systool' {{(pid=147257) _process_cmd /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:480}}
Jan 15 21:19:31.619581 ncdv-master-1 cinder-backup[122641]: Traceback (most recent call last):
Jan 15 21:19:31.619581 ncdv-master-1 cinder-backup[122641]:   File "/usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py", line 477, in _process_cmd
Jan 15 21:19:31.619581 ncdv-master-1 cinder-backup[122641]:     ret = func(*f_args, **f_kwargs)
Jan 15 21:19:31.619581 ncdv-master-1 cinder-backup[122641]:   File "/usr/local/lib/python3.8/dist-packages/oslo_privsep/priv_context.py", line 274, in _wrap
Jan 15 21:19:31.619581 ncdv-master-1 cinder-backup[122641]:     return func(*args, **kwargs)
Jan 15 21:19:31.619581 ncdv-master-1 cinder-backup[122641]:   File "/usr/local/lib/python3.8/dist-packages/os_brick/privileged/rootwrap.py", line 197, in execute_root
Jan 15 21:19:31.619581 ncdv-master-1 cinder-backup[122641]:     return custom_execute(*cmd, shell=False, run_as_root=False, **kwargs)
Jan 15 21:19:31.619581 ncdv-master-1 cinder-backup[122641]:   File "/usr/local/lib/python3.8/dist-packages/os_brick/privileged/rootwrap.py", line 145, in custom_execute
Jan 15 21:19:31.619581 ncdv-master-1 cinder-backup[122641]:     return putils.execute(on_execute=on_execute,
Jan 15 21:19:31.619581 ncdv-master-1 cinder-backup[122641]:   File "/usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py", line 395, in execute
Jan 15 21:19:31.619581 ncdv-master-1 cinder-backup[122641]:     obj = subprocess.Popen(cmd,
Jan 15 21:19:31.619581 ncdv-master-1 cinder-backup[122641]:   File "/usr/lib/python3.8/subprocess.py", line 858, in __init__
Jan 15 21:19:31.619581 ncdv-master-1 cinder-backup[122641]:     self._execute_child(args, executable, preexec_fn, close_fds,
Jan 15 21:19:31.619581 ncdv-master-1 cinder-backup[122641]:   File "/usr/lib/python3.8/subprocess.py", line 1704, in _execute_child
Jan 15 21:19:31.619581 ncdv-master-1 cinder-backup[122641]:     raise child_exception_type(errno_num, err_msg, err_filename)
Jan 15 21:19:31.619581 ncdv-master-1 cinder-backup[122641]: FileNotFoundError: [Errno 2] No such file or directory: 'systool'
Jan 15 21:19:31.621059 ncdv-master-1 cinder-backup[122641]: DEBUG oslo.privsep.daemon [-] privsep: reply[210892ad-0f07-4da2-a734-2e8b91ab9883]: (5, 'builtins.FileNotFoundError', (2, 'No such file or directory')) {{(pid=147257) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:502}}
Jan 15 21:19:31.624648 ncdv-master-1 cinder-backup[122641]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=147257) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 15 21:19:31.655040 ncdv-master-1 cinder-backup[122641]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.031s {{(pid=147257) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Jan 15 21:19:31.655776 ncdv-master-1 cinder-backup[122641]: DEBUG oslo.privsep.daemon [-] privsep: reply[87d1d507-bbbf-48dd-a9fe-2a1eb4efb74a]: (4, ('/dev/sda1\n', '')) {{(pid=147257) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:502}}
Jan 15 21:19:31.659800 ncdv-master-1 cinder-backup[122641]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/sda1 -s UUID -o value {{(pid=147257) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 15 21:19:31.676096 ncdv-master-1 cinder-backup[122641]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/sda1 -s UUID -o value" returned: 0 in 0.018s {{(pid=147257) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Jan 15 21:19:31.676613 ncdv-master-1 cinder-backup[122641]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e3396df-d9d9-487c-9be5-f30e453ed184]: (4, ('02bb033c-a191-40c0-94fb-bb025c724b13\n', '')) {{(pid=147257) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:502}}
Jan 15 21:19:31.680611 ncdv-master-1 cinder-backup[122641]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /sys/class/dmi/id/product_uuid {{(pid=147257) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 15 21:19:31.693122 ncdv-master-1 cinder-backup[122641]: DEBUG oslo_concurrency.processutils [-] CMD "cat /sys/class/dmi/id/product_uuid" returned: 0 in 0.013s {{(pid=147257) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Jan 15 21:19:31.694269 ncdv-master-1 cinder-backup[122641]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dce21a5-18fa-4ff6-ba57-2bdc298f638d]: (4, ('1b06c783-92a7-1942-a345-69784a0224b6\n', '')) {{(pid=147257) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:502}}
Jan 15 21:19:31.695772 ncdv-master-1 cinder-backup[122641]: DEBUG oslo_concurrency.processutils [None req-6e3b1ce9-80de-41d3-828e-c084939cc30e tempest-VolumesBackupsV39Test-1693006658 None] Running cmd (subprocess): nvme version {{(pid=122641) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 15 21:19:31.718870 ncdv-master-1 cinder-backup[122641]: DEBUG oslo_concurrency.processutils [None req-6e3b1ce9-80de-41d3-828e-c084939cc30e tempest-VolumesBackupsV39Test-1693006658 None] CMD "nvme version" returned: 0 in 0.023s {{(pid=122641) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Jan 15 21:19:31.720258 ncdv-master-1 cinder-backup[122641]: DEBUG os_brick.utils [None req-6e3b1ce9-80de-41d3-828e-c084939cc30e tempest-VolumesBackupsV39Test-1693006658 None] <== get_connector_properties: return (146ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.222.0.46', 'host': 'ncdv-master-1', 'multipath': False, 'initiator': 'iqn.1993-08.org.debian:01:b3cf3389e31a', 'do_local_attach': False, 'uuid': '02bb033c-a191-40c0-94fb-bb025c724b13', 'system uuid': '1b06c783-92a7-1942-a345-69784a0224b6', 'nqn': 'nqn.2014-08.org.nvmexpress:uuid:2f801fe5-9757-4764-9681-7ba5df13a96f'} {{(pid=122641) trace_logging_wrapper /usr/local/lib/python3.8/dist-packages/os_brick/utils.py:184}}
Jan 15 21:19:32.693747 ncdv-master-1 cinder-backup[122641]: DEBUG os_brick.initiator.connector [None req-6e3b1ce9-80de-41d3-828e-c084939cc30e tempest-VolumesBackupsV39Test-1693006658 None] Factory for rbd on None {{(pid=122641) factory /usr/local/lib/python3.8/dist-packages/os_brick/initiator/connector.py:281}}
Jan 15 21:19:32.696086 ncdv-master-1 cinder-backup[122641]: DEBUG os_brick.initiator.connectors.rbd [None req-6e3b1ce9-80de-41d3-828e-c084939cc30e tempest-VolumesBackupsV39Test-1693006658 None] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.rbd.RBDConnector object at 0x7f1af471bee0>, 'connection_properties': {'name': 'volumes/volume-9d62692a-94e4-40f2-aee4-6e224e251c3c', 'hosts': ['10.222.0.46'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '***', 'volume_id': '9d62692a-94e4-40f2-aee4-6e224e251c3c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}}" {{(pid=122641) trace_logging_wrapper /usr/local/lib/python3.8/dist-packages/os_brick/utils.py:157}}
Jan 15 21:19:32.697445 ncdv-master-1 cinder-backup[122641]: DEBUG os_brick.initiator.linuxrbd [None req-6e3b1ce9-80de-41d3-828e-c084939cc30e tempest-VolumesBackupsV39Test-1693006658 None] opening connection to ceph cluster (timeout=-1). {{(pid=122641) connect /usr/local/lib/python3.8/dist-packages/os_brick/initiator/linuxrbd.py:70}}
Jan 15 21:19:32.762219 ncdv-master-1 cinder-backup[122641]: DEBUG os_brick.initiator.connectors.rbd [None req-6e3b1ce9-80de-41d3-828e-c084939cc30e tempest-VolumesBackupsV39Test-1693006658 None] <== connect_volume: return (65ms) {'path': <os_brick.initiator.linuxrbd.RBDVolumeIOWrapper object at 0x7f1af3ce8b50>} {{(pid=122641) trace_logging_wrapper /usr/local/lib/python3.8/dist-packages/os_brick/utils.py:184}}
Jan 15 21:19:32.769328 ncdv-master-1 cinder-backup[122641]: DEBUG oslo_db.sqlalchemy.engines [None req-6e3b1ce9-80de-41d3-828e-c084939cc30e tempest-VolumesBackupsV39Test-1693006658 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122641) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}}
Jan 15 21:19:32.805348 ncdv-master-1 cinder-backup[122641]: DEBUG cinder.backup.drivers.ceph [None req-6e3b1ce9-80de-41d3-828e-c084939cc30e tempest-VolumesBackupsV39Test-1693006658 None] Starting backup of volume='9d62692a-94e4-40f2-aee4-6e224e251c3c'. {{(pid=122641) backup /opt/stack/cinder/cinder/backup/drivers/ceph.py:974}}
Jan 15 21:19:32.806559 ncdv-master-1 cinder-backup[122641]: DEBUG cinder.backup.drivers.ceph [None req-6e3b1ce9-80de-41d3-828e-c084939cc30e tempest-VolumesBackupsV39Test-1693006658 None] Volume file is RBD: attempting optimized backup {{(pid=122641) backup /opt/stack/cinder/cinder/backup/drivers/ceph.py:985}}
Jan 15 21:19:32.861011 ncdv-master-1 cinder-backup[122641]: DEBUG cinder.backup.drivers.ceph [None req-6e3b1ce9-80de-41d3-828e-c084939cc30e tempest-VolumesBackupsV39Test-1693006658 None] Creating base image 'volume-9d62692a-94e4-40f2-aee4-6e224e251c3c.backup.5dd9c52d-5ba4-4c61-959c-3e8db4fbb3b3' {{(pid=122641) _create_base_image /opt/stack/cinder/cinder/backup/drivers/ceph.py:444}}
Jan 15 21:19:32.861659 ncdv-master-1 cinder-backup[122641]: DEBUG cinder.backup.drivers.ceph [None req-6e3b1ce9-80de-41d3-828e-c084939cc30e tempest-VolumesBackupsV39Test-1693006658 None] RBD also supports fast-diff, enabling it together with exclusive-lock and object-map {{(pid=122641) _get_rbd_support /opt/stack/cinder/cinder/backup/drivers/ceph.py:272}}
Jan 15 21:19:32.923041 ncdv-master-1 cinder-backup[122641]: DEBUG cinder.backup.drivers.ceph [None req-6e3b1ce9-80de-41d3-828e-c084939cc30e tempest-VolumesBackupsV39Test-1693006658 None] Using --from-snap 'None' for incremental backup of volume 9d62692a-94e4-40f2-aee4-6e224e251c3c. {{(pid=122641) _backup_rbd /opt/stack/cinder/cinder/backup/drivers/ceph.py:764}}
Jan 15 21:19:32.923680 ncdv-master-1 cinder-backup[122641]: DEBUG cinder.backup.drivers.ceph [None req-6e3b1ce9-80de-41d3-828e-c084939cc30e tempest-VolumesBackupsV39Test-1693006658 None] Creating backup snapshot='backup.5dd9c52d-5ba4-4c61-959c-3e8db4fbb3b3.snap.1642281572.923065' {{(pid=122641) _backup_rbd /opt/stack/cinder/cinder/backup/drivers/ceph.py:770}}
Jan 15 21:19:33.447141 ncdv-master-1 cinder-backup[122641]: DEBUG cinder.backup.drivers.ceph [None req-6e3b1ce9-80de-41d3-828e-c084939cc30e tempest-VolumesBackupsV39Test-1693006658 None] Performing differential transfer from 'volume-9d62692a-94e4-40f2-aee4-6e224e251c3c' to 'volume-9d62692a-94e4-40f2-aee4-6e224e251c3c.backup.5dd9c52d-5ba4-4c61-959c-3e8db4fbb3b3' {{(pid=122641) _rbd_diff_transfer /opt/stack/cinder/cinder/backup/drivers/ceph.py:624}}
Jan 15 21:19:33.448092 ncdv-master-1 cinder-backup[122641]: DEBUG cinder.backup.drivers.ceph [None req-6e3b1ce9-80de-41d3-828e-c084939cc30e tempest-VolumesBackupsV39Test-1693006658 None] Piping cmd1='rbd export-diff --id cinder --conf /tmp/brickrbd_ta8l3nf_ --pool volumes volumes/volume-9d62692a-94e4-40f2-aee4-6e224e251c3c@backup.5dd9c52d-5ba4-4c61-959c-3e8db4fbb3b3.snap.1642281572.923065 -' into... {{(pid=122641) _piped_execute /opt/stack/cinder/cinder/backup/drivers/ceph.py:585}}
Jan 15 21:19:33.449118 ncdv-master-1 cinder-backup[122641]: DEBUG cinder.backup.drivers.ceph [None req-6e3b1ce9-80de-41d3-828e-c084939cc30e tempest-VolumesBackupsV39Test-1693006658 None] cmd2='rbd import-diff --id cinder-bak --conf /etc/ceph/ceph.conf --pool backups - backups/volume-9d62692a-94e4-40f2-aee4-6e224e251c3c.backup.5dd9c52d-5ba4-4c61-959c-3e8db4fbb3b3' {{(pid=122641) _piped_execute /opt/stack/cinder/cinder/backup/drivers/ceph.py:586}}
Jan 15 21:19:34.492812 ncdv-master-1 cinder-backup[122641]: DEBUG cinder.backup.drivers.ceph [None req-6e3b1ce9-80de-41d3-828e-c084939cc30e tempest-VolumesBackupsV39Test-1693006658 None] Differential backup transfer completed in 1.0434s {{(pid=122641) _backup_rbd /opt/stack/cinder/cinder/backup/drivers/ceph.py:790}}
Jan 15 21:19:34.494251 ncdv-master-1 cinder-backup[122641]: DEBUG cinder.backup.driver [None req-6e3b1ce9-80de-41d3-828e-c084939cc30e tempest-VolumesBackupsV39Test-1693006658 None] Getting metadata type 'volume-base-metadata' {{(pid=122641) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:79}}
Jan 15 21:19:34.512369 ncdv-master-1 cinder-backup[122641]: DEBUG cinder.backup.driver [None req-6e3b1ce9-80de-41d3-828e-c084939cc30e tempest-VolumesBackupsV39Test-1693006658 None] Completed fetching metadata type 'volume-base-metadata' {{(pid=122641) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:98}}
Jan 15 21:19:34.513123 ncdv-master-1 cinder-backup[122641]: DEBUG cinder.backup.driver [None req-6e3b1ce9-80de-41d3-828e-c084939cc30e tempest-VolumesBackupsV39Test-1693006658 None] Getting metadata type 'volume-metadata' {{(pid=122641) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:109}}
Jan 15 21:19:34.521254 ncdv-master-1 cinder-backup[122641]: DEBUG cinder.backup.driver [None req-6e3b1ce9-80de-41d3-828e-c084939cc30e tempest-VolumesBackupsV39Test-1693006658 None] No metadata type 'volume-metadata' available {{(pid=122641) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:123}}
Jan 15 21:19:34.522695 ncdv-master-1 cinder-backup[122641]: DEBUG cinder.backup.driver [None req-6e3b1ce9-80de-41d3-828e-c084939cc30e tempest-VolumesBackupsV39Test-1693006658 None] Getting metadata type 'volume-glance-metadata' {{(pid=122641) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:132}}
Jan 15 21:19:34.531214 ncdv-master-1 cinder-backup[122641]: DEBUG cinder.backup.driver [None req-6e3b1ce9-80de-41d3-828e-c084939cc30e tempest-VolumesBackupsV39Test-1693006658 None] No metadata type 'volume-glance-metadata' available {{(pid=122641) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:147}}
Jan 15 21:19:34.532627 ncdv-master-1 cinder-backup[122641]: DEBUG cinder.backup.drivers.ceph [None req-6e3b1ce9-80de-41d3-828e-c084939cc30e tempest-VolumesBackupsV39Test-1693006658 None] Backing up metadata for volume 9d62692a-94e4-40f2-aee4-6e224e251c3c. {{(pid=122641) _backup_metadata /opt/stack/cinder/cinder/backup/drivers/ceph.py:951}}
Jan 15 21:19:34.586183 ncdv-master-1 cinder-backup[122641]: DEBUG cinder.backup.drivers.ceph [None req-6e3b1ce9-80de-41d3-828e-c084939cc30e tempest-VolumesBackupsV39Test-1693006658 None] Backup '5dd9c52d-5ba4-4c61-959c-3e8db4fbb3b3' of volume 9d62692a-94e4-40f2-aee4-6e224e251c3c finished. {{(pid=122641) backup /opt/stack/cinder/cinder/backup/drivers/ceph.py:1015}}
Jan 15 21:19:34.587840 ncdv-master-1 cinder-backup[122641]: DEBUG os_brick.initiator.connectors.rbd [None req-6e3b1ce9-80de-41d3-828e-c084939cc30e tempest-VolumesBackupsV39Test-1693006658 None] ==> disconnect_volume: call "{'self': <os_brick.initiator.connectors.rbd.RBDConnector object at 0x7f1af471bee0>, 'connection_properties': {'name': 'volumes/volume-9d62692a-94e4-40f2-aee4-6e224e251c3c', 'hosts': ['10.222.0.46'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '***', 'volume_id': '9d62692a-94e4-40f2-aee4-6e224e251c3c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'device_info': {'path': <os_brick.initiator.linuxrbd.RBDVolumeIOWrapper object at 0x7f1af3ce8b50>}, 'force': True, 'ignore_errors': True}" {{(pid=122641) trace_logging_wrapper /usr/local/lib/python3.8/dist-packages/os_brick/utils.py:157}}
Jan 15 21:19:34.620134 ncdv-master-1 cinder-backup[122641]: DEBUG os_brick.initiator.connectors.rbd [None req-6e3b1ce9-80de-41d3-828e-c084939cc30e tempest-VolumesBackupsV39Test-1693006658 None] <== disconnect_volume: return (30ms) None {{(pid=122641) trace_logging_wrapper /usr/local/lib/python3.8/dist-packages/os_brick/utils.py:184}}
Jan 15 21:19:34.713638 ncdv-master-1 cinder-backup[122641]: INFO cinder.backup.manager [None req-6e3b1ce9-80de-41d3-828e-c084939cc30e tempest-VolumesBackupsV39Test-1693006658 None] Create backup finished. backup: 5dd9c52d-5ba4-4c61-959c-3e8db4fbb3b3.
Jan 15 21:19:36.033843 ncdv-master-1 cinder-backup[122641]: INFO cinder.backup.manager [None req-dcd53b5c-a3f0-40ee-b7cb-49b5fa316dd7 tempest-VolumesBackupsV39Test-1693006658 None] Delete backup started, backup: 5dd9c52d-5ba4-4c61-959c-3e8db4fbb3b3.
Jan 15 21:19:36.041170 ncdv-master-1 cinder-backup[122641]: DEBUG cinder.backup.drivers.ceph [None req-dcd53b5c-a3f0-40ee-b7cb-49b5fa316dd7 tempest-VolumesBackupsV39Test-1693006658 None] Delete started for backup=5dd9c52d-5ba4-4c61-959c-3e8db4fbb3b3 {{(pid=122641) delete_backup /opt/stack/cinder/cinder/backup/drivers/ceph.py:1301}}
Jan 15 21:19:36.041619 ncdv-master-1 cinder-backup[122641]: DEBUG cinder.backup.drivers.ceph [None req-dcd53b5c-a3f0-40ee-b7cb-49b5fa316dd7 tempest-VolumesBackupsV39Test-1693006658 None] Trying diff format basename='volume-9d62692a-94e4-40f2-aee4-6e224e251c3c.backup.5dd9c52d-5ba4-4c61-959c-3e8db4fbb3b3' for backup base image of volume 9d62692a-94e4-40f2-aee4-6e224e251c3c. {{(pid=122641) _try_delete_base_image /opt/stack/cinder/cinder/backup/drivers/ceph.py:513}}
Jan 15 21:19:36.182724 ncdv-master-1 cinder-backup[122641]: DEBUG cinder.backup.drivers.ceph [None req-dcd53b5c-a3f0-40ee-b7cb-49b5fa316dd7 tempest-VolumesBackupsV39Test-1693006658 None] Looking for snapshot of backup base 'volume-9d62692a-94e4-40f2-aee4-6e224e251c3c.backup.5dd9c52d-5ba4-4c61-959c-3e8db4fbb3b3' {{(pid=122641) _get_backup_snap_name /opt/stack/cinder/cinder/backup/drivers/ceph.py:905}}
Jan 15 21:19:36.183785 ncdv-master-1 cinder-backup[122641]: DEBUG cinder.backup.drivers.ceph [None req-dcd53b5c-a3f0-40ee-b7cb-49b5fa316dd7 tempest-VolumesBackupsV39Test-1693006658 None] Found snapshot 'backup.5dd9c52d-5ba4-4c61-959c-3e8db4fbb3b3.snap.1642281572.923065' {{(pid=122641) _get_backup_snap_name /opt/stack/cinder/cinder/backup/drivers/ceph.py:924}}
Jan 15 21:19:36.184604 ncdv-master-1 cinder-backup[122641]: DEBUG cinder.backup.drivers.ceph [None req-dcd53b5c-a3f0-40ee-b7cb-49b5fa316dd7 tempest-VolumesBackupsV39Test-1693006658 None] Deleting backup snapshot='backup.5dd9c52d-5ba4-4c61-959c-3e8db4fbb3b3.snap.1642281572.923065' {{(pid=122641) _delete_backup_snapshot /opt/stack/cinder/cinder/backup/drivers/ceph.py:473}}
Jan 15 21:19:37.132490 ncdv-master-1 cinder-backup[122641]: INFO cinder.backup.drivers.ceph [None req-dcd53b5c-a3f0-40ee-b7cb-49b5fa316dd7 tempest-VolumesBackupsV39Test-1693006658 None] Deleting backup base image='volume-9d62692a-94e4-40f2-aee4-6e224e251c3c.backup.5dd9c52d-5ba4-4c61-959c-3e8db4fbb3b3' of volume 9d62692a-94e4-40f2-aee4-6e224e251c3c.
Jan 15 21:19:37.431667 ncdv-master-1 cinder-backup[122641]: DEBUG cinder.backup.drivers.ceph [None req-dcd53b5c-a3f0-40ee-b7cb-49b5fa316dd7 tempest-VolumesBackupsV39Test-1693006658 None] Base backup image='volume-9d62692a-94e4-40f2-aee4-6e224e251c3c.backup.5dd9c52d-5ba4-4c61-959c-3e8db4fbb3b3' of volume 9d62692a-94e4-40f2-aee4-6e224e251c3c deleted. {{(pid=122641) _try_delete_base_image /opt/stack/cinder/cinder/backup/drivers/ceph.py:561}}
Jan 15 21:19:37.495513 ncdv-master-1 cinder-backup[122641]: DEBUG cinder.backup.drivers.ceph [None req-dcd53b5c-a3f0-40ee-b7cb-49b5fa316dd7 tempest-VolumesBackupsV39Test-1693006658 None] Delete of backup '5dd9c52d-5ba4-4c61-959c-3e8db4fbb3b3' for volume '9d62692a-94e4-40f2-aee4-6e224e251c3c' finished. {{(pid=122641) delete_backup /opt/stack/cinder/cinder/backup/drivers/ceph.py:1329}}
Jan 15 21:19:37.501423 ncdv-master-1 cinder-backup[122641]: DEBUG oslo_db.sqlalchemy.engines [None req-dcd53b5c-a3f0-40ee-b7cb-49b5fa316dd7 tempest-VolumesBackupsV39Test-1693006658 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122641) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}}
Jan 15 21:19:37.544670 ncdv-master-1 cinder-backup[122641]: DEBUG cinder.quota [None req-dcd53b5c-a3f0-40ee-b7cb-49b5fa316dd7 tempest-VolumesBackupsV39Test-1693006658 None] Created reservations ['bca5e5b4-5a55-43e3-b404-70ac5930154b', 'f7f4b836-d093-4acf-8d8c-c7b83f7fb1e7'] {{(pid=122641) reserve /opt/stack/cinder/cinder/quota.py:755}}
Jan 15 21:19:37.590544 ncdv-master-1 cinder-backup[122641]: INFO cinder.backup.manager [None req-dcd53b5c-a3f0-40ee-b7cb-49b5fa316dd7 tempest-VolumesBackupsV39Test-1693006658 None] Delete backup finished, backup 5dd9c52d-5ba4-4c61-959c-3e8db4fbb3b3 deleted.
Jan 15 21:20:11.224639 ncdv-master-1 cinder-backup[122641]: DEBUG oslo_service.periodic_task [None req-880577f5-cbba-4bc0-b820-8647ffc48ae5 None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=122641) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Jan 15 21:20:11.226089 ncdv-master-1 cinder-backup[122641]: DEBUG cinder.manager [None req-880577f5-cbba-4bc0-b820-8647ffc48ae5 None None] Notifying Schedulers of capabilities ... {{(pid=122641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jan 15 21:21:11.222199 ncdv-master-1 cinder-backup[122641]: DEBUG oslo_service.periodic_task [None req-880577f5-cbba-4bc0-b820-8647ffc48ae5 None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=122641) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Jan 15 21:21:11.223062 ncdv-master-1 cinder-backup[122641]: DEBUG cinder.manager [None req-880577f5-cbba-4bc0-b820-8647ffc48ae5 None None] Notifying Schedulers of capabilities ... {{(pid=122641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jan 15 21:21:13.902530 ncdv-master-1 cinder-backup[122641]: INFO cinder.backup.manager [None req-42b0b976-b806-483c-99d3-45247029c1a5 tempest-TestVolumeBackupRestore-1457821269 None] Create backup started, backup: c32e5733-73a3-4752-8300-0a48c780cef7 volume: 3a4ab464-a9de-4070-bc0c-659687fd928e.
Jan 15 21:21:13.913598 ncdv-master-1 cinder-backup[122641]: DEBUG os_brick.utils [None req-42b0b976-b806-483c-99d3-45247029c1a5 tempest-TestVolumeBackupRestore-1457821269 None] ==> get_connector_properties: call "{'root_helper': 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf', 'my_ip': '10.222.0.46', 'multipath': False, 'enforce_multipath': False, 'host': None, 'execute': None}" {{(pid=122641) trace_logging_wrapper /usr/local/lib/python3.8/dist-packages/os_brick/utils.py:157}}
Jan 15 21:21:13.915059 ncdv-master-1 cinder-backup[122641]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=147257) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 15 21:21:13.924829 ncdv-master-1 cinder-backup[122641]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.009s {{(pid=147257) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Jan 15 21:21:13.925279 ncdv-master-1 cinder-backup[122641]: DEBUG oslo.privsep.daemon [-] privsep: reply[717f6ac7-adea-4e24-8769-e56e81cf3e98]: (4, ('## DO NOT EDIT OR REMOVE THIS FILE!\n## If you remove this file, the iSCSI daemon will not start.\n## If you change the InitiatorName, existing access control lists\n## may reject this initiator.  The InitiatorName must be unique\n## for each iSCSI initiator.  Do NOT duplicate iSCSI InitiatorNames.\nInitiatorName=iqn.1993-08.org.debian:01:b3cf3389e31a\n', '')) {{(pid=147257) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:502}}
Jan 15 21:21:13.926665 ncdv-master-1 cinder-backup[122641]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): systool -c fc_host -v {{(pid=147257) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 15 21:21:13.934510 ncdv-master-1 cinder-backup[122641]: DEBUG oslo_concurrency.processutils [-] 'systool -c fc_host -v' failed. Not Retrying. {{(pid=147257) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:473}}
Jan 15 21:21:13.934896 ncdv-master-1 cinder-backup[122641]: DEBUG oslo.privsep.daemon [-] privsep: Exception during request[e849e0dc-23c9-4866-8c3f-644abcd6282e]: [Errno 2] No such file or directory: 'systool' {{(pid=147257) _process_cmd /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:480}}
Jan 15 21:21:13.934896 ncdv-master-1 cinder-backup[122641]: Traceback (most recent call last):
Jan 15 21:21:13.934896 ncdv-master-1 cinder-backup[122641]:   File "/usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py", line 477, in _process_cmd
Jan 15 21:21:13.934896 ncdv-master-1 cinder-backup[122641]:     ret = func(*f_args, **f_kwargs)
Jan 15 21:21:13.934896 ncdv-master-1 cinder-backup[122641]:   File "/usr/local/lib/python3.8/dist-packages/oslo_privsep/priv_context.py", line 274, in _wrap
Jan 15 21:21:13.934896 ncdv-master-1 cinder-backup[122641]:     return func(*args, **kwargs)
Jan 15 21:21:13.934896 ncdv-master-1 cinder-backup[122641]:   File "/usr/local/lib/python3.8/dist-packages/os_brick/privileged/rootwrap.py", line 197, in execute_root
Jan 15 21:21:13.934896 ncdv-master-1 cinder-backup[122641]:     return custom_execute(*cmd, shell=False, run_as_root=False, **kwargs)
Jan 15 21:21:13.934896 ncdv-master-1 cinder-backup[122641]:   File "/usr/local/lib/python3.8/dist-packages/os_brick/privileged/rootwrap.py", line 145, in custom_execute
Jan 15 21:21:13.934896 ncdv-master-1 cinder-backup[122641]:     return putils.execute(on_execute=on_execute,
Jan 15 21:21:13.934896 ncdv-master-1 cinder-backup[122641]:   File "/usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py", line 395, in execute
Jan 15 21:21:13.934896 ncdv-master-1 cinder-backup[122641]:     obj = subprocess.Popen(cmd,
Jan 15 21:21:13.934896 ncdv-master-1 cinder-backup[122641]:   File "/usr/lib/python3.8/subprocess.py", line 858, in __init__
Jan 15 21:21:13.934896 ncdv-master-1 cinder-backup[122641]:     self._execute_child(args, executable, preexec_fn, close_fds,
Jan 15 21:21:13.934896 ncdv-master-1 cinder-backup[122641]:   File "/usr/lib/python3.8/subprocess.py", line 1704, in _execute_child
Jan 15 21:21:13.934896 ncdv-master-1 cinder-backup[122641]:     raise child_exception_type(errno_num, err_msg, err_filename)
Jan 15 21:21:13.934896 ncdv-master-1 cinder-backup[122641]: FileNotFoundError: [Errno 2] No such file or directory: 'systool'
Jan 15 21:21:13.936151 ncdv-master-1 cinder-backup[122641]: DEBUG oslo.privsep.daemon [-] privsep: reply[e849e0dc-23c9-4866-8c3f-644abcd6282e]: (5, 'builtins.FileNotFoundError', (2, 'No such file or directory')) {{(pid=147257) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:502}}
Jan 15 21:21:13.936717 ncdv-master-1 cinder-backup[122641]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): systool -c fc_host -v {{(pid=147257) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 15 21:21:13.943502 ncdv-master-1 cinder-backup[122641]: DEBUG oslo_concurrency.processutils [-] 'systool -c fc_host -v' failed. Not Retrying. {{(pid=147257) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:473}}
Jan 15 21:21:13.944402 ncdv-master-1 cinder-backup[122641]: DEBUG oslo.privsep.daemon [-] privsep: Exception during request[fcd8e62a-befe-4dd0-aeeb-884a007b5bc8]: [Errno 2] No such file or directory: 'systool' {{(pid=147257) _process_cmd /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:480}}
Jan 15 21:21:13.944402 ncdv-master-1 cinder-backup[122641]: Traceback (most recent call last):
Jan 15 21:21:13.944402 ncdv-master-1 cinder-backup[122641]:   File "/usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py", line 477, in _process_cmd
Jan 15 21:21:13.944402 ncdv-master-1 cinder-backup[122641]:     ret = func(*f_args, **f_kwargs)
Jan 15 21:21:13.944402 ncdv-master-1 cinder-backup[122641]:   File "/usr/local/lib/python3.8/dist-packages/oslo_privsep/priv_context.py", line 274, in _wrap
Jan 15 21:21:13.944402 ncdv-master-1 cinder-backup[122641]:     return func(*args, **kwargs)
Jan 15 21:21:13.944402 ncdv-master-1 cinder-backup[122641]:   File "/usr/local/lib/python3.8/dist-packages/os_brick/privileged/rootwrap.py", line 197, in execute_root
Jan 15 21:21:13.944402 ncdv-master-1 cinder-backup[122641]:     return custom_execute(*cmd, shell=False, run_as_root=False, **kwargs)
Jan 15 21:21:13.944402 ncdv-master-1 cinder-backup[122641]:   File "/usr/local/lib/python3.8/dist-packages/os_brick/privileged/rootwrap.py", line 145, in custom_execute
Jan 15 21:21:13.944402 ncdv-master-1 cinder-backup[122641]:     return putils.execute(on_execute=on_execute,
Jan 15 21:21:13.944402 ncdv-master-1 cinder-backup[122641]:   File "/usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py", line 395, in execute
Jan 15 21:21:13.944402 ncdv-master-1 cinder-backup[122641]:     obj = subprocess.Popen(cmd,
Jan 15 21:21:13.944402 ncdv-master-1 cinder-backup[122641]:   File "/usr/lib/python3.8/subprocess.py", line 858, in __init__
Jan 15 21:21:13.944402 ncdv-master-1 cinder-backup[122641]:     self._execute_child(args, executable, preexec_fn, close_fds,
Jan 15 21:21:13.944402 ncdv-master-1 cinder-backup[122641]:   File "/usr/lib/python3.8/subprocess.py", line 1704, in _execute_child
Jan 15 21:21:13.944402 ncdv-master-1 cinder-backup[122641]:     raise child_exception_type(errno_num, err_msg, err_filename)
Jan 15 21:21:13.944402 ncdv-master-1 cinder-backup[122641]: FileNotFoundError: [Errno 2] No such file or directory: 'systool'
Jan 15 21:21:13.945466 ncdv-master-1 cinder-backup[122641]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcd8e62a-befe-4dd0-aeeb-884a007b5bc8]: (5, 'builtins.FileNotFoundError', (2, 'No such file or directory')) {{(pid=147257) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:502}}
Jan 15 21:21:13.946470 ncdv-master-1 cinder-backup[122641]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=147257) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 15 21:21:13.959501 ncdv-master-1 cinder-backup[122641]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.013s {{(pid=147257) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Jan 15 21:21:13.960151 ncdv-master-1 cinder-backup[122641]: DEBUG oslo.privsep.daemon [-] privsep: reply[a795ba91-6152-4930-8e0b-d30cb7f0f0bc]: (4, ('/dev/sda1\n', '')) {{(pid=147257) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:502}}
Jan 15 21:21:13.961556 ncdv-master-1 cinder-backup[122641]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/sda1 -s UUID -o value {{(pid=147257) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 15 21:21:13.973310 ncdv-master-1 cinder-backup[122641]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/sda1 -s UUID -o value" returned: 0 in 0.011s {{(pid=147257) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Jan 15 21:21:13.974287 ncdv-master-1 cinder-backup[122641]: DEBUG oslo.privsep.daemon [-] privsep: reply[82ba0e65-de10-43f7-819f-6bddd29247cb]: (4, ('02bb033c-a191-40c0-94fb-bb025c724b13\n', '')) {{(pid=147257) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:502}}
Jan 15 21:21:13.976719 ncdv-master-1 cinder-backup[122641]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /sys/class/dmi/id/product_uuid {{(pid=147257) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 15 21:21:13.985531 ncdv-master-1 cinder-backup[122641]: DEBUG oslo_concurrency.processutils [-] CMD "cat /sys/class/dmi/id/product_uuid" returned: 0 in 0.009s {{(pid=147257) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Jan 15 21:21:13.985789 ncdv-master-1 cinder-backup[122641]: DEBUG oslo.privsep.daemon [-] privsep: reply[49637ccc-603b-4e0b-a0e3-1b3176139406]: (4, ('1b06c783-92a7-1942-a345-69784a0224b6\n', '')) {{(pid=147257) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:502}}
Jan 15 21:21:13.987452 ncdv-master-1 cinder-backup[122641]: DEBUG oslo_concurrency.processutils [None req-42b0b976-b806-483c-99d3-45247029c1a5 tempest-TestVolumeBackupRestore-1457821269 None] Running cmd (subprocess): nvme version {{(pid=122641) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 15 21:21:14.010742 ncdv-master-1 cinder-backup[122641]: DEBUG oslo_concurrency.processutils [None req-42b0b976-b806-483c-99d3-45247029c1a5 tempest-TestVolumeBackupRestore-1457821269 None] CMD "nvme version" returned: 0 in 0.023s {{(pid=122641) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Jan 15 21:21:14.012220 ncdv-master-1 cinder-backup[122641]: DEBUG os_brick.utils [None req-42b0b976-b806-483c-99d3-45247029c1a5 tempest-TestVolumeBackupRestore-1457821269 None] <== get_connector_properties: return (97ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.222.0.46', 'host': 'ncdv-master-1', 'multipath': False, 'initiator': 'iqn.1993-08.org.debian:01:b3cf3389e31a', 'do_local_attach': False, 'uuid': '02bb033c-a191-40c0-94fb-bb025c724b13', 'system uuid': '1b06c783-92a7-1942-a345-69784a0224b6', 'nqn': 'nqn.2014-08.org.nvmexpress:uuid:2f801fe5-9757-4764-9681-7ba5df13a96f'} {{(pid=122641) trace_logging_wrapper /usr/local/lib/python3.8/dist-packages/os_brick/utils.py:184}}
Jan 15 21:21:14.923089 ncdv-master-1 cinder-backup[122641]: DEBUG os_brick.initiator.connector [None req-42b0b976-b806-483c-99d3-45247029c1a5 tempest-TestVolumeBackupRestore-1457821269 None] Factory for rbd on None {{(pid=122641) factory /usr/local/lib/python3.8/dist-packages/os_brick/initiator/connector.py:281}}
Jan 15 21:21:14.923089 ncdv-master-1 cinder-backup[122641]: DEBUG os_brick.initiator.connectors.rbd [None req-42b0b976-b806-483c-99d3-45247029c1a5 tempest-TestVolumeBackupRestore-1457821269 None] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.rbd.RBDConnector object at 0x7f1af3cec400>, 'connection_properties': {'name': 'volumes/volume-3a4ab464-a9de-4070-bc0c-659687fd928e', 'hosts': ['10.222.0.46'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '***', 'volume_id': '3a4ab464-a9de-4070-bc0c-659687fd928e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}}" {{(pid=122641) trace_logging_wrapper /usr/local/lib/python3.8/dist-packages/os_brick/utils.py:157}}
Jan 15 21:21:14.923089 ncdv-master-1 cinder-backup[122641]: DEBUG os_brick.initiator.linuxrbd [None req-42b0b976-b806-483c-99d3-45247029c1a5 tempest-TestVolumeBackupRestore-1457821269 None] opening connection to ceph cluster (timeout=-1). {{(pid=122641) connect /usr/local/lib/python3.8/dist-packages/os_brick/initiator/linuxrbd.py:70}}
Jan 15 21:21:15.031947 ncdv-master-1 cinder-backup[122641]: DEBUG os_brick.initiator.connectors.rbd [None req-42b0b976-b806-483c-99d3-45247029c1a5 tempest-TestVolumeBackupRestore-1457821269 None] <== connect_volume: return (109ms) {'path': <os_brick.initiator.linuxrbd.RBDVolumeIOWrapper object at 0x7f1af461cd90>} {{(pid=122641) trace_logging_wrapper /usr/local/lib/python3.8/dist-packages/os_brick/utils.py:184}}
Jan 15 21:21:15.041737 ncdv-master-1 cinder-backup[122641]: DEBUG oslo_db.sqlalchemy.engines [None req-42b0b976-b806-483c-99d3-45247029c1a5 tempest-TestVolumeBackupRestore-1457821269 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122641) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}}
Jan 15 21:21:15.062306 ncdv-master-1 cinder-backup[122641]: DEBUG cinder.backup.drivers.ceph [None req-42b0b976-b806-483c-99d3-45247029c1a5 tempest-TestVolumeBackupRestore-1457821269 None] Starting backup of volume='3a4ab464-a9de-4070-bc0c-659687fd928e'. {{(pid=122641) backup /opt/stack/cinder/cinder/backup/drivers/ceph.py:974}}
Jan 15 21:21:15.063674 ncdv-master-1 cinder-backup[122641]: DEBUG cinder.backup.drivers.ceph [None req-42b0b976-b806-483c-99d3-45247029c1a5 tempest-TestVolumeBackupRestore-1457821269 None] Volume file is RBD: attempting optimized backup {{(pid=122641) backup /opt/stack/cinder/cinder/backup/drivers/ceph.py:985}}
Jan 15 21:21:15.088980 ncdv-master-1 cinder-backup[122641]: DEBUG cinder.backup.drivers.ceph [None req-42b0b976-b806-483c-99d3-45247029c1a5 tempest-TestVolumeBackupRestore-1457821269 None] Creating base image 'volume-3a4ab464-a9de-4070-bc0c-659687fd928e.backup.c32e5733-73a3-4752-8300-0a48c780cef7' {{(pid=122641) _create_base_image /opt/stack/cinder/cinder/backup/drivers/ceph.py:444}}
Jan 15 21:21:15.089341 ncdv-master-1 cinder-backup[122641]: DEBUG cinder.backup.drivers.ceph [None req-42b0b976-b806-483c-99d3-45247029c1a5 tempest-TestVolumeBackupRestore-1457821269 None] RBD also supports fast-diff, enabling it together with exclusive-lock and object-map {{(pid=122641) _get_rbd_support /opt/stack/cinder/cinder/backup/drivers/ceph.py:272}}
Jan 15 21:21:15.141644 ncdv-master-1 cinder-backup[122641]: DEBUG cinder.backup.drivers.ceph [None req-42b0b976-b806-483c-99d3-45247029c1a5 tempest-TestVolumeBackupRestore-1457821269 None] Using --from-snap 'None' for incremental backup of volume 3a4ab464-a9de-4070-bc0c-659687fd928e. {{(pid=122641) _backup_rbd /opt/stack/cinder/cinder/backup/drivers/ceph.py:764}}
Jan 15 21:21:15.142207 ncdv-master-1 cinder-backup[122641]: DEBUG cinder.backup.drivers.ceph [None req-42b0b976-b806-483c-99d3-45247029c1a5 tempest-TestVolumeBackupRestore-1457821269 None] Creating backup snapshot='backup.c32e5733-73a3-4752-8300-0a48c780cef7.snap.1642281675.1416693' {{(pid=122641) _backup_rbd /opt/stack/cinder/cinder/backup/drivers/ceph.py:770}}
Jan 15 21:21:16.167259 ncdv-master-1 cinder-backup[122641]: DEBUG cinder.backup.drivers.ceph [None req-42b0b976-b806-483c-99d3-45247029c1a5 tempest-TestVolumeBackupRestore-1457821269 None] Performing differential transfer from 'volume-3a4ab464-a9de-4070-bc0c-659687fd928e' to 'volume-3a4ab464-a9de-4070-bc0c-659687fd928e.backup.c32e5733-73a3-4752-8300-0a48c780cef7' {{(pid=122641) _rbd_diff_transfer /opt/stack/cinder/cinder/backup/drivers/ceph.py:624}}
Jan 15 21:21:16.168081 ncdv-master-1 cinder-backup[122641]: DEBUG cinder.backup.drivers.ceph [None req-42b0b976-b806-483c-99d3-45247029c1a5 tempest-TestVolumeBackupRestore-1457821269 None] Piping cmd1='rbd export-diff --id cinder --conf /tmp/brickrbd_wa48vy6r --pool volumes volumes/volume-3a4ab464-a9de-4070-bc0c-659687fd928e@backup.c32e5733-73a3-4752-8300-0a48c780cef7.snap.1642281675.1416693 -' into... {{(pid=122641) _piped_execute /opt/stack/cinder/cinder/backup/drivers/ceph.py:585}}
Jan 15 21:21:16.168081 ncdv-master-1 cinder-backup[122641]: DEBUG cinder.backup.drivers.ceph [None req-42b0b976-b806-483c-99d3-45247029c1a5 tempest-TestVolumeBackupRestore-1457821269 None] cmd2='rbd import-diff --id cinder-bak --conf /etc/ceph/ceph.conf --pool backups - backups/volume-3a4ab464-a9de-4070-bc0c-659687fd928e.backup.c32e5733-73a3-4752-8300-0a48c780cef7' {{(pid=122641) _piped_execute /opt/stack/cinder/cinder/backup/drivers/ceph.py:586}}
Jan 15 21:21:19.606657 ncdv-master-1 cinder-backup[122641]: DEBUG cinder.backup.drivers.ceph [None req-42b0b976-b806-483c-99d3-45247029c1a5 tempest-TestVolumeBackupRestore-1457821269 None] Differential backup transfer completed in 3.4391s {{(pid=122641) _backup_rbd /opt/stack/cinder/cinder/backup/drivers/ceph.py:790}}
Jan 15 21:21:19.607312 ncdv-master-1 cinder-backup[122641]: DEBUG cinder.backup.driver [None req-42b0b976-b806-483c-99d3-45247029c1a5 tempest-TestVolumeBackupRestore-1457821269 None] Getting metadata type 'volume-base-metadata' {{(pid=122641) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:79}}
Jan 15 21:21:19.620381 ncdv-master-1 cinder-backup[122641]: DEBUG cinder.backup.driver [None req-42b0b976-b806-483c-99d3-45247029c1a5 tempest-TestVolumeBackupRestore-1457821269 None] Completed fetching metadata type 'volume-base-metadata' {{(pid=122641) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:98}}
Jan 15 21:21:19.620905 ncdv-master-1 cinder-backup[122641]: DEBUG cinder.backup.driver [None req-42b0b976-b806-483c-99d3-45247029c1a5 tempest-TestVolumeBackupRestore-1457821269 None] Getting metadata type 'volume-metadata' {{(pid=122641) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:109}}
Jan 15 21:21:19.628326 ncdv-master-1 cinder-backup[122641]: DEBUG cinder.backup.driver [None req-42b0b976-b806-483c-99d3-45247029c1a5 tempest-TestVolumeBackupRestore-1457821269 None] No metadata type 'volume-metadata' available {{(pid=122641) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:123}}
Jan 15 21:21:19.628702 ncdv-master-1 cinder-backup[122641]: DEBUG cinder.backup.driver [None req-42b0b976-b806-483c-99d3-45247029c1a5 tempest-TestVolumeBackupRestore-1457821269 None] Getting metadata type 'volume-glance-metadata' {{(pid=122641) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:132}}
Jan 15 21:21:19.636130 ncdv-master-1 cinder-backup[122641]: DEBUG cinder.backup.driver [None req-42b0b976-b806-483c-99d3-45247029c1a5 tempest-TestVolumeBackupRestore-1457821269 None] Completed fetching metadata type 'volume-glance-metadata' {{(pid=122641) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:145}}
Jan 15 21:21:19.636675 ncdv-master-1 cinder-backup[122641]: DEBUG cinder.backup.drivers.ceph [None req-42b0b976-b806-483c-99d3-45247029c1a5 tempest-TestVolumeBackupRestore-1457821269 None] Backing up metadata for volume 3a4ab464-a9de-4070-bc0c-659687fd928e. {{(pid=122641) _backup_metadata /opt/stack/cinder/cinder/backup/drivers/ceph.py:951}}
Jan 15 21:21:19.670685 ncdv-master-1 cinder-backup[122641]: DEBUG cinder.backup.drivers.ceph [None req-42b0b976-b806-483c-99d3-45247029c1a5 tempest-TestVolumeBackupRestore-1457821269 None] Backup 'c32e5733-73a3-4752-8300-0a48c780cef7' of volume 3a4ab464-a9de-4070-bc0c-659687fd928e finished. {{(pid=122641) backup /opt/stack/cinder/cinder/backup/drivers/ceph.py:1015}}
Jan 15 21:21:19.672392 ncdv-master-1 cinder-backup[122641]: DEBUG os_brick.initiator.connectors.rbd [None req-42b0b976-b806-483c-99d3-45247029c1a5 tempest-TestVolumeBackupRestore-1457821269 None] ==> disconnect_volume: call "{'self': <os_brick.initiator.connectors.rbd.RBDConnector object at 0x7f1af3cec400>, 'connection_properties': {'name': 'volumes/volume-3a4ab464-a9de-4070-bc0c-659687fd928e', 'hosts': ['10.222.0.46'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '***', 'volume_id': '3a4ab464-a9de-4070-bc0c-659687fd928e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'device_info': {'path': <os_brick.initiator.linuxrbd.RBDVolumeIOWrapper object at 0x7f1af461cd90>}, 'force': True, 'ignore_errors': True}" {{(pid=122641) trace_logging_wrapper /usr/local/lib/python3.8/dist-packages/os_brick/utils.py:157}}
Jan 15 21:21:19.699246 ncdv-master-1 cinder-backup[122641]: DEBUG os_brick.initiator.connectors.rbd [None req-42b0b976-b806-483c-99d3-45247029c1a5 tempest-TestVolumeBackupRestore-1457821269 None] <== disconnect_volume: return (25ms) None {{(pid=122641) trace_logging_wrapper /usr/local/lib/python3.8/dist-packages/os_brick/utils.py:184}}
Jan 15 21:21:19.760814 ncdv-master-1 cinder-backup[122641]: INFO cinder.backup.manager [None req-42b0b976-b806-483c-99d3-45247029c1a5 tempest-TestVolumeBackupRestore-1457821269 None] Create backup finished. backup: c32e5733-73a3-4752-8300-0a48c780cef7.
Jan 15 21:21:21.470663 ncdv-master-1 cinder-backup[122641]: INFO cinder.backup.manager [None req-7d8f44fe-29a8-41cf-a52e-4a078e028aff tempest-TestVolumeBackupRestore-1457821269 None] Restore backup started, backup: c32e5733-73a3-4752-8300-0a48c780cef7 volume: bd619176-6e0b-4a31-92d4-89d5b07e409a.
Jan 15 21:21:21.488008 ncdv-master-1 cinder-backup[122641]: DEBUG os_brick.utils [None req-7d8f44fe-29a8-41cf-a52e-4a078e028aff tempest-TestVolumeBackupRestore-1457821269 None] ==> get_connector_properties: call "{'root_helper': 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf', 'my_ip': '10.222.0.46', 'multipath': False, 'enforce_multipath': False, 'host': None, 'execute': None}" {{(pid=122641) trace_logging_wrapper /usr/local/lib/python3.8/dist-packages/os_brick/utils.py:157}}
Jan 15 21:21:21.489282 ncdv-master-1 cinder-backup[122641]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=147257) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 15 21:21:21.499141 ncdv-master-1 cinder-backup[122641]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.009s {{(pid=147257) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Jan 15 21:21:21.499566 ncdv-master-1 cinder-backup[122641]: DEBUG oslo.privsep.daemon [-] privsep: reply[e85f6990-2947-4572-bdbc-eb3919a9634c]: (4, ('## DO NOT EDIT OR REMOVE THIS FILE!\n## If you remove this file, the iSCSI daemon will not start.\n## If you change the InitiatorName, existing access control lists\n## may reject this initiator.  The InitiatorName must be unique\n## for each iSCSI initiator.  Do NOT duplicate iSCSI InitiatorNames.\nInitiatorName=iqn.1993-08.org.debian:01:b3cf3389e31a\n', '')) {{(pid=147257) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:502}}
Jan 15 21:21:21.501090 ncdv-master-1 cinder-backup[122641]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): systool -c fc_host -v {{(pid=147257) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 15 21:21:21.507663 ncdv-master-1 cinder-backup[122641]: DEBUG oslo_concurrency.processutils [-] 'systool -c fc_host -v' failed. Not Retrying. {{(pid=147257) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:473}}
Jan 15 21:21:21.508213 ncdv-master-1 cinder-backup[122641]: DEBUG oslo.privsep.daemon [-] privsep: Exception during request[dea66783-c2e8-495f-8f6c-26ca455097db]: [Errno 2] No such file or directory: 'systool' {{(pid=147257) _process_cmd /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:480}}
Jan 15 21:21:21.508213 ncdv-master-1 cinder-backup[122641]: Traceback (most recent call last):
Jan 15 21:21:21.508213 ncdv-master-1 cinder-backup[122641]:   File "/usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py", line 477, in _process_cmd
Jan 15 21:21:21.508213 ncdv-master-1 cinder-backup[122641]:     ret = func(*f_args, **f_kwargs)
Jan 15 21:21:21.508213 ncdv-master-1 cinder-backup[122641]:   File "/usr/local/lib/python3.8/dist-packages/oslo_privsep/priv_context.py", line 274, in _wrap
Jan 15 21:21:21.508213 ncdv-master-1 cinder-backup[122641]:     return func(*args, **kwargs)
Jan 15 21:21:21.508213 ncdv-master-1 cinder-backup[122641]:   File "/usr/local/lib/python3.8/dist-packages/os_brick/privileged/rootwrap.py", line 197, in execute_root
Jan 15 21:21:21.508213 ncdv-master-1 cinder-backup[122641]:     return custom_execute(*cmd, shell=False, run_as_root=False, **kwargs)
Jan 15 21:21:21.508213 ncdv-master-1 cinder-backup[122641]:   File "/usr/local/lib/python3.8/dist-packages/os_brick/privileged/rootwrap.py", line 145, in custom_execute
Jan 15 21:21:21.508213 ncdv-master-1 cinder-backup[122641]:     return putils.execute(on_execute=on_execute,
Jan 15 21:21:21.508213 ncdv-master-1 cinder-backup[122641]:   File "/usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py", line 395, in execute
Jan 15 21:21:21.508213 ncdv-master-1 cinder-backup[122641]:     obj = subprocess.Popen(cmd,
Jan 15 21:21:21.508213 ncdv-master-1 cinder-backup[122641]:   File "/usr/lib/python3.8/subprocess.py", line 858, in __init__
Jan 15 21:21:21.508213 ncdv-master-1 cinder-backup[122641]:     self._execute_child(args, executable, preexec_fn, close_fds,
Jan 15 21:21:21.508213 ncdv-master-1 cinder-backup[122641]:   File "/usr/lib/python3.8/subprocess.py", line 1704, in _execute_child
Jan 15 21:21:21.508213 ncdv-master-1 cinder-backup[122641]:     raise child_exception_type(errno_num, err_msg, err_filename)
Jan 15 21:21:21.508213 ncdv-master-1 cinder-backup[122641]: FileNotFoundError: [Errno 2] No such file or directory: 'systool'
Jan 15 21:21:21.510669 ncdv-master-1 cinder-backup[122641]: DEBUG oslo.privsep.daemon [-] privsep: reply[dea66783-c2e8-495f-8f6c-26ca455097db]: (5, 'builtins.FileNotFoundError', (2, 'No such file or directory')) {{(pid=147257) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:502}}
Jan 15 21:21:21.512949 ncdv-master-1 cinder-backup[122641]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): systool -c fc_host -v {{(pid=147257) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 15 21:21:21.523172 ncdv-master-1 cinder-backup[122641]: DEBUG oslo_concurrency.processutils [-] 'systool -c fc_host -v' failed. Not Retrying. {{(pid=147257) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:473}}
Jan 15 21:21:21.523793 ncdv-master-1 cinder-backup[122641]: DEBUG oslo.privsep.daemon [-] privsep: Exception during request[959b4852-a8b9-4b87-8121-c854230f755a]: [Errno 2] No such file or directory: 'systool' {{(pid=147257) _process_cmd /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:480}}
Jan 15 21:21:21.523793 ncdv-master-1 cinder-backup[122641]: Traceback (most recent call last):
Jan 15 21:21:21.523793 ncdv-master-1 cinder-backup[122641]:   File "/usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py", line 477, in _process_cmd
Jan 15 21:21:21.523793 ncdv-master-1 cinder-backup[122641]:     ret = func(*f_args, **f_kwargs)
Jan 15 21:21:21.523793 ncdv-master-1 cinder-backup[122641]:   File "/usr/local/lib/python3.8/dist-packages/oslo_privsep/priv_context.py", line 274, in _wrap
Jan 15 21:21:21.523793 ncdv-master-1 cinder-backup[122641]:     return func(*args, **kwargs)
Jan 15 21:21:21.523793 ncdv-master-1 cinder-backup[122641]:   File "/usr/local/lib/python3.8/dist-packages/os_brick/privileged/rootwrap.py", line 197, in execute_root
Jan 15 21:21:21.523793 ncdv-master-1 cinder-backup[122641]:     return custom_execute(*cmd, shell=False, run_as_root=False, **kwargs)
Jan 15 21:21:21.523793 ncdv-master-1 cinder-backup[122641]:   File "/usr/local/lib/python3.8/dist-packages/os_brick/privileged/rootwrap.py", line 145, in custom_execute
Jan 15 21:21:21.523793 ncdv-master-1 cinder-backup[122641]:     return putils.execute(on_execute=on_execute,
Jan 15 21:21:21.523793 ncdv-master-1 cinder-backup[122641]:   File "/usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py", line 395, in execute
Jan 15 21:21:21.523793 ncdv-master-1 cinder-backup[122641]:     obj = subprocess.Popen(cmd,
Jan 15 21:21:21.523793 ncdv-master-1 cinder-backup[122641]:   File "/usr/lib/python3.8/subprocess.py", line 858, in __init__
Jan 15 21:21:21.523793 ncdv-master-1 cinder-backup[122641]:     self._execute_child(args, executable, preexec_fn, close_fds,
Jan 15 21:21:21.523793 ncdv-master-1 cinder-backup[122641]:   File "/usr/lib/python3.8/subprocess.py", line 1704, in _execute_child
Jan 15 21:21:21.523793 ncdv-master-1 cinder-backup[122641]:     raise child_exception_type(errno_num, err_msg, err_filename)
Jan 15 21:21:21.523793 ncdv-master-1 cinder-backup[122641]: FileNotFoundError: [Errno 2] No such file or directory: 'systool'
Jan 15 21:21:21.525454 ncdv-master-1 cinder-backup[122641]: DEBUG oslo.privsep.daemon [-] privsep: reply[959b4852-a8b9-4b87-8121-c854230f755a]: (5, 'builtins.FileNotFoundError', (2, 'No such file or directory')) {{(pid=147257) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:502}}
Jan 15 21:21:21.526586 ncdv-master-1 cinder-backup[122641]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=147257) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 15 21:21:21.542613 ncdv-master-1 cinder-backup[122641]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=147257) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Jan 15 21:21:21.542937 ncdv-master-1 cinder-backup[122641]: DEBUG oslo.privsep.daemon [-] privsep: reply[9243580e-1dd7-4a63-84af-db80eb5a9417]: (4, ('/dev/sda1\n', '')) {{(pid=147257) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:502}}
Jan 15 21:21:21.544888 ncdv-master-1 cinder-backup[122641]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/sda1 -s UUID -o value {{(pid=147257) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 15 21:21:21.559354 ncdv-master-1 cinder-backup[122641]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/sda1 -s UUID -o value" returned: 0 in 0.014s {{(pid=147257) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Jan 15 21:21:21.559737 ncdv-master-1 cinder-backup[122641]: DEBUG oslo.privsep.daemon [-] privsep: reply[62a55887-d08e-4cc6-ba4f-80a42d5ac4aa]: (4, ('02bb033c-a191-40c0-94fb-bb025c724b13\n', '')) {{(pid=147257) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:502}}
Jan 15 21:21:21.561818 ncdv-master-1 cinder-backup[122641]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /sys/class/dmi/id/product_uuid {{(pid=147257) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 15 21:21:21.574408 ncdv-master-1 cinder-backup[122641]: DEBUG oslo_concurrency.processutils [-] CMD "cat /sys/class/dmi/id/product_uuid" returned: 0 in 0.012s {{(pid=147257) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Jan 15 21:21:21.574744 ncdv-master-1 cinder-backup[122641]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b6a757c-bfc4-4bdc-8a81-aa93b9bc76c1]: (4, ('1b06c783-92a7-1942-a345-69784a0224b6\n', '')) {{(pid=147257) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:502}}
Jan 15 21:21:21.575654 ncdv-master-1 cinder-backup[122641]: DEBUG oslo_concurrency.processutils [None req-7d8f44fe-29a8-41cf-a52e-4a078e028aff tempest-TestVolumeBackupRestore-1457821269 None] Running cmd (subprocess): nvme version {{(pid=122641) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 15 21:21:21.596910 ncdv-master-1 cinder-backup[122641]: DEBUG oslo_concurrency.processutils [None req-7d8f44fe-29a8-41cf-a52e-4a078e028aff tempest-TestVolumeBackupRestore-1457821269 None] CMD "nvme version" returned: 0 in 0.021s {{(pid=122641) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Jan 15 21:21:21.599186 ncdv-master-1 cinder-backup[122641]: DEBUG os_brick.utils [None req-7d8f44fe-29a8-41cf-a52e-4a078e028aff tempest-TestVolumeBackupRestore-1457821269 None] <== get_connector_properties: return (110ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.222.0.46', 'host': 'ncdv-master-1', 'multipath': False, 'initiator': 'iqn.1993-08.org.debian:01:b3cf3389e31a', 'do_local_attach': False, 'uuid': '02bb033c-a191-40c0-94fb-bb025c724b13', 'system uuid': '1b06c783-92a7-1942-a345-69784a0224b6', 'nqn': 'nqn.2014-08.org.nvmexpress:uuid:2f801fe5-9757-4764-9681-7ba5df13a96f'} {{(pid=122641) trace_logging_wrapper /usr/local/lib/python3.8/dist-packages/os_brick/utils.py:184}}
Jan 15 21:21:22.384926 ncdv-master-1 cinder-backup[122641]: DEBUG os_brick.initiator.connector [None req-7d8f44fe-29a8-41cf-a52e-4a078e028aff tempest-TestVolumeBackupRestore-1457821269 None] Factory for rbd on None {{(pid=122641) factory /usr/local/lib/python3.8/dist-packages/os_brick/initiator/connector.py:281}}
Jan 15 21:21:22.386496 ncdv-master-1 cinder-backup[122641]: DEBUG os_brick.initiator.connectors.rbd [None req-7d8f44fe-29a8-41cf-a52e-4a078e028aff tempest-TestVolumeBackupRestore-1457821269 None] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.rbd.RBDConnector object at 0x7f1af4744dc0>, 'connection_properties': {'name': 'volumes/volume-bd619176-6e0b-4a31-92d4-89d5b07e409a', 'hosts': ['10.222.0.46'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '***', 'volume_id': 'bd619176-6e0b-4a31-92d4-89d5b07e409a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}}" {{(pid=122641) trace_logging_wrapper /usr/local/lib/python3.8/dist-packages/os_brick/utils.py:157}}
Jan 15 21:21:22.387607 ncdv-master-1 cinder-backup[122641]: DEBUG os_brick.initiator.linuxrbd [None req-7d8f44fe-29a8-41cf-a52e-4a078e028aff tempest-TestVolumeBackupRestore-1457821269 None] opening connection to ceph cluster (timeout=-1). {{(pid=122641) connect /usr/local/lib/python3.8/dist-packages/os_brick/initiator/linuxrbd.py:70}}
Jan 15 21:21:22.431308 ncdv-master-1 cinder-backup[122641]: DEBUG os_brick.initiator.connectors.rbd [None req-7d8f44fe-29a8-41cf-a52e-4a078e028aff tempest-TestVolumeBackupRestore-1457821269 None] <== connect_volume: return (44ms) {'path': <os_brick.initiator.linuxrbd.RBDVolumeIOWrapper object at 0x7f1af4685310>} {{(pid=122641) trace_logging_wrapper /usr/local/lib/python3.8/dist-packages/os_brick/utils.py:184}}
Jan 15 21:21:22.439517 ncdv-master-1 cinder-backup[122641]: DEBUG oslo_db.sqlalchemy.engines [None req-7d8f44fe-29a8-41cf-a52e-4a078e028aff tempest-TestVolumeBackupRestore-1457821269 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122641) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}}
Jan 15 21:21:22.451642 ncdv-master-1 cinder-backup[122641]: DEBUG cinder.backup.drivers.ceph [None req-7d8f44fe-29a8-41cf-a52e-4a078e028aff tempest-TestVolumeBackupRestore-1457821269 None] Starting restore from Ceph backup=c32e5733-73a3-4752-8300-0a48c780cef7 to volume=volume-bd619176-6e0b-4a31-92d4-89d5b07e409a {{(pid=122641) restore /opt/stack/cinder/cinder/backup/drivers/ceph.py:1274}}
Jan 15 21:21:22.519250 ncdv-master-1 cinder-backup[122641]: DEBUG cinder.backup.drivers.ceph [None req-7d8f44fe-29a8-41cf-a52e-4a078e028aff tempest-TestVolumeBackupRestore-1457821269 None] Looking for snapshot of backup base 'volume-3a4ab464-a9de-4070-bc0c-659687fd928e.backup.c32e5733-73a3-4752-8300-0a48c780cef7' {{(pid=122641) _get_backup_snap_name /opt/stack/cinder/cinder/backup/drivers/ceph.py:905}}
Jan 15 21:21:22.520291 ncdv-master-1 cinder-backup[122641]: DEBUG cinder.backup.drivers.ceph [None req-7d8f44fe-29a8-41cf-a52e-4a078e028aff tempest-TestVolumeBackupRestore-1457821269 None] Found snapshot 'backup.c32e5733-73a3-4752-8300-0a48c780cef7.snap.1642281675.1416693' {{(pid=122641) _get_backup_snap_name /opt/stack/cinder/cinder/backup/drivers/ceph.py:924}}
Jan 15 21:21:22.530358 ncdv-master-1 cinder-backup[122641]: DEBUG cinder.backup.drivers.ceph [None req-7d8f44fe-29a8-41cf-a52e-4a078e028aff tempest-TestVolumeBackupRestore-1457821269 None] Volume file is RBD. {{(pid=122641) _diff_restore_allowed /opt/stack/cinder/cinder/backup/drivers/ceph.py:1184}}
Jan 15 21:21:22.571609 ncdv-master-1 cinder-backup[122641]: DEBUG cinder.backup.drivers.ceph [None req-7d8f44fe-29a8-41cf-a52e-4a078e028aff tempest-TestVolumeBackupRestore-1457821269 None] Attempting differential restore. {{(pid=122641) _restore_volume /opt/stack/cinder/cinder/backup/drivers/ceph.py:1234}}
Jan 15 21:21:22.572090 ncdv-master-1 cinder-backup[122641]: DEBUG cinder.backup.drivers.ceph [None req-7d8f44fe-29a8-41cf-a52e-4a078e028aff tempest-TestVolumeBackupRestore-1457821269 None] Attempting incremental restore from base='volume-3a4ab464-a9de-4070-bc0c-659687fd928e.backup.c32e5733-73a3-4752-8300-0a48c780cef7' snap='backup.c32e5733-73a3-4752-8300-0a48c780cef7.snap.1642281675.1416693' {{(pid=122641) _diff_restore_rbd /opt/stack/cinder/cinder/backup/drivers/ceph.py:1089}}
Jan 15 21:21:22.572541 ncdv-master-1 cinder-backup[122641]: DEBUG cinder.backup.drivers.ceph [None req-7d8f44fe-29a8-41cf-a52e-4a078e028aff tempest-TestVolumeBackupRestore-1457821269 None] Performing differential transfer from 'volume-3a4ab464-a9de-4070-bc0c-659687fd928e.backup.c32e5733-73a3-4752-8300-0a48c780cef7' to 'volume-bd619176-6e0b-4a31-92d4-89d5b07e409a' {{(pid=122641) _rbd_diff_transfer /opt/stack/cinder/cinder/backup/drivers/ceph.py:624}}
Jan 15 21:21:22.572946 ncdv-master-1 cinder-backup[122641]: DEBUG cinder.backup.drivers.ceph [None req-7d8f44fe-29a8-41cf-a52e-4a078e028aff tempest-TestVolumeBackupRestore-1457821269 None] Piping cmd1='rbd export-diff --id cinder-bak --conf /etc/ceph/ceph.conf --pool backups backups/volume-3a4ab464-a9de-4070-bc0c-659687fd928e.backup.c32e5733-73a3-4752-8300-0a48c780cef7@backup.c32e5733-73a3-4752-8300-0a48c780cef7.snap.1642281675.1416693 -' into... {{(pid=122641) _piped_execute /opt/stack/cinder/cinder/backup/drivers/ceph.py:585}}
Jan 15 21:21:22.573315 ncdv-master-1 cinder-backup[122641]: DEBUG cinder.backup.drivers.ceph [None req-7d8f44fe-29a8-41cf-a52e-4a078e028aff tempest-TestVolumeBackupRestore-1457821269 None] cmd2='rbd import-diff --id cinder --conf /tmp/brickrbd_zm8u1rmk --pool volumes - volumes/volume-bd619176-6e0b-4a31-92d4-89d5b07e409a' {{(pid=122641) _piped_execute /opt/stack/cinder/cinder/backup/drivers/ceph.py:586}}
Jan 15 21:21:26.240727 ncdv-master-1 cinder-backup[122641]: DEBUG cinder.backup.drivers.ceph [None req-7d8f44fe-29a8-41cf-a52e-4a078e028aff tempest-TestVolumeBackupRestore-1457821269 None] Restore transfer completed in 3.6677s {{(pid=122641) _diff_restore_rbd /opt/stack/cinder/cinder/backup/drivers/ceph.py:1111}}
Jan 15 21:21:26.241761 ncdv-master-1 cinder-backup[122641]: DEBUG cinder.backup.drivers.ceph [None req-7d8f44fe-29a8-41cf-a52e-4a078e028aff tempest-TestVolumeBackupRestore-1457821269 None] Restore target I/O object does not support fileno() - skipping call to fsync(). {{(pid=122641) restore /opt/stack/cinder/cinder/backup/drivers/ceph.py:1285}}
Jan 15 21:21:26.268815 ncdv-master-1 cinder-backup[122641]: DEBUG cinder.backup.driver [None req-7d8f44fe-29a8-41cf-a52e-4a078e028aff tempest-TestVolumeBackupRestore-1457821269 None] Restoring volume base metadata {{(pid=122641) _restore_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:177}}
Jan 15 21:21:26.293349 ncdv-master-1 cinder-backup[122641]: DEBUG cinder.backup.driver [None req-7d8f44fe-29a8-41cf-a52e-4a078e028aff tempest-TestVolumeBackupRestore-1457821269 None] No metadata of type 'volume-metadata' to restore {{(pid=122641) put /opt/stack/cinder/cinder/backup/driver.py:345}}
Jan 15 21:21:26.293874 ncdv-master-1 cinder-backup[122641]: DEBUG cinder.backup.driver [None req-7d8f44fe-29a8-41cf-a52e-4a078e028aff tempest-TestVolumeBackupRestore-1457821269 None] Restoring volume glance metadata {{(pid=122641) _restore_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:258}}
Jan 15 21:21:26.440146 ncdv-master-1 cinder-backup[122641]: DEBUG cinder.backup.drivers.ceph [None req-7d8f44fe-29a8-41cf-a52e-4a078e028aff tempest-TestVolumeBackupRestore-1457821269 None] Restore to volume bd619176-6e0b-4a31-92d4-89d5b07e409a finished successfully. {{(pid=122641) restore /opt/stack/cinder/cinder/backup/drivers/ceph.py:1292}}
Jan 15 21:21:26.441683 ncdv-master-1 cinder-backup[122641]: DEBUG os_brick.initiator.connectors.rbd [None req-7d8f44fe-29a8-41cf-a52e-4a078e028aff tempest-TestVolumeBackupRestore-1457821269 None] ==> disconnect_volume: call "{'self': <os_brick.initiator.connectors.rbd.RBDConnector object at 0x7f1af4744dc0>, 'connection_properties': {'name': 'volumes/volume-bd619176-6e0b-4a31-92d4-89d5b07e409a', 'hosts': ['10.222.0.46'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '***', 'volume_id': 'bd619176-6e0b-4a31-92d4-89d5b07e409a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'device_info': {'path': <os_brick.initiator.linuxrbd.RBDVolumeIOWrapper object at 0x7f1af4685310>}, 'force': True, 'ignore_errors': False}" {{(pid=122641) trace_logging_wrapper /usr/local/lib/python3.8/dist-packages/os_brick/utils.py:157}}
Jan 15 21:21:26.452233 ncdv-master-1 cinder-backup[122641]: DEBUG os_brick.initiator.connectors.rbd [None req-7d8f44fe-29a8-41cf-a52e-4a078e028aff tempest-TestVolumeBackupRestore-1457821269 None] <== disconnect_volume: return (10ms) None {{(pid=122641) trace_logging_wrapper /usr/local/lib/python3.8/dist-packages/os_brick/utils.py:184}}
Jan 15 21:21:26.500185 ncdv-master-1 cinder-backup[122641]: DEBUG cinder.backup.manager [None req-7d8f44fe-29a8-41cf-a52e-4a078e028aff tempest-TestVolumeBackupRestore-1457821269 None] Encryption key ID for volume bd619176-6e0b-4a31-92d4-89d5b07e409a already matches encryption key ID in backup c32e5733-73a3-4752-8300-0a48c780cef7. {{(pid=122641) _run_restore /opt/stack/cinder/cinder/backup/manager.py:801}}
Jan 15 21:21:26.529259 ncdv-master-1 cinder-backup[122641]: INFO cinder.backup.manager [None req-7d8f44fe-29a8-41cf-a52e-4a078e028aff tempest-TestVolumeBackupRestore-1457821269 None] Finished restoring backup c32e5733-73a3-4752-8300-0a48c780cef7 to volume bd619176-6e0b-4a31-92d4-89d5b07e409a.
Jan 15 21:22:11.221574 ncdv-master-1 cinder-backup[122641]: DEBUG oslo_service.periodic_task [None req-880577f5-cbba-4bc0-b820-8647ffc48ae5 None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=122641) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Jan 15 21:22:11.222462 ncdv-master-1 cinder-backup[122641]: DEBUG cinder.manager [None req-880577f5-cbba-4bc0-b820-8647ffc48ae5 None None] Notifying Schedulers of capabilities ... {{(pid=122641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jan 15 21:22:31.229408 ncdv-master-1 cinder-backup[122641]: INFO cinder.backup.manager [None req-8cb106cd-c274-4057-b25d-3bea21f70688 tempest-TestVolumeBackupRestore-1457821269 None] Delete backup started, backup: c32e5733-73a3-4752-8300-0a48c780cef7.
Jan 15 21:22:31.231486 ncdv-master-1 cinder-backup[122641]: DEBUG cinder.backup.drivers.ceph [None req-8cb106cd-c274-4057-b25d-3bea21f70688 tempest-TestVolumeBackupRestore-1457821269 None] Delete started for backup=c32e5733-73a3-4752-8300-0a48c780cef7 {{(pid=122641) delete_backup /opt/stack/cinder/cinder/backup/drivers/ceph.py:1301}}
Jan 15 21:22:31.231938 ncdv-master-1 cinder-backup[122641]: DEBUG cinder.backup.drivers.ceph [None req-8cb106cd-c274-4057-b25d-3bea21f70688 tempest-TestVolumeBackupRestore-1457821269 None] Trying diff format basename='volume-3a4ab464-a9de-4070-bc0c-659687fd928e.backup.c32e5733-73a3-4752-8300-0a48c780cef7' for backup base image of volume 3a4ab464-a9de-4070-bc0c-659687fd928e. {{(pid=122641) _try_delete_base_image /opt/stack/cinder/cinder/backup/drivers/ceph.py:513}}
Jan 15 21:22:31.302374 ncdv-master-1 cinder-backup[122641]: DEBUG cinder.backup.drivers.ceph [None req-8cb106cd-c274-4057-b25d-3bea21f70688 tempest-TestVolumeBackupRestore-1457821269 None] Looking for snapshot of backup base 'volume-3a4ab464-a9de-4070-bc0c-659687fd928e.backup.c32e5733-73a3-4752-8300-0a48c780cef7' {{(pid=122641) _get_backup_snap_name /opt/stack/cinder/cinder/backup/drivers/ceph.py:905}}
Jan 15 21:22:31.303117 ncdv-master-1 cinder-backup[122641]: DEBUG cinder.backup.drivers.ceph [None req-8cb106cd-c274-4057-b25d-3bea21f70688 tempest-TestVolumeBackupRestore-1457821269 None] Found snapshot 'backup.c32e5733-73a3-4752-8300-0a48c780cef7.snap.1642281675.1416693' {{(pid=122641) _get_backup_snap_name /opt/stack/cinder/cinder/backup/drivers/ceph.py:924}}
Jan 15 21:22:31.303679 ncdv-master-1 cinder-backup[122641]: DEBUG cinder.backup.drivers.ceph [None req-8cb106cd-c274-4057-b25d-3bea21f70688 tempest-TestVolumeBackupRestore-1457821269 None] Deleting backup snapshot='backup.c32e5733-73a3-4752-8300-0a48c780cef7.snap.1642281675.1416693' {{(pid=122641) _delete_backup_snapshot /opt/stack/cinder/cinder/backup/drivers/ceph.py:473}}
Jan 15 21:22:31.483095 ncdv-master-1 cinder-backup[122641]: INFO cinder.backup.drivers.ceph [None req-8cb106cd-c274-4057-b25d-3bea21f70688 tempest-TestVolumeBackupRestore-1457821269 None] Deleting backup base image='volume-3a4ab464-a9de-4070-bc0c-659687fd928e.backup.c32e5733-73a3-4752-8300-0a48c780cef7' of volume 3a4ab464-a9de-4070-bc0c-659687fd928e.
Jan 15 21:22:31.986985 ncdv-master-1 cinder-backup[122641]: DEBUG cinder.backup.drivers.ceph [None req-8cb106cd-c274-4057-b25d-3bea21f70688 tempest-TestVolumeBackupRestore-1457821269 None] Base backup image='volume-3a4ab464-a9de-4070-bc0c-659687fd928e.backup.c32e5733-73a3-4752-8300-0a48c780cef7' of volume 3a4ab464-a9de-4070-bc0c-659687fd928e deleted. {{(pid=122641) _try_delete_base_image /opt/stack/cinder/cinder/backup/drivers/ceph.py:561}}
Jan 15 21:22:32.022691 ncdv-master-1 cinder-backup[122641]: DEBUG cinder.backup.drivers.ceph [None req-8cb106cd-c274-4057-b25d-3bea21f70688 tempest-TestVolumeBackupRestore-1457821269 None] Delete of backup 'c32e5733-73a3-4752-8300-0a48c780cef7' for volume '3a4ab464-a9de-4070-bc0c-659687fd928e' finished. {{(pid=122641) delete_backup /opt/stack/cinder/cinder/backup/drivers/ceph.py:1329}}
Jan 15 21:22:32.028447 ncdv-master-1 cinder-backup[122641]: DEBUG oslo_db.sqlalchemy.engines [None req-8cb106cd-c274-4057-b25d-3bea21f70688 tempest-TestVolumeBackupRestore-1457821269 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122641) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}}
Jan 15 21:22:32.052275 ncdv-master-1 cinder-backup[122641]: DEBUG cinder.quota [None req-8cb106cd-c274-4057-b25d-3bea21f70688 tempest-TestVolumeBackupRestore-1457821269 None] Created reservations ['bcd50d63-290f-4e5e-b58c-639886bd915f', '9f971507-6560-44e8-8f2f-afa71c326ce1'] {{(pid=122641) reserve /opt/stack/cinder/cinder/quota.py:755}}
Jan 15 21:22:32.079962 ncdv-master-1 cinder-backup[122641]: INFO cinder.backup.manager [None req-8cb106cd-c274-4057-b25d-3bea21f70688 tempest-TestVolumeBackupRestore-1457821269 None] Delete backup finished, backup c32e5733-73a3-4752-8300-0a48c780cef7 deleted.
Jan 15 21:23:11.226616 ncdv-master-1 cinder-backup[122641]: DEBUG oslo_service.periodic_task [None req-880577f5-cbba-4bc0-b820-8647ffc48ae5 None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=122641) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Jan 15 21:23:11.227274 ncdv-master-1 cinder-backup[122641]: DEBUG cinder.manager [None req-880577f5-cbba-4bc0-b820-8647ffc48ae5 None None] Notifying Schedulers of capabilities ... {{(pid=122641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jan 15 21:24:11.232415 ncdv-master-1 cinder-backup[122641]: DEBUG oslo_service.periodic_task [None req-880577f5-cbba-4bc0-b820-8647ffc48ae5 None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=122641) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Jan 15 21:24:11.233349 ncdv-master-1 cinder-backup[122641]: DEBUG cinder.manager [None req-880577f5-cbba-4bc0-b820-8647ffc48ae5 None None] Notifying Schedulers of capabilities ... {{(pid=122641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jan 15 21:25:11.228598 ncdv-master-1 cinder-backup[122641]: DEBUG oslo_service.periodic_task [None req-880577f5-cbba-4bc0-b820-8647ffc48ae5 None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=122641) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Jan 15 21:25:11.229278 ncdv-master-1 cinder-backup[122641]: DEBUG cinder.manager [None req-880577f5-cbba-4bc0-b820-8647ffc48ae5 None None] Notifying Schedulers of capabilities ... {{(pid=122641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jan 15 21:26:11.234130 ncdv-master-1 cinder-backup[122641]: DEBUG oslo_service.periodic_task [None req-880577f5-cbba-4bc0-b820-8647ffc48ae5 None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=122641) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Jan 15 21:26:11.234851 ncdv-master-1 cinder-backup[122641]: DEBUG cinder.manager [None req-880577f5-cbba-4bc0-b820-8647ffc48ae5 None None] Notifying Schedulers of capabilities ... {{(pid=122641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jan 15 21:27:11.231281 ncdv-master-1 cinder-backup[122641]: DEBUG oslo_service.periodic_task [None req-880577f5-cbba-4bc0-b820-8647ffc48ae5 None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=122641) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Jan 15 21:27:11.231920 ncdv-master-1 cinder-backup[122641]: DEBUG cinder.manager [None req-880577f5-cbba-4bc0-b820-8647ffc48ae5 None None] Notifying Schedulers of capabilities ... {{(pid=122641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jan 15 21:28:11.237202 ncdv-master-1 cinder-backup[122641]: DEBUG oslo_service.periodic_task [None req-880577f5-cbba-4bc0-b820-8647ffc48ae5 None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=122641) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Jan 15 21:28:11.237859 ncdv-master-1 cinder-backup[122641]: DEBUG cinder.manager [None req-880577f5-cbba-4bc0-b820-8647ffc48ae5 None None] Notifying Schedulers of capabilities ... {{(pid=122641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jan 15 21:29:11.243119 ncdv-master-1 cinder-backup[122641]: DEBUG oslo_service.periodic_task [None req-880577f5-cbba-4bc0-b820-8647ffc48ae5 None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=122641) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Jan 15 21:29:11.243921 ncdv-master-1 cinder-backup[122641]: DEBUG cinder.manager [None req-880577f5-cbba-4bc0-b820-8647ffc48ae5 None None] Notifying Schedulers of capabilities ... {{(pid=122641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jan 15 21:30:11.238811 ncdv-master-1 cinder-backup[122641]: DEBUG oslo_service.periodic_task [None req-880577f5-cbba-4bc0-b820-8647ffc48ae5 None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=122641) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Jan 15 21:30:11.239382 ncdv-master-1 cinder-backup[122641]: DEBUG cinder.manager [None req-880577f5-cbba-4bc0-b820-8647ffc48ae5 None None] Notifying Schedulers of capabilities ... {{(pid=122641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jan 15 21:31:11.244619 ncdv-master-1 cinder-backup[122641]: DEBUG oslo_service.periodic_task [None req-880577f5-cbba-4bc0-b820-8647ffc48ae5 None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=122641) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Jan 15 21:31:11.245305 ncdv-master-1 cinder-backup[122641]: DEBUG cinder.manager [None req-880577f5-cbba-4bc0-b820-8647ffc48ae5 None None] Notifying Schedulers of capabilities ... {{(pid=122641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jan 15 21:32:11.241500 ncdv-master-1 cinder-backup[122641]: DEBUG oslo_service.periodic_task [None req-880577f5-cbba-4bc0-b820-8647ffc48ae5 None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=122641) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Jan 15 21:32:11.242112 ncdv-master-1 cinder-backup[122641]: DEBUG cinder.manager [None req-880577f5-cbba-4bc0-b820-8647ffc48ae5 None None] Notifying Schedulers of capabilities ... {{(pid=122641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jan 15 21:33:11.246698 ncdv-master-1 cinder-backup[122641]: DEBUG oslo_service.periodic_task [None req-880577f5-cbba-4bc0-b820-8647ffc48ae5 None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=122641) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Jan 15 21:33:11.247308 ncdv-master-1 cinder-backup[122641]: DEBUG cinder.manager [None req-880577f5-cbba-4bc0-b820-8647ffc48ae5 None None] Notifying Schedulers of capabilities ... {{(pid=122641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jan 15 21:34:11.251272 ncdv-master-1 cinder-backup[122641]: DEBUG oslo_service.periodic_task [None req-880577f5-cbba-4bc0-b820-8647ffc48ae5 None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=122641) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Jan 15 21:34:11.251943 ncdv-master-1 cinder-backup[122641]: DEBUG cinder.manager [None req-880577f5-cbba-4bc0-b820-8647ffc48ae5 None None] Notifying Schedulers of capabilities ... {{(pid=122641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jan 15 21:35:11.256093 ncdv-master-1 cinder-backup[122641]: DEBUG oslo_service.periodic_task [None req-880577f5-cbba-4bc0-b820-8647ffc48ae5 None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=122641) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Jan 15 21:35:11.256683 ncdv-master-1 cinder-backup[122641]: DEBUG cinder.manager [None req-880577f5-cbba-4bc0-b820-8647ffc48ae5 None None] Notifying Schedulers of capabilities ... {{(pid=122641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jan 15 21:36:11.261499 ncdv-master-1 cinder-backup[122641]: DEBUG oslo_service.periodic_task [None req-880577f5-cbba-4bc0-b820-8647ffc48ae5 None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=122641) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Jan 15 21:36:11.262067 ncdv-master-1 cinder-backup[122641]: DEBUG cinder.manager [None req-880577f5-cbba-4bc0-b820-8647ffc48ae5 None None] Notifying Schedulers of capabilities ... {{(pid=122641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jan 15 21:37:11.257562 ncdv-master-1 cinder-backup[122641]: DEBUG oslo_service.periodic_task [None req-880577f5-cbba-4bc0-b820-8647ffc48ae5 None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=122641) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Jan 15 21:37:11.258110 ncdv-master-1 cinder-backup[122641]: DEBUG cinder.manager [None req-880577f5-cbba-4bc0-b820-8647ffc48ae5 None None] Notifying Schedulers of capabilities ... {{(pid=122641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jan 15 21:38:11.263034 ncdv-master-1 cinder-backup[122641]: DEBUG oslo_service.periodic_task [None req-880577f5-cbba-4bc0-b820-8647ffc48ae5 None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=122641) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Jan 15 21:38:11.263601 ncdv-master-1 cinder-backup[122641]: DEBUG cinder.manager [None req-880577f5-cbba-4bc0-b820-8647ffc48ae5 None None] Notifying Schedulers of capabilities ... {{(pid=122641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jan 15 21:39:11.267746 ncdv-master-1 cinder-backup[122641]: DEBUG oslo_service.periodic_task [None req-880577f5-cbba-4bc0-b820-8647ffc48ae5 None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=122641) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Jan 15 21:39:11.268439 ncdv-master-1 cinder-backup[122641]: DEBUG cinder.manager [None req-880577f5-cbba-4bc0-b820-8647ffc48ae5 None None] Notifying Schedulers of capabilities ... {{(pid=122641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jan 15 21:40:11.272557 ncdv-master-1 cinder-backup[122641]: DEBUG oslo_service.periodic_task [None req-880577f5-cbba-4bc0-b820-8647ffc48ae5 None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=122641) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Jan 15 21:40:11.273102 ncdv-master-1 cinder-backup[122641]: DEBUG cinder.manager [None req-880577f5-cbba-4bc0-b820-8647ffc48ae5 None None] Notifying Schedulers of capabilities ... {{(pid=122641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jan 15 21:41:11.278168 ncdv-master-1 cinder-backup[122641]: DEBUG oslo_service.periodic_task [None req-880577f5-cbba-4bc0-b820-8647ffc48ae5 None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=122641) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Jan 15 21:41:11.278929 ncdv-master-1 cinder-backup[122641]: DEBUG cinder.manager [None req-880577f5-cbba-4bc0-b820-8647ffc48ae5 None None] Notifying Schedulers of capabilities ... {{(pid=122641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jan 15 21:42:11.274792 ncdv-master-1 cinder-backup[122641]: DEBUG oslo_service.periodic_task [None req-880577f5-cbba-4bc0-b820-8647ffc48ae5 None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=122641) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Jan 15 21:42:11.275514 ncdv-master-1 cinder-backup[122641]: DEBUG cinder.manager [None req-880577f5-cbba-4bc0-b820-8647ffc48ae5 None None] Notifying Schedulers of capabilities ... {{(pid=122641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jan 15 21:43:11.280483 ncdv-master-1 cinder-backup[122641]: DEBUG oslo_service.periodic_task [None req-880577f5-cbba-4bc0-b820-8647ffc48ae5 None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=122641) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Jan 15 21:43:11.281229 ncdv-master-1 cinder-backup[122641]: DEBUG cinder.manager [None req-880577f5-cbba-4bc0-b820-8647ffc48ae5 None None] Notifying Schedulers of capabilities ... {{(pid=122641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jan 15 21:44:11.285622 ncdv-master-1 cinder-backup[122641]: DEBUG oslo_service.periodic_task [None req-880577f5-cbba-4bc0-b820-8647ffc48ae5 None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=122641) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Jan 15 21:44:11.286341 ncdv-master-1 cinder-backup[122641]: DEBUG cinder.manager [None req-880577f5-cbba-4bc0-b820-8647ffc48ae5 None None] Notifying Schedulers of capabilities ... {{(pid=122641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jan 15 21:45:11.291194 ncdv-master-1 cinder-backup[122641]: DEBUG oslo_service.periodic_task [None req-880577f5-cbba-4bc0-b820-8647ffc48ae5 None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=122641) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Jan 15 21:45:11.291898 ncdv-master-1 cinder-backup[122641]: DEBUG cinder.manager [None req-880577f5-cbba-4bc0-b820-8647ffc48ae5 None None] Notifying Schedulers of capabilities ... {{(pid=122641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jan 15 21:46:11.287744 ncdv-master-1 cinder-backup[122641]: DEBUG oslo_service.periodic_task [None req-880577f5-cbba-4bc0-b820-8647ffc48ae5 None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=122641) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Jan 15 21:46:11.288450 ncdv-master-1 cinder-backup[122641]: DEBUG cinder.manager [None req-880577f5-cbba-4bc0-b820-8647ffc48ae5 None None] Notifying Schedulers of capabilities ... {{(pid=122641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jan 15 21:47:11.283813 ncdv-master-1 cinder-backup[122641]: DEBUG oslo_service.periodic_task [None req-880577f5-cbba-4bc0-b820-8647ffc48ae5 None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=122641) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Jan 15 21:47:11.284524 ncdv-master-1 cinder-backup[122641]: DEBUG cinder.manager [None req-880577f5-cbba-4bc0-b820-8647ffc48ae5 None None] Notifying Schedulers of capabilities ... {{(pid=122641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jan 15 21:48:11.288866 ncdv-master-1 cinder-backup[122641]: DEBUG oslo_service.periodic_task [None req-880577f5-cbba-4bc0-b820-8647ffc48ae5 None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=122641) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Jan 15 21:48:11.289564 ncdv-master-1 cinder-backup[122641]: DEBUG cinder.manager [None req-880577f5-cbba-4bc0-b820-8647ffc48ae5 None None] Notifying Schedulers of capabilities ... {{(pid=122641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jan 15 21:49:11.294287 ncdv-master-1 cinder-backup[122641]: DEBUG oslo_service.periodic_task [None req-880577f5-cbba-4bc0-b820-8647ffc48ae5 None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=122641) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Jan 15 21:49:11.295003 ncdv-master-1 cinder-backup[122641]: DEBUG cinder.manager [None req-880577f5-cbba-4bc0-b820-8647ffc48ae5 None None] Notifying Schedulers of capabilities ... {{(pid=122641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jan 15 21:50:11.299868 ncdv-master-1 cinder-backup[122641]: DEBUG oslo_service.periodic_task [None req-880577f5-cbba-4bc0-b820-8647ffc48ae5 None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=122641) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Jan 15 21:50:11.301744 ncdv-master-1 cinder-backup[122641]: DEBUG cinder.manager [None req-880577f5-cbba-4bc0-b820-8647ffc48ae5 None None] Notifying Schedulers of capabilities ... {{(pid=122641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jan 15 21:51:11.297837 ncdv-master-1 cinder-backup[122641]: DEBUG oslo_service.periodic_task [None req-880577f5-cbba-4bc0-b820-8647ffc48ae5 None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=122641) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Jan 15 21:51:11.298658 ncdv-master-1 cinder-backup[122641]: DEBUG cinder.manager [None req-880577f5-cbba-4bc0-b820-8647ffc48ae5 None None] Notifying Schedulers of capabilities ... {{(pid=122641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jan 15 21:52:11.294907 ncdv-master-1 cinder-backup[122641]: DEBUG oslo_service.periodic_task [None req-880577f5-cbba-4bc0-b820-8647ffc48ae5 None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=122641) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Jan 15 21:52:11.295641 ncdv-master-1 cinder-backup[122641]: DEBUG cinder.manager [None req-880577f5-cbba-4bc0-b820-8647ffc48ae5 None None] Notifying Schedulers of capabilities ... {{(pid=122641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jan 15 21:53:11.300769 ncdv-master-1 cinder-backup[122641]: DEBUG oslo_service.periodic_task [None req-880577f5-cbba-4bc0-b820-8647ffc48ae5 None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=122641) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Jan 15 21:53:11.301566 ncdv-master-1 cinder-backup[122641]: DEBUG cinder.manager [None req-880577f5-cbba-4bc0-b820-8647ffc48ae5 None None] Notifying Schedulers of capabilities ... {{(pid=122641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jan 15 21:54:11.306146 ncdv-master-1 cinder-backup[122641]: DEBUG oslo_service.periodic_task [None req-880577f5-cbba-4bc0-b820-8647ffc48ae5 None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=122641) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Jan 15 21:54:11.306915 ncdv-master-1 cinder-backup[122641]: DEBUG cinder.manager [None req-880577f5-cbba-4bc0-b820-8647ffc48ae5 None None] Notifying Schedulers of capabilities ... {{(pid=122641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jan 15 21:55:11.311756 ncdv-master-1 cinder-backup[122641]: DEBUG oslo_service.periodic_task [None req-880577f5-cbba-4bc0-b820-8647ffc48ae5 None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=122641) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Jan 15 21:55:11.312517 ncdv-master-1 cinder-backup[122641]: DEBUG cinder.manager [None req-880577f5-cbba-4bc0-b820-8647ffc48ae5 None None] Notifying Schedulers of capabilities ... {{(pid=122641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jan 15 21:56:11.316861 ncdv-master-1 cinder-backup[122641]: DEBUG oslo_service.periodic_task [None req-880577f5-cbba-4bc0-b820-8647ffc48ae5 None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=122641) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Jan 15 21:56:11.317587 ncdv-master-1 cinder-backup[122641]: DEBUG cinder.manager [None req-880577f5-cbba-4bc0-b820-8647ffc48ae5 None None] Notifying Schedulers of capabilities ... {{(pid=122641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jan 15 21:57:11.314269 ncdv-master-1 cinder-backup[122641]: DEBUG oslo_service.periodic_task [None req-880577f5-cbba-4bc0-b820-8647ffc48ae5 None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=122641) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Jan 15 21:57:11.315113 ncdv-master-1 cinder-backup[122641]: DEBUG cinder.manager [None req-880577f5-cbba-4bc0-b820-8647ffc48ae5 None None] Notifying Schedulers of capabilities ... {{(pid=122641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jan 15 21:58:11.319396 ncdv-master-1 cinder-backup[122641]: DEBUG oslo_service.periodic_task [None req-880577f5-cbba-4bc0-b820-8647ffc48ae5 None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=122641) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Jan 15 21:58:11.320096 ncdv-master-1 cinder-backup[122641]: DEBUG cinder.manager [None req-880577f5-cbba-4bc0-b820-8647ffc48ae5 None None] Notifying Schedulers of capabilities ... {{(pid=122641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jan 15 21:59:11.324510 ncdv-master-1 cinder-backup[122641]: DEBUG oslo_service.periodic_task [None req-880577f5-cbba-4bc0-b820-8647ffc48ae5 None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=122641) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Jan 15 21:59:11.325315 ncdv-master-1 cinder-backup[122641]: DEBUG cinder.manager [None req-880577f5-cbba-4bc0-b820-8647ffc48ae5 None None] Notifying Schedulers of capabilities ... {{(pid=122641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jan 15 22:00:11.330658 ncdv-master-1 cinder-backup[122641]: DEBUG oslo_service.periodic_task [None req-880577f5-cbba-4bc0-b820-8647ffc48ae5 None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=122641) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Jan 15 22:00:11.331303 ncdv-master-1 cinder-backup[122641]: DEBUG cinder.manager [None req-880577f5-cbba-4bc0-b820-8647ffc48ae5 None None] Notifying Schedulers of capabilities ... {{(pid=122641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jan 15 22:01:11.330372 ncdv-master-1 cinder-backup[122641]: DEBUG oslo_service.periodic_task [None req-880577f5-cbba-4bc0-b820-8647ffc48ae5 None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=122641) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Jan 15 22:01:11.331106 ncdv-master-1 cinder-backup[122641]: DEBUG cinder.manager [None req-880577f5-cbba-4bc0-b820-8647ffc48ae5 None None] Notifying Schedulers of capabilities ... {{(pid=122641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jan 15 22:02:11.335090 ncdv-master-1 cinder-backup[122641]: DEBUG oslo_service.periodic_task [None req-880577f5-cbba-4bc0-b820-8647ffc48ae5 None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=122641) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Jan 15 22:02:11.335818 ncdv-master-1 cinder-backup[122641]: DEBUG cinder.manager [None req-880577f5-cbba-4bc0-b820-8647ffc48ae5 None None] Notifying Schedulers of capabilities ... {{(pid=122641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jan 15 22:03:11.340483 ncdv-master-1 cinder-backup[122641]: DEBUG oslo_service.periodic_task [None req-880577f5-cbba-4bc0-b820-8647ffc48ae5 None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=122641) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Jan 15 22:03:11.341304 ncdv-master-1 cinder-backup[122641]: DEBUG cinder.manager [None req-880577f5-cbba-4bc0-b820-8647ffc48ae5 None None] Notifying Schedulers of capabilities ... {{(pid=122641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jan 15 22:04:11.345542 ncdv-master-1 cinder-backup[122641]: DEBUG oslo_service.periodic_task [None req-880577f5-cbba-4bc0-b820-8647ffc48ae5 None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=122641) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Jan 15 22:04:11.346233 ncdv-master-1 cinder-backup[122641]: DEBUG cinder.manager [None req-880577f5-cbba-4bc0-b820-8647ffc48ae5 None None] Notifying Schedulers of capabilities ... {{(pid=122641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jan 15 22:05:11.350683 ncdv-master-1 cinder-backup[122641]: DEBUG oslo_service.periodic_task [None req-880577f5-cbba-4bc0-b820-8647ffc48ae5 None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=122641) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Jan 15 22:05:11.351320 ncdv-master-1 cinder-backup[122641]: DEBUG cinder.manager [None req-880577f5-cbba-4bc0-b820-8647ffc48ae5 None None] Notifying Schedulers of capabilities ... {{(pid=122641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jan 15 22:06:11.347307 ncdv-master-1 cinder-backup[122641]: DEBUG oslo_service.periodic_task [None req-880577f5-cbba-4bc0-b820-8647ffc48ae5 None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=122641) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Jan 15 22:06:11.347936 ncdv-master-1 cinder-backup[122641]: DEBUG cinder.manager [None req-880577f5-cbba-4bc0-b820-8647ffc48ae5 None None] Notifying Schedulers of capabilities ... {{(pid=122641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jan 15 22:07:11.342732 ncdv-master-1 cinder-backup[122641]: DEBUG oslo_service.periodic_task [None req-880577f5-cbba-4bc0-b820-8647ffc48ae5 None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=122641) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Jan 15 22:07:11.343394 ncdv-master-1 cinder-backup[122641]: DEBUG cinder.manager [None req-880577f5-cbba-4bc0-b820-8647ffc48ae5 None None] Notifying Schedulers of capabilities ... {{(pid=122641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jan 15 22:08:11.347686 ncdv-master-1 cinder-backup[122641]: DEBUG oslo_service.periodic_task [None req-880577f5-cbba-4bc0-b820-8647ffc48ae5 None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=122641) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Jan 15 22:08:11.348406 ncdv-master-1 cinder-backup[122641]: DEBUG cinder.manager [None req-880577f5-cbba-4bc0-b820-8647ffc48ae5 None None] Notifying Schedulers of capabilities ... {{(pid=122641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jan 15 22:09:11.352681 ncdv-master-1 cinder-backup[122641]: DEBUG oslo_service.periodic_task [None req-880577f5-cbba-4bc0-b820-8647ffc48ae5 None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=122641) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Jan 15 22:09:11.353361 ncdv-master-1 cinder-backup[122641]: DEBUG cinder.manager [None req-880577f5-cbba-4bc0-b820-8647ffc48ae5 None None] Notifying Schedulers of capabilities ... {{(pid=122641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jan 15 22:10:11.358358 ncdv-master-1 cinder-backup[122641]: DEBUG oslo_service.periodic_task [None req-880577f5-cbba-4bc0-b820-8647ffc48ae5 None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=122641) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Jan 15 22:10:11.359022 ncdv-master-1 cinder-backup[122641]: DEBUG cinder.manager [None req-880577f5-cbba-4bc0-b820-8647ffc48ae5 None None] Notifying Schedulers of capabilities ... {{(pid=122641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jan 15 22:12:11.365100 ncdv-master-1 cinder-backup[122641]: DEBUG oslo_service.periodic_task [None req-880577f5-cbba-4bc0-b820-8647ffc48ae5 None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=122641) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Jan 15 22:12:11.365748 ncdv-master-1 cinder-backup[122641]: DEBUG cinder.manager [None req-880577f5-cbba-4bc0-b820-8647ffc48ae5 None None] Notifying Schedulers of capabilities ... {{(pid=122641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}