-- Logs begin at Sat 2022-06-18 20:01:13 UTC, end at Sat 2022-06-18 23:29:23 UTC. --
Jun 18 21:51:31.408718 ncdv-master-1 systemd[1]: Started Devstack devstack@c-bak.service.
Jun 18 21:51:34.696910 ncdv-master-1 cinder-backup[123337]: INFO cinder.cmd.backup [-] Backup running with 1 processes.
Jun 18 21:51:34.699217 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=123337) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}}
Jun 18 21:51:34.699217 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=123337) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}}
Jun 18 21:51:34.916744 ncdv-master-1 cinder-backup[123337]: INFO dbcounter [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] Registered counter for database cinder
Jun 18 21:51:34.942676 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_db.sqlalchemy.engines [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123337) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}}
Jun 18 21:51:34.952032 ncdv-master-1 cinder-backup[123337]: DEBUG dbcounter [-] [123337] Writer thread running {{(pid=123337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}}
Jun 18 21:51:35.191587 ncdv-master-1 cinder-backup[123337]: INFO cinder.rpc [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] Automatically selected cinder-backup objects version 1.39 as minimum service version.
Jun 18 21:51:35.196598 ncdv-master-1 cinder-backup[123337]: INFO cinder.rpc [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] Automatically selected cinder-backup RPC version 2.3 as minimum service version.
Jun 18 21:51:35.202173 ncdv-master-1 cinder-backup[123337]: INFO cinder.rpc [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] Automatically selected cinder-volume objects version 1.39 as minimum service version.
Jun 18 21:51:35.206536 ncdv-master-1 cinder-backup[123337]: INFO cinder.rpc [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] Automatically selected cinder-volume RPC version 3.18 as minimum service version.
Jun 18 21:51:35.212870 ncdv-master-1 cinder-backup[123337]: INFO cinder.rpc [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Jun 18 21:51:35.217675 ncdv-master-1 cinder-backup[123337]: INFO cinder.rpc [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Jun 18 21:51:35.271152 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_db.sqlalchemy.engines [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123337) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}}
Jun 18 21:51:35.299921 ncdv-master-1 cinder-backup[123337]: INFO oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] Starting 1 workers
Jun 18 21:51:35.306178 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] Started child 123790 {{(pid=123337) _start_child /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:575}}
Jun 18 21:51:35.307558 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] Full set of CONF: {{(pid=123337) wait /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:649}}
Jun 18 21:51:35.308259 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] ******************************************************************************** {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}}
Jun 18 21:51:35.308778 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] Configuration options gathered from: {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}}
Jun 18 21:51:35.309387 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}}
Jun 18 21:51:35.310803 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}}
Jun 18 21:51:35.311442 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] ================================================================================ {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}}
Jun 18 21:51:35.312615 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] allow_availability_zone_fallback = False {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 18 21:51:35.313254 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] allow_compression_on_image_upload = False {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 18 21:51:35.314056 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] allowed_direct_url_schemes     = [] {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 18 21:51:35.314759 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] api_rate_limit                 = True {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 18 21:51:35.315462 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] auth_strategy                  = keystone {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 18 21:51:35.318182 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] backend_availability_zone      = None {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 18 21:51:35.318819 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] backup_api_class               = cinder.backup.api.API {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 18 21:51:35.319431 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] backup_ceph_chunk_size         = 134217728 {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 18 21:51:35.320298 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] backup_ceph_conf               = /etc/ceph/ceph.conf {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 18 21:51:35.320990 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] backup_ceph_image_journals     = False {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 18 21:51:35.322303 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] backup_ceph_pool               = backups {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 18 21:51:35.324573 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] backup_ceph_stripe_count       = 0 {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 18 21:51:35.325300 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] backup_ceph_stripe_unit        = 0 {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 18 21:51:35.325922 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] backup_ceph_user               = cinder-bak {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 18 21:51:35.329424 ncdv-master-1 cinder-backup[123790]: INFO cinder.service [-] Starting cinder-backup node (version 20.1.0)
Jun 18 21:51:35.330829 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] backup_driver                  = cinder.backup.drivers.ceph.CephBackupDriver {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 18 21:51:35.331149 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] backup_driver_init_check_interval = 60 {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 18 21:51:35.332360 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] backup_driver_stats_polling_interval = 60 {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 18 21:51:35.332957 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 18 21:51:35.334003 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] backup_max_operations          = 15 {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 18 21:51:35.334323 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] backup_metadata_version        = 2 {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 18 21:51:35.335204 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] backup_name_template           = backup-%s {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 18 21:51:35.336837 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] backup_native_threads_pool_size = 60 {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 18 21:51:35.337454 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] backup_object_number_per_notification = 10 {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 18 21:51:35.339142 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] backup_service_inithost_offload = True {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 18 21:51:35.339782 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] backup_timer_interval          = 120 {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 18 21:51:35.341411 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] backup_use_same_host           = False {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 18 21:51:35.344095 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] backup_use_temp_snapshot       = False {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 18 21:51:35.344747 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] backup_workers                 = 1 {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 18 21:51:35.345399 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] chap_password                  = **** {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 18 21:51:35.346058 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] chap_username                  =  {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 18 21:51:35.346698 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 18 21:51:35.348478 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] cinder_internal_tenant_project_id = 7325bff278b145a5a9112160d2e00a5e {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 18 21:51:35.349104 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] cinder_internal_tenant_user_id = 028b67b31190461b96d35563506b6c8e {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 18 21:51:35.349722 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] compression_format             = gzip {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 18 21:51:35.352039 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] config_dir                     = [] {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 18 21:51:35.352690 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 18 21:51:35.353356 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] config_source                  = [] {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 18 21:51:35.356350 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 18 21:51:35.357002 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] control_exchange               = openstack {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 18 21:51:35.357654 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] debug                          = True {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 18 21:51:35.358267 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] default_availability_zone      = None {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 18 21:51:35.358950 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] default_group_type             = None {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 18 21:51:35.361314 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'swiftclient=WARN', 'botocore=WARN'] {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 18 21:51:35.362557 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] default_volume_type            = ceph {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 18 21:51:35.363152 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] driver_client_cert             = None {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 18 21:51:35.370540 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] driver_client_cert_key         = None {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 18 21:51:35.372349 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] driver_data_namespace          = None {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 18 21:51:35.373015 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] driver_ssl_cert_path           = None {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 18 21:51:35.374752 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] driver_ssl_cert_verify         = False {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 18 21:51:35.375378 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] driver_use_ssl                 = False {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 18 21:51:35.375907 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] enable_new_services            = True {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 18 21:51:35.377290 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] enable_unsupported_driver      = False {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 18 21:51:35.377929 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] enabled_backends               = ['ceph'] {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 18 21:51:35.380649 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] enforce_multipath_for_image_xfer = False {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 18 21:51:35.381500 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] filter_function                = None {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 18 21:51:35.382806 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] glance_api_insecure            = False {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 18 21:51:35.384639 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] glance_api_servers             = ['http://10.222.0.30/image'] {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 18 21:51:35.385282 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] glance_api_ssl_compression     = False {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 18 21:51:35.386699 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] glance_ca_certificates_file    = None {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 18 21:51:35.387432 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] glance_catalog_info            = image:glance:publicURL {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 18 21:51:35.388764 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] glance_certfile                = None {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 18 21:51:35.389605 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 18 21:51:35.390847 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] glance_keyfile                 = None {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 18 21:51:35.391814 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] glance_num_retries             = 3 {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 18 21:51:35.393497 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] glance_request_timeout         = None {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 18 21:51:35.394079 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] goodness_function              = None {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 18 21:51:35.395763 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] graceful_shutdown_timeout      = 5 {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 18 21:51:35.397153 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] group_api_class                = cinder.group.api.API {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 18 21:51:35.398689 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] host                           = ncdv-master-1 {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 18 21:51:35.534775 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] iet_conf                       = /etc/iet/ietd.conf {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 18 21:51:35.534775 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] image_compress_on_upload       = True {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 18 21:51:35.534775 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] image_conversion_address_space_limit = 1 {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 18 21:51:35.534775 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] image_conversion_cpu_limit     = 60 {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 18 21:51:35.534775 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 18 21:51:35.534775 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] image_conversion_disable       = False {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 18 21:51:35.535288 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] image_upload_use_cinder_backend = False {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 18 21:51:35.535288 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] image_upload_use_internal_tenant = False {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 18 21:51:35.535288 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] image_volume_cache_enabled     = False {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 18 21:51:35.535288 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] image_volume_cache_max_count   = 0 {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 18 21:51:35.535288 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] image_volume_cache_max_size_gb = 0 {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 18 21:51:35.535288 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] instance_format                = [instance: %(uuid)s]  {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 18 21:51:35.535667 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 18 21:51:35.535667 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] iscsi_iotype                   = fileio {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 18 21:51:35.535667 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] iscsi_secondary_ip_addresses   = [] {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 18 21:51:35.535667 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] iscsi_target_flags             =  {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 18 21:51:35.535667 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] iscsi_write_cache              = on {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 18 21:51:35.535989 ncdv-master-1 cinder-backup[123790]: DEBUG oslo_concurrency.lockutils [None req-ae02f82e-98be-4e44-b0d8-ee9870788a06 None None] Lock "cleanup_incomplete_backups_123337" acquired by "cinder.backup.manager.BackupManager._cleanup_incomplete_backup_operations" :: waited 0.002s {{(pid=123790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}}
Jun 18 21:51:35.535989 ncdv-master-1 cinder-backup[123790]: INFO cinder.backup.manager [None req-ae02f82e-98be-4e44-b0d8-ee9870788a06 None None] Cleaning up incomplete backup operations.
Jun 18 21:51:35.536135 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] iser_helper                    = tgtadm {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 18 21:51:35.536135 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] iser_ip_address                = 10.222.0.30 {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 18 21:51:35.536135 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] iser_port                      = 3260 {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 18 21:51:35.536135 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 18 21:51:35.536135 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] log_config_append              = None {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 18 21:51:35.536135 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 18 21:51:35.536537 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] log_dir                        = None {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 18 21:51:35.536537 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] log_file                       = None {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 18 21:51:35.536537 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] log_options                    = True {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 18 21:51:35.536537 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] log_rotate_interval            = 1 {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 18 21:51:35.536537 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] log_rotate_interval_type       = days {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 18 21:51:35.536537 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] log_rotation_type              = none {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 18 21:51:35.536952 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 18 21:51:35.536952 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 18 21:51:35.536952 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 18 21:51:35.536952 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 18 21:51:35.536952 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 18 21:51:35.537345 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] max_age                        = 0 {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 18 21:51:35.537345 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] max_logfile_count              = 30 {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 18 21:51:35.537345 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] max_logfile_size_mb            = 200 {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 18 21:51:35.537550 ncdv-master-1 cinder-backup[123790]: DEBUG oslo_db.sqlalchemy.engines [None req-ae02f82e-98be-4e44-b0d8-ee9870788a06 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123790) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}}
Jun 18 21:51:35.537628 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] max_over_subscription_ratio    = 20.0 {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 18 21:51:35.537628 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] message_reap_interval          = 86400 {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 18 21:51:35.537628 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] message_ttl                    = 2592000 {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 18 21:51:35.537628 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] monkey_patch                   = False {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 18 21:51:35.537628 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] monkey_patch_modules           = [] {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 18 21:51:35.537628 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] my_ip                          = 10.222.0.30 {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 18 21:51:35.537628 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] no_snapshot_gb_quota           = False {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 18 21:51:35.538056 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] num_iser_scan_tries            = 3 {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 18 21:51:35.538056 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] num_shell_tries                = 3 {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 18 21:51:35.538056 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] num_volume_device_scan_tries   = 3 {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 18 21:51:35.538056 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] nvmet_ns_id                    = 10 {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 18 21:51:35.538056 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] nvmet_port_id                  = 1 {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 18 21:51:35.538056 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] osapi_max_limit                = 1000 {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 18 21:51:35.538056 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] osapi_volume_ext_list          = [] {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 18 21:51:35.538564 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 18 21:51:35.538564 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] osapi_volume_listen            = 0.0.0.0 {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 18 21:51:35.538564 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] osapi_volume_listen_port       = 8776 {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 18 21:51:35.538564 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] osapi_volume_use_ssl           = False {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 18 21:51:35.538564 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] osapi_volume_workers           = 2 {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 18 21:51:35.538564 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] per_volume_size_limit          = -1 {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 18 21:51:35.538942 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] periodic_fuzzy_delay           = 60 {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 18 21:51:35.538942 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] periodic_interval              = 60 {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 18 21:51:35.538942 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] project_id_regex               = [0-9a-f\-]+ {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 18 21:51:35.538942 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] public_endpoint                = None {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 18 21:51:35.538942 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] publish_errors                 = False {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 18 21:51:35.538942 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] quota_backup_gigabytes         = 1000 {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 18 21:51:35.538942 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] quota_backups                  = 10 {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 18 21:51:35.539397 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] quota_consistencygroups        = 10 {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 18 21:51:35.539397 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 18 21:51:35.539397 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] quota_gigabytes                = 1000 {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 18 21:51:35.539397 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] quota_groups                   = 10 {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 18 21:51:35.539397 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] quota_snapshots                = 10 {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 18 21:51:35.539397 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] quota_volumes                  = 10 {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 18 21:51:35.539397 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] rate_limit_burst               = 0 {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 18 21:51:35.542597 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] rate_limit_except_level        = CRITICAL {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 18 21:51:35.542597 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] rate_limit_interval            = 0 {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 18 21:51:35.542597 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] replication_device             = **** {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 18 21:51:35.542597 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] report_discard_supported       = False {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 18 21:51:35.542597 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] report_interval                = 10 {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 18 21:51:35.542597 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] reservation_clean_interval     = 86400 {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 18 21:51:35.542597 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] reservation_expire             = 86400 {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 18 21:51:35.543061 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] reserved_percentage            = 0 {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 18 21:51:35.543061 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 18 21:51:35.543061 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] restore_discard_excess_bytes   = True {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 18 21:51:35.543061 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 18 21:51:35.543061 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] rpc_response_timeout           = 120 {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 18 21:51:35.543061 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] run_external_periodic_tasks    = True {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 18 21:51:35.543489 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 18 21:51:35.543489 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] scst_target_driver             = iscsi {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 18 21:51:35.543489 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] scst_target_iqn_name           = None {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 18 21:51:35.543489 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] service_down_time              = 60 {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 18 21:51:35.543489 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] snapshot_name_template         = snapshot-%s {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 18 21:51:35.543489 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] split_loggers                  = False {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 18 21:51:35.543861 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] state_path                     = /opt/stack/data/cinder {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 18 21:51:35.543861 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] storage_availability_zone      = nova {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 18 21:51:35.543861 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] storage_protocol               = iSCSI {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 18 21:51:35.543861 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] syslog_log_facility            = LOG_USER {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 18 21:51:35.543861 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] target_helper                  = lioadm {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 18 21:51:35.543861 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] target_ip_address              = 10.222.0.30 {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 18 21:51:35.543861 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] target_port                    = 3260 {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 18 21:51:35.544353 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 18 21:51:35.544353 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] target_protocol                = iscsi {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 18 21:51:35.544353 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] trace_flags                    = None {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 18 21:51:35.544353 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] transfer_api_class             = cinder.transfer.api.API {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 18 21:51:35.544353 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] transport_url                  = **** {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 18 21:51:35.544353 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] until_refresh                  = 0 {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 18 21:51:35.544743 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] use_chap_auth                  = False {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 18 21:51:35.544743 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] use_default_quota_class        = True {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 18 21:51:35.544743 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] use_eventlog                   = False {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 18 21:51:35.544743 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] use_journal                    = False {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 18 21:51:35.544743 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] use_json                       = False {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 18 21:51:35.544743 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] use_multipath_for_image_xfer   = False {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 18 21:51:35.544743 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] use_stderr                     = False {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 18 21:51:35.555080 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] use_syslog                     = False {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 18 21:51:35.555080 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] verify_glance_signatures       = enabled {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 18 21:51:35.555080 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] volume_api_class               = cinder.volume.api.API {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 18 21:51:35.555080 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] volume_backend_name            = None {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 18 21:51:35.555080 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] volume_clear                   = zero {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 18 21:51:35.555080 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] volume_clear_ionice            = None {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 18 21:51:35.555080 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] volume_clear_size              = 0 {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 18 21:51:35.556109 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 18 21:51:35.556109 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] volume_copy_bps_limit          = 0 {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 18 21:51:35.556109 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] volume_dd_blocksize            = 1M {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 18 21:51:35.556109 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 18 21:51:35.556109 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] volume_name_template           = volume-%s {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 18 21:51:35.556109 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] volume_usage_audit_period      = month {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 18 21:51:35.557390 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 18 21:51:35.557390 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] watch_log_file                 = False {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 18 21:51:35.557390 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 18 21:51:35.557390 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 18 21:51:35.557390 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] oslo_concurrency.disable_process_locking = False {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 18 21:51:35.557390 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 18 21:51:35.558297 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 18 21:51:35.558297 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 18 21:51:35.558297 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 18 21:51:35.558297 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 18 21:51:35.558297 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 18 21:51:35.558297 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] keystone_authtoken.admin_password = **** {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 18 21:51:35.559147 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] keystone_authtoken.admin_tenant_name = admin {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 18 21:51:35.559147 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] keystone_authtoken.admin_token = **** {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 18 21:51:35.559147 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] keystone_authtoken.admin_user  = None {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 18 21:51:35.559147 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] keystone_authtoken.auth_admin_prefix =  {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 18 21:51:35.559147 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] keystone_authtoken.auth_host   = 127.0.0.1 {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 18 21:51:35.559147 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] keystone_authtoken.auth_port   = 35357 {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 18 21:51:35.559147 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] keystone_authtoken.auth_protocol = https {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 18 21:51:35.560228 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] keystone_authtoken.auth_section = None {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 18 21:51:35.560228 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] keystone_authtoken.auth_type   = password {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 18 21:51:35.560228 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] keystone_authtoken.auth_uri    = None {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 18 21:51:35.560228 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] keystone_authtoken.auth_version = None {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 18 21:51:35.560228 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] keystone_authtoken.cache       = None {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 18 21:51:35.560228 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 18 21:51:35.560228 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] keystone_authtoken.certfile    = None {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 18 21:51:35.561260 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] keystone_authtoken.delay_auth_decision = False {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 18 21:51:35.561260 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 18 21:51:35.561260 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] keystone_authtoken.http_connect_timeout = None {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 18 21:51:35.561260 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 18 21:51:35.561260 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] keystone_authtoken.identity_uri = None {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 18 21:51:35.561260 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] keystone_authtoken.include_service_catalog = True {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 18 21:51:35.562148 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] keystone_authtoken.insecure    = False {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 18 21:51:35.562148 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] keystone_authtoken.interface   = public {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 18 21:51:35.562148 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] keystone_authtoken.keyfile     = None {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 18 21:51:35.562148 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 18 21:51:35.562148 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 18 21:51:35.562148 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 18 21:51:35.574171 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 18 21:51:35.574171 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 18 21:51:35.574171 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] keystone_authtoken.memcache_secret_key = **** {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 18 21:51:35.574171 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] keystone_authtoken.memcache_security_strategy = None {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 18 21:51:35.574171 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 18 21:51:35.574171 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 18 21:51:35.575029 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] keystone_authtoken.region_name = None {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 18 21:51:35.575029 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 18 21:51:35.575029 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] keystone_authtoken.service_token_roles_required = False {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 18 21:51:35.575029 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] keystone_authtoken.service_type = None {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 18 21:51:35.575029 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] keystone_authtoken.token_cache_time = 300 {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 18 21:51:35.575029 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] keystone_authtoken.www_authenticate_uri = None {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 18 21:51:35.575892 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] cache.backend                  = dogpile.cache.null {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 18 21:51:35.575892 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] cache.backend_argument         = **** {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 18 21:51:35.575892 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] cache.config_prefix            = cache.oslo {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 18 21:51:35.575892 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] cache.dead_timeout             = 60.0 {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 18 21:51:35.575892 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] cache.debug_cache_backend      = False {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 18 21:51:35.575892 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] cache.enable_retry_client      = False {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 18 21:51:35.575892 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] cache.enable_socket_keepalive  = False {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 18 21:51:35.576904 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] cache.enabled                  = False {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 18 21:51:35.576904 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] cache.expiration_time          = 600 {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 18 21:51:35.576904 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] cache.hashclient_retry_attempts = 2 {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 18 21:51:35.576904 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] cache.hashclient_retry_delay   = 1.0 {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 18 21:51:35.576904 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] cache.memcache_dead_retry      = 300 {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 18 21:51:35.576904 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 18 21:51:35.576904 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 18 21:51:35.577966 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] cache.memcache_pool_maxsize    = 10 {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 18 21:51:35.577966 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] cache.memcache_pool_unused_timeout = 60 {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 18 21:51:35.577966 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 18 21:51:35.577966 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] cache.memcache_socket_timeout  = 1.0 {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 18 21:51:35.577966 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] cache.proxies                  = [] {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 18 21:51:35.577966 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] cache.retry_attempts           = 2 {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 18 21:51:35.577966 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] cache.retry_delay              = 0.0 {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 18 21:51:35.578943 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] cache.socket_keepalive_count   = 1 {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 18 21:51:35.578943 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] cache.socket_keepalive_idle    = 1 {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 18 21:51:35.578943 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] cache.socket_keepalive_interval = 1 {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 18 21:51:35.578943 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] cache.tls_allowed_ciphers      = None {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 18 21:51:35.578943 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] cache.tls_cafile               = None {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 18 21:51:35.578943 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] cache.tls_certfile             = None {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 18 21:51:35.578943 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] cache.tls_enabled              = False {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 18 21:51:35.579910 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] cache.tls_keyfile              = None {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 18 21:51:35.579910 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] coordination.backend_url       = etcd3+http://10.222.0.30:2379 {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 18 21:51:35.579910 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] database.backend               = sqlalchemy {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 18 21:51:35.579910 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] database.connection            = **** {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 18 21:51:35.579910 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] database.connection_debug      = 0 {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 18 21:51:35.579910 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] database.connection_parameters =  {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 18 21:51:35.579910 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] database.connection_recycle_time = 3600 {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 18 21:51:35.580880 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] database.connection_trace      = False {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 18 21:51:35.580880 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] database.db_inc_retry_interval = True {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 18 21:51:35.580880 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] database.db_max_retries        = 20 {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 18 21:51:35.580880 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] database.db_max_retry_interval = 10 {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 18 21:51:35.580880 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] database.db_retry_interval     = 1 {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 18 21:51:35.580880 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] database.max_overflow          = 50 {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 18 21:51:35.580880 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] database.max_pool_size         = 5 {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 18 21:51:35.582207 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] database.max_retries           = 10 {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 18 21:51:35.582207 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] database.mysql_enable_ndb      = False {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 18 21:51:35.582207 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 18 21:51:35.582207 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] database.pool_timeout          = None {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 18 21:51:35.582207 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] database.retry_interval        = 10 {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 18 21:51:35.582207 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] database.slave_connection      = **** {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 18 21:51:35.582207 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] database.sqlite_synchronous    = True {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 18 21:51:35.583183 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] database.use_db_reconnect      = False {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 18 21:51:35.583183 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] oslo_policy.enforce_new_defaults = False {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 18 21:51:35.583183 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] oslo_policy.enforce_scope      = False {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 18 21:51:35.583183 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] oslo_policy.policy_default_rule = default {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 18 21:51:35.583183 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 18 21:51:35.583183 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] oslo_policy.policy_file        = policy.yaml {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 18 21:51:35.584379 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 18 21:51:35.584379 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 18 21:51:35.584379 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 18 21:51:35.584379 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 18 21:51:35.584379 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 18 21:51:35.584379 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] profiler.connection_string     = messaging:// {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 18 21:51:35.589383 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] profiler.enabled               = False {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 18 21:51:35.589383 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] profiler.es_doc_type           = notification {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 18 21:51:35.589383 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] profiler.es_scroll_size        = 10000 {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 18 21:51:35.589383 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] profiler.es_scroll_time        = 2m {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 18 21:51:35.589383 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] profiler.filter_error_trace    = False {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 18 21:51:35.589383 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] profiler.hmac_keys             = SECRET_KEY {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 18 21:51:35.589383 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] profiler.sentinel_service_name = mymaster {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 18 21:51:35.590422 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] profiler.socket_timeout        = 0.1 {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 18 21:51:35.590422 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] profiler.trace_sqlalchemy      = False {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 18 21:51:35.590422 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] privsep_osbrick.capabilities   = [21] {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 18 21:51:35.590422 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] privsep_osbrick.group          = None {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 18 21:51:35.590422 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] privsep_osbrick.helper_command = None {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 18 21:51:35.590422 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] privsep_osbrick.logger_name    = oslo_privsep.daemon {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 18 21:51:35.590422 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] privsep_osbrick.thread_pool_size = 4 {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 18 21:51:35.591420 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] privsep_osbrick.user           = None {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 18 21:51:35.591420 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 18 21:51:35.591420 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] cinder_sys_admin.group         = None {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 18 21:51:35.591420 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] cinder_sys_admin.helper_command = None {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 18 21:51:35.591420 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 18 21:51:35.591420 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 18 21:51:35.591420 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] cinder_sys_admin.user          = None {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 18 21:51:35.592391 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] service_user.auth_section      = None {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 18 21:51:35.592391 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] service_user.auth_type         = None {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 18 21:51:35.592391 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] service_user.cafile            = None {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 18 21:51:35.592391 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] service_user.certfile          = None {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 18 21:51:35.592391 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] service_user.collect_timing    = False {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 18 21:51:35.592391 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] service_user.insecure          = False {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 18 21:51:35.592391 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] service_user.keyfile           = None {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 18 21:51:35.594091 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] service_user.send_service_user_token = False {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 18 21:51:35.594091 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] service_user.split_loggers     = False {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 18 21:51:35.594091 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] service_user.timeout           = None {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 18 21:51:35.594091 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] backend_defaults.backend_availability_zone = None {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 18 21:51:35.594091 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] backend_defaults.chap_password = **** {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 18 21:51:35.594091 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] backend_defaults.chap_username =  {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 18 21:51:35.618555 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 18 21:51:35.618555 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] backend_defaults.deferred_deletion_delay = 0 {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 18 21:51:35.618555 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] backend_defaults.deferred_deletion_purge_interval = 60 {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 18 21:51:35.618555 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] backend_defaults.driver_client_cert = None {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 18 21:51:35.618555 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] backend_defaults.driver_client_cert_key = None {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 18 21:51:35.618555 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] backend_defaults.driver_data_namespace = None {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 18 21:51:35.619386 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] backend_defaults.driver_ssl_cert_path = None {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 18 21:51:35.619386 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 18 21:51:35.619386 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] backend_defaults.driver_use_ssl = False {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 18 21:51:35.619386 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] backend_defaults.enable_deferred_deletion = False {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 18 21:51:35.619386 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] backend_defaults.enable_unsupported_driver = False {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 18 21:51:35.619386 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 18 21:51:35.620319 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] backend_defaults.filter_function = None {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 18 21:51:35.620319 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] backend_defaults.goodness_function = None {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 18 21:51:35.620319 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] backend_defaults.iet_conf      = /etc/iet/ietd.conf {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 18 21:51:35.620319 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 18 21:51:35.620319 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 18 21:51:35.620319 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] backend_defaults.image_volume_cache_enabled = False {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 18 21:51:35.621804 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 18 21:51:35.621804 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 18 21:51:35.621804 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] backend_defaults.iscsi_iotype  = fileio {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 18 21:51:35.621804 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] backend_defaults.iscsi_secondary_ip_addresses = [] {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 18 21:51:35.621804 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] backend_defaults.iscsi_target_flags =  {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 18 21:51:35.621804 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] backend_defaults.iscsi_write_cache = on {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 18 21:51:35.622733 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] backend_defaults.iser_helper   = tgtadm {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 18 21:51:35.622733 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] backend_defaults.iser_ip_address = 10.222.0.30 {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 18 21:51:35.622733 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] backend_defaults.iser_port     = 3260 {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 18 21:51:35.622733 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 18 21:51:35.622733 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 18 21:51:35.622733 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 18 21:51:35.623595 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] backend_defaults.num_shell_tries = 3 {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 18 21:51:35.623595 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 18 21:51:35.623595 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 18 21:51:35.623595 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] backend_defaults.nvmet_port_id = 1 {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 18 21:51:35.623595 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] backend_defaults.rados_connect_timeout = -1 {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 18 21:51:35.623595 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] backend_defaults.rados_connection_interval = 5 {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 18 21:51:35.623595 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] backend_defaults.rados_connection_retries = 3 {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 18 21:51:35.624644 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] backend_defaults.rbd_ceph_conf =  {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 18 21:51:35.624644 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] backend_defaults.rbd_cluster_name = ceph {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 18 21:51:35.624644 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] backend_defaults.rbd_exclusive_cinder_pool = True {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 18 21:51:35.624644 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] backend_defaults.rbd_flatten_volume_from_snapshot = False {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 18 21:51:35.624644 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] backend_defaults.rbd_max_clone_depth = 5 {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 18 21:51:35.624644 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] backend_defaults.rbd_pool      = rbd {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 18 21:51:35.625529 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] backend_defaults.rbd_secret_uuid = None {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 18 21:51:35.625529 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] backend_defaults.rbd_store_chunk_size = 4 {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 18 21:51:35.625529 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] backend_defaults.rbd_user      = None {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 18 21:51:35.625529 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] backend_defaults.replication_connect_timeout = 5 {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 18 21:51:35.625529 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] backend_defaults.replication_device = **** {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 18 21:51:35.625529 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] backend_defaults.report_discard_supported = False {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 18 21:51:35.626393 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] backend_defaults.report_dynamic_total_capacity = True {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 18 21:51:35.626393 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] backend_defaults.reserved_percentage = 0 {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 18 21:51:35.626393 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] backend_defaults.scst_target_driver = iscsi {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 18 21:51:35.626393 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] backend_defaults.scst_target_iqn_name = None {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 18 21:51:35.626393 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] backend_defaults.storage_protocol = iSCSI {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 18 21:51:35.626393 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] backend_defaults.target_helper = tgtadm {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 18 21:51:35.627225 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] backend_defaults.target_ip_address = 10.222.0.30 {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 18 21:51:35.627225 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] backend_defaults.target_port   = 3260 {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 18 21:51:35.627225 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 18 21:51:35.627225 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] backend_defaults.target_protocol = iscsi {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 18 21:51:35.627225 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] backend_defaults.trace_flags   = None {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 18 21:51:35.627225 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] backend_defaults.unique_fqdn_network = True {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 18 21:51:35.628077 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] backend_defaults.use_chap_auth = False {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 18 21:51:35.628077 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 18 21:51:35.628077 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] backend_defaults.volume_backend_name = None {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 18 21:51:35.628077 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] backend_defaults.volume_clear  = zero {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 18 21:51:35.628077 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] backend_defaults.volume_clear_ionice = None {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 18 21:51:35.628077 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] backend_defaults.volume_clear_size = 0 {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 18 21:51:35.628928 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 18 21:51:35.628928 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 18 21:51:35.628928 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 18 21:51:35.628928 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 18 21:51:35.628928 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] oslo_reports.file_event_handler = None {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 18 21:51:35.628928 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] oslo_reports.file_event_handler_interval = 1 {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 18 21:51:35.629797 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] oslo_reports.log_dir           = None {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 18 21:51:35.629797 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 18 21:51:35.629797 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 18 21:51:35.629797 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 18 21:51:35.629797 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 18 21:51:35.629797 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 18 21:51:35.630845 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 18 21:51:35.630845 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 18 21:51:35.630845 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 18 21:51:35.630845 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 18 21:51:35.630845 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 18 21:51:35.630845 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 18 21:51:35.631694 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 18 21:51:35.631694 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 18 21:51:35.631694 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 18 21:51:35.631694 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 18 21:51:35.631694 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 18 21:51:35.631694 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 18 21:51:35.632560 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 18 21:51:35.632560 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 18 21:51:35.632560 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 18 21:51:35.632560 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 18 21:51:35.632560 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 18 21:51:35.632560 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] oslo_messaging_rabbit.ssl      = False {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 18 21:51:35.633508 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 18 21:51:35.633508 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 18 21:51:35.633508 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 18 21:51:35.633508 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 18 21:51:35.633508 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] oslo_messaging_rabbit.ssl_version =  {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 18 21:51:35.633508 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] oslo_messaging_notifications.driver = [] {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 18 21:51:35.633508 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] oslo_messaging_notifications.retry = -1 {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 18 21:51:35.634496 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 18 21:51:35.634496 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] oslo_messaging_notifications.transport_url = **** {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 18 21:51:35.634496 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 18 21:51:35.634496 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 18 21:51:35.634496 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] barbican.barbican_api_version  = None {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 18 21:51:35.634496 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] barbican.barbican_endpoint     = None {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 18 21:51:35.635343 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] barbican.barbican_endpoint_type = public {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 18 21:51:35.635343 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] barbican.barbican_region_name  = None {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 18 21:51:35.635343 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] barbican.cafile                = None {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 18 21:51:35.635343 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] barbican.certfile              = None {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 18 21:51:35.635343 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] barbican.collect_timing        = False {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 18 21:51:35.635343 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] barbican.insecure              = False {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 18 21:51:35.635343 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] barbican.keyfile               = None {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 18 21:51:35.636554 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] barbican.number_of_retries     = 60 {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 18 21:51:35.636554 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] barbican.retry_delay           = 1 {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 18 21:51:35.636554 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] barbican.send_service_user_token = False {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 18 21:51:35.636554 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] barbican.split_loggers         = False {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 18 21:51:35.636554 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] barbican.timeout               = None {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 18 21:51:35.636554 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] barbican.verify_ssl            = True {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 18 21:51:35.636554 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] barbican.verify_ssl_path       = None {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 18 21:51:35.637582 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] barbican_service_user.auth_section = None {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 18 21:51:35.637582 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] barbican_service_user.auth_type = None {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 18 21:51:35.637582 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] barbican_service_user.cafile   = None {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 18 21:51:35.637582 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] barbican_service_user.certfile = None {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 18 21:51:35.637582 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] barbican_service_user.collect_timing = False {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 18 21:51:35.637582 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] barbican_service_user.insecure = False {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 18 21:51:35.637582 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] barbican_service_user.keyfile  = None {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 18 21:51:35.638563 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] barbican_service_user.split_loggers = False {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 18 21:51:35.638563 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] barbican_service_user.timeout  = None {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 18 21:51:35.638563 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] vault.approle_role_id          = None {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 18 21:51:35.638563 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] vault.approle_secret_id        = None {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 18 21:51:35.638563 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] vault.cafile                   = None {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 18 21:51:35.638563 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] vault.certfile                 = None {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 18 21:51:35.638563 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] vault.collect_timing           = False {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 18 21:51:35.639545 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] vault.insecure                 = False {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 18 21:51:35.639545 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] vault.keyfile                  = None {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 18 21:51:35.639545 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] vault.kv_mountpoint            = secret {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 18 21:51:35.639545 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] vault.kv_version               = 2 {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 18 21:51:35.639545 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] vault.namespace                = None {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 18 21:51:35.639545 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] vault.root_token_id            = None {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 18 21:51:35.639545 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] vault.split_loggers            = False {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 18 21:51:35.640578 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] vault.ssl_ca_crt_file          = None {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 18 21:51:35.640578 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] vault.timeout                  = None {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 18 21:51:35.640578 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] vault.use_ssl                  = False {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 18 21:51:35.640578 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 18 21:51:35.640578 ncdv-master-1 cinder-backup[123337]: DEBUG oslo_service.service [None req-93ae0430-e31f-4194-9a71-cdeb92ecf0ab None None] ******************************************************************************** {{(pid=123337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}}
Jun 18 21:51:35.649851 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writer thread running {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}}
Jun 18 21:51:35.678868 ncdv-master-1 cinder-backup[123790]: DEBUG oslo_concurrency.lockutils [None req-ae02f82e-98be-4e44-b0d8-ee9870788a06 None None] Lock "cleanup_incomplete_backups_123337" "released" by "cinder.backup.manager.BackupManager._cleanup_incomplete_backup_operations" :: held 0.266s {{(pid=123790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}}
Jun 18 21:51:35.685560 ncdv-master-1 cinder-backup[123790]: DEBUG oslo_db.sqlalchemy.engines [None req-ae02f82e-98be-4e44-b0d8-ee9870788a06 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123790) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}}
Jun 18 21:51:35.692003 ncdv-master-1 cinder-backup[123790]: DEBUG cinder.manager [None req-ae02f82e-98be-4e44-b0d8-ee9870788a06 None None] Notifying Schedulers of capabilities ... {{(pid=123790) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jun 18 21:51:35.721696 ncdv-master-1 cinder-backup[123790]: INFO cinder.keymgr.migration [None req-6cede38b-2640-4c96-aa1a-63ff27276e33 None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Jun 18 21:51:35.748337 ncdv-master-1 cinder-backup[123790]: DEBUG cinder.service [None req-ae02f82e-98be-4e44-b0d8-ee9870788a06 None None] Creating RPC server for service cinder-backup {{(pid=123790) start /opt/stack/cinder/cinder/service.py:231}}
Jun 18 21:51:35.759970 ncdv-master-1 cinder-backup[123790]: DEBUG cinder.service [None req-ae02f82e-98be-4e44-b0d8-ee9870788a06 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=123790) start /opt/stack/cinder/cinder/service.py:237}}
Jun 18 21:51:45.288107 ncdv-master-1 cinder-backup[123337]: DEBUG dbcounter [-] [123337] Writing DB stats cinder:SELECT=16,cinder:INSERT=1 {{(pid=123337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 21:51:45.754008 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writing DB stats cinder:SELECT=3 {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 21:51:45.756926 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writing DB stats cinder:SELECT=19,cinder:INSERT=1 {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 21:52:05.799892 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writing DB stats cinder:SELECT=4,cinder:UPDATE=1 {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 21:52:15.804103 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 21:52:35.803398 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writing DB stats cinder:SELECT=1 {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 21:52:45.813347 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writing DB stats cinder:SELECT=7,cinder:UPDATE=3 {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 21:53:05.810103 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 21:53:08.796120 ncdv-master-1 cinder-backup[123790]: DEBUG oslo_service.periodic_task [None req-d82f921b-aced-4971-81d0-f3b75344497b None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=123790) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Jun 18 21:53:08.796832 ncdv-master-1 cinder-backup[123790]: DEBUG cinder.manager [None req-d82f921b-aced-4971-81d0-f3b75344497b None None] Notifying Schedulers of capabilities ... {{(pid=123790) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jun 18 21:53:15.821972 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writing DB stats cinder:SELECT=4,cinder:UPDATE=2 {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 21:53:25.824818 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 21:53:45.818864 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writing DB stats cinder:SELECT=4,cinder:UPDATE=1 {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 21:54:05.825743 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writing DB stats cinder:SELECT=8,cinder:UPDATE=2 {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 21:54:08.792562 ncdv-master-1 cinder-backup[123790]: DEBUG oslo_service.periodic_task [None req-d82f921b-aced-4971-81d0-f3b75344497b None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=123790) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Jun 18 21:54:08.793914 ncdv-master-1 cinder-backup[123790]: DEBUG cinder.manager [None req-d82f921b-aced-4971-81d0-f3b75344497b None None] Notifying Schedulers of capabilities ... {{(pid=123790) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jun 18 21:54:15.833236 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writing DB stats cinder:UPDATE=2,cinder:SELECT=3 {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 21:54:35.835255 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writing DB stats cinder:SELECT=4,cinder:UPDATE=1 {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 21:54:55.830933 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writing DB stats cinder:SELECT=8,cinder:UPDATE=2 {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 21:55:08.791112 ncdv-master-1 cinder-backup[123790]: DEBUG oslo_service.periodic_task [None req-d82f921b-aced-4971-81d0-f3b75344497b None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=123790) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Jun 18 21:55:08.792481 ncdv-master-1 cinder-backup[123790]: DEBUG cinder.manager [None req-d82f921b-aced-4971-81d0-f3b75344497b None None] Notifying Schedulers of capabilities ... {{(pid=123790) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jun 18 21:55:15.831123 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 21:55:25.843344 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writing DB stats cinder:SELECT=5,cinder:UPDATE=3 {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 21:55:45.835106 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writing DB stats cinder:SELECT=3 {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 21:56:05.843383 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writing DB stats cinder:SELECT=2 {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 21:56:05.847359 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writing DB stats cinder:SELECT=6,cinder:UPDATE=3 {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 21:56:08.790073 ncdv-master-1 cinder-backup[123790]: DEBUG oslo_service.periodic_task [None req-d82f921b-aced-4971-81d0-f3b75344497b None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=123790) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Jun 18 21:56:08.791193 ncdv-master-1 cinder-backup[123790]: DEBUG cinder.manager [None req-d82f921b-aced-4971-81d0-f3b75344497b None None] Notifying Schedulers of capabilities ... {{(pid=123790) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jun 18 21:56:45.839021 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writing DB stats cinder:SELECT=4,cinder:UPDATE=1 {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 21:56:45.842907 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writing DB stats cinder:SELECT=8,cinder:UPDATE=3 {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 21:57:08.789075 ncdv-master-1 cinder-backup[123790]: DEBUG oslo_service.periodic_task [None req-d82f921b-aced-4971-81d0-f3b75344497b None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=123790) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Jun 18 21:57:08.790220 ncdv-master-1 cinder-backup[123790]: DEBUG cinder.manager [None req-d82f921b-aced-4971-81d0-f3b75344497b None None] Notifying Schedulers of capabilities ... {{(pid=123790) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jun 18 21:57:15.856213 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writing DB stats cinder:SELECT=5,cinder:UPDATE=2 {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 21:57:25.848658 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writing DB stats cinder:SELECT=7,cinder:UPDATE=2 {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 21:57:55.859052 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writing DB stats cinder:SELECT=7,cinder:UPDATE=2 {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 21:57:55.864083 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writing DB stats cinder:SELECT=4,cinder:UPDATE=1 {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 21:58:08.787893 ncdv-master-1 cinder-backup[123790]: DEBUG oslo_service.periodic_task [None req-d82f921b-aced-4971-81d0-f3b75344497b None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=123790) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Jun 18 21:58:08.789143 ncdv-master-1 cinder-backup[123790]: DEBUG cinder.manager [None req-d82f921b-aced-4971-81d0-f3b75344497b None None] Notifying Schedulers of capabilities ... {{(pid=123790) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jun 18 21:58:15.859142 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writing DB stats cinder:UPDATE=1,cinder:SELECT=2 {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 21:58:35.857221 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writing DB stats cinder:SELECT=5,cinder:UPDATE=2 {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 21:58:55.862491 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writing DB stats cinder:SELECT=1 {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 21:58:55.863521 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writing DB stats cinder:SELECT=8,cinder:UPDATE=3 {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 21:59:08.787291 ncdv-master-1 cinder-backup[123790]: DEBUG oslo_service.periodic_task [None req-d82f921b-aced-4971-81d0-f3b75344497b None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=123790) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Jun 18 21:59:08.788393 ncdv-master-1 cinder-backup[123790]: DEBUG cinder.manager [None req-d82f921b-aced-4971-81d0-f3b75344497b None None] Notifying Schedulers of capabilities ... {{(pid=123790) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jun 18 21:59:15.877968 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writing DB stats cinder:SELECT=4,cinder:UPDATE=2 {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 21:59:25.879011 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 21:59:45.890419 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writing DB stats cinder:SELECT=4,cinder:UPDATE=3 {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 21:59:55.892487 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 22:00:08.786978 ncdv-master-1 cinder-backup[123790]: DEBUG oslo_service.periodic_task [None req-d82f921b-aced-4971-81d0-f3b75344497b None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=123790) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Jun 18 22:00:08.788116 ncdv-master-1 cinder-backup[123790]: DEBUG cinder.manager [None req-d82f921b-aced-4971-81d0-f3b75344497b None None] Notifying Schedulers of capabilities ... {{(pid=123790) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jun 18 22:00:15.887045 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writing DB stats cinder:SELECT=1 {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 22:00:25.885989 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writing DB stats cinder:SELECT=7,cinder:UPDATE=2 {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 22:00:45.882515 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writing DB stats cinder:SELECT=4,cinder:UPDATE=1 {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 22:01:05.898731 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writing DB stats cinder:SELECT=8,cinder:UPDATE=2 {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 22:01:08.785323 ncdv-master-1 cinder-backup[123790]: DEBUG oslo_service.periodic_task [None req-d82f921b-aced-4971-81d0-f3b75344497b None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=123790) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Jun 18 22:01:08.786025 ncdv-master-1 cinder-backup[123790]: DEBUG cinder.manager [None req-d82f921b-aced-4971-81d0-f3b75344497b None None] Notifying Schedulers of capabilities ... {{(pid=123790) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jun 18 22:01:15.921285 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writing DB stats cinder:UPDATE=2,cinder:SELECT=3 {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 22:01:35.899100 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writing DB stats cinder:SELECT=4,cinder:UPDATE=1 {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 22:01:55.918872 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writing DB stats cinder:SELECT=7,cinder:UPDATE=2 {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 22:02:08.783512 ncdv-master-1 cinder-backup[123790]: DEBUG oslo_service.periodic_task [None req-d82f921b-aced-4971-81d0-f3b75344497b None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=123790) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Jun 18 22:02:08.784402 ncdv-master-1 cinder-backup[123790]: DEBUG cinder.manager [None req-d82f921b-aced-4971-81d0-f3b75344497b None None] Notifying Schedulers of capabilities ... {{(pid=123790) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jun 18 22:02:15.913932 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 22:02:25.904164 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writing DB stats cinder:SELECT=10,cinder:UPDATE=3 {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 22:02:45.919060 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writing DB stats cinder:SELECT=2 {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 22:02:55.919958 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 22:03:08.780699 ncdv-master-1 cinder-backup[123790]: DEBUG oslo_service.periodic_task [None req-d82f921b-aced-4971-81d0-f3b75344497b None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=123790) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Jun 18 22:03:08.781343 ncdv-master-1 cinder-backup[123790]: DEBUG cinder.manager [None req-d82f921b-aced-4971-81d0-f3b75344497b None None] Notifying Schedulers of capabilities ... {{(pid=123790) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jun 18 22:03:25.909547 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writing DB stats cinder:SELECT=7,cinder:UPDATE=2 {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 22:03:35.910287 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writing DB stats cinder:SELECT=6,cinder:UPDATE=3 {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 22:03:55.917828 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writing DB stats cinder:SELECT=2 {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 22:04:05.910461 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writing DB stats cinder:SELECT=7,cinder:UPDATE=3 {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 22:04:08.785996 ncdv-master-1 cinder-backup[123790]: DEBUG oslo_service.periodic_task [None req-d82f921b-aced-4971-81d0-f3b75344497b None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=123790) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Jun 18 22:04:08.786916 ncdv-master-1 cinder-backup[123790]: DEBUG cinder.manager [None req-d82f921b-aced-4971-81d0-f3b75344497b None None] Notifying Schedulers of capabilities ... {{(pid=123790) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jun 18 22:04:25.926326 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writing DB stats cinder:SELECT=4,cinder:UPDATE=1 {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 22:04:45.930140 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 22:05:05.930199 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 22:05:08.791039 ncdv-master-1 cinder-backup[123790]: DEBUG oslo_service.periodic_task [None req-d82f921b-aced-4971-81d0-f3b75344497b None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=123790) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Jun 18 22:05:08.791747 ncdv-master-1 cinder-backup[123790]: DEBUG cinder.manager [None req-d82f921b-aced-4971-81d0-f3b75344497b None None] Notifying Schedulers of capabilities ... {{(pid=123790) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jun 18 22:05:25.936785 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writing DB stats cinder:SELECT=6,cinder:UPDATE=1 {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 22:05:45.941256 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writing DB stats cinder:SELECT=6,cinder:UPDATE=3 {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 22:06:05.931379 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writing DB stats cinder:SELECT=6,cinder:UPDATE=3 {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 22:06:08.796463 ncdv-master-1 cinder-backup[123790]: DEBUG oslo_service.periodic_task [None req-d82f921b-aced-4971-81d0-f3b75344497b None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=123790) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Jun 18 22:06:08.797112 ncdv-master-1 cinder-backup[123790]: DEBUG cinder.manager [None req-d82f921b-aced-4971-81d0-f3b75344497b None None] Notifying Schedulers of capabilities ... {{(pid=123790) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jun 18 22:06:25.942851 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writing DB stats cinder:SELECT=6,cinder:UPDATE=1 {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 22:06:45.940693 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writing DB stats cinder:SELECT=7,cinder:UPDATE=3 {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 22:07:08.795367 ncdv-master-1 cinder-backup[123790]: DEBUG oslo_service.periodic_task [None req-d82f921b-aced-4971-81d0-f3b75344497b None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=123790) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Jun 18 22:07:08.796751 ncdv-master-1 cinder-backup[123790]: DEBUG cinder.manager [None req-d82f921b-aced-4971-81d0-f3b75344497b None None] Notifying Schedulers of capabilities ... {{(pid=123790) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jun 18 22:07:15.935895 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writing DB stats cinder:SELECT=2 {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 22:07:15.936914 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writing DB stats cinder:SELECT=8,cinder:UPDATE=3 {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 22:07:35.948020 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writing DB stats cinder:SELECT=5,cinder:UPDATE=2 {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 22:08:05.946230 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 22:08:08.793133 ncdv-master-1 cinder-backup[123790]: DEBUG oslo_service.periodic_task [None req-d82f921b-aced-4971-81d0-f3b75344497b None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=123790) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Jun 18 22:08:08.793791 ncdv-master-1 cinder-backup[123790]: DEBUG cinder.manager [None req-d82f921b-aced-4971-81d0-f3b75344497b None None] Notifying Schedulers of capabilities ... {{(pid=123790) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jun 18 22:08:15.940724 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writing DB stats cinder:SELECT=5,cinder:UPDATE=3 {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 22:08:45.941511 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 22:08:55.943545 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writing DB stats cinder:SELECT=5,cinder:UPDATE=3 {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 22:09:08.789878 ncdv-master-1 cinder-backup[123790]: DEBUG oslo_service.periodic_task [None req-d82f921b-aced-4971-81d0-f3b75344497b None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=123790) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Jun 18 22:09:08.791005 ncdv-master-1 cinder-backup[123790]: DEBUG cinder.manager [None req-d82f921b-aced-4971-81d0-f3b75344497b None None] Notifying Schedulers of capabilities ... {{(pid=123790) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jun 18 22:09:15.950650 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writing DB stats cinder:SELECT=2,cinder:UPDATE=1 {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 22:09:25.949615 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writing DB stats cinder:SELECT=7,cinder:UPDATE=2 {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 22:09:55.940515 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writing DB stats cinder:SELECT=7,cinder:UPDATE=3 {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 22:10:08.788286 ncdv-master-1 cinder-backup[123790]: DEBUG oslo_service.periodic_task [None req-d82f921b-aced-4971-81d0-f3b75344497b None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=123790) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Jun 18 22:10:08.788998 ncdv-master-1 cinder-backup[123790]: DEBUG cinder.manager [None req-d82f921b-aced-4971-81d0-f3b75344497b None None] Notifying Schedulers of capabilities ... {{(pid=123790) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jun 18 22:10:15.947861 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writing DB stats cinder:SELECT=8,cinder:UPDATE=2 {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 22:10:45.942661 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writing DB stats cinder:SELECT=5,cinder:UPDATE=2 {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 22:10:55.943494 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writing DB stats cinder:SELECT=7,cinder:UPDATE=2 {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 22:11:08.785768 ncdv-master-1 cinder-backup[123790]: DEBUG oslo_service.periodic_task [None req-d82f921b-aced-4971-81d0-f3b75344497b None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=123790) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Jun 18 22:11:08.786388 ncdv-master-1 cinder-backup[123790]: DEBUG cinder.manager [None req-d82f921b-aced-4971-81d0-f3b75344497b None None] Notifying Schedulers of capabilities ... {{(pid=123790) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jun 18 22:11:25.944866 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writing DB stats cinder:SELECT=5,cinder:UPDATE=3 {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 22:11:25.959575 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writing DB stats cinder:SELECT=6 {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 22:11:45.948543 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writing DB stats cinder:UPDATE=1,cinder:SELECT=2 {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 22:12:05.980034 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writing DB stats cinder:SELECT=5,cinder:UPDATE=3 {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 22:12:08.788655 ncdv-master-1 cinder-backup[123790]: DEBUG oslo_service.periodic_task [None req-d82f921b-aced-4971-81d0-f3b75344497b None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=123790) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Jun 18 22:12:08.789372 ncdv-master-1 cinder-backup[123790]: DEBUG cinder.manager [None req-d82f921b-aced-4971-81d0-f3b75344497b None None] Notifying Schedulers of capabilities ... {{(pid=123790) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jun 18 22:12:25.959210 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 22:12:35.970819 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writing DB stats cinder:SELECT=4,cinder:UPDATE=2 {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 22:12:55.970268 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 22:13:08.787613 ncdv-master-1 cinder-backup[123790]: DEBUG oslo_service.periodic_task [None req-d82f921b-aced-4971-81d0-f3b75344497b None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=123790) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Jun 18 22:13:08.788298 ncdv-master-1 cinder-backup[123790]: DEBUG cinder.manager [None req-d82f921b-aced-4971-81d0-f3b75344497b None None] Notifying Schedulers of capabilities ... {{(pid=123790) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jun 18 22:13:15.973597 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writing DB stats cinder:SELECT=8,cinder:UPDATE=3 {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 22:13:45.979708 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writing DB stats cinder:SELECT=8,cinder:UPDATE=3 {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 22:14:05.995047 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 22:14:08.784315 ncdv-master-1 cinder-backup[123790]: DEBUG oslo_service.periodic_task [None req-d82f921b-aced-4971-81d0-f3b75344497b None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=123790) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Jun 18 22:14:08.785513 ncdv-master-1 cinder-backup[123790]: DEBUG cinder.manager [None req-d82f921b-aced-4971-81d0-f3b75344497b None None] Notifying Schedulers of capabilities ... {{(pid=123790) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jun 18 22:14:15.989964 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writing DB stats cinder:SELECT=9,cinder:UPDATE=2 {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 22:14:45.984710 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writing DB stats cinder:SELECT=7,cinder:UPDATE=3 {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 22:15:05.986410 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 22:15:08.782933 ncdv-master-1 cinder-backup[123790]: DEBUG oslo_service.periodic_task [None req-d82f921b-aced-4971-81d0-f3b75344497b None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=123790) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Jun 18 22:15:08.782933 ncdv-master-1 cinder-backup[123790]: DEBUG cinder.manager [None req-d82f921b-aced-4971-81d0-f3b75344497b None None] Notifying Schedulers of capabilities ... {{(pid=123790) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jun 18 22:15:15.996508 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writing DB stats cinder:SELECT=3,cinder:UPDATE=2 {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 22:15:45.988662 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writing DB stats cinder:SELECT=7,cinder:UPDATE=2 {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 22:15:55.989332 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 22:16:08.784132 ncdv-master-1 cinder-backup[123790]: DEBUG oslo_service.periodic_task [None req-d82f921b-aced-4971-81d0-f3b75344497b None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=123790) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Jun 18 22:16:08.784775 ncdv-master-1 cinder-backup[123790]: DEBUG cinder.manager [None req-d82f921b-aced-4971-81d0-f3b75344497b None None] Notifying Schedulers of capabilities ... {{(pid=123790) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jun 18 22:16:15.999924 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writing DB stats cinder:SELECT=2 {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 22:16:26.003433 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writing DB stats cinder:SELECT=5,cinder:UPDATE=2 {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 22:16:56.005674 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writing DB stats cinder:SELECT=9,cinder:UPDATE=2 {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 22:17:06.007968 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writing DB stats cinder:SELECT=5,cinder:UPDATE=3 {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 22:17:08.784526 ncdv-master-1 cinder-backup[123790]: DEBUG oslo_service.periodic_task [None req-d82f921b-aced-4971-81d0-f3b75344497b None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=123790) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Jun 18 22:17:08.785117 ncdv-master-1 cinder-backup[123790]: DEBUG cinder.manager [None req-d82f921b-aced-4971-81d0-f3b75344497b None None] Notifying Schedulers of capabilities ... {{(pid=123790) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jun 18 22:17:26.018251 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writing DB stats cinder:SELECT=2 {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 22:17:26.042274 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 22:17:46.032480 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writing DB stats cinder:SELECT=1 {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 22:18:06.023012 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 22:18:06.024067 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writing DB stats cinder:UPDATE=3,cinder:SELECT=6 {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 22:18:08.781486 ncdv-master-1 cinder-backup[123790]: DEBUG oslo_service.periodic_task [None req-d82f921b-aced-4971-81d0-f3b75344497b None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=123790) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Jun 18 22:18:08.782074 ncdv-master-1 cinder-backup[123790]: DEBUG cinder.manager [None req-d82f921b-aced-4971-81d0-f3b75344497b None None] Notifying Schedulers of capabilities ... {{(pid=123790) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jun 18 22:18:26.019378 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writing DB stats cinder:SELECT=2 {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 22:18:36.033625 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writing DB stats cinder:SELECT=5,cinder:UPDATE=2 {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 22:18:46.050710 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writing DB stats cinder:SELECT=4,cinder:UPDATE=2 {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 22:19:08.781752 ncdv-master-1 cinder-backup[123790]: DEBUG oslo_service.periodic_task [None req-d82f921b-aced-4971-81d0-f3b75344497b None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=123790) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Jun 18 22:19:08.782466 ncdv-master-1 cinder-backup[123790]: DEBUG cinder.manager [None req-d82f921b-aced-4971-81d0-f3b75344497b None None] Notifying Schedulers of capabilities ... {{(pid=123790) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jun 18 22:19:16.023504 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 22:19:26.013943 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writing DB stats cinder:SELECT=5,cinder:UPDATE=3 {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 22:19:46.042677 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writing DB stats cinder:SELECT=2 {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 22:19:46.043812 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writing DB stats cinder:SELECT=4,cinder:UPDATE=2 {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 22:20:08.781591 ncdv-master-1 cinder-backup[123790]: DEBUG oslo_service.periodic_task [None req-d82f921b-aced-4971-81d0-f3b75344497b None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=123790) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Jun 18 22:20:08.782207 ncdv-master-1 cinder-backup[123790]: DEBUG cinder.manager [None req-d82f921b-aced-4971-81d0-f3b75344497b None None] Notifying Schedulers of capabilities ... {{(pid=123790) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jun 18 22:20:26.020506 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 22:20:26.021650 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writing DB stats cinder:SELECT=7,cinder:UPDATE=3 {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 22:20:56.036343 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 22:20:56.037109 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writing DB stats cinder:SELECT=3,cinder:UPDATE=2 {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 22:21:08.786771 ncdv-master-1 cinder-backup[123790]: DEBUG oslo_service.periodic_task [None req-d82f921b-aced-4971-81d0-f3b75344497b None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=123790) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Jun 18 22:21:08.787424 ncdv-master-1 cinder-backup[123790]: DEBUG cinder.manager [None req-d82f921b-aced-4971-81d0-f3b75344497b None None] Notifying Schedulers of capabilities ... {{(pid=123790) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jun 18 22:21:26.049265 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writing DB stats cinder:SELECT=8,cinder:UPDATE=2 {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 22:21:46.049310 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writing DB stats cinder:SELECT=2 {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 22:21:46.050728 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writing DB stats cinder:SELECT=6,cinder:UPDATE=3 {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 22:22:06.053009 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writing DB stats cinder:SELECT=2 {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 22:22:08.784088 ncdv-master-1 cinder-backup[123790]: DEBUG oslo_service.periodic_task [None req-d82f921b-aced-4971-81d0-f3b75344497b None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=123790) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Jun 18 22:22:08.784678 ncdv-master-1 cinder-backup[123790]: DEBUG cinder.manager [None req-d82f921b-aced-4971-81d0-f3b75344497b None None] Notifying Schedulers of capabilities ... {{(pid=123790) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jun 18 22:22:26.047778 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writing DB stats cinder:SELECT=7,cinder:UPDATE=2 {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 22:22:46.047145 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writing DB stats cinder:SELECT=8,cinder:UPDATE=4 {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 22:23:06.049218 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writing DB stats cinder:SELECT=7,cinder:UPDATE=2 {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 22:23:08.780227 ncdv-master-1 cinder-backup[123790]: DEBUG oslo_service.periodic_task [None req-d82f921b-aced-4971-81d0-f3b75344497b None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=123790) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Jun 18 22:23:08.780970 ncdv-master-1 cinder-backup[123790]: DEBUG cinder.manager [None req-d82f921b-aced-4971-81d0-f3b75344497b None None] Notifying Schedulers of capabilities ... {{(pid=123790) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jun 18 22:23:26.058944 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 22:23:36.054176 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writing DB stats cinder:SELECT=8,cinder:UPDATE=2 {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 22:23:56.062953 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 22:24:05.515955 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writing DB stats cinder:SELECT=8,cinder:UPDATE=2 {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 22:24:05.527376 ncdv-master-1 cinder-backup[123790]: INFO cinder.backup.manager [None req-fdd0bf00-0c80-46cd-944c-5744cf7d21c3 tempest-TestVolumeBackupRestore-341744755 None] Create backup started, backup: a3698ae7-44c1-4a7d-b2c7-d321fb04718a volume: 8dabb3c4-c9ba-4817-af56-8a86d1572234.
Jun 18 22:24:05.559154 ncdv-master-1 cinder-backup[123790]: INFO cinder.backup.manager [None req-fdd0bf00-0c80-46cd-944c-5744cf7d21c3 tempest-TestVolumeBackupRestore-341744755 None] Call Volume Manager to get_backup_device for Backup(availability_zone=None,container=None,created_at=2022-06-18T22:24:04Z,data_timestamp=2022-06-18T22:24:04Z,deleted=False,deleted_at=None,display_description=None,display_name=None,encryption_key_id=None,fail_reason=None,host='ncdv-master-1',id=a3698ae7-44c1-4a7d-b2c7-d321fb04718a,metadata={},num_dependent_backups=0,object_count=0,parent=None,parent_id=None,project_id='106e2aa0adfd40da9a2d689f3b4653db',restore_volume_id=None,service='cinder.backup.drivers.ceph.CephBackupDriver',service_metadata=None,size=1,snapshot_id=None,status='creating',temp_snapshot_id=None,temp_volume_id=None,updated_at=None,user_id='01ecbaf0e5004723bd6a96296ea135d8',volume_id=8dabb3c4-c9ba-4817-af56-8a86d1572234)
Jun 18 22:24:05.727378 ncdv-master-1 cinder-backup[123790]: DEBUG os_brick.utils [None req-fdd0bf00-0c80-46cd-944c-5744cf7d21c3 tempest-TestVolumeBackupRestore-341744755 None] ==> get_connector_properties: call "{'root_helper': 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf', 'my_ip': '10.222.0.30', 'multipath': False, 'enforce_multipath': False, 'host': None, 'execute': None}" {{(pid=123790) trace_logging_wrapper /usr/local/lib/python3.8/dist-packages/os_brick/utils.py:167}}
Jun 18 22:24:05.761371 ncdv-master-1 cinder-backup[123790]: INFO oslo.privsep.daemon [None req-fdd0bf00-0c80-46cd-944c-5744cf7d21c3 tempest-TestVolumeBackupRestore-341744755 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'os_brick.privileged.default', '--privsep_sock_path', '/tmp/tmpx5tpe0ak/privsep.sock']
Jun 18 22:24:05.902858 ncdv-master-1 sudo[161730]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context os_brick.privileged.default --privsep_sock_path /tmp/tmpx5tpe0ak/privsep.sock
Jun 18 22:24:05.904670 ncdv-master-1 sudo[161730]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jun 18 22:24:06.070482 ncdv-master-1 cinder-backup[123790]: DEBUG oslo_db.sqlalchemy.engines [None req-e84d75e5-5441-4d43-964b-5b6d3790e0a5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123790) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}}
Jun 18 22:24:08.778046 ncdv-master-1 cinder-backup[123790]: DEBUG oslo_service.periodic_task [None req-d82f921b-aced-4971-81d0-f3b75344497b None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=123790) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Jun 18 22:24:08.778689 ncdv-master-1 cinder-backup[123790]: DEBUG cinder.manager [None req-d82f921b-aced-4971-81d0-f3b75344497b None None] Notifying Schedulers of capabilities ... {{(pid=123790) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jun 18 22:24:14.128101 ncdv-master-1 sudo[161730]: pam_unix(sudo:session): session closed for user root
Jun 18 22:24:14.134217 ncdv-master-1 cinder-backup[123790]: INFO oslo.privsep.daemon [None req-fdd0bf00-0c80-46cd-944c-5744cf7d21c3 tempest-TestVolumeBackupRestore-341744755 None] Spawned new privsep daemon via rootwrap
Jun 18 22:24:14.140359 ncdv-master-1 cinder-backup[123790]: DEBUG oslo.privsep.daemon [None req-fdd0bf00-0c80-46cd-944c-5744cf7d21c3 tempest-TestVolumeBackupRestore-341744755 None] Accepted privsep connection to /tmp/tmpx5tpe0ak/privsep.sock {{(pid=123790) __init__ /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:362}}
Jun 18 22:24:14.143736 ncdv-master-1 cinder-backup[123790]: INFO oslo.privsep.daemon [-] privsep daemon starting
Jun 18 22:24:14.144191 ncdv-master-1 cinder-backup[123790]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Jun 18 22:24:14.144597 ncdv-master-1 cinder-backup[123790]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_SYS_ADMIN/CAP_SYS_ADMIN/none
Jun 18 22:24:14.145282 ncdv-master-1 cinder-backup[123790]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 161870
Jun 18 22:24:14.156060 ncdv-master-1 cinder-backup[123790]: DEBUG oslo.privsep.daemon [-] privsep: reply[3660f514-c4cb-49a1-a0ad-8557585d6a27]: (2,) {{(pid=161870) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}}
Jun 18 22:24:14.453558 ncdv-master-1 cinder-backup[123790]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=161870) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Jun 18 22:24:14.488635 ncdv-master-1 cinder-backup[123790]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.035s {{(pid=161870) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Jun 18 22:24:14.489199 ncdv-master-1 cinder-backup[123790]: DEBUG oslo.privsep.daemon [-] privsep: reply[56134f5f-a561-48a9-b491-63955f06de14]: (4, ('## DO NOT EDIT OR REMOVE THIS FILE!\n## If you remove this file, the iSCSI daemon will not start.\n## If you change the InitiatorName, existing access control lists\n## may reject this initiator.  The InitiatorName must be unique\n## for each iSCSI initiator.  Do NOT duplicate iSCSI InitiatorNames.\nInitiatorName=iqn.1993-08.org.debian:01:f965e8976dfc\n', '')) {{(pid=161870) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}}
Jun 18 22:24:14.493016 ncdv-master-1 cinder-backup[123790]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): systool -c fc_host -v {{(pid=161870) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Jun 18 22:24:14.512613 ncdv-master-1 cinder-backup[123790]: DEBUG oslo_concurrency.processutils [-] 'systool -c fc_host -v' failed. Not Retrying. {{(pid=161870) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:473}}
Jun 18 22:24:14.544209 ncdv-master-1 cinder-backup[123790]: DEBUG oslo.privsep.daemon [-] privsep: Exception during request[35832fa9-4bb6-4476-b38c-807b0edfd95c]: [Errno 2] No such file or directory: 'systool' {{(pid=161870) _process_cmd /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:479}}
Jun 18 22:24:14.544209 ncdv-master-1 cinder-backup[123790]: Traceback (most recent call last):
Jun 18 22:24:14.544209 ncdv-master-1 cinder-backup[123790]:   File "/usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py", line 476, in _process_cmd
Jun 18 22:24:14.544209 ncdv-master-1 cinder-backup[123790]:     ret = func(*f_args, **f_kwargs)
Jun 18 22:24:14.544209 ncdv-master-1 cinder-backup[123790]:   File "/usr/local/lib/python3.8/dist-packages/oslo_privsep/priv_context.py", line 274, in _wrap
Jun 18 22:24:14.544209 ncdv-master-1 cinder-backup[123790]:     return func(*args, **kwargs)
Jun 18 22:24:14.544209 ncdv-master-1 cinder-backup[123790]:   File "/usr/local/lib/python3.8/dist-packages/os_brick/privileged/rootwrap.py", line 197, in execute_root
Jun 18 22:24:14.544209 ncdv-master-1 cinder-backup[123790]:     return custom_execute(*cmd, shell=False, run_as_root=False, **kwargs)
Jun 18 22:24:14.544209 ncdv-master-1 cinder-backup[123790]:   File "/usr/local/lib/python3.8/dist-packages/os_brick/privileged/rootwrap.py", line 145, in custom_execute
Jun 18 22:24:14.544209 ncdv-master-1 cinder-backup[123790]:     return putils.execute(on_execute=on_execute,
Jun 18 22:24:14.544209 ncdv-master-1 cinder-backup[123790]:   File "/usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py", line 395, in execute
Jun 18 22:24:14.544209 ncdv-master-1 cinder-backup[123790]:     obj = subprocess.Popen(cmd,
Jun 18 22:24:14.544209 ncdv-master-1 cinder-backup[123790]:   File "/usr/lib/python3.8/subprocess.py", line 858, in __init__
Jun 18 22:24:14.544209 ncdv-master-1 cinder-backup[123790]:     self._execute_child(args, executable, preexec_fn, close_fds,
Jun 18 22:24:14.544209 ncdv-master-1 cinder-backup[123790]:   File "/usr/lib/python3.8/subprocess.py", line 1704, in _execute_child
Jun 18 22:24:14.544209 ncdv-master-1 cinder-backup[123790]:     raise child_exception_type(errno_num, err_msg, err_filename)
Jun 18 22:24:14.544209 ncdv-master-1 cinder-backup[123790]: FileNotFoundError: [Errno 2] No such file or directory: 'systool'
Jun 18 22:24:14.545739 ncdv-master-1 cinder-backup[123790]: DEBUG oslo.privsep.daemon [-] privsep: reply[35832fa9-4bb6-4476-b38c-807b0edfd95c]: (5, 'builtins.FileNotFoundError', (2, 'No such file or directory')) {{(pid=161870) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}}
Jun 18 22:24:14.548424 ncdv-master-1 cinder-backup[123790]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): systool -c fc_host -v {{(pid=161870) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Jun 18 22:24:14.563314 ncdv-master-1 cinder-backup[123790]: DEBUG oslo_concurrency.processutils [-] 'systool -c fc_host -v' failed. Not Retrying. {{(pid=161870) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:473}}
Jun 18 22:24:14.565253 ncdv-master-1 cinder-backup[123790]: DEBUG oslo.privsep.daemon [-] privsep: Exception during request[990b2a4f-828c-40c2-b7dc-1e9b615eb31d]: [Errno 2] No such file or directory: 'systool' {{(pid=161870) _process_cmd /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:479}}
Jun 18 22:24:14.565253 ncdv-master-1 cinder-backup[123790]: Traceback (most recent call last):
Jun 18 22:24:14.565253 ncdv-master-1 cinder-backup[123790]:   File "/usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py", line 476, in _process_cmd
Jun 18 22:24:14.565253 ncdv-master-1 cinder-backup[123790]:     ret = func(*f_args, **f_kwargs)
Jun 18 22:24:14.565253 ncdv-master-1 cinder-backup[123790]:   File "/usr/local/lib/python3.8/dist-packages/oslo_privsep/priv_context.py", line 274, in _wrap
Jun 18 22:24:14.565253 ncdv-master-1 cinder-backup[123790]:     return func(*args, **kwargs)
Jun 18 22:24:14.565253 ncdv-master-1 cinder-backup[123790]:   File "/usr/local/lib/python3.8/dist-packages/os_brick/privileged/rootwrap.py", line 197, in execute_root
Jun 18 22:24:14.565253 ncdv-master-1 cinder-backup[123790]:     return custom_execute(*cmd, shell=False, run_as_root=False, **kwargs)
Jun 18 22:24:14.565253 ncdv-master-1 cinder-backup[123790]:   File "/usr/local/lib/python3.8/dist-packages/os_brick/privileged/rootwrap.py", line 145, in custom_execute
Jun 18 22:24:14.565253 ncdv-master-1 cinder-backup[123790]:     return putils.execute(on_execute=on_execute,
Jun 18 22:24:14.565253 ncdv-master-1 cinder-backup[123790]:   File "/usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py", line 395, in execute
Jun 18 22:24:14.565253 ncdv-master-1 cinder-backup[123790]:     obj = subprocess.Popen(cmd,
Jun 18 22:24:14.565253 ncdv-master-1 cinder-backup[123790]:   File "/usr/lib/python3.8/subprocess.py", line 858, in __init__
Jun 18 22:24:14.565253 ncdv-master-1 cinder-backup[123790]:     self._execute_child(args, executable, preexec_fn, close_fds,
Jun 18 22:24:14.565253 ncdv-master-1 cinder-backup[123790]:   File "/usr/lib/python3.8/subprocess.py", line 1704, in _execute_child
Jun 18 22:24:14.565253 ncdv-master-1 cinder-backup[123790]:     raise child_exception_type(errno_num, err_msg, err_filename)
Jun 18 22:24:14.565253 ncdv-master-1 cinder-backup[123790]: FileNotFoundError: [Errno 2] No such file or directory: 'systool'
Jun 18 22:24:14.567394 ncdv-master-1 cinder-backup[123790]: DEBUG oslo.privsep.daemon [-] privsep: reply[990b2a4f-828c-40c2-b7dc-1e9b615eb31d]: (5, 'builtins.FileNotFoundError', (2, 'No such file or directory')) {{(pid=161870) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}}
Jun 18 22:24:14.574538 ncdv-master-1 cinder-backup[123790]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=161870) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Jun 18 22:24:14.617690 ncdv-master-1 cinder-backup[123790]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.044s {{(pid=161870) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Jun 18 22:24:14.618050 ncdv-master-1 cinder-backup[123790]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ec91ac5-7677-49b2-a9e8-3fecf936f7d0]: (4, ('/dev/sda1\n', '')) {{(pid=161870) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}}
Jun 18 22:24:14.620807 ncdv-master-1 cinder-backup[123790]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/sda1 -s UUID -o value {{(pid=161870) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Jun 18 22:24:14.698582 ncdv-master-1 cinder-backup[123790]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/sda1 -s UUID -o value" returned: 0 in 0.078s {{(pid=161870) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Jun 18 22:24:14.699620 ncdv-master-1 cinder-backup[123790]: DEBUG oslo.privsep.daemon [-] privsep: reply[52b75e06-a06f-4ee6-90f4-46d6d322ae2b]: (4, ('02bb033c-a191-40c0-94fb-bb025c724b13\n', '')) {{(pid=161870) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}}
Jun 18 22:24:14.706069 ncdv-master-1 cinder-backup[123790]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /sys/class/dmi/id/product_uuid {{(pid=161870) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Jun 18 22:24:14.738539 ncdv-master-1 cinder-backup[123790]: DEBUG oslo_concurrency.processutils [-] CMD "cat /sys/class/dmi/id/product_uuid" returned: 0 in 0.036s {{(pid=161870) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Jun 18 22:24:14.739606 ncdv-master-1 cinder-backup[123790]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d80e0bf-e04d-41e9-a71c-303041e33822]: (4, ('cdfe4be3-957b-ec4d-8b08-ab749503be55\n', '')) {{(pid=161870) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}}
Jun 18 22:24:14.740885 ncdv-master-1 cinder-backup[123790]: DEBUG oslo_concurrency.processutils [None req-fdd0bf00-0c80-46cd-944c-5744cf7d21c3 tempest-TestVolumeBackupRestore-341744755 None] Running cmd (subprocess): nvme version {{(pid=123790) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Jun 18 22:24:14.814027 ncdv-master-1 cinder-backup[123790]: DEBUG oslo_concurrency.processutils [None req-fdd0bf00-0c80-46cd-944c-5744cf7d21c3 tempest-TestVolumeBackupRestore-341744755 None] CMD "nvme version" returned: 0 in 0.073s {{(pid=123790) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Jun 18 22:24:14.854209 ncdv-master-1 cinder-backup[123790]: DEBUG os_brick.initiator.connectors.lightos [None req-fdd0bf00-0c80-46cd-944c-5744cf7d21c3 tempest-TestVolumeBackupRestore-341744755 None] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=123790) find_dsc /usr/local/lib/python3.8/dist-packages/os_brick/initiator/connectors/lightos.py:100}}
Jun 18 22:24:14.855223 ncdv-master-1 cinder-backup[123790]: DEBUG os_brick.initiator.connectors.lightos [None req-fdd0bf00-0c80-46cd-944c-5744cf7d21c3 tempest-TestVolumeBackupRestore-341744755 None] LIGHTOS: did not find dsc, continuing anyway. {{(pid=123790) get_connector_properties /usr/local/lib/python3.8/dist-packages/os_brick/initiator/connectors/lightos.py:78}}
Jun 18 22:24:14.855826 ncdv-master-1 cinder-backup[123790]: DEBUG os_brick.initiator.connectors.lightos [None req-fdd0bf00-0c80-46cd-944c-5744cf7d21c3 tempest-TestVolumeBackupRestore-341744755 None] LIGHTOS: finally hostnqn: nqn.2014-08.org.nvmexpress:uuid:84627872-5390-4220-b960-ed5945b5c24c dsc:  {{(pid=123790) get_connector_properties /usr/local/lib/python3.8/dist-packages/os_brick/initiator/connectors/lightos.py:81}}
Jun 18 22:24:14.857285 ncdv-master-1 cinder-backup[123790]: DEBUG os_brick.utils [None req-fdd0bf00-0c80-46cd-944c-5744cf7d21c3 tempest-TestVolumeBackupRestore-341744755 None] <== get_connector_properties: return (9128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.222.0.30', 'host': 'ncdv-master-1', 'multipath': False, 'initiator': 'iqn.1993-08.org.debian:01:f965e8976dfc', 'do_local_attach': False, 'uuid': '02bb033c-a191-40c0-94fb-bb025c724b13', 'system uuid': 'cdfe4be3-957b-ec4d-8b08-ab749503be55', 'nqn': 'nqn.2014-08.org.nvmexpress:uuid:84627872-5390-4220-b960-ed5945b5c24c', 'found_dsc': ''} {{(pid=123790) trace_logging_wrapper /usr/local/lib/python3.8/dist-packages/os_brick/utils.py:194}}
Jun 18 22:24:15.894230 ncdv-master-1 cinder-backup[123790]: DEBUG os_brick.initiator.connector [None req-fdd0bf00-0c80-46cd-944c-5744cf7d21c3 tempest-TestVolumeBackupRestore-341744755 None] Factory for rbd on None {{(pid=123790) factory /usr/local/lib/python3.8/dist-packages/os_brick/initiator/connector.py:284}}
Jun 18 22:24:15.896919 ncdv-master-1 cinder-backup[123790]: DEBUG os_brick.initiator.connectors.rbd [None req-fdd0bf00-0c80-46cd-944c-5744cf7d21c3 tempest-TestVolumeBackupRestore-341744755 None] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.rbd.RBDConnector object at 0x7fa8a838b1c0>, 'connection_properties': {'name': 'volumes/volume-8dabb3c4-c9ba-4817-af56-8a86d1572234', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '***', 'volume_id': '8dabb3c4-c9ba-4817-af56-8a86d1572234', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, ': False}}" {{(pid=123790) trace_logging_wrapper /usr/local/lib/python3.8/dist-packages/os_brick/utils.py:167}}
Jun 18 22:24:15.898148 ncdv-master-1 cinder-backup[123790]: DEBUG os_brick.initiator.linuxrbd [None req-fdd0bf00-0c80-46cd-944c-5744cf7d21c3 tempest-TestVolumeBackupRestore-341744755 None] opening connection to ceph cluster (timeout=-1). {{(pid=123790) connect /usr/local/lib/python3.8/dist-packages/os_brick/initiator/linuxrbd.py:70}}
Jun 18 22:24:16.017654 ncdv-master-1 cinder-backup[123790]: DEBUG os_brick.initiator.connectors.rbd [None req-fdd0bf00-0c80-46cd-944c-5744cf7d21c3 tempest-TestVolumeBackupRestore-341744755 None] <== connect_volume: return (119ms) {'path': <os_brick.initiator.linuxrbd.RBDVolumeIOWrapper object at 0x7fa8a819c820>} {{(pid=123790) trace_logging_wrapper /usr/local/lib/python3.8/dist-packages/os_brick/utils.py:194}}
Jun 18 22:24:16.066533 ncdv-master-1 cinder-backup[123790]: DEBUG cinder.backup.drivers.ceph [None req-fdd0bf00-0c80-46cd-944c-5744cf7d21c3 tempest-TestVolumeBackupRestore-341744755 None] Starting backup of volume='8dabb3c4-c9ba-4817-af56-8a86d1572234'. {{(pid=123790) backup /opt/stack/cinder/cinder/backup/drivers/ceph.py:1024}}
Jun 18 22:24:16.068073 ncdv-master-1 cinder-backup[123790]: DEBUG cinder.backup.drivers.ceph [None req-fdd0bf00-0c80-46cd-944c-5744cf7d21c3 tempest-TestVolumeBackupRestore-341744755 None] Volume file is RBD: attempting optimized backup {{(pid=123790) backup /opt/stack/cinder/cinder/backup/drivers/ceph.py:1035}}
Jun 18 22:24:16.142003 ncdv-master-1 cinder-backup[123790]: DEBUG cinder.backup.drivers.ceph [None req-fdd0bf00-0c80-46cd-944c-5744cf7d21c3 tempest-TestVolumeBackupRestore-341744755 None] Creating base image 'volume-8dabb3c4-c9ba-4817-af56-8a86d1572234.backup.a3698ae7-44c1-4a7d-b2c7-d321fb04718a' {{(pid=123790) _create_base_image /opt/stack/cinder/cinder/backup/drivers/ceph.py:467}}
Jun 18 22:24:16.142941 ncdv-master-1 cinder-backup[123790]: DEBUG cinder.backup.drivers.ceph [None req-fdd0bf00-0c80-46cd-944c-5744cf7d21c3 tempest-TestVolumeBackupRestore-341744755 None] RBD also supports fast-diff, enabling it together with exclusive-lock and object-map {{(pid=123790) _get_rbd_support /opt/stack/cinder/cinder/backup/drivers/ceph.py:277}}
Jun 18 22:24:17.940416 ncdv-master-1 cinder-backup[123790]: DEBUG cinder.backup.drivers.ceph [None req-fdd0bf00-0c80-46cd-944c-5744cf7d21c3 tempest-TestVolumeBackupRestore-341744755 None] Using --from-snap 'None' for incremental backup of volume 8dabb3c4-c9ba-4817-af56-8a86d1572234. {{(pid=123790) _backup_rbd /opt/stack/cinder/cinder/backup/drivers/ceph.py:808}}
Jun 18 22:24:17.941562 ncdv-master-1 cinder-backup[123790]: DEBUG cinder.backup.drivers.ceph [None req-fdd0bf00-0c80-46cd-944c-5744cf7d21c3 tempest-TestVolumeBackupRestore-341744755 None] Creating backup snapshot='backup.a3698ae7-44c1-4a7d-b2c7-d321fb04718a.snap.1655591057.9411347' {{(pid=123790) _backup_rbd /opt/stack/cinder/cinder/backup/drivers/ceph.py:814}}
Jun 18 22:24:18.968167 ncdv-master-1 cinder-backup[123790]: DEBUG cinder.backup.drivers.ceph [None req-fdd0bf00-0c80-46cd-944c-5744cf7d21c3 tempest-TestVolumeBackupRestore-341744755 None] Performing differential transfer from 'volume-8dabb3c4-c9ba-4817-af56-8a86d1572234' to 'volume-8dabb3c4-c9ba-4817-af56-8a86d1572234.backup.a3698ae7-44c1-4a7d-b2c7-d321fb04718a' {{(pid=123790) _rbd_diff_transfer /opt/stack/cinder/cinder/backup/drivers/ceph.py:656}}
Jun 18 22:24:18.970074 ncdv-master-1 cinder-backup[123790]: DEBUG cinder.backup.drivers.ceph [None req-fdd0bf00-0c80-46cd-944c-5744cf7d21c3 tempest-TestVolumeBackupRestore-341744755 None] Piping cmd1='rbd export-diff --id cinder --conf /tmp/brickrbd_awffrsce --pool volumes volumes/volume-8dabb3c4-c9ba-4817-af56-8a86d1572234@backup.a3698ae7-44c1-4a7d-b2c7-d321fb04718a.snap.1655591057.9411347 -' into... {{(pid=123790) _piped_execute /opt/stack/cinder/cinder/backup/drivers/ceph.py:613}}
Jun 18 22:24:18.970638 ncdv-master-1 cinder-backup[123790]: DEBUG cinder.backup.drivers.ceph [None req-fdd0bf00-0c80-46cd-944c-5744cf7d21c3 tempest-TestVolumeBackupRestore-341744755 None] cmd2='rbd import-diff --id cinder-bak --conf /etc/ceph/ceph.conf --pool backups - backups/volume-8dabb3c4-c9ba-4817-af56-8a86d1572234.backup.a3698ae7-44c1-4a7d-b2c7-d321fb04718a' {{(pid=123790) _piped_execute /opt/stack/cinder/cinder/backup/drivers/ceph.py:614}}
Jun 18 22:24:26.070600 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writing DB stats cinder:SELECT=7,cinder:UPDATE=2 {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 22:24:28.515738 ncdv-master-1 cinder-backup[123790]: DEBUG cinder.backup.drivers.ceph [None req-fdd0bf00-0c80-46cd-944c-5744cf7d21c3 tempest-TestVolumeBackupRestore-341744755 None] Differential backup transfer completed in 9.5475s {{(pid=123790) _backup_rbd /opt/stack/cinder/cinder/backup/drivers/ceph.py:834}}
Jun 18 22:24:28.516352 ncdv-master-1 cinder-backup[123790]: DEBUG cinder.backup.driver [None req-fdd0bf00-0c80-46cd-944c-5744cf7d21c3 tempest-TestVolumeBackupRestore-341744755 None] Getting metadata type 'volume-base-metadata' {{(pid=123790) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:79}}
Jun 18 22:24:28.537138 ncdv-master-1 cinder-backup[123790]: DEBUG cinder.backup.driver [None req-fdd0bf00-0c80-46cd-944c-5744cf7d21c3 tempest-TestVolumeBackupRestore-341744755 None] Completed fetching metadata type 'volume-base-metadata' {{(pid=123790) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:98}}
Jun 18 22:24:28.537539 ncdv-master-1 cinder-backup[123790]: DEBUG cinder.backup.driver [None req-fdd0bf00-0c80-46cd-944c-5744cf7d21c3 tempest-TestVolumeBackupRestore-341744755 None] Getting metadata type 'volume-metadata' {{(pid=123790) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:109}}
Jun 18 22:24:28.550325 ncdv-master-1 cinder-backup[123790]: DEBUG cinder.backup.driver [None req-fdd0bf00-0c80-46cd-944c-5744cf7d21c3 tempest-TestVolumeBackupRestore-341744755 None] No metadata type 'volume-metadata' available {{(pid=123790) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:123}}
Jun 18 22:24:28.550699 ncdv-master-1 cinder-backup[123790]: DEBUG cinder.backup.driver [None req-fdd0bf00-0c80-46cd-944c-5744cf7d21c3 tempest-TestVolumeBackupRestore-341744755 None] Getting metadata type 'volume-glance-metadata' {{(pid=123790) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:132}}
Jun 18 22:24:28.567332 ncdv-master-1 cinder-backup[123790]: DEBUG cinder.backup.driver [None req-fdd0bf00-0c80-46cd-944c-5744cf7d21c3 tempest-TestVolumeBackupRestore-341744755 None] Completed fetching metadata type 'volume-glance-metadata' {{(pid=123790) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:145}}
Jun 18 22:24:28.567915 ncdv-master-1 cinder-backup[123790]: DEBUG cinder.backup.drivers.ceph [None req-fdd0bf00-0c80-46cd-944c-5744cf7d21c3 tempest-TestVolumeBackupRestore-341744755 None] Backing up metadata for volume 8dabb3c4-c9ba-4817-af56-8a86d1572234. {{(pid=123790) _backup_metadata /opt/stack/cinder/cinder/backup/drivers/ceph.py:999}}
Jun 18 22:24:28.652124 ncdv-master-1 cinder-backup[123790]: DEBUG cinder.backup.drivers.ceph [None req-fdd0bf00-0c80-46cd-944c-5744cf7d21c3 tempest-TestVolumeBackupRestore-341744755 None] Backup 'a3698ae7-44c1-4a7d-b2c7-d321fb04718a' of volume 8dabb3c4-c9ba-4817-af56-8a86d1572234 finished. {{(pid=123790) backup /opt/stack/cinder/cinder/backup/drivers/ceph.py:1065}}
Jun 18 22:24:28.654682 ncdv-master-1 cinder-backup[123790]: DEBUG os_brick.initiator.connectors.rbd [None req-fdd0bf00-0c80-46cd-944c-5744cf7d21c3 tempest-TestVolumeBackupRestore-341744755 None] ==> disconnect_volume: call "{'self': <os_brick.initiator.connectors.rbd.RBDConnector object at 0x7fa8a838b1c0>, 'connection_properties': {'name': 'volumes/volume-8dabb3c4-c9ba-4817-af56-8a86d1572234', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '***', 'volume_id': '8dabb3c4-c9ba-4817-af56-8a86d1572234', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'device_info': {'path': <os_brick.initiator.linuxrbd.RBDVolumeIOWrapper object at 0x7fa8a819c820>}, 'force': True, ': True}" {{(pid=123790) trace_logging_wrapper /usr/local/lib/python3.8/dist-packages/os_brick/utils.py:167}}
Jun 18 22:24:28.689732 ncdv-master-1 cinder-backup[123790]: DEBUG os_brick.initiator.connectors.rbd [None req-fdd0bf00-0c80-46cd-944c-5744cf7d21c3 tempest-TestVolumeBackupRestore-341744755 None] <== disconnect_volume: return (34ms) None {{(pid=123790) trace_logging_wrapper /usr/local/lib/python3.8/dist-packages/os_brick/utils.py:194}}
Jun 18 22:24:28.998773 ncdv-master-1 cinder-backup[123790]: INFO cinder.backup.manager [None req-fdd0bf00-0c80-46cd-944c-5744cf7d21c3 tempest-TestVolumeBackupRestore-341744755 None] Create backup finished. backup: a3698ae7-44c1-4a7d-b2c7-d321fb04718a.
Jun 18 22:24:30.938543 ncdv-master-1 cinder-backup[123790]: INFO cinder.backup.manager [None req-94d93596-d7fd-42bc-9754-370529b0eae3 tempest-TestVolumeBackupRestore-341744755 None] Restore backup started, backup: a3698ae7-44c1-4a7d-b2c7-d321fb04718a volume: 03029fa6-9d19-40c2-951e-e96cf9fbc135.
Jun 18 22:24:31.000457 ncdv-master-1 cinder-backup[123790]: DEBUG os_brick.utils [None req-94d93596-d7fd-42bc-9754-370529b0eae3 tempest-TestVolumeBackupRestore-341744755 None] ==> get_connector_properties: call "{'root_helper': 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf', 'my_ip': '10.222.0.30', 'multipath': False, 'enforce_multipath': False, 'host': None, 'execute': None}" {{(pid=123790) trace_logging_wrapper /usr/local/lib/python3.8/dist-packages/os_brick/utils.py:167}}
Jun 18 22:24:31.002836 ncdv-master-1 cinder-backup[123790]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=161870) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Jun 18 22:24:31.051442 ncdv-master-1 cinder-backup[123790]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.047s {{(pid=161870) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Jun 18 22:24:31.051914 ncdv-master-1 cinder-backup[123790]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef623923-b76a-480d-981b-97029eba93ac]: (4, ('## DO NOT EDIT OR REMOVE THIS FILE!\n## If you remove this file, the iSCSI daemon will not start.\n## If you change the InitiatorName, existing access control lists\n## may reject this initiator.  The InitiatorName must be unique\n## for each iSCSI initiator.  Do NOT duplicate iSCSI InitiatorNames.\nInitiatorName=iqn.1993-08.org.debian:01:f965e8976dfc\n', '')) {{(pid=161870) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}}
Jun 18 22:24:31.056509 ncdv-master-1 cinder-backup[123790]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): systool -c fc_host -v {{(pid=161870) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Jun 18 22:24:31.068035 ncdv-master-1 cinder-backup[123790]: DEBUG oslo_concurrency.processutils [-] 'systool -c fc_host -v' failed. Not Retrying. {{(pid=161870) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:473}}
Jun 18 22:24:31.070299 ncdv-master-1 cinder-backup[123790]: DEBUG oslo.privsep.daemon [-] privsep: Exception during request[88f84748-10fd-4e57-ba3f-e113a670755d]: [Errno 2] No such file or directory: 'systool' {{(pid=161870) _process_cmd /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:479}}
Jun 18 22:24:31.070299 ncdv-master-1 cinder-backup[123790]: Traceback (most recent call last):
Jun 18 22:24:31.070299 ncdv-master-1 cinder-backup[123790]:   File "/usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py", line 476, in _process_cmd
Jun 18 22:24:31.070299 ncdv-master-1 cinder-backup[123790]:     ret = func(*f_args, **f_kwargs)
Jun 18 22:24:31.070299 ncdv-master-1 cinder-backup[123790]:   File "/usr/local/lib/python3.8/dist-packages/oslo_privsep/priv_context.py", line 274, in _wrap
Jun 18 22:24:31.070299 ncdv-master-1 cinder-backup[123790]:     return func(*args, **kwargs)
Jun 18 22:24:31.070299 ncdv-master-1 cinder-backup[123790]:   File "/usr/local/lib/python3.8/dist-packages/os_brick/privileged/rootwrap.py", line 197, in execute_root
Jun 18 22:24:31.070299 ncdv-master-1 cinder-backup[123790]:     return custom_execute(*cmd, shell=False, run_as_root=False, **kwargs)
Jun 18 22:24:31.070299 ncdv-master-1 cinder-backup[123790]:   File "/usr/local/lib/python3.8/dist-packages/os_brick/privileged/rootwrap.py", line 145, in custom_execute
Jun 18 22:24:31.070299 ncdv-master-1 cinder-backup[123790]:     return putils.execute(on_execute=on_execute,
Jun 18 22:24:31.070299 ncdv-master-1 cinder-backup[123790]:   File "/usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py", line 395, in execute
Jun 18 22:24:31.070299 ncdv-master-1 cinder-backup[123790]:     obj = subprocess.Popen(cmd,
Jun 18 22:24:31.070299 ncdv-master-1 cinder-backup[123790]:   File "/usr/lib/python3.8/subprocess.py", line 858, in __init__
Jun 18 22:24:31.070299 ncdv-master-1 cinder-backup[123790]:     self._execute_child(args, executable, preexec_fn, close_fds,
Jun 18 22:24:31.070299 ncdv-master-1 cinder-backup[123790]:   File "/usr/lib/python3.8/subprocess.py", line 1704, in _execute_child
Jun 18 22:24:31.070299 ncdv-master-1 cinder-backup[123790]:     raise child_exception_type(errno_num, err_msg, err_filename)
Jun 18 22:24:31.070299 ncdv-master-1 cinder-backup[123790]: FileNotFoundError: [Errno 2] No such file or directory: 'systool'
Jun 18 22:24:31.071724 ncdv-master-1 cinder-backup[123790]: DEBUG oslo.privsep.daemon [-] privsep: reply[88f84748-10fd-4e57-ba3f-e113a670755d]: (5, 'builtins.FileNotFoundError', (2, 'No such file or directory')) {{(pid=161870) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}}
Jun 18 22:24:31.075645 ncdv-master-1 cinder-backup[123790]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): systool -c fc_host -v {{(pid=161870) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Jun 18 22:24:31.090647 ncdv-master-1 cinder-backup[123790]: DEBUG oslo_concurrency.processutils [-] 'systool -c fc_host -v' failed. Not Retrying. {{(pid=161870) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:473}}
Jun 18 22:24:31.091138 ncdv-master-1 cinder-backup[123790]: DEBUG oslo.privsep.daemon [-] privsep: Exception during request[50b5151d-2dcf-4448-bb00-647869754e44]: [Errno 2] No such file or directory: 'systool' {{(pid=161870) _process_cmd /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:479}}
Jun 18 22:24:31.091138 ncdv-master-1 cinder-backup[123790]: Traceback (most recent call last):
Jun 18 22:24:31.091138 ncdv-master-1 cinder-backup[123790]:   File "/usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py", line 476, in _process_cmd
Jun 18 22:24:31.091138 ncdv-master-1 cinder-backup[123790]:     ret = func(*f_args, **f_kwargs)
Jun 18 22:24:31.091138 ncdv-master-1 cinder-backup[123790]:   File "/usr/local/lib/python3.8/dist-packages/oslo_privsep/priv_context.py", line 274, in _wrap
Jun 18 22:24:31.091138 ncdv-master-1 cinder-backup[123790]:     return func(*args, **kwargs)
Jun 18 22:24:31.091138 ncdv-master-1 cinder-backup[123790]:   File "/usr/local/lib/python3.8/dist-packages/os_brick/privileged/rootwrap.py", line 197, in execute_root
Jun 18 22:24:31.091138 ncdv-master-1 cinder-backup[123790]:     return custom_execute(*cmd, shell=False, run_as_root=False, **kwargs)
Jun 18 22:24:31.091138 ncdv-master-1 cinder-backup[123790]:   File "/usr/local/lib/python3.8/dist-packages/os_brick/privileged/rootwrap.py", line 145, in custom_execute
Jun 18 22:24:31.091138 ncdv-master-1 cinder-backup[123790]:     return putils.execute(on_execute=on_execute,
Jun 18 22:24:31.091138 ncdv-master-1 cinder-backup[123790]:   File "/usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py", line 395, in execute
Jun 18 22:24:31.091138 ncdv-master-1 cinder-backup[123790]:     obj = subprocess.Popen(cmd,
Jun 18 22:24:31.091138 ncdv-master-1 cinder-backup[123790]:   File "/usr/lib/python3.8/subprocess.py", line 858, in __init__
Jun 18 22:24:31.091138 ncdv-master-1 cinder-backup[123790]:     self._execute_child(args, executable, preexec_fn, close_fds,
Jun 18 22:24:31.091138 ncdv-master-1 cinder-backup[123790]:   File "/usr/lib/python3.8/subprocess.py", line 1704, in _execute_child
Jun 18 22:24:31.091138 ncdv-master-1 cinder-backup[123790]:     raise child_exception_type(errno_num, err_msg, err_filename)
Jun 18 22:24:31.091138 ncdv-master-1 cinder-backup[123790]: FileNotFoundError: [Errno 2] No such file or directory: 'systool'
Jun 18 22:24:31.092373 ncdv-master-1 cinder-backup[123790]: DEBUG oslo.privsep.daemon [-] privsep: reply[50b5151d-2dcf-4448-bb00-647869754e44]: (5, 'builtins.FileNotFoundError', (2, 'No such file or directory')) {{(pid=161870) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}}
Jun 18 22:24:31.093211 ncdv-master-1 cinder-backup[123790]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=161870) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Jun 18 22:24:31.124471 ncdv-master-1 cinder-backup[123790]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.031s {{(pid=161870) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Jun 18 22:24:31.125809 ncdv-master-1 cinder-backup[123790]: DEBUG oslo.privsep.daemon [-] privsep: reply[f661af7d-7133-4c85-9119-7ecb6707488b]: (4, ('/dev/sda1\n', '')) {{(pid=161870) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}}
Jun 18 22:24:31.129175 ncdv-master-1 cinder-backup[123790]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/sda1 -s UUID -o value {{(pid=161870) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Jun 18 22:24:31.151230 ncdv-master-1 cinder-backup[123790]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/sda1 -s UUID -o value" returned: 0 in 0.021s {{(pid=161870) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Jun 18 22:24:31.152281 ncdv-master-1 cinder-backup[123790]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9363b05-f716-430d-8439-a8cfb3ec70ce]: (4, ('02bb033c-a191-40c0-94fb-bb025c724b13\n', '')) {{(pid=161870) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}}
Jun 18 22:24:31.154308 ncdv-master-1 cinder-backup[123790]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /sys/class/dmi/id/product_uuid {{(pid=161870) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Jun 18 22:24:31.167006 ncdv-master-1 cinder-backup[123790]: DEBUG oslo_concurrency.processutils [-] CMD "cat /sys/class/dmi/id/product_uuid" returned: 0 in 0.012s {{(pid=161870) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Jun 18 22:24:31.167305 ncdv-master-1 cinder-backup[123790]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9ddf0a3-0336-45e0-af3c-9393fd953105]: (4, ('cdfe4be3-957b-ec4d-8b08-ab749503be55\n', '')) {{(pid=161870) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}}
Jun 18 22:24:31.168129 ncdv-master-1 cinder-backup[123790]: DEBUG oslo_concurrency.processutils [None req-94d93596-d7fd-42bc-9754-370529b0eae3 tempest-TestVolumeBackupRestore-341744755 None] Running cmd (subprocess): nvme version {{(pid=123790) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Jun 18 22:24:31.209768 ncdv-master-1 cinder-backup[123790]: DEBUG oslo_concurrency.processutils [None req-94d93596-d7fd-42bc-9754-370529b0eae3 tempest-TestVolumeBackupRestore-341744755 None] CMD "nvme version" returned: 0 in 0.041s {{(pid=123790) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Jun 18 22:24:31.212465 ncdv-master-1 cinder-backup[123790]: DEBUG os_brick.initiator.connectors.lightos [None req-94d93596-d7fd-42bc-9754-370529b0eae3 tempest-TestVolumeBackupRestore-341744755 None] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=123790) find_dsc /usr/local/lib/python3.8/dist-packages/os_brick/initiator/connectors/lightos.py:100}}
Jun 18 22:24:31.213318 ncdv-master-1 cinder-backup[123790]: DEBUG os_brick.initiator.connectors.lightos [None req-94d93596-d7fd-42bc-9754-370529b0eae3 tempest-TestVolumeBackupRestore-341744755 None] LIGHTOS: did not find dsc, continuing anyway. {{(pid=123790) get_connector_properties /usr/local/lib/python3.8/dist-packages/os_brick/initiator/connectors/lightos.py:78}}
Jun 18 22:24:31.214727 ncdv-master-1 cinder-backup[123790]: DEBUG os_brick.initiator.connectors.lightos [None req-94d93596-d7fd-42bc-9754-370529b0eae3 tempest-TestVolumeBackupRestore-341744755 None] LIGHTOS: finally hostnqn: nqn.2014-08.org.nvmexpress:uuid:84627872-5390-4220-b960-ed5945b5c24c dsc:  {{(pid=123790) get_connector_properties /usr/local/lib/python3.8/dist-packages/os_brick/initiator/connectors/lightos.py:81}}
Jun 18 22:24:31.216819 ncdv-master-1 cinder-backup[123790]: DEBUG os_brick.utils [None req-94d93596-d7fd-42bc-9754-370529b0eae3 tempest-TestVolumeBackupRestore-341744755 None] <== get_connector_properties: return (214ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.222.0.30', 'host': 'ncdv-master-1', 'multipath': False, 'initiator': 'iqn.1993-08.org.debian:01:f965e8976dfc', 'do_local_attach': False, 'uuid': '02bb033c-a191-40c0-94fb-bb025c724b13', 'system uuid': 'cdfe4be3-957b-ec4d-8b08-ab749503be55', 'nqn': 'nqn.2014-08.org.nvmexpress:uuid:84627872-5390-4220-b960-ed5945b5c24c', 'found_dsc': ''} {{(pid=123790) trace_logging_wrapper /usr/local/lib/python3.8/dist-packages/os_brick/utils.py:194}}
Jun 18 22:24:32.597502 ncdv-master-1 cinder-backup[123790]: DEBUG os_brick.initiator.connector [None req-94d93596-d7fd-42bc-9754-370529b0eae3 tempest-TestVolumeBackupRestore-341744755 None] Factory for rbd on None {{(pid=123790) factory /usr/local/lib/python3.8/dist-packages/os_brick/initiator/connector.py:284}}
Jun 18 22:24:32.599138 ncdv-master-1 cinder-backup[123790]: DEBUG os_brick.initiator.connectors.rbd [None req-94d93596-d7fd-42bc-9754-370529b0eae3 tempest-TestVolumeBackupRestore-341744755 None] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.rbd.RBDConnector object at 0x7fa8a8199df0>, 'connection_properties': {'name': 'volumes/volume-03029fa6-9d19-40c2-951e-e96cf9fbc135', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '***', 'volume_id': '03029fa6-9d19-40c2-951e-e96cf9fbc135', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, ': False}}" {{(pid=123790) trace_logging_wrapper /usr/local/lib/python3.8/dist-packages/os_brick/utils.py:167}}
Jun 18 22:24:32.600283 ncdv-master-1 cinder-backup[123790]: DEBUG os_brick.initiator.linuxrbd [None req-94d93596-d7fd-42bc-9754-370529b0eae3 tempest-TestVolumeBackupRestore-341744755 None] opening connection to ceph cluster (timeout=-1). {{(pid=123790) connect /usr/local/lib/python3.8/dist-packages/os_brick/initiator/linuxrbd.py:70}}
Jun 18 22:24:32.682793 ncdv-master-1 cinder-backup[123790]: DEBUG os_brick.initiator.connectors.rbd [None req-94d93596-d7fd-42bc-9754-370529b0eae3 tempest-TestVolumeBackupRestore-341744755 None] <== connect_volume: return (82ms) {'path': <os_brick.initiator.linuxrbd.RBDVolumeIOWrapper object at 0x7fa8a8212a30>} {{(pid=123790) trace_logging_wrapper /usr/local/lib/python3.8/dist-packages/os_brick/utils.py:194}}
Jun 18 22:24:32.692427 ncdv-master-1 cinder-backup[123790]: DEBUG oslo_db.sqlalchemy.engines [None req-94d93596-d7fd-42bc-9754-370529b0eae3 tempest-TestVolumeBackupRestore-341744755 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123790) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}}
Jun 18 22:24:32.713302 ncdv-master-1 cinder-backup[123790]: DEBUG cinder.backup.drivers.ceph [None req-94d93596-d7fd-42bc-9754-370529b0eae3 tempest-TestVolumeBackupRestore-341744755 None] Starting restore from Ceph backup=a3698ae7-44c1-4a7d-b2c7-d321fb04718a to volume=volume-03029fa6-9d19-40c2-951e-e96cf9fbc135 {{(pid=123790) restore /opt/stack/cinder/cinder/backup/drivers/ceph.py:1345}}
Jun 18 22:24:32.872119 ncdv-master-1 cinder-backup[123790]: DEBUG cinder.backup.drivers.ceph [None req-94d93596-d7fd-42bc-9754-370529b0eae3 tempest-TestVolumeBackupRestore-341744755 None] Looking for snapshot of backup base 'volume-8dabb3c4-c9ba-4817-af56-8a86d1572234.backup.a3698ae7-44c1-4a7d-b2c7-d321fb04718a' {{(pid=123790) _get_backup_snap_name /opt/stack/cinder/cinder/backup/drivers/ceph.py:953}}
Jun 18 22:24:32.872494 ncdv-master-1 cinder-backup[123790]: DEBUG cinder.backup.drivers.ceph [None req-94d93596-d7fd-42bc-9754-370529b0eae3 tempest-TestVolumeBackupRestore-341744755 None] Found snapshot 'backup.a3698ae7-44c1-4a7d-b2c7-d321fb04718a.snap.1655591057.9411347' {{(pid=123790) _get_backup_snap_name /opt/stack/cinder/cinder/backup/drivers/ceph.py:972}}
Jun 18 22:24:32.909406 ncdv-master-1 cinder-backup[123790]: DEBUG cinder.backup.drivers.ceph [None req-94d93596-d7fd-42bc-9754-370529b0eae3 tempest-TestVolumeBackupRestore-341744755 None] Volume file is RBD. {{(pid=123790) _diff_restore_allowed /opt/stack/cinder/cinder/backup/drivers/ceph.py:1247}}
Jun 18 22:24:32.979137 ncdv-master-1 cinder-backup[123790]: DEBUG cinder.backup.drivers.ceph [None req-94d93596-d7fd-42bc-9754-370529b0eae3 tempest-TestVolumeBackupRestore-341744755 None] Attempting differential restore. {{(pid=123790) _restore_volume /opt/stack/cinder/cinder/backup/drivers/ceph.py:1300}}
Jun 18 22:24:32.979829 ncdv-master-1 cinder-backup[123790]: DEBUG cinder.backup.drivers.ceph [None req-94d93596-d7fd-42bc-9754-370529b0eae3 tempest-TestVolumeBackupRestore-341744755 None] Attempting incremental restore from base='volume-8dabb3c4-c9ba-4817-af56-8a86d1572234.backup.a3698ae7-44c1-4a7d-b2c7-d321fb04718a' snap='backup.a3698ae7-44c1-4a7d-b2c7-d321fb04718a.snap.1655591057.9411347' {{(pid=123790) _diff_restore_rbd /opt/stack/cinder/cinder/backup/drivers/ceph.py:1146}}
Jun 18 22:24:32.980386 ncdv-master-1 cinder-backup[123790]: DEBUG cinder.backup.drivers.ceph [None req-94d93596-d7fd-42bc-9754-370529b0eae3 tempest-TestVolumeBackupRestore-341744755 None] Performing differential transfer from 'volume-8dabb3c4-c9ba-4817-af56-8a86d1572234.backup.a3698ae7-44c1-4a7d-b2c7-d321fb04718a' to 'volume-03029fa6-9d19-40c2-951e-e96cf9fbc135' {{(pid=123790) _rbd_diff_transfer /opt/stack/cinder/cinder/backup/drivers/ceph.py:656}}
Jun 18 22:24:32.980938 ncdv-master-1 cinder-backup[123790]: DEBUG cinder.backup.drivers.ceph [None req-94d93596-d7fd-42bc-9754-370529b0eae3 tempest-TestVolumeBackupRestore-341744755 None] Piping cmd1='rbd export-diff --id cinder-bak --conf /etc/ceph/ceph.conf --pool backups backups/volume-8dabb3c4-c9ba-4817-af56-8a86d1572234.backup.a3698ae7-44c1-4a7d-b2c7-d321fb04718a@backup.a3698ae7-44c1-4a7d-b2c7-d321fb04718a.snap.1655591057.9411347 -' into... {{(pid=123790) _piped_execute /opt/stack/cinder/cinder/backup/drivers/ceph.py:613}}
Jun 18 22:24:32.981511 ncdv-master-1 cinder-backup[123790]: DEBUG cinder.backup.drivers.ceph [None req-94d93596-d7fd-42bc-9754-370529b0eae3 tempest-TestVolumeBackupRestore-341744755 None] cmd2='rbd import-diff --id cinder --conf /tmp/brickrbd_2wb_j6mc --pool volumes - volumes/volume-03029fa6-9d19-40c2-951e-e96cf9fbc135' {{(pid=123790) _piped_execute /opt/stack/cinder/cinder/backup/drivers/ceph.py:614}}
Jun 18 22:24:36.086926 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writing DB stats cinder:SELECT=17,cinder:UPDATE=3 {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 22:24:40.116878 ncdv-master-1 cinder-backup[123790]: DEBUG cinder.backup.drivers.ceph [None req-94d93596-d7fd-42bc-9754-370529b0eae3 tempest-TestVolumeBackupRestore-341744755 None] Restore transfer completed in 7.1360s {{(pid=123790) _diff_restore_rbd /opt/stack/cinder/cinder/backup/drivers/ceph.py:1168}}
Jun 18 22:24:40.118823 ncdv-master-1 cinder-backup[123790]: DEBUG cinder.backup.drivers.ceph [None req-94d93596-d7fd-42bc-9754-370529b0eae3 tempest-TestVolumeBackupRestore-341744755 None] Restore target I/O object does not support fileno() - skipping call to fsync(). {{(pid=123790) restore /opt/stack/cinder/cinder/backup/drivers/ceph.py:1356}}
Jun 18 22:24:40.175784 ncdv-master-1 cinder-backup[123790]: DEBUG cinder.backup.driver [None req-94d93596-d7fd-42bc-9754-370529b0eae3 tempest-TestVolumeBackupRestore-341744755 None] Restoring volume base metadata {{(pid=123790) _restore_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:177}}
Jun 18 22:24:40.202874 ncdv-master-1 cinder-backup[123790]: DEBUG cinder.backup.driver [None req-94d93596-d7fd-42bc-9754-370529b0eae3 tempest-TestVolumeBackupRestore-341744755 None] No metadata of type 'volume-metadata' to restore {{(pid=123790) put /opt/stack/cinder/cinder/backup/driver.py:345}}
Jun 18 22:24:40.215372 ncdv-master-1 cinder-backup[123790]: DEBUG cinder.backup.driver [None req-94d93596-d7fd-42bc-9754-370529b0eae3 tempest-TestVolumeBackupRestore-341744755 None] Restoring volume glance metadata {{(pid=123790) _restore_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:258}}
Jun 18 22:24:40.574189 ncdv-master-1 cinder-backup[123790]: DEBUG cinder.backup.drivers.ceph [None req-94d93596-d7fd-42bc-9754-370529b0eae3 tempest-TestVolumeBackupRestore-341744755 None] Restore to volume 03029fa6-9d19-40c2-951e-e96cf9fbc135 finished successfully. {{(pid=123790) restore /opt/stack/cinder/cinder/backup/drivers/ceph.py:1363}}
Jun 18 22:24:40.576812 ncdv-master-1 cinder-backup[123790]: DEBUG os_brick.initiator.connectors.rbd [None req-94d93596-d7fd-42bc-9754-370529b0eae3 tempest-TestVolumeBackupRestore-341744755 None] ==> disconnect_volume: call "{'self': <os_brick.initiator.connectors.rbd.RBDConnector object at 0x7fa8a8199df0>, 'connection_properties': {'name': 'volumes/volume-03029fa6-9d19-40c2-951e-e96cf9fbc135', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '***', 'volume_id': '03029fa6-9d19-40c2-951e-e96cf9fbc135', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'device_info': {'path': <os_brick.initiator.linuxrbd.RBDVolumeIOWrapper object at 0x7fa8a8212a30>}, 'force': True, ': False}" {{(pid=123790) trace_logging_wrapper /usr/local/lib/python3.8/dist-packages/os_brick/utils.py:167}}
Jun 18 22:24:40.595826 ncdv-master-1 cinder-backup[123790]: DEBUG os_brick.initiator.connectors.rbd [None req-94d93596-d7fd-42bc-9754-370529b0eae3 tempest-TestVolumeBackupRestore-341744755 None] <== disconnect_volume: return (18ms) None {{(pid=123790) trace_logging_wrapper /usr/local/lib/python3.8/dist-packages/os_brick/utils.py:194}}
Jun 18 22:24:40.669589 ncdv-master-1 cinder-backup[123790]: DEBUG cinder.backup.manager [None req-94d93596-d7fd-42bc-9754-370529b0eae3 tempest-TestVolumeBackupRestore-341744755 None] Encryption key ID for volume 03029fa6-9d19-40c2-951e-e96cf9fbc135 already matches encryption key ID in backup a3698ae7-44c1-4a7d-b2c7-d321fb04718a. {{(pid=123790) _run_restore /opt/stack/cinder/cinder/backup/manager.py:824}}
Jun 18 22:24:40.723757 ncdv-master-1 cinder-backup[123790]: INFO cinder.backup.manager [None req-94d93596-d7fd-42bc-9754-370529b0eae3 tempest-TestVolumeBackupRestore-341744755 None] Finished restoring backup a3698ae7-44c1-4a7d-b2c7-d321fb04718a to volume 03029fa6-9d19-40c2-951e-e96cf9fbc135.
Jun 18 22:24:56.070806 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writing DB stats cinder:SELECT=46,cinder:UPDATE=7,cinder:INSERT=9 {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 22:25:08.776070 ncdv-master-1 cinder-backup[123790]: DEBUG oslo_service.periodic_task [None req-d82f921b-aced-4971-81d0-f3b75344497b None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=123790) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Jun 18 22:25:08.777198 ncdv-master-1 cinder-backup[123790]: DEBUG cinder.manager [None req-d82f921b-aced-4971-81d0-f3b75344497b None None] Notifying Schedulers of capabilities ... {{(pid=123790) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jun 18 22:25:16.070729 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writing DB stats cinder:SELECT=37,cinder:INSERT=4,cinder:UPDATE=3 {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 22:25:36.092635 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writing DB stats cinder:SELECT=6,cinder:UPDATE=3 {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 22:25:56.081317 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writing DB stats cinder:SELECT=9,cinder:UPDATE=2 {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 22:26:06.088429 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writing DB stats cinder:SELECT=2,cinder:UPDATE=1 {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 22:26:08.776964 ncdv-master-1 cinder-backup[123790]: DEBUG oslo_service.periodic_task [None req-d82f921b-aced-4971-81d0-f3b75344497b None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=123790) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Jun 18 22:26:08.778477 ncdv-master-1 cinder-backup[123790]: DEBUG cinder.manager [None req-d82f921b-aced-4971-81d0-f3b75344497b None None] Notifying Schedulers of capabilities ... {{(pid=123790) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jun 18 22:26:16.091287 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 22:26:29.899329 ncdv-master-1 cinder-backup[123790]: INFO cinder.backup.manager [None req-512daa49-76b5-40cd-8eef-82bdb9346580 tempest-TestVolumeBackupRestore-341744755 None] Delete backup started, backup: a3698ae7-44c1-4a7d-b2c7-d321fb04718a.
Jun 18 22:26:29.901401 ncdv-master-1 cinder-backup[123790]: DEBUG cinder.backup.drivers.ceph [None req-512daa49-76b5-40cd-8eef-82bdb9346580 tempest-TestVolumeBackupRestore-341744755 None] Delete started for backup=a3698ae7-44c1-4a7d-b2c7-d321fb04718a {{(pid=123790) delete_backup /opt/stack/cinder/cinder/backup/drivers/ceph.py:1372}}
Jun 18 22:26:29.901966 ncdv-master-1 cinder-backup[123790]: DEBUG cinder.backup.drivers.ceph [None req-512daa49-76b5-40cd-8eef-82bdb9346580 tempest-TestVolumeBackupRestore-341744755 None] Trying diff format basename='volume-8dabb3c4-c9ba-4817-af56-8a86d1572234.backup.a3698ae7-44c1-4a7d-b2c7-d321fb04718a' for backup base image of volume 8dabb3c4-c9ba-4817-af56-8a86d1572234. {{(pid=123790) _try_delete_base_image /opt/stack/cinder/cinder/backup/drivers/ceph.py:541}}
Jun 18 22:26:30.025545 ncdv-master-1 cinder-backup[123790]: DEBUG cinder.backup.drivers.ceph [None req-512daa49-76b5-40cd-8eef-82bdb9346580 tempest-TestVolumeBackupRestore-341744755 None] Looking for snapshot of backup base 'volume-8dabb3c4-c9ba-4817-af56-8a86d1572234.backup.a3698ae7-44c1-4a7d-b2c7-d321fb04718a' {{(pid=123790) _get_backup_snap_name /opt/stack/cinder/cinder/backup/drivers/ceph.py:953}}
Jun 18 22:26:30.033420 ncdv-master-1 cinder-backup[123790]: DEBUG cinder.backup.drivers.ceph [None req-512daa49-76b5-40cd-8eef-82bdb9346580 tempest-TestVolumeBackupRestore-341744755 None] Found snapshot 'backup.a3698ae7-44c1-4a7d-b2c7-d321fb04718a.snap.1655591057.9411347' {{(pid=123790) _get_backup_snap_name /opt/stack/cinder/cinder/backup/drivers/ceph.py:972}}
Jun 18 22:26:30.034064 ncdv-master-1 cinder-backup[123790]: DEBUG cinder.backup.drivers.ceph [None req-512daa49-76b5-40cd-8eef-82bdb9346580 tempest-TestVolumeBackupRestore-341744755 None] Deleting backup snapshot='backup.a3698ae7-44c1-4a7d-b2c7-d321fb04718a.snap.1655591057.9411347' {{(pid=123790) _delete_backup_snapshot /opt/stack/cinder/cinder/backup/drivers/ceph.py:499}}
Jun 18 22:26:30.450459 ncdv-master-1 cinder-backup[123790]: INFO cinder.backup.drivers.ceph [None req-512daa49-76b5-40cd-8eef-82bdb9346580 tempest-TestVolumeBackupRestore-341744755 None] Deleting backup base image='volume-8dabb3c4-c9ba-4817-af56-8a86d1572234.backup.a3698ae7-44c1-4a7d-b2c7-d321fb04718a' of volume 8dabb3c4-c9ba-4817-af56-8a86d1572234.
Jun 18 22:26:31.599584 ncdv-master-1 cinder-backup[123790]: DEBUG cinder.backup.drivers.ceph [None req-512daa49-76b5-40cd-8eef-82bdb9346580 tempest-TestVolumeBackupRestore-341744755 None] Base backup image='volume-8dabb3c4-c9ba-4817-af56-8a86d1572234.backup.a3698ae7-44c1-4a7d-b2c7-d321fb04718a' of volume 8dabb3c4-c9ba-4817-af56-8a86d1572234 deleted. {{(pid=123790) _try_delete_base_image /opt/stack/cinder/cinder/backup/drivers/ceph.py:589}}
Jun 18 22:26:31.698873 ncdv-master-1 cinder-backup[123790]: DEBUG cinder.backup.drivers.ceph [None req-512daa49-76b5-40cd-8eef-82bdb9346580 tempest-TestVolumeBackupRestore-341744755 None] Delete of backup 'a3698ae7-44c1-4a7d-b2c7-d321fb04718a' for volume '8dabb3c4-c9ba-4817-af56-8a86d1572234' finished. {{(pid=123790) delete_backup /opt/stack/cinder/cinder/backup/drivers/ceph.py:1400}}
Jun 18 22:26:31.710643 ncdv-master-1 cinder-backup[123790]: DEBUG oslo_db.sqlalchemy.engines [None req-512daa49-76b5-40cd-8eef-82bdb9346580 tempest-TestVolumeBackupRestore-341744755 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123790) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}}
Jun 18 22:26:31.749565 ncdv-master-1 cinder-backup[123790]: WARNING cinder.quota [None req-512daa49-76b5-40cd-8eef-82bdb9346580 tempest-TestVolumeBackupRestore-341744755 None] Deprecated: Default quota for resource: backups is set by the default quota flag: quota_backups, it is now deprecated. Please use the default quota class for default quota.
Jun 18 22:26:31.753022 ncdv-master-1 cinder-backup[123790]: WARNING cinder.quota [None req-512daa49-76b5-40cd-8eef-82bdb9346580 tempest-TestVolumeBackupRestore-341744755 None] Deprecated: Default quota for resource: backup_gigabytes is set by the default quota flag: quota_backup_gigabytes, it is now deprecated. Please use the default quota class for default quota.
Jun 18 22:26:31.794324 ncdv-master-1 cinder-backup[123790]: DEBUG cinder.quota [None req-512daa49-76b5-40cd-8eef-82bdb9346580 tempest-TestVolumeBackupRestore-341744755 None] Created reservations ['d5eeb4cb-542c-41a6-8988-b846006c5c19', '76d71d74-677e-47ec-ae90-6319660bc106'] {{(pid=123790) reserve /opt/stack/cinder/cinder/quota.py:755}}
Jun 18 22:26:31.906976 ncdv-master-1 cinder-backup[123790]: INFO cinder.backup.manager [None req-512daa49-76b5-40cd-8eef-82bdb9346580 tempest-TestVolumeBackupRestore-341744755 None] Delete backup finished, backup a3698ae7-44c1-4a7d-b2c7-d321fb04718a deleted.
Jun 18 22:26:46.086342 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writing DB stats cinder:SELECT=10,cinder:UPDATE=4,cinder:INSERT=2 {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 22:26:46.087633 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writing DB stats cinder:SELECT=13,cinder:UPDATE=5 {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 22:27:06.087486 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 22:27:08.776956 ncdv-master-1 cinder-backup[123790]: DEBUG oslo_service.periodic_task [None req-d82f921b-aced-4971-81d0-f3b75344497b None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=123790) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Jun 18 22:27:08.776956 ncdv-master-1 cinder-backup[123790]: DEBUG cinder.manager [None req-d82f921b-aced-4971-81d0-f3b75344497b None None] Notifying Schedulers of capabilities ... {{(pid=123790) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jun 18 22:27:26.084596 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writing DB stats cinder:SELECT=9,cinder:UPDATE=2 {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 22:27:46.095339 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writing DB stats cinder:SELECT=6,cinder:UPDATE=3 {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 22:27:56.100027 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writing DB stats cinder:SELECT=4,cinder:UPDATE=1 {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 22:28:08.772522 ncdv-master-1 cinder-backup[123790]: DEBUG oslo_service.periodic_task [None req-d82f921b-aced-4971-81d0-f3b75344497b None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=123790) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Jun 18 22:28:08.773149 ncdv-master-1 cinder-backup[123790]: DEBUG cinder.manager [None req-d82f921b-aced-4971-81d0-f3b75344497b None None] Notifying Schedulers of capabilities ... {{(pid=123790) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jun 18 22:28:16.099908 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writing DB stats cinder:SELECT=4,cinder:UPDATE=2 {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 22:28:26.100932 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 22:28:46.103267 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writing DB stats cinder:SELECT=5,cinder:UPDATE=2 {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 22:29:06.113060 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writing DB stats cinder:SELECT=6,cinder:UPDATE=1 {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 22:29:08.773564 ncdv-master-1 cinder-backup[123790]: DEBUG oslo_service.periodic_task [None req-d82f921b-aced-4971-81d0-f3b75344497b None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=123790) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Jun 18 22:29:08.774856 ncdv-master-1 cinder-backup[123790]: DEBUG cinder.manager [None req-d82f921b-aced-4971-81d0-f3b75344497b None None] Notifying Schedulers of capabilities ... {{(pid=123790) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jun 18 22:29:16.119226 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writing DB stats cinder:SELECT=5,cinder:UPDATE=2 {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 22:29:46.122611 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writing DB stats cinder:SELECT=7,cinder:UPDATE=2 {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 22:30:06.135261 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writing DB stats cinder:SELECT=6,cinder:UPDATE=3 {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 22:30:26.123867 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 22:30:36.138931 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writing DB stats cinder:SELECT=3,cinder:UPDATE=2 {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 22:30:56.141475 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 22:31:01.879105 ncdv-master-1 cinder-backup[123790]: INFO cinder.backup.manager [None req-6ac0cb0b-b65d-4e49-ace5-09ad670d63e3 tempest-VolumesSnapshotTestJSON-1142548725 None] Create backup started, backup: bb5cf546-2c9c-4eea-963e-c7f45d138bda volume: 0bb96dac-d22f-48b7-8475-af7c0c8e42d2 snapshot: 92c8fd42-8bc0-49e1-9cc0-424f61d17e4b.
Jun 18 22:31:01.892770 ncdv-master-1 cinder-backup[123790]: INFO cinder.backup.manager [None req-6ac0cb0b-b65d-4e49-ace5-09ad670d63e3 tempest-VolumesSnapshotTestJSON-1142548725 None] Call Volume Manager to get_backup_device for Backup(availability_zone=None,container=None,created_at=2022-06-18T22:31:01Z,data_timestamp=2022-06-18T22:31:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Backup-784499451',encryption_key_id=None,fail_reason=None,host='ncdv-master-1',id=bb5cf546-2c9c-4eea-963e-c7f45d138bda,metadata={},num_dependent_backups=0,object_count=0,parent=None,parent_id=None,project_id='d65dfa8232fa458fb3c49822a1f4ede1',restore_volume_id=None,service='cinder.backup.drivers.ceph.CephBackupDriver',service_metadata=None,size=1,snapshot_id='92c8fd42-8bc0-49e1-9cc0-424f61d17e4b',status='creating',temp_snapshot_id=None,temp_volume_id=None,updated_at=None,user_id='61121749f1aa4a2285c8f270abb74fdf',volume_id=0bb96dac-d22f-48b7-8475-af7c0c8e42d2)
Jun 18 22:31:02.344245 ncdv-master-1 cinder-backup[123790]: DEBUG os_brick.utils [None req-6ac0cb0b-b65d-4e49-ace5-09ad670d63e3 tempest-VolumesSnapshotTestJSON-1142548725 None] ==> get_connector_properties: call "{'root_helper': 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf', 'my_ip': '10.222.0.30', 'multipath': False, 'enforce_multipath': False, 'host': None, 'execute': None}" {{(pid=123790) trace_logging_wrapper /usr/local/lib/python3.8/dist-packages/os_brick/utils.py:167}}
Jun 18 22:31:02.354963 ncdv-master-1 cinder-backup[123790]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=161870) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Jun 18 22:31:02.382947 ncdv-master-1 cinder-backup[123790]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.037s {{(pid=161870) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Jun 18 22:31:02.383355 ncdv-master-1 cinder-backup[123790]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a500e93-e89e-425f-922e-daa9da782722]: (4, ('## DO NOT EDIT OR REMOVE THIS FILE!\n## If you remove this file, the iSCSI daemon will not start.\n## If you change the InitiatorName, existing access control lists\n## may reject this initiator.  The InitiatorName must be unique\n## for each iSCSI initiator.  Do NOT duplicate iSCSI InitiatorNames.\nInitiatorName=iqn.1993-08.org.debian:01:f965e8976dfc\n', '')) {{(pid=161870) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}}
Jun 18 22:31:02.387773 ncdv-master-1 cinder-backup[123790]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): systool -c fc_host -v {{(pid=161870) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Jun 18 22:31:02.407246 ncdv-master-1 cinder-backup[123790]: DEBUG oslo_concurrency.processutils [-] 'systool -c fc_host -v' failed. Not Retrying. {{(pid=161870) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:473}}
Jun 18 22:31:02.408140 ncdv-master-1 cinder-backup[123790]: DEBUG oslo.privsep.daemon [-] privsep: Exception during request[86618199-a1a5-4d06-aafc-af807c4e2e41]: [Errno 2] No such file or directory: 'systool' {{(pid=161870) _process_cmd /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:479}}
Jun 18 22:31:02.408140 ncdv-master-1 cinder-backup[123790]: Traceback (most recent call last):
Jun 18 22:31:02.408140 ncdv-master-1 cinder-backup[123790]:   File "/usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py", line 476, in _process_cmd
Jun 18 22:31:02.408140 ncdv-master-1 cinder-backup[123790]:     ret = func(*f_args, **f_kwargs)
Jun 18 22:31:02.408140 ncdv-master-1 cinder-backup[123790]:   File "/usr/local/lib/python3.8/dist-packages/oslo_privsep/priv_context.py", line 274, in _wrap
Jun 18 22:31:02.408140 ncdv-master-1 cinder-backup[123790]:     return func(*args, **kwargs)
Jun 18 22:31:02.408140 ncdv-master-1 cinder-backup[123790]:   File "/usr/local/lib/python3.8/dist-packages/os_brick/privileged/rootwrap.py", line 197, in execute_root
Jun 18 22:31:02.408140 ncdv-master-1 cinder-backup[123790]:     return custom_execute(*cmd, shell=False, run_as_root=False, **kwargs)
Jun 18 22:31:02.408140 ncdv-master-1 cinder-backup[123790]:   File "/usr/local/lib/python3.8/dist-packages/os_brick/privileged/rootwrap.py", line 145, in custom_execute
Jun 18 22:31:02.408140 ncdv-master-1 cinder-backup[123790]:     return putils.execute(on_execute=on_execute,
Jun 18 22:31:02.408140 ncdv-master-1 cinder-backup[123790]:   File "/usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py", line 395, in execute
Jun 18 22:31:02.408140 ncdv-master-1 cinder-backup[123790]:     obj = subprocess.Popen(cmd,
Jun 18 22:31:02.408140 ncdv-master-1 cinder-backup[123790]:   File "/usr/lib/python3.8/subprocess.py", line 858, in __init__
Jun 18 22:31:02.408140 ncdv-master-1 cinder-backup[123790]:     self._execute_child(args, executable, preexec_fn, close_fds,
Jun 18 22:31:02.408140 ncdv-master-1 cinder-backup[123790]:   File "/usr/lib/python3.8/subprocess.py", line 1704, in _execute_child
Jun 18 22:31:02.408140 ncdv-master-1 cinder-backup[123790]:     raise child_exception_type(errno_num, err_msg, err_filename)
Jun 18 22:31:02.408140 ncdv-master-1 cinder-backup[123790]: FileNotFoundError: [Errno 2] No such file or directory: 'systool'
Jun 18 22:31:02.409797 ncdv-master-1 cinder-backup[123790]: DEBUG oslo.privsep.daemon [-] privsep: reply[86618199-a1a5-4d06-aafc-af807c4e2e41]: (5, 'builtins.FileNotFoundError', (2, 'No such file or directory')) {{(pid=161870) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}}
Jun 18 22:31:02.414537 ncdv-master-1 cinder-backup[123790]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): systool -c fc_host -v {{(pid=161870) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Jun 18 22:31:02.438532 ncdv-master-1 cinder-backup[123790]: DEBUG oslo_concurrency.processutils [-] 'systool -c fc_host -v' failed. Not Retrying. {{(pid=161870) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:473}}
Jun 18 22:31:02.440237 ncdv-master-1 cinder-backup[123790]: DEBUG oslo.privsep.daemon [-] privsep: Exception during request[8d47f38c-f3be-4563-abdc-d4c9b99c7951]: [Errno 2] No such file or directory: 'systool' {{(pid=161870) _process_cmd /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:479}}
Jun 18 22:31:02.440237 ncdv-master-1 cinder-backup[123790]: Traceback (most recent call last):
Jun 18 22:31:02.440237 ncdv-master-1 cinder-backup[123790]:   File "/usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py", line 476, in _process_cmd
Jun 18 22:31:02.440237 ncdv-master-1 cinder-backup[123790]:     ret = func(*f_args, **f_kwargs)
Jun 18 22:31:02.440237 ncdv-master-1 cinder-backup[123790]:   File "/usr/local/lib/python3.8/dist-packages/oslo_privsep/priv_context.py", line 274, in _wrap
Jun 18 22:31:02.440237 ncdv-master-1 cinder-backup[123790]:     return func(*args, **kwargs)
Jun 18 22:31:02.440237 ncdv-master-1 cinder-backup[123790]:   File "/usr/local/lib/python3.8/dist-packages/os_brick/privileged/rootwrap.py", line 197, in execute_root
Jun 18 22:31:02.440237 ncdv-master-1 cinder-backup[123790]:     return custom_execute(*cmd, shell=False, run_as_root=False, **kwargs)
Jun 18 22:31:02.440237 ncdv-master-1 cinder-backup[123790]:   File "/usr/local/lib/python3.8/dist-packages/os_brick/privileged/rootwrap.py", line 145, in custom_execute
Jun 18 22:31:02.440237 ncdv-master-1 cinder-backup[123790]:     return putils.execute(on_execute=on_execute,
Jun 18 22:31:02.440237 ncdv-master-1 cinder-backup[123790]:   File "/usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py", line 395, in execute
Jun 18 22:31:02.440237 ncdv-master-1 cinder-backup[123790]:     obj = subprocess.Popen(cmd,
Jun 18 22:31:02.440237 ncdv-master-1 cinder-backup[123790]:   File "/usr/lib/python3.8/subprocess.py", line 858, in __init__
Jun 18 22:31:02.440237 ncdv-master-1 cinder-backup[123790]:     self._execute_child(args, executable, preexec_fn, close_fds,
Jun 18 22:31:02.440237 ncdv-master-1 cinder-backup[123790]:   File "/usr/lib/python3.8/subprocess.py", line 1704, in _execute_child
Jun 18 22:31:02.440237 ncdv-master-1 cinder-backup[123790]:     raise child_exception_type(errno_num, err_msg, err_filename)
Jun 18 22:31:02.440237 ncdv-master-1 cinder-backup[123790]: FileNotFoundError: [Errno 2] No such file or directory: 'systool'
Jun 18 22:31:02.442340 ncdv-master-1 cinder-backup[123790]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d47f38c-f3be-4563-abdc-d4c9b99c7951]: (5, 'builtins.FileNotFoundError', (2, 'No such file or directory')) {{(pid=161870) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}}
Jun 18 22:31:02.443962 ncdv-master-1 cinder-backup[123790]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=161870) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Jun 18 22:31:02.465488 ncdv-master-1 cinder-backup[123790]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.021s {{(pid=161870) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Jun 18 22:31:02.465956 ncdv-master-1 cinder-backup[123790]: DEBUG oslo.privsep.daemon [-] privsep: reply[e235e0fd-865a-45ba-87df-e64e9d3b80b6]: (4, ('/dev/sda1\n', '')) {{(pid=161870) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}}
Jun 18 22:31:02.467515 ncdv-master-1 cinder-backup[123790]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/sda1 -s UUID -o value {{(pid=161870) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Jun 18 22:31:02.500571 ncdv-master-1 cinder-backup[123790]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/sda1 -s UUID -o value" returned: 0 in 0.033s {{(pid=161870) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Jun 18 22:31:02.501218 ncdv-master-1 cinder-backup[123790]: DEBUG oslo.privsep.daemon [-] privsep: reply[c548198f-ef35-4ae5-9461-633e599ee023]: (4, ('02bb033c-a191-40c0-94fb-bb025c724b13\n', '')) {{(pid=161870) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}}
Jun 18 22:31:02.502881 ncdv-master-1 cinder-backup[123790]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /sys/class/dmi/id/product_uuid {{(pid=161870) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Jun 18 22:31:02.518778 ncdv-master-1 cinder-backup[123790]: DEBUG oslo_concurrency.processutils [-] CMD "cat /sys/class/dmi/id/product_uuid" returned: 0 in 0.014s {{(pid=161870) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Jun 18 22:31:02.519603 ncdv-master-1 cinder-backup[123790]: DEBUG oslo.privsep.daemon [-] privsep: reply[46ec2ef5-50eb-4277-bb01-61edfc6f5262]: (4, ('cdfe4be3-957b-ec4d-8b08-ab749503be55\n', '')) {{(pid=161870) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}}
Jun 18 22:31:02.521365 ncdv-master-1 cinder-backup[123790]: DEBUG oslo_concurrency.processutils [None req-6ac0cb0b-b65d-4e49-ace5-09ad670d63e3 tempest-VolumesSnapshotTestJSON-1142548725 None] Running cmd (subprocess): nvme version {{(pid=123790) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Jun 18 22:31:02.590273 ncdv-master-1 cinder-backup[123790]: DEBUG oslo_concurrency.processutils [None req-6ac0cb0b-b65d-4e49-ace5-09ad670d63e3 tempest-VolumesSnapshotTestJSON-1142548725 None] CMD "nvme version" returned: 0 in 0.069s {{(pid=123790) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Jun 18 22:31:02.594010 ncdv-master-1 cinder-backup[123790]: DEBUG os_brick.initiator.connectors.lightos [None req-6ac0cb0b-b65d-4e49-ace5-09ad670d63e3 tempest-VolumesSnapshotTestJSON-1142548725 None] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=123790) find_dsc /usr/local/lib/python3.8/dist-packages/os_brick/initiator/connectors/lightos.py:100}}
Jun 18 22:31:02.596610 ncdv-master-1 cinder-backup[123790]: DEBUG os_brick.initiator.connectors.lightos [None req-6ac0cb0b-b65d-4e49-ace5-09ad670d63e3 tempest-VolumesSnapshotTestJSON-1142548725 None] LIGHTOS: did not find dsc, continuing anyway. {{(pid=123790) get_connector_properties /usr/local/lib/python3.8/dist-packages/os_brick/initiator/connectors/lightos.py:78}}
Jun 18 22:31:02.596935 ncdv-master-1 cinder-backup[123790]: DEBUG os_brick.initiator.connectors.lightos [None req-6ac0cb0b-b65d-4e49-ace5-09ad670d63e3 tempest-VolumesSnapshotTestJSON-1142548725 None] LIGHTOS: finally hostnqn: nqn.2014-08.org.nvmexpress:uuid:84627872-5390-4220-b960-ed5945b5c24c dsc:  {{(pid=123790) get_connector_properties /usr/local/lib/python3.8/dist-packages/os_brick/initiator/connectors/lightos.py:81}}
Jun 18 22:31:02.597748 ncdv-master-1 cinder-backup[123790]: DEBUG os_brick.utils [None req-6ac0cb0b-b65d-4e49-ace5-09ad670d63e3 tempest-VolumesSnapshotTestJSON-1142548725 None] <== get_connector_properties: return (252ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.222.0.30', 'host': 'ncdv-master-1', 'multipath': False, 'initiator': 'iqn.1993-08.org.debian:01:f965e8976dfc', 'do_local_attach': False, 'uuid': '02bb033c-a191-40c0-94fb-bb025c724b13', 'system uuid': 'cdfe4be3-957b-ec4d-8b08-ab749503be55', 'nqn': 'nqn.2014-08.org.nvmexpress:uuid:84627872-5390-4220-b960-ed5945b5c24c', 'found_dsc': ''} {{(pid=123790) trace_logging_wrapper /usr/local/lib/python3.8/dist-packages/os_brick/utils.py:194}}
Jun 18 22:31:03.806020 ncdv-master-1 cinder-backup[123790]: DEBUG os_brick.initiator.connector [None req-6ac0cb0b-b65d-4e49-ace5-09ad670d63e3 tempest-VolumesSnapshotTestJSON-1142548725 None] Factory for rbd on None {{(pid=123790) factory /usr/local/lib/python3.8/dist-packages/os_brick/initiator/connector.py:284}}
Jun 18 22:31:03.807591 ncdv-master-1 cinder-backup[123790]: DEBUG os_brick.initiator.connectors.rbd [None req-6ac0cb0b-b65d-4e49-ace5-09ad670d63e3 tempest-VolumesSnapshotTestJSON-1142548725 None] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.rbd.RBDConnector object at 0x7fa8a83865e0>, 'connection_properties': {'name': 'volumes/volume-8d6b610a-80ae-4fa0-9c29-0e33db3b191b', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '***', 'volume_id': '8d6b610a-80ae-4fa0-9c29-0e33db3b191b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, ': False}}" {{(pid=123790) trace_logging_wrapper /usr/local/lib/python3.8/dist-packages/os_brick/utils.py:167}}
Jun 18 22:31:03.808635 ncdv-master-1 cinder-backup[123790]: DEBUG os_brick.initiator.linuxrbd [None req-6ac0cb0b-b65d-4e49-ace5-09ad670d63e3 tempest-VolumesSnapshotTestJSON-1142548725 None] opening connection to ceph cluster (timeout=-1). {{(pid=123790) connect /usr/local/lib/python3.8/dist-packages/os_brick/initiator/linuxrbd.py:70}}
Jun 18 22:31:03.882968 ncdv-master-1 cinder-backup[123790]: DEBUG os_brick.initiator.connectors.rbd [None req-6ac0cb0b-b65d-4e49-ace5-09ad670d63e3 tempest-VolumesSnapshotTestJSON-1142548725 None] <== connect_volume: return (74ms) {'path': <os_brick.initiator.linuxrbd.RBDVolumeIOWrapper object at 0x7fa8a7fd7a60>} {{(pid=123790) trace_logging_wrapper /usr/local/lib/python3.8/dist-packages/os_brick/utils.py:194}}
Jun 18 22:31:03.893085 ncdv-master-1 cinder-backup[123790]: DEBUG oslo_db.sqlalchemy.engines [None req-6ac0cb0b-b65d-4e49-ace5-09ad670d63e3 tempest-VolumesSnapshotTestJSON-1142548725 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123790) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}}
Jun 18 22:31:03.929403 ncdv-master-1 cinder-backup[123790]: DEBUG cinder.backup.drivers.ceph [None req-6ac0cb0b-b65d-4e49-ace5-09ad670d63e3 tempest-VolumesSnapshotTestJSON-1142548725 None] Starting backup of volume='0bb96dac-d22f-48b7-8475-af7c0c8e42d2'. {{(pid=123790) backup /opt/stack/cinder/cinder/backup/drivers/ceph.py:1024}}
Jun 18 22:31:03.979335 ncdv-master-1 cinder-backup[123790]: DEBUG cinder.backup.drivers.ceph [None req-6ac0cb0b-b65d-4e49-ace5-09ad670d63e3 tempest-VolumesSnapshotTestJSON-1142548725 None] RBD also supports fast-diff, enabling it together with exclusive-lock and object-map {{(pid=123790) _get_rbd_support /opt/stack/cinder/cinder/backup/drivers/ceph.py:277}}
Jun 18 22:31:03.979733 ncdv-master-1 cinder-backup[123790]: DEBUG cinder.backup.drivers.ceph [None req-6ac0cb0b-b65d-4e49-ace5-09ad670d63e3 tempest-VolumesSnapshotTestJSON-1142548725 None] Creating backup base image='volume-0bb96dac-d22f-48b7-8475-af7c0c8e42d2.backup.base' for volume 0bb96dac-d22f-48b7-8475-af7c0c8e42d2. {{(pid=123790) _full_backup /opt/stack/cinder/cinder/backup/drivers/ceph.py:877}}
Jun 18 22:31:04.046573 ncdv-master-1 cinder-backup[123790]: DEBUG cinder.backup.drivers.ceph [None req-6ac0cb0b-b65d-4e49-ace5-09ad670d63e3 tempest-VolumesSnapshotTestJSON-1142548725 None] Copying data from volume 0bb96dac-d22f-48b7-8475-af7c0c8e42d2. {{(pid=123790) _full_backup /opt/stack/cinder/cinder/backup/drivers/ceph.py:889}}
Jun 18 22:31:04.071195 ncdv-master-1 cinder-backup[123790]: DEBUG cinder.backup.drivers.ceph [None req-6ac0cb0b-b65d-4e49-ace5-09ad670d63e3 tempest-VolumesSnapshotTestJSON-1142548725 None] Transferring data between 'volume-0bb96dac-d22f-48b7-8475-af7c0c8e42d2' and 'volume-0bb96dac-d22f-48b7-8475-af7c0c8e42d2.backup.base' {{(pid=123790) _transfer_data /opt/stack/cinder/cinder/backup/drivers/ceph.py:419}}
Jun 18 22:31:04.071775 ncdv-master-1 cinder-backup[123790]: DEBUG cinder.backup.drivers.ceph [None req-6ac0cb0b-b65d-4e49-ace5-09ad670d63e3 tempest-VolumesSnapshotTestJSON-1142548725 None] 8 chunks of 134217728 bytes to be transferred {{(pid=123790) _transfer_data /opt/stack/cinder/cinder/backup/drivers/ceph.py:423}}
Jun 18 22:31:05.626694 ncdv-master-1 cinder-backup[123790]: DEBUG cinder.backup.drivers.ceph [None req-6ac0cb0b-b65d-4e49-ace5-09ad670d63e3 tempest-VolumesSnapshotTestJSON-1142548725 None] Transferred chunk 1 of 8 (84333K/s) {{(pid=123790) _transfer_data /opt/stack/cinder/cinder/backup/drivers/ceph.py:442}}
Jun 18 22:31:07.271368 ncdv-master-1 cinder-backup[123790]: DEBUG cinder.backup.drivers.ceph [None req-6ac0cb0b-b65d-4e49-ace5-09ad670d63e3 tempest-VolumesSnapshotTestJSON-1142548725 None] Transferred chunk 2 of 8 (79819K/s) {{(pid=123790) _transfer_data /opt/stack/cinder/cinder/backup/drivers/ceph.py:442}}
Jun 18 22:31:08.756662 ncdv-master-1 cinder-backup[123790]: DEBUG cinder.backup.drivers.ceph [None req-6ac0cb0b-b65d-4e49-ace5-09ad670d63e3 tempest-VolumesSnapshotTestJSON-1142548725 None] Transferred chunk 3 of 8 (88323K/s) {{(pid=123790) _transfer_data /opt/stack/cinder/cinder/backup/drivers/ceph.py:442}}
Jun 18 22:31:08.789744 ncdv-master-1 cinder-backup[123790]: DEBUG oslo_service.periodic_task [None req-d82f921b-aced-4971-81d0-f3b75344497b None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=123790) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Jun 18 22:31:08.790387 ncdv-master-1 cinder-backup[123790]: DEBUG cinder.manager [None req-d82f921b-aced-4971-81d0-f3b75344497b None None] Notifying Schedulers of capabilities ... {{(pid=123790) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jun 18 22:31:10.429982 ncdv-master-1 cinder-backup[123790]: DEBUG cinder.backup.drivers.ceph [None req-6ac0cb0b-b65d-4e49-ace5-09ad670d63e3 tempest-VolumesSnapshotTestJSON-1142548725 None] Transferred chunk 4 of 8 (78397K/s) {{(pid=123790) _transfer_data /opt/stack/cinder/cinder/backup/drivers/ceph.py:442}}
Jun 18 22:31:12.093411 ncdv-master-1 cinder-backup[123790]: DEBUG cinder.backup.drivers.ceph [None req-6ac0cb0b-b65d-4e49-ace5-09ad670d63e3 tempest-VolumesSnapshotTestJSON-1142548725 None] Transferred chunk 5 of 8 (78821K/s) {{(pid=123790) _transfer_data /opt/stack/cinder/cinder/backup/drivers/ceph.py:442}}
Jun 18 22:31:14.210111 ncdv-master-1 cinder-backup[123790]: DEBUG cinder.backup.drivers.ceph [None req-6ac0cb0b-b65d-4e49-ace5-09ad670d63e3 tempest-VolumesSnapshotTestJSON-1142548725 None] Transferred chunk 6 of 8 (61942K/s) {{(pid=123790) _transfer_data /opt/stack/cinder/cinder/backup/drivers/ceph.py:442}}
Jun 18 22:31:16.102766 ncdv-master-1 cinder-backup[123790]: DEBUG cinder.backup.drivers.ceph [None req-6ac0cb0b-b65d-4e49-ace5-09ad670d63e3 tempest-VolumesSnapshotTestJSON-1142548725 None] Transferred chunk 7 of 8 (69274K/s) {{(pid=123790) _transfer_data /opt/stack/cinder/cinder/backup/drivers/ceph.py:442}}
Jun 18 22:31:16.138302 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writing DB stats cinder:SELECT=13,cinder:UPDATE=5 {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 22:31:17.921980 ncdv-master-1 cinder-backup[123790]: DEBUG cinder.backup.drivers.ceph [None req-6ac0cb0b-b65d-4e49-ace5-09ad670d63e3 tempest-VolumesSnapshotTestJSON-1142548725 None] Transferred chunk 8 of 8 (72101K/s) {{(pid=123790) _transfer_data /opt/stack/cinder/cinder/backup/drivers/ceph.py:442}}
Jun 18 22:31:17.992052 ncdv-master-1 cinder-backup[123790]: DEBUG cinder.backup.driver [None req-6ac0cb0b-b65d-4e49-ace5-09ad670d63e3 tempest-VolumesSnapshotTestJSON-1142548725 None] Getting metadata type 'volume-base-metadata' {{(pid=123790) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:79}}
Jun 18 22:31:18.011824 ncdv-master-1 cinder-backup[123790]: DEBUG cinder.backup.driver [None req-6ac0cb0b-b65d-4e49-ace5-09ad670d63e3 tempest-VolumesSnapshotTestJSON-1142548725 None] Completed fetching metadata type 'volume-base-metadata' {{(pid=123790) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:98}}
Jun 18 22:31:18.012124 ncdv-master-1 cinder-backup[123790]: DEBUG cinder.backup.driver [None req-6ac0cb0b-b65d-4e49-ace5-09ad670d63e3 tempest-VolumesSnapshotTestJSON-1142548725 None] Getting metadata type 'volume-metadata' {{(pid=123790) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:109}}
Jun 18 22:31:18.038307 ncdv-master-1 cinder-backup[123790]: DEBUG cinder.backup.driver [None req-6ac0cb0b-b65d-4e49-ace5-09ad670d63e3 tempest-VolumesSnapshotTestJSON-1142548725 None] No metadata type 'volume-metadata' available {{(pid=123790) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:123}}
Jun 18 22:31:18.039152 ncdv-master-1 cinder-backup[123790]: DEBUG cinder.backup.driver [None req-6ac0cb0b-b65d-4e49-ace5-09ad670d63e3 tempest-VolumesSnapshotTestJSON-1142548725 None] Getting metadata type 'volume-glance-metadata' {{(pid=123790) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:132}}
Jun 18 22:31:18.046309 ncdv-master-1 cinder-backup[123790]: DEBUG cinder.backup.driver [None req-6ac0cb0b-b65d-4e49-ace5-09ad670d63e3 tempest-VolumesSnapshotTestJSON-1142548725 None] No metadata type 'volume-glance-metadata' available {{(pid=123790) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:147}}
Jun 18 22:31:18.046864 ncdv-master-1 cinder-backup[123790]: DEBUG cinder.backup.drivers.ceph [None req-6ac0cb0b-b65d-4e49-ace5-09ad670d63e3 tempest-VolumesSnapshotTestJSON-1142548725 None] Backing up metadata for volume 0bb96dac-d22f-48b7-8475-af7c0c8e42d2. {{(pid=123790) _backup_metadata /opt/stack/cinder/cinder/backup/drivers/ceph.py:999}}
Jun 18 22:31:18.138008 ncdv-master-1 cinder-backup[123790]: DEBUG cinder.backup.drivers.ceph [None req-6ac0cb0b-b65d-4e49-ace5-09ad670d63e3 tempest-VolumesSnapshotTestJSON-1142548725 None] Backup 'bb5cf546-2c9c-4eea-963e-c7f45d138bda' of volume 0bb96dac-d22f-48b7-8475-af7c0c8e42d2 finished. {{(pid=123790) backup /opt/stack/cinder/cinder/backup/drivers/ceph.py:1065}}
Jun 18 22:31:18.141322 ncdv-master-1 cinder-backup[123790]: DEBUG os_brick.initiator.connectors.rbd [None req-6ac0cb0b-b65d-4e49-ace5-09ad670d63e3 tempest-VolumesSnapshotTestJSON-1142548725 None] ==> disconnect_volume: call "{'self': <os_brick.initiator.connectors.rbd.RBDConnector object at 0x7fa8a83865e0>, 'connection_properties': {'name': 'volumes/volume-8d6b610a-80ae-4fa0-9c29-0e33db3b191b', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '***', 'volume_id': '8d6b610a-80ae-4fa0-9c29-0e33db3b191b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'device_info': {'path': <os_brick.initiator.linuxrbd.RBDVolumeIOWrapper object at 0x7fa8a7fd7a60>}, 'force': True, ': True}" {{(pid=123790) trace_logging_wrapper /usr/local/lib/python3.8/dist-packages/os_brick/utils.py:167}}
Jun 18 22:31:18.157948 ncdv-master-1 cinder-backup[123790]: DEBUG os_brick.initiator.connectors.rbd [None req-6ac0cb0b-b65d-4e49-ace5-09ad670d63e3 tempest-VolumesSnapshotTestJSON-1142548725 None] <== disconnect_volume: return (15ms) None {{(pid=123790) trace_logging_wrapper /usr/local/lib/python3.8/dist-packages/os_brick/utils.py:194}}
Jun 18 22:31:18.492284 ncdv-master-1 cinder-backup[123790]: INFO cinder.backup.manager [None req-6ac0cb0b-b65d-4e49-ace5-09ad670d63e3 tempest-VolumesSnapshotTestJSON-1142548725 None] Create backup finished. backup: bb5cf546-2c9c-4eea-963e-c7f45d138bda.
Jun 18 22:31:18.999472 ncdv-master-1 cinder-backup[123790]: INFO cinder.backup.manager [None req-ae1ab266-5f3e-46fa-988c-c2eafec42f6a tempest-VolumesSnapshotTestJSON-1142548725 None] Delete backup started, backup: bb5cf546-2c9c-4eea-963e-c7f45d138bda.
Jun 18 22:31:19.003180 ncdv-master-1 cinder-backup[123790]: DEBUG cinder.backup.drivers.ceph [None req-ae1ab266-5f3e-46fa-988c-c2eafec42f6a tempest-VolumesSnapshotTestJSON-1142548725 None] Delete started for backup=bb5cf546-2c9c-4eea-963e-c7f45d138bda {{(pid=123790) delete_backup /opt/stack/cinder/cinder/backup/drivers/ceph.py:1372}}
Jun 18 22:31:19.003861 ncdv-master-1 cinder-backup[123790]: DEBUG cinder.backup.drivers.ceph [None req-ae1ab266-5f3e-46fa-988c-c2eafec42f6a tempest-VolumesSnapshotTestJSON-1142548725 None] Trying diff format basename='volume-0bb96dac-d22f-48b7-8475-af7c0c8e42d2.backup.bb5cf546-2c9c-4eea-963e-c7f45d138bda' for backup base image of volume 0bb96dac-d22f-48b7-8475-af7c0c8e42d2. {{(pid=123790) _try_delete_base_image /opt/stack/cinder/cinder/backup/drivers/ceph.py:541}}
Jun 18 22:31:19.083932 ncdv-master-1 cinder-backup[123790]: DEBUG cinder.backup.drivers.ceph [None req-ae1ab266-5f3e-46fa-988c-c2eafec42f6a tempest-VolumesSnapshotTestJSON-1142548725 None] Image 'volume-0bb96dac-d22f-48b7-8475-af7c0c8e42d2.backup.bb5cf546-2c9c-4eea-963e-c7f45d138bda' not found - trying diff format name {{(pid=123790) _rbd_image_exists /opt/stack/cinder/cinder/backup/drivers/ceph.py:694}}
Jun 18 22:31:19.108203 ncdv-master-1 cinder-backup[123790]: DEBUG cinder.backup.drivers.ceph [None req-ae1ab266-5f3e-46fa-988c-c2eafec42f6a tempest-VolumesSnapshotTestJSON-1142548725 None] Looking for snapshot of backup base 'volume-0bb96dac-d22f-48b7-8475-af7c0c8e42d2.backup.base' {{(pid=123790) _get_backup_snap_name /opt/stack/cinder/cinder/backup/drivers/ceph.py:953}}
Jun 18 22:31:19.108864 ncdv-master-1 cinder-backup[123790]: DEBUG cinder.backup.drivers.ceph [None req-ae1ab266-5f3e-46fa-988c-c2eafec42f6a tempest-VolumesSnapshotTestJSON-1142548725 None] Backup base 'volume-0bb96dac-d22f-48b7-8475-af7c0c8e42d2.backup.base' has no snapshots {{(pid=123790) _get_backup_snap_name /opt/stack/cinder/cinder/backup/drivers/ceph.py:956}}
Jun 18 22:31:19.109870 ncdv-master-1 cinder-backup[123790]: DEBUG cinder.backup.drivers.ceph [None req-ae1ab266-5f3e-46fa-988c-c2eafec42f6a tempest-VolumesSnapshotTestJSON-1142548725 None] No backup snapshot to delete {{(pid=123790) _delete_backup_snapshot /opt/stack/cinder/cinder/backup/drivers/ceph.py:502}}
Jun 18 22:31:19.121953 ncdv-master-1 cinder-backup[123790]: INFO cinder.backup.drivers.ceph [None req-ae1ab266-5f3e-46fa-988c-c2eafec42f6a tempest-VolumesSnapshotTestJSON-1142548725 None] Deleting backup base image='volume-0bb96dac-d22f-48b7-8475-af7c0c8e42d2.backup.base' of volume 0bb96dac-d22f-48b7-8475-af7c0c8e42d2.
Jun 18 22:31:20.161658 ncdv-master-1 cinder-backup[123790]: DEBUG cinder.backup.drivers.ceph [None req-ae1ab266-5f3e-46fa-988c-c2eafec42f6a tempest-VolumesSnapshotTestJSON-1142548725 None] Base backup image='volume-0bb96dac-d22f-48b7-8475-af7c0c8e42d2.backup.base' of volume 0bb96dac-d22f-48b7-8475-af7c0c8e42d2 deleted. {{(pid=123790) _try_delete_base_image /opt/stack/cinder/cinder/backup/drivers/ceph.py:589}}
Jun 18 22:31:20.229799 ncdv-master-1 cinder-backup[123790]: DEBUG cinder.backup.drivers.ceph [None req-ae1ab266-5f3e-46fa-988c-c2eafec42f6a tempest-VolumesSnapshotTestJSON-1142548725 None] Delete of backup 'bb5cf546-2c9c-4eea-963e-c7f45d138bda' for volume '0bb96dac-d22f-48b7-8475-af7c0c8e42d2' finished. {{(pid=123790) delete_backup /opt/stack/cinder/cinder/backup/drivers/ceph.py:1400}}
Jun 18 22:31:20.238000 ncdv-master-1 cinder-backup[123790]: DEBUG oslo_db.sqlalchemy.engines [None req-ae1ab266-5f3e-46fa-988c-c2eafec42f6a tempest-VolumesSnapshotTestJSON-1142548725 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123790) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}}
Jun 18 22:31:20.272471 ncdv-master-1 cinder-backup[123790]: DEBUG cinder.quota [None req-ae1ab266-5f3e-46fa-988c-c2eafec42f6a tempest-VolumesSnapshotTestJSON-1142548725 None] Created reservations ['10cd5aff-2910-4a73-b9f9-6c7873253c81', 'dfa13c8b-6c52-4b07-b687-45a83e3e6450'] {{(pid=123790) reserve /opt/stack/cinder/cinder/quota.py:755}}
Jun 18 22:31:20.320390 ncdv-master-1 cinder-backup[123790]: INFO cinder.backup.manager [None req-ae1ab266-5f3e-46fa-988c-c2eafec42f6a tempest-VolumesSnapshotTestJSON-1142548725 None] Delete backup finished, backup bb5cf546-2c9c-4eea-963e-c7f45d138bda deleted.
Jun 18 22:31:36.135268 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writing DB stats cinder:SELECT=24,cinder:UPDATE=7,cinder:INSERT=1 {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 22:31:54.682950 ncdv-master-1 cinder-backup[123790]: INFO cinder.backup.manager [None req-c6755f34-6e05-4cb9-b931-5dee5b79a462 tempest-VolumesBackupsTest-624856523 None] Create backup started, backup: b20abb62-1047-4cef-914d-a4dd1d8060f4 volume: 0e6040aa-afe5-48b7-82e1-848690284862.
Jun 18 22:31:54.696586 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writing DB stats cinder:SELECT=23,cinder:UPDATE=5,cinder:INSERT=1 {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 22:31:54.711705 ncdv-master-1 cinder-backup[123790]: INFO cinder.backup.manager [None req-c6755f34-6e05-4cb9-b931-5dee5b79a462 tempest-VolumesBackupsTest-624856523 None] Call Volume Manager to get_backup_device for Backup(availability_zone=None,container=None,created_at=2022-06-18T22:31:54Z,data_timestamp=2022-06-18T22:31:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsTest-Backup-1024607679',encryption_key_id=None,fail_reason=None,host='ncdv-master-1',id=b20abb62-1047-4cef-914d-a4dd1d8060f4,metadata={},num_dependent_backups=0,object_count=0,parent=None,parent_id=None,project_id='f7b4d0121cf24c619d4ad0f5af414dd8',restore_volume_id=None,service='cinder.backup.drivers.ceph.CephBackupDriver',service_metadata=None,size=1,snapshot_id=None,status='creating',temp_snapshot_id=None,temp_volume_id=None,updated_at=None,user_id='a4b5f6d69d1e4804923d47dd4d71d443',volume_id=0e6040aa-afe5-48b7-82e1-848690284862)
Jun 18 22:31:55.862608 ncdv-master-1 cinder-backup[123790]: DEBUG os_brick.utils [None req-c6755f34-6e05-4cb9-b931-5dee5b79a462 tempest-VolumesBackupsTest-624856523 None] ==> get_connector_properties: call "{'root_helper': 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf', 'my_ip': '10.222.0.30', 'multipath': False, 'enforce_multipath': False, 'host': None, 'execute': None}" {{(pid=123790) trace_logging_wrapper /usr/local/lib/python3.8/dist-packages/os_brick/utils.py:167}}
Jun 18 22:31:55.864985 ncdv-master-1 cinder-backup[123790]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=161870) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Jun 18 22:31:55.880739 ncdv-master-1 cinder-backup[123790]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=161870) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Jun 18 22:31:55.881102 ncdv-master-1 cinder-backup[123790]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf87d7e4-2c94-4a48-b1be-714281e6d0aa]: (4, ('## DO NOT EDIT OR REMOVE THIS FILE!\n## If you remove this file, the iSCSI daemon will not start.\n## If you change the InitiatorName, existing access control lists\n## may reject this initiator.  The InitiatorName must be unique\n## for each iSCSI initiator.  Do NOT duplicate iSCSI InitiatorNames.\nInitiatorName=iqn.1993-08.org.debian:01:f965e8976dfc\n', '')) {{(pid=161870) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}}
Jun 18 22:31:55.887171 ncdv-master-1 cinder-backup[123790]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): systool -c fc_host -v {{(pid=161870) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Jun 18 22:31:55.891076 ncdv-master-1 cinder-backup[123790]: DEBUG oslo_concurrency.processutils [-] 'systool -c fc_host -v' failed. Not Retrying. {{(pid=161870) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:473}}
Jun 18 22:31:55.892421 ncdv-master-1 cinder-backup[123790]: DEBUG oslo.privsep.daemon [-] privsep: Exception during request[e727e073-d7a8-438f-a9d2-1293315f709a]: [Errno 2] No such file or directory: 'systool' {{(pid=161870) _process_cmd /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:479}}
Jun 18 22:31:55.892421 ncdv-master-1 cinder-backup[123790]: Traceback (most recent call last):
Jun 18 22:31:55.892421 ncdv-master-1 cinder-backup[123790]:   File "/usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py", line 476, in _process_cmd
Jun 18 22:31:55.892421 ncdv-master-1 cinder-backup[123790]:     ret = func(*f_args, **f_kwargs)
Jun 18 22:31:55.892421 ncdv-master-1 cinder-backup[123790]:   File "/usr/local/lib/python3.8/dist-packages/oslo_privsep/priv_context.py", line 274, in _wrap
Jun 18 22:31:55.892421 ncdv-master-1 cinder-backup[123790]:     return func(*args, **kwargs)
Jun 18 22:31:55.892421 ncdv-master-1 cinder-backup[123790]:   File "/usr/local/lib/python3.8/dist-packages/os_brick/privileged/rootwrap.py", line 197, in execute_root
Jun 18 22:31:55.892421 ncdv-master-1 cinder-backup[123790]:     return custom_execute(*cmd, shell=False, run_as_root=False, **kwargs)
Jun 18 22:31:55.892421 ncdv-master-1 cinder-backup[123790]:   File "/usr/local/lib/python3.8/dist-packages/os_brick/privileged/rootwrap.py", line 145, in custom_execute
Jun 18 22:31:55.892421 ncdv-master-1 cinder-backup[123790]:     return putils.execute(on_execute=on_execute,
Jun 18 22:31:55.892421 ncdv-master-1 cinder-backup[123790]:   File "/usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py", line 395, in execute
Jun 18 22:31:55.892421 ncdv-master-1 cinder-backup[123790]:     obj = subprocess.Popen(cmd,
Jun 18 22:31:55.892421 ncdv-master-1 cinder-backup[123790]:   File "/usr/lib/python3.8/subprocess.py", line 858, in __init__
Jun 18 22:31:55.892421 ncdv-master-1 cinder-backup[123790]:     self._execute_child(args, executable, preexec_fn, close_fds,
Jun 18 22:31:55.892421 ncdv-master-1 cinder-backup[123790]:   File "/usr/lib/python3.8/subprocess.py", line 1704, in _execute_child
Jun 18 22:31:55.892421 ncdv-master-1 cinder-backup[123790]:     raise child_exception_type(errno_num, err_msg, err_filename)
Jun 18 22:31:55.892421 ncdv-master-1 cinder-backup[123790]: FileNotFoundError: [Errno 2] No such file or directory: 'systool'
Jun 18 22:31:55.894678 ncdv-master-1 cinder-backup[123790]: DEBUG oslo.privsep.daemon [-] privsep: reply[e727e073-d7a8-438f-a9d2-1293315f709a]: (5, 'builtins.FileNotFoundError', (2, 'No such file or directory')) {{(pid=161870) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}}
Jun 18 22:31:55.900558 ncdv-master-1 cinder-backup[123790]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): systool -c fc_host -v {{(pid=161870) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Jun 18 22:31:55.917492 ncdv-master-1 cinder-backup[123790]: DEBUG oslo_concurrency.processutils [-] 'systool -c fc_host -v' failed. Not Retrying. {{(pid=161870) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:473}}
Jun 18 22:31:55.919152 ncdv-master-1 cinder-backup[123790]: DEBUG oslo.privsep.daemon [-] privsep: Exception during request[9168d0d1-01ef-4be2-8cc6-f6cd88530b87]: [Errno 2] No such file or directory: 'systool' {{(pid=161870) _process_cmd /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:479}}
Jun 18 22:31:55.919152 ncdv-master-1 cinder-backup[123790]: Traceback (most recent call last):
Jun 18 22:31:55.919152 ncdv-master-1 cinder-backup[123790]:   File "/usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py", line 476, in _process_cmd
Jun 18 22:31:55.919152 ncdv-master-1 cinder-backup[123790]:     ret = func(*f_args, **f_kwargs)
Jun 18 22:31:55.919152 ncdv-master-1 cinder-backup[123790]:   File "/usr/local/lib/python3.8/dist-packages/oslo_privsep/priv_context.py", line 274, in _wrap
Jun 18 22:31:55.919152 ncdv-master-1 cinder-backup[123790]:     return func(*args, **kwargs)
Jun 18 22:31:55.919152 ncdv-master-1 cinder-backup[123790]:   File "/usr/local/lib/python3.8/dist-packages/os_brick/privileged/rootwrap.py", line 197, in execute_root
Jun 18 22:31:55.919152 ncdv-master-1 cinder-backup[123790]:     return custom_execute(*cmd, shell=False, run_as_root=False, **kwargs)
Jun 18 22:31:55.919152 ncdv-master-1 cinder-backup[123790]:   File "/usr/local/lib/python3.8/dist-packages/os_brick/privileged/rootwrap.py", line 145, in custom_execute
Jun 18 22:31:55.919152 ncdv-master-1 cinder-backup[123790]:     return putils.execute(on_execute=on_execute,
Jun 18 22:31:55.919152 ncdv-master-1 cinder-backup[123790]:   File "/usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py", line 395, in execute
Jun 18 22:31:55.919152 ncdv-master-1 cinder-backup[123790]:     obj = subprocess.Popen(cmd,
Jun 18 22:31:55.919152 ncdv-master-1 cinder-backup[123790]:   File "/usr/lib/python3.8/subprocess.py", line 858, in __init__
Jun 18 22:31:55.919152 ncdv-master-1 cinder-backup[123790]:     self._execute_child(args, executable, preexec_fn, close_fds,
Jun 18 22:31:55.919152 ncdv-master-1 cinder-backup[123790]:   File "/usr/lib/python3.8/subprocess.py", line 1704, in _execute_child
Jun 18 22:31:55.919152 ncdv-master-1 cinder-backup[123790]:     raise child_exception_type(errno_num, err_msg, err_filename)
Jun 18 22:31:55.919152 ncdv-master-1 cinder-backup[123790]: FileNotFoundError: [Errno 2] No such file or directory: 'systool'
Jun 18 22:31:55.920789 ncdv-master-1 cinder-backup[123790]: DEBUG oslo.privsep.daemon [-] privsep: reply[9168d0d1-01ef-4be2-8cc6-f6cd88530b87]: (5, 'builtins.FileNotFoundError', (2, 'No such file or directory')) {{(pid=161870) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}}
Jun 18 22:31:55.928488 ncdv-master-1 cinder-backup[123790]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=161870) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Jun 18 22:31:55.950687 ncdv-master-1 cinder-backup[123790]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.027s {{(pid=161870) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Jun 18 22:31:55.950976 ncdv-master-1 cinder-backup[123790]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ceadae1-9109-4e21-8280-4a1863522b22]: (4, ('/dev/sda1\n', '')) {{(pid=161870) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}}
Jun 18 22:31:55.952360 ncdv-master-1 cinder-backup[123790]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/sda1 -s UUID -o value {{(pid=161870) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Jun 18 22:31:55.985313 ncdv-master-1 cinder-backup[123790]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/sda1 -s UUID -o value" returned: 0 in 0.031s {{(pid=161870) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Jun 18 22:31:55.986044 ncdv-master-1 cinder-backup[123790]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a92cc94-f33c-408a-b215-d4cb22dbac36]: (4, ('02bb033c-a191-40c0-94fb-bb025c724b13\n', '')) {{(pid=161870) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}}
Jun 18 22:31:55.988257 ncdv-master-1 cinder-backup[123790]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /sys/class/dmi/id/product_uuid {{(pid=161870) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Jun 18 22:31:56.000177 ncdv-master-1 cinder-backup[123790]: DEBUG oslo_concurrency.processutils [-] CMD "cat /sys/class/dmi/id/product_uuid" returned: 0 in 0.011s {{(pid=161870) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Jun 18 22:31:56.000889 ncdv-master-1 cinder-backup[123790]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e403cf1-ad65-4f9e-92ce-3316bebb3807]: (4, ('cdfe4be3-957b-ec4d-8b08-ab749503be55\n', '')) {{(pid=161870) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}}
Jun 18 22:31:56.002160 ncdv-master-1 cinder-backup[123790]: DEBUG oslo_concurrency.processutils [None req-c6755f34-6e05-4cb9-b931-5dee5b79a462 tempest-VolumesBackupsTest-624856523 None] Running cmd (subprocess): nvme version {{(pid=123790) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Jun 18 22:31:56.038811 ncdv-master-1 cinder-backup[123790]: DEBUG oslo_concurrency.processutils [None req-c6755f34-6e05-4cb9-b931-5dee5b79a462 tempest-VolumesBackupsTest-624856523 None] CMD "nvme version" returned: 0 in 0.036s {{(pid=123790) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Jun 18 22:31:56.041547 ncdv-master-1 cinder-backup[123790]: DEBUG os_brick.initiator.connectors.lightos [None req-c6755f34-6e05-4cb9-b931-5dee5b79a462 tempest-VolumesBackupsTest-624856523 None] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=123790) find_dsc /usr/local/lib/python3.8/dist-packages/os_brick/initiator/connectors/lightos.py:100}}
Jun 18 22:31:56.041935 ncdv-master-1 cinder-backup[123790]: DEBUG os_brick.initiator.connectors.lightos [None req-c6755f34-6e05-4cb9-b931-5dee5b79a462 tempest-VolumesBackupsTest-624856523 None] LIGHTOS: did not find dsc, continuing anyway. {{(pid=123790) get_connector_properties /usr/local/lib/python3.8/dist-packages/os_brick/initiator/connectors/lightos.py:78}}
Jun 18 22:31:56.042342 ncdv-master-1 cinder-backup[123790]: DEBUG os_brick.initiator.connectors.lightos [None req-c6755f34-6e05-4cb9-b931-5dee5b79a462 tempest-VolumesBackupsTest-624856523 None] LIGHTOS: finally hostnqn: nqn.2014-08.org.nvmexpress:uuid:84627872-5390-4220-b960-ed5945b5c24c dsc:  {{(pid=123790) get_connector_properties /usr/local/lib/python3.8/dist-packages/os_brick/initiator/connectors/lightos.py:81}}
Jun 18 22:31:56.043110 ncdv-master-1 cinder-backup[123790]: DEBUG os_brick.utils [None req-c6755f34-6e05-4cb9-b931-5dee5b79a462 tempest-VolumesBackupsTest-624856523 None] <== get_connector_properties: return (178ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.222.0.30', 'host': 'ncdv-master-1', 'multipath': False, 'initiator': 'iqn.1993-08.org.debian:01:f965e8976dfc', 'do_local_attach': False, 'uuid': '02bb033c-a191-40c0-94fb-bb025c724b13', 'system uuid': 'cdfe4be3-957b-ec4d-8b08-ab749503be55', 'nqn': 'nqn.2014-08.org.nvmexpress:uuid:84627872-5390-4220-b960-ed5945b5c24c', 'found_dsc': ''} {{(pid=123790) trace_logging_wrapper /usr/local/lib/python3.8/dist-packages/os_brick/utils.py:194}}
Jun 18 22:31:56.140214 ncdv-master-1 cinder-backup[123790]: DEBUG oslo_db.sqlalchemy.engines [None req-e84d75e5-5441-4d43-964b-5b6d3790e0a5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123790) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}}
Jun 18 22:31:57.690037 ncdv-master-1 cinder-backup[123790]: DEBUG os_brick.initiator.connector [None req-c6755f34-6e05-4cb9-b931-5dee5b79a462 tempest-VolumesBackupsTest-624856523 None] Factory for rbd on None {{(pid=123790) factory /usr/local/lib/python3.8/dist-packages/os_brick/initiator/connector.py:284}}
Jun 18 22:31:57.692452 ncdv-master-1 cinder-backup[123790]: DEBUG os_brick.initiator.connectors.rbd [None req-c6755f34-6e05-4cb9-b931-5dee5b79a462 tempest-VolumesBackupsTest-624856523 None] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.rbd.RBDConnector object at 0x7fa8a8212e20>, 'connection_properties': {'name': 'volumes/volume-0e6040aa-afe5-48b7-82e1-848690284862', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '***', 'volume_id': '0e6040aa-afe5-48b7-82e1-848690284862', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, ': False}}" {{(pid=123790) trace_logging_wrapper /usr/local/lib/python3.8/dist-packages/os_brick/utils.py:167}}
Jun 18 22:31:57.694278 ncdv-master-1 cinder-backup[123790]: DEBUG os_brick.initiator.linuxrbd [None req-c6755f34-6e05-4cb9-b931-5dee5b79a462 tempest-VolumesBackupsTest-624856523 None] opening connection to ceph cluster (timeout=-1). {{(pid=123790) connect /usr/local/lib/python3.8/dist-packages/os_brick/initiator/linuxrbd.py:70}}
Jun 18 22:31:57.809149 ncdv-master-1 cinder-backup[123790]: DEBUG os_brick.initiator.connectors.rbd [None req-c6755f34-6e05-4cb9-b931-5dee5b79a462 tempest-VolumesBackupsTest-624856523 None] <== connect_volume: return (115ms) {'path': <os_brick.initiator.linuxrbd.RBDVolumeIOWrapper object at 0x7fa8a7fce250>} {{(pid=123790) trace_logging_wrapper /usr/local/lib/python3.8/dist-packages/os_brick/utils.py:194}}
Jun 18 22:31:57.844859 ncdv-master-1 cinder-backup[123790]: DEBUG cinder.backup.drivers.ceph [None req-c6755f34-6e05-4cb9-b931-5dee5b79a462 tempest-VolumesBackupsTest-624856523 None] Starting backup of volume='0e6040aa-afe5-48b7-82e1-848690284862'. {{(pid=123790) backup /opt/stack/cinder/cinder/backup/drivers/ceph.py:1024}}
Jun 18 22:31:57.848542 ncdv-master-1 cinder-backup[123790]: DEBUG cinder.backup.drivers.ceph [None req-c6755f34-6e05-4cb9-b931-5dee5b79a462 tempest-VolumesBackupsTest-624856523 None] Volume file is RBD: attempting optimized backup {{(pid=123790) backup /opt/stack/cinder/cinder/backup/drivers/ceph.py:1035}}
Jun 18 22:31:57.906096 ncdv-master-1 cinder-backup[123790]: DEBUG cinder.backup.drivers.ceph [None req-c6755f34-6e05-4cb9-b931-5dee5b79a462 tempest-VolumesBackupsTest-624856523 None] Creating base image 'volume-0e6040aa-afe5-48b7-82e1-848690284862.backup.b20abb62-1047-4cef-914d-a4dd1d8060f4' {{(pid=123790) _create_base_image /opt/stack/cinder/cinder/backup/drivers/ceph.py:467}}
Jun 18 22:31:57.907047 ncdv-master-1 cinder-backup[123790]: DEBUG cinder.backup.drivers.ceph [None req-c6755f34-6e05-4cb9-b931-5dee5b79a462 tempest-VolumesBackupsTest-624856523 None] RBD also supports fast-diff, enabling it together with exclusive-lock and object-map {{(pid=123790) _get_rbd_support /opt/stack/cinder/cinder/backup/drivers/ceph.py:277}}
Jun 18 22:31:57.952038 ncdv-master-1 cinder-backup[123790]: DEBUG cinder.backup.drivers.ceph [None req-c6755f34-6e05-4cb9-b931-5dee5b79a462 tempest-VolumesBackupsTest-624856523 None] Using --from-snap 'None' for incremental backup of volume 0e6040aa-afe5-48b7-82e1-848690284862. {{(pid=123790) _backup_rbd /opt/stack/cinder/cinder/backup/drivers/ceph.py:808}}
Jun 18 22:31:57.953362 ncdv-master-1 cinder-backup[123790]: DEBUG cinder.backup.drivers.ceph [None req-c6755f34-6e05-4cb9-b931-5dee5b79a462 tempest-VolumesBackupsTest-624856523 None] Creating backup snapshot='backup.b20abb62-1047-4cef-914d-a4dd1d8060f4.snap.1655591517.9519763' {{(pid=123790) _backup_rbd /opt/stack/cinder/cinder/backup/drivers/ceph.py:814}}
Jun 18 22:31:58.771309 ncdv-master-1 cinder-backup[123790]: DEBUG cinder.backup.drivers.ceph [None req-c6755f34-6e05-4cb9-b931-5dee5b79a462 tempest-VolumesBackupsTest-624856523 None] Performing differential transfer from 'volume-0e6040aa-afe5-48b7-82e1-848690284862' to 'volume-0e6040aa-afe5-48b7-82e1-848690284862.backup.b20abb62-1047-4cef-914d-a4dd1d8060f4' {{(pid=123790) _rbd_diff_transfer /opt/stack/cinder/cinder/backup/drivers/ceph.py:656}}
Jun 18 22:31:58.772318 ncdv-master-1 cinder-backup[123790]: DEBUG cinder.backup.drivers.ceph [None req-c6755f34-6e05-4cb9-b931-5dee5b79a462 tempest-VolumesBackupsTest-624856523 None] Piping cmd1='rbd export-diff --id cinder --conf /tmp/brickrbd_20h97y9e --pool volumes volumes/volume-0e6040aa-afe5-48b7-82e1-848690284862@backup.b20abb62-1047-4cef-914d-a4dd1d8060f4.snap.1655591517.9519763 -' into... {{(pid=123790) _piped_execute /opt/stack/cinder/cinder/backup/drivers/ceph.py:613}}
Jun 18 22:31:58.772960 ncdv-master-1 cinder-backup[123790]: DEBUG cinder.backup.drivers.ceph [None req-c6755f34-6e05-4cb9-b931-5dee5b79a462 tempest-VolumesBackupsTest-624856523 None] cmd2='rbd import-diff --id cinder-bak --conf /etc/ceph/ceph.conf --pool backups - backups/volume-0e6040aa-afe5-48b7-82e1-848690284862.backup.b20abb62-1047-4cef-914d-a4dd1d8060f4' {{(pid=123790) _piped_execute /opt/stack/cinder/cinder/backup/drivers/ceph.py:614}}
Jun 18 22:31:59.690693 ncdv-master-1 cinder-backup[123790]: DEBUG cinder.backup.drivers.ceph [None req-c6755f34-6e05-4cb9-b931-5dee5b79a462 tempest-VolumesBackupsTest-624856523 None] Differential backup transfer completed in 0.9178s {{(pid=123790) _backup_rbd /opt/stack/cinder/cinder/backup/drivers/ceph.py:834}}
Jun 18 22:31:59.691562 ncdv-master-1 cinder-backup[123790]: DEBUG cinder.backup.driver [None req-c6755f34-6e05-4cb9-b931-5dee5b79a462 tempest-VolumesBackupsTest-624856523 None] Getting metadata type 'volume-base-metadata' {{(pid=123790) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:79}}
Jun 18 22:31:59.716578 ncdv-master-1 cinder-backup[123790]: DEBUG cinder.backup.driver [None req-c6755f34-6e05-4cb9-b931-5dee5b79a462 tempest-VolumesBackupsTest-624856523 None] Completed fetching metadata type 'volume-base-metadata' {{(pid=123790) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:98}}
Jun 18 22:31:59.717062 ncdv-master-1 cinder-backup[123790]: DEBUG cinder.backup.driver [None req-c6755f34-6e05-4cb9-b931-5dee5b79a462 tempest-VolumesBackupsTest-624856523 None] Getting metadata type 'volume-metadata' {{(pid=123790) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:109}}
Jun 18 22:31:59.735571 ncdv-master-1 cinder-backup[123790]: DEBUG cinder.backup.driver [None req-c6755f34-6e05-4cb9-b931-5dee5b79a462 tempest-VolumesBackupsTest-624856523 None] No metadata type 'volume-metadata' available {{(pid=123790) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:123}}
Jun 18 22:31:59.740352 ncdv-master-1 cinder-backup[123790]: DEBUG cinder.backup.driver [None req-c6755f34-6e05-4cb9-b931-5dee5b79a462 tempest-VolumesBackupsTest-624856523 None] Getting metadata type 'volume-glance-metadata' {{(pid=123790) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:132}}
Jun 18 22:31:59.747462 ncdv-master-1 cinder-backup[123790]: DEBUG cinder.backup.driver [None req-c6755f34-6e05-4cb9-b931-5dee5b79a462 tempest-VolumesBackupsTest-624856523 None] No metadata type 'volume-glance-metadata' available {{(pid=123790) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:147}}
Jun 18 22:31:59.748861 ncdv-master-1 cinder-backup[123790]: DEBUG cinder.backup.drivers.ceph [None req-c6755f34-6e05-4cb9-b931-5dee5b79a462 tempest-VolumesBackupsTest-624856523 None] Backing up metadata for volume 0e6040aa-afe5-48b7-82e1-848690284862. {{(pid=123790) _backup_metadata /opt/stack/cinder/cinder/backup/drivers/ceph.py:999}}
Jun 18 22:31:59.822610 ncdv-master-1 cinder-backup[123790]: DEBUG cinder.backup.drivers.ceph [None req-c6755f34-6e05-4cb9-b931-5dee5b79a462 tempest-VolumesBackupsTest-624856523 None] Backup 'b20abb62-1047-4cef-914d-a4dd1d8060f4' of volume 0e6040aa-afe5-48b7-82e1-848690284862 finished. {{(pid=123790) backup /opt/stack/cinder/cinder/backup/drivers/ceph.py:1065}}
Jun 18 22:31:59.835381 ncdv-master-1 cinder-backup[123790]: DEBUG os_brick.initiator.connectors.rbd [None req-c6755f34-6e05-4cb9-b931-5dee5b79a462 tempest-VolumesBackupsTest-624856523 None] ==> disconnect_volume: call "{'self': <os_brick.initiator.connectors.rbd.RBDConnector object at 0x7fa8a8212e20>, 'connection_properties': {'name': 'volumes/volume-0e6040aa-afe5-48b7-82e1-848690284862', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '***', 'volume_id': '0e6040aa-afe5-48b7-82e1-848690284862', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'device_info': {'path': <os_brick.initiator.linuxrbd.RBDVolumeIOWrapper object at 0x7fa8a7fce250>}, 'force': True, ': True}" {{(pid=123790) trace_logging_wrapper /usr/local/lib/python3.8/dist-packages/os_brick/utils.py:167}}
Jun 18 22:31:59.848856 ncdv-master-1 cinder-backup[123790]: DEBUG os_brick.initiator.connectors.rbd [None req-c6755f34-6e05-4cb9-b931-5dee5b79a462 tempest-VolumesBackupsTest-624856523 None] <== disconnect_volume: return (12ms) None {{(pid=123790) trace_logging_wrapper /usr/local/lib/python3.8/dist-packages/os_brick/utils.py:194}}
Jun 18 22:31:59.959552 ncdv-master-1 cinder-backup[123790]: INFO cinder.backup.manager [None req-c6755f34-6e05-4cb9-b931-5dee5b79a462 tempest-VolumesBackupsTest-624856523 None] Create backup finished. backup: b20abb62-1047-4cef-914d-a4dd1d8060f4.
Jun 18 22:32:00.390543 ncdv-master-1 cinder-backup[123790]: INFO cinder.backup.manager [None req-a8b2bd64-f920-4a9d-a60e-60e8eab1a101 tempest-VolumesBackupsTest-624856523 None] Delete backup started, backup: b20abb62-1047-4cef-914d-a4dd1d8060f4.
Jun 18 22:32:00.390543 ncdv-master-1 cinder-backup[123790]: DEBUG cinder.backup.drivers.ceph [None req-a8b2bd64-f920-4a9d-a60e-60e8eab1a101 tempest-VolumesBackupsTest-624856523 None] Delete started for backup=b20abb62-1047-4cef-914d-a4dd1d8060f4 {{(pid=123790) delete_backup /opt/stack/cinder/cinder/backup/drivers/ceph.py:1372}}
Jun 18 22:32:00.391116 ncdv-master-1 cinder-backup[123790]: DEBUG cinder.backup.drivers.ceph [None req-a8b2bd64-f920-4a9d-a60e-60e8eab1a101 tempest-VolumesBackupsTest-624856523 None] Trying diff format basename='volume-0e6040aa-afe5-48b7-82e1-848690284862.backup.b20abb62-1047-4cef-914d-a4dd1d8060f4' for backup base image of volume 0e6040aa-afe5-48b7-82e1-848690284862. {{(pid=123790) _try_delete_base_image /opt/stack/cinder/cinder/backup/drivers/ceph.py:541}}
Jun 18 22:32:00.488065 ncdv-master-1 cinder-backup[123790]: DEBUG cinder.backup.drivers.ceph [None req-a8b2bd64-f920-4a9d-a60e-60e8eab1a101 tempest-VolumesBackupsTest-624856523 None] Looking for snapshot of backup base 'volume-0e6040aa-afe5-48b7-82e1-848690284862.backup.b20abb62-1047-4cef-914d-a4dd1d8060f4' {{(pid=123790) _get_backup_snap_name /opt/stack/cinder/cinder/backup/drivers/ceph.py:953}}
Jun 18 22:32:00.488523 ncdv-master-1 cinder-backup[123790]: DEBUG cinder.backup.drivers.ceph [None req-a8b2bd64-f920-4a9d-a60e-60e8eab1a101 tempest-VolumesBackupsTest-624856523 None] Found snapshot 'backup.b20abb62-1047-4cef-914d-a4dd1d8060f4.snap.1655591517.9519763' {{(pid=123790) _get_backup_snap_name /opt/stack/cinder/cinder/backup/drivers/ceph.py:972}}
Jun 18 22:32:00.489263 ncdv-master-1 cinder-backup[123790]: DEBUG cinder.backup.drivers.ceph [None req-a8b2bd64-f920-4a9d-a60e-60e8eab1a101 tempest-VolumesBackupsTest-624856523 None] Deleting backup snapshot='backup.b20abb62-1047-4cef-914d-a4dd1d8060f4.snap.1655591517.9519763' {{(pid=123790) _delete_backup_snapshot /opt/stack/cinder/cinder/backup/drivers/ceph.py:499}}
Jun 18 22:32:00.826956 ncdv-master-1 cinder-backup[123790]: INFO cinder.backup.drivers.ceph [None req-a8b2bd64-f920-4a9d-a60e-60e8eab1a101 tempest-VolumesBackupsTest-624856523 None] Deleting backup base image='volume-0e6040aa-afe5-48b7-82e1-848690284862.backup.b20abb62-1047-4cef-914d-a4dd1d8060f4' of volume 0e6040aa-afe5-48b7-82e1-848690284862.
Jun 18 22:32:01.139336 ncdv-master-1 cinder-backup[123790]: DEBUG cinder.backup.drivers.ceph [None req-a8b2bd64-f920-4a9d-a60e-60e8eab1a101 tempest-VolumesBackupsTest-624856523 None] Base backup image='volume-0e6040aa-afe5-48b7-82e1-848690284862.backup.b20abb62-1047-4cef-914d-a4dd1d8060f4' of volume 0e6040aa-afe5-48b7-82e1-848690284862 deleted. {{(pid=123790) _try_delete_base_image /opt/stack/cinder/cinder/backup/drivers/ceph.py:589}}
Jun 18 22:32:01.261671 ncdv-master-1 cinder-backup[123790]: DEBUG cinder.backup.drivers.ceph [None req-a8b2bd64-f920-4a9d-a60e-60e8eab1a101 tempest-VolumesBackupsTest-624856523 None] Delete of backup 'b20abb62-1047-4cef-914d-a4dd1d8060f4' for volume '0e6040aa-afe5-48b7-82e1-848690284862' finished. {{(pid=123790) delete_backup /opt/stack/cinder/cinder/backup/drivers/ceph.py:1400}}
Jun 18 22:32:01.272855 ncdv-master-1 cinder-backup[123790]: DEBUG oslo_db.sqlalchemy.engines [None req-a8b2bd64-f920-4a9d-a60e-60e8eab1a101 tempest-VolumesBackupsTest-624856523 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123790) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}}
Jun 18 22:32:01.318971 ncdv-master-1 cinder-backup[123790]: DEBUG cinder.quota [None req-a8b2bd64-f920-4a9d-a60e-60e8eab1a101 tempest-VolumesBackupsTest-624856523 None] Created reservations ['cf7b5503-ba59-4e5e-8a29-6405fd2b8767', 'e54af3ef-b8f6-4a6f-a9e1-1338cfb88da4'] {{(pid=123790) reserve /opt/stack/cinder/cinder/quota.py:755}}
Jun 18 22:32:01.420011 ncdv-master-1 cinder-backup[123790]: INFO cinder.backup.manager [None req-a8b2bd64-f920-4a9d-a60e-60e8eab1a101 tempest-VolumesBackupsTest-624856523 None] Delete backup finished, backup b20abb62-1047-4cef-914d-a4dd1d8060f4 deleted.
Jun 18 22:32:08.786794 ncdv-master-1 cinder-backup[123790]: DEBUG oslo_service.periodic_task [None req-d82f921b-aced-4971-81d0-f3b75344497b None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=123790) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Jun 18 22:32:08.787555 ncdv-master-1 cinder-backup[123790]: DEBUG cinder.manager [None req-d82f921b-aced-4971-81d0-f3b75344497b None None] Notifying Schedulers of capabilities ... {{(pid=123790) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jun 18 22:32:13.183963 ncdv-master-1 cinder-backup[123790]: INFO cinder.backup.manager [None req-b0d9615a-0420-44d0-a09a-45bd3e71d345 tempest-VolumesBackupsTest-624856523 None] Create backup started, backup: 1a444022-9454-4029-a324-97aed3646e0c volume: e19dbd28-395a-445b-b3fc-c301aa82e185.
Jun 18 22:32:13.194154 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writing DB stats cinder:SELECT=31,cinder:UPDATE=4,cinder:INSERT=1 {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 22:32:13.205302 ncdv-master-1 cinder-backup[123790]: INFO cinder.backup.manager [None req-b0d9615a-0420-44d0-a09a-45bd3e71d345 tempest-VolumesBackupsTest-624856523 None] Call Volume Manager to get_backup_device for Backup(availability_zone=None,container=None,created_at=2022-06-18T22:32:13Z,data_timestamp=2022-06-18T22:32:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsTest-Backup-866247733',encryption_key_id=None,fail_reason=None,host='ncdv-master-1',id=1a444022-9454-4029-a324-97aed3646e0c,metadata={},num_dependent_backups=0,object_count=0,parent=None,parent_id=None,project_id='f7b4d0121cf24c619d4ad0f5af414dd8',restore_volume_id=None,service='cinder.backup.drivers.ceph.CephBackupDriver',service_metadata=None,size=1,snapshot_id=None,status='creating',temp_snapshot_id=None,temp_volume_id=None,updated_at=None,user_id='a4b5f6d69d1e4804923d47dd4d71d443',volume_id=e19dbd28-395a-445b-b3fc-c301aa82e185)
Jun 18 22:32:13.399929 ncdv-master-1 cinder-backup[123790]: DEBUG os_brick.utils [None req-b0d9615a-0420-44d0-a09a-45bd3e71d345 tempest-VolumesBackupsTest-624856523 None] ==> get_connector_properties: call "{'root_helper': 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf', 'my_ip': '10.222.0.30', 'multipath': False, 'enforce_multipath': False, 'host': None, 'execute': None}" {{(pid=123790) trace_logging_wrapper /usr/local/lib/python3.8/dist-packages/os_brick/utils.py:167}}
Jun 18 22:32:13.401570 ncdv-master-1 cinder-backup[123790]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=161870) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Jun 18 22:32:13.422573 ncdv-master-1 cinder-backup[123790]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.021s {{(pid=161870) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Jun 18 22:32:13.422950 ncdv-master-1 cinder-backup[123790]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8bc0d34-3bda-4456-a744-53c549f156fa]: (4, ('## DO NOT EDIT OR REMOVE THIS FILE!\n## If you remove this file, the iSCSI daemon will not start.\n## If you change the InitiatorName, existing access control lists\n## may reject this initiator.  The InitiatorName must be unique\n## for each iSCSI initiator.  Do NOT duplicate iSCSI InitiatorNames.\nInitiatorName=iqn.1993-08.org.debian:01:f965e8976dfc\n', '')) {{(pid=161870) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}}
Jun 18 22:32:13.426228 ncdv-master-1 cinder-backup[123790]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): systool -c fc_host -v {{(pid=161870) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Jun 18 22:32:13.438005 ncdv-master-1 cinder-backup[123790]: DEBUG oslo_concurrency.processutils [-] 'systool -c fc_host -v' failed. Not Retrying. {{(pid=161870) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:473}}
Jun 18 22:32:13.439294 ncdv-master-1 cinder-backup[123790]: DEBUG oslo.privsep.daemon [-] privsep: Exception during request[b28828f0-8d51-4ca5-bfd0-bde9eb24f9e5]: [Errno 2] No such file or directory: 'systool' {{(pid=161870) _process_cmd /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:479}}
Jun 18 22:32:13.439294 ncdv-master-1 cinder-backup[123790]: Traceback (most recent call last):
Jun 18 22:32:13.439294 ncdv-master-1 cinder-backup[123790]:   File "/usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py", line 476, in _process_cmd
Jun 18 22:32:13.439294 ncdv-master-1 cinder-backup[123790]:     ret = func(*f_args, **f_kwargs)
Jun 18 22:32:13.439294 ncdv-master-1 cinder-backup[123790]:   File "/usr/local/lib/python3.8/dist-packages/oslo_privsep/priv_context.py", line 274, in _wrap
Jun 18 22:32:13.439294 ncdv-master-1 cinder-backup[123790]:     return func(*args, **kwargs)
Jun 18 22:32:13.439294 ncdv-master-1 cinder-backup[123790]:   File "/usr/local/lib/python3.8/dist-packages/os_brick/privileged/rootwrap.py", line 197, in execute_root
Jun 18 22:32:13.439294 ncdv-master-1 cinder-backup[123790]:     return custom_execute(*cmd, shell=False, run_as_root=False, **kwargs)
Jun 18 22:32:13.439294 ncdv-master-1 cinder-backup[123790]:   File "/usr/local/lib/python3.8/dist-packages/os_brick/privileged/rootwrap.py", line 145, in custom_execute
Jun 18 22:32:13.439294 ncdv-master-1 cinder-backup[123790]:     return putils.execute(on_execute=on_execute,
Jun 18 22:32:13.439294 ncdv-master-1 cinder-backup[123790]:   File "/usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py", line 395, in execute
Jun 18 22:32:13.439294 ncdv-master-1 cinder-backup[123790]:     obj = subprocess.Popen(cmd,
Jun 18 22:32:13.439294 ncdv-master-1 cinder-backup[123790]:   File "/usr/lib/python3.8/subprocess.py", line 858, in __init__
Jun 18 22:32:13.439294 ncdv-master-1 cinder-backup[123790]:     self._execute_child(args, executable, preexec_fn, close_fds,
Jun 18 22:32:13.439294 ncdv-master-1 cinder-backup[123790]:   File "/usr/lib/python3.8/subprocess.py", line 1704, in _execute_child
Jun 18 22:32:13.439294 ncdv-master-1 cinder-backup[123790]:     raise child_exception_type(errno_num, err_msg, err_filename)
Jun 18 22:32:13.439294 ncdv-master-1 cinder-backup[123790]: FileNotFoundError: [Errno 2] No such file or directory: 'systool'
Jun 18 22:32:13.441132 ncdv-master-1 cinder-backup[123790]: DEBUG oslo.privsep.daemon [-] privsep: reply[b28828f0-8d51-4ca5-bfd0-bde9eb24f9e5]: (5, 'builtins.FileNotFoundError', (2, 'No such file or directory')) {{(pid=161870) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}}
Jun 18 22:32:13.445762 ncdv-master-1 cinder-backup[123790]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): systool -c fc_host -v {{(pid=161870) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Jun 18 22:32:13.463436 ncdv-master-1 cinder-backup[123790]: DEBUG oslo_concurrency.processutils [-] 'systool -c fc_host -v' failed. Not Retrying. {{(pid=161870) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:473}}
Jun 18 22:32:13.463959 ncdv-master-1 cinder-backup[123790]: DEBUG oslo.privsep.daemon [-] privsep: Exception during request[82f74343-f92a-4034-bbda-787300dec0c2]: [Errno 2] No such file or directory: 'systool' {{(pid=161870) _process_cmd /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:479}}
Jun 18 22:32:13.463959 ncdv-master-1 cinder-backup[123790]: Traceback (most recent call last):
Jun 18 22:32:13.463959 ncdv-master-1 cinder-backup[123790]:   File "/usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py", line 476, in _process_cmd
Jun 18 22:32:13.463959 ncdv-master-1 cinder-backup[123790]:     ret = func(*f_args, **f_kwargs)
Jun 18 22:32:13.463959 ncdv-master-1 cinder-backup[123790]:   File "/usr/local/lib/python3.8/dist-packages/oslo_privsep/priv_context.py", line 274, in _wrap
Jun 18 22:32:13.463959 ncdv-master-1 cinder-backup[123790]:     return func(*args, **kwargs)
Jun 18 22:32:13.463959 ncdv-master-1 cinder-backup[123790]:   File "/usr/local/lib/python3.8/dist-packages/os_brick/privileged/rootwrap.py", line 197, in execute_root
Jun 18 22:32:13.463959 ncdv-master-1 cinder-backup[123790]:     return custom_execute(*cmd, shell=False, run_as_root=False, **kwargs)
Jun 18 22:32:13.463959 ncdv-master-1 cinder-backup[123790]:   File "/usr/local/lib/python3.8/dist-packages/os_brick/privileged/rootwrap.py", line 145, in custom_execute
Jun 18 22:32:13.463959 ncdv-master-1 cinder-backup[123790]:     return putils.execute(on_execute=on_execute,
Jun 18 22:32:13.463959 ncdv-master-1 cinder-backup[123790]:   File "/usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py", line 395, in execute
Jun 18 22:32:13.463959 ncdv-master-1 cinder-backup[123790]:     obj = subprocess.Popen(cmd,
Jun 18 22:32:13.463959 ncdv-master-1 cinder-backup[123790]:   File "/usr/lib/python3.8/subprocess.py", line 858, in __init__
Jun 18 22:32:13.463959 ncdv-master-1 cinder-backup[123790]:     self._execute_child(args, executable, preexec_fn, close_fds,
Jun 18 22:32:13.463959 ncdv-master-1 cinder-backup[123790]:   File "/usr/lib/python3.8/subprocess.py", line 1704, in _execute_child
Jun 18 22:32:13.463959 ncdv-master-1 cinder-backup[123790]:     raise child_exception_type(errno_num, err_msg, err_filename)
Jun 18 22:32:13.463959 ncdv-master-1 cinder-backup[123790]: FileNotFoundError: [Errno 2] No such file or directory: 'systool'
Jun 18 22:32:13.465590 ncdv-master-1 cinder-backup[123790]: DEBUG oslo.privsep.daemon [-] privsep: reply[82f74343-f92a-4034-bbda-787300dec0c2]: (5, 'builtins.FileNotFoundError', (2, 'No such file or directory')) {{(pid=161870) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}}
Jun 18 22:32:13.467767 ncdv-master-1 cinder-backup[123790]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=161870) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Jun 18 22:32:13.498889 ncdv-master-1 cinder-backup[123790]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.030s {{(pid=161870) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Jun 18 22:32:13.499452 ncdv-master-1 cinder-backup[123790]: DEBUG oslo.privsep.daemon [-] privsep: reply[159891ab-574a-4765-b61b-f2ad706248d0]: (4, ('/dev/sda1\n', '')) {{(pid=161870) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}}
Jun 18 22:32:13.502946 ncdv-master-1 cinder-backup[123790]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/sda1 -s UUID -o value {{(pid=161870) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Jun 18 22:32:13.525472 ncdv-master-1 cinder-backup[123790]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/sda1 -s UUID -o value" returned: 0 in 0.024s {{(pid=161870) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Jun 18 22:32:13.526021 ncdv-master-1 cinder-backup[123790]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed248bd1-8b29-4e5d-a0f2-04c73ff9c355]: (4, ('02bb033c-a191-40c0-94fb-bb025c724b13\n', '')) {{(pid=161870) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}}
Jun 18 22:32:13.529498 ncdv-master-1 cinder-backup[123790]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /sys/class/dmi/id/product_uuid {{(pid=161870) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Jun 18 22:32:13.541924 ncdv-master-1 cinder-backup[123790]: DEBUG oslo_concurrency.processutils [-] CMD "cat /sys/class/dmi/id/product_uuid" returned: 0 in 0.014s {{(pid=161870) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Jun 18 22:32:13.542456 ncdv-master-1 cinder-backup[123790]: DEBUG oslo.privsep.daemon [-] privsep: reply[4843a4c9-eec3-47dd-b2d6-593b87f3cbef]: (4, ('cdfe4be3-957b-ec4d-8b08-ab749503be55\n', '')) {{(pid=161870) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}}
Jun 18 22:32:13.543414 ncdv-master-1 cinder-backup[123790]: DEBUG oslo_concurrency.processutils [None req-b0d9615a-0420-44d0-a09a-45bd3e71d345 tempest-VolumesBackupsTest-624856523 None] Running cmd (subprocess): nvme version {{(pid=123790) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Jun 18 22:32:13.604628 ncdv-master-1 cinder-backup[123790]: DEBUG oslo_concurrency.processutils [None req-b0d9615a-0420-44d0-a09a-45bd3e71d345 tempest-VolumesBackupsTest-624856523 None] CMD "nvme version" returned: 0 in 0.061s {{(pid=123790) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Jun 18 22:32:13.610974 ncdv-master-1 cinder-backup[123790]: DEBUG os_brick.initiator.connectors.lightos [None req-b0d9615a-0420-44d0-a09a-45bd3e71d345 tempest-VolumesBackupsTest-624856523 None] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=123790) find_dsc /usr/local/lib/python3.8/dist-packages/os_brick/initiator/connectors/lightos.py:100}}
Jun 18 22:32:13.626311 ncdv-master-1 cinder-backup[123790]: DEBUG os_brick.initiator.connectors.lightos [None req-b0d9615a-0420-44d0-a09a-45bd3e71d345 tempest-VolumesBackupsTest-624856523 None] LIGHTOS: did not find dsc, continuing anyway. {{(pid=123790) get_connector_properties /usr/local/lib/python3.8/dist-packages/os_brick/initiator/connectors/lightos.py:78}}
Jun 18 22:32:13.629217 ncdv-master-1 cinder-backup[123790]: DEBUG os_brick.initiator.connectors.lightos [None req-b0d9615a-0420-44d0-a09a-45bd3e71d345 tempest-VolumesBackupsTest-624856523 None] LIGHTOS: finally hostnqn: nqn.2014-08.org.nvmexpress:uuid:84627872-5390-4220-b960-ed5945b5c24c dsc:  {{(pid=123790) get_connector_properties /usr/local/lib/python3.8/dist-packages/os_brick/initiator/connectors/lightos.py:81}}
Jun 18 22:32:13.631938 ncdv-master-1 cinder-backup[123790]: DEBUG os_brick.utils [None req-b0d9615a-0420-44d0-a09a-45bd3e71d345 tempest-VolumesBackupsTest-624856523 None] <== get_connector_properties: return (229ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.222.0.30', 'host': 'ncdv-master-1', 'multipath': False, 'initiator': 'iqn.1993-08.org.debian:01:f965e8976dfc', 'do_local_attach': False, 'uuid': '02bb033c-a191-40c0-94fb-bb025c724b13', 'system uuid': 'cdfe4be3-957b-ec4d-8b08-ab749503be55', 'nqn': 'nqn.2014-08.org.nvmexpress:uuid:84627872-5390-4220-b960-ed5945b5c24c', 'found_dsc': ''} {{(pid=123790) trace_logging_wrapper /usr/local/lib/python3.8/dist-packages/os_brick/utils.py:194}}
Jun 18 22:32:15.018246 ncdv-master-1 cinder-backup[123790]: DEBUG os_brick.initiator.connector [None req-b0d9615a-0420-44d0-a09a-45bd3e71d345 tempest-VolumesBackupsTest-624856523 None] Factory for rbd on None {{(pid=123790) factory /usr/local/lib/python3.8/dist-packages/os_brick/initiator/connector.py:284}}
Jun 18 22:32:15.020532 ncdv-master-1 cinder-backup[123790]: DEBUG os_brick.initiator.connectors.rbd [None req-b0d9615a-0420-44d0-a09a-45bd3e71d345 tempest-VolumesBackupsTest-624856523 None] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.rbd.RBDConnector object at 0x7fa8a8468340>, 'connection_properties': {'name': 'volumes/volume-e19dbd28-395a-445b-b3fc-c301aa82e185', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '***', 'volume_id': 'e19dbd28-395a-445b-b3fc-c301aa82e185', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, ': False}}" {{(pid=123790) trace_logging_wrapper /usr/local/lib/python3.8/dist-packages/os_brick/utils.py:167}}
Jun 18 22:32:15.021788 ncdv-master-1 cinder-backup[123790]: DEBUG os_brick.initiator.linuxrbd [None req-b0d9615a-0420-44d0-a09a-45bd3e71d345 tempest-VolumesBackupsTest-624856523 None] opening connection to ceph cluster (timeout=-1). {{(pid=123790) connect /usr/local/lib/python3.8/dist-packages/os_brick/initiator/linuxrbd.py:70}}
Jun 18 22:32:15.162093 ncdv-master-1 cinder-backup[123790]: DEBUG os_brick.initiator.connectors.rbd [None req-b0d9615a-0420-44d0-a09a-45bd3e71d345 tempest-VolumesBackupsTest-624856523 None] <== connect_volume: return (140ms) {'path': <os_brick.initiator.linuxrbd.RBDVolumeIOWrapper object at 0x7fa8a81bc640>} {{(pid=123790) trace_logging_wrapper /usr/local/lib/python3.8/dist-packages/os_brick/utils.py:194}}
Jun 18 22:32:15.170575 ncdv-master-1 cinder-backup[123790]: DEBUG oslo_db.sqlalchemy.engines [None req-b0d9615a-0420-44d0-a09a-45bd3e71d345 tempest-VolumesBackupsTest-624856523 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123790) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}}
Jun 18 22:32:15.215953 ncdv-master-1 cinder-backup[123790]: DEBUG cinder.backup.drivers.ceph [None req-b0d9615a-0420-44d0-a09a-45bd3e71d345 tempest-VolumesBackupsTest-624856523 None] Starting backup of volume='e19dbd28-395a-445b-b3fc-c301aa82e185'. {{(pid=123790) backup /opt/stack/cinder/cinder/backup/drivers/ceph.py:1024}}
Jun 18 22:32:15.218037 ncdv-master-1 cinder-backup[123790]: DEBUG cinder.backup.drivers.ceph [None req-b0d9615a-0420-44d0-a09a-45bd3e71d345 tempest-VolumesBackupsTest-624856523 None] Volume file is RBD: attempting optimized backup {{(pid=123790) backup /opt/stack/cinder/cinder/backup/drivers/ceph.py:1035}}
Jun 18 22:32:15.282168 ncdv-master-1 cinder-backup[123790]: DEBUG cinder.backup.drivers.ceph [None req-b0d9615a-0420-44d0-a09a-45bd3e71d345 tempest-VolumesBackupsTest-624856523 None] Creating base image 'volume-e19dbd28-395a-445b-b3fc-c301aa82e185.backup.1a444022-9454-4029-a324-97aed3646e0c' {{(pid=123790) _create_base_image /opt/stack/cinder/cinder/backup/drivers/ceph.py:467}}
Jun 18 22:32:15.282963 ncdv-master-1 cinder-backup[123790]: DEBUG cinder.backup.drivers.ceph [None req-b0d9615a-0420-44d0-a09a-45bd3e71d345 tempest-VolumesBackupsTest-624856523 None] RBD also supports fast-diff, enabling it together with exclusive-lock and object-map {{(pid=123790) _get_rbd_support /opt/stack/cinder/cinder/backup/drivers/ceph.py:277}}
Jun 18 22:32:15.346669 ncdv-master-1 cinder-backup[123790]: DEBUG cinder.backup.drivers.ceph [None req-b0d9615a-0420-44d0-a09a-45bd3e71d345 tempest-VolumesBackupsTest-624856523 None] Using --from-snap 'None' for incremental backup of volume e19dbd28-395a-445b-b3fc-c301aa82e185. {{(pid=123790) _backup_rbd /opt/stack/cinder/cinder/backup/drivers/ceph.py:808}}
Jun 18 22:32:15.347309 ncdv-master-1 cinder-backup[123790]: DEBUG cinder.backup.drivers.ceph [None req-b0d9615a-0420-44d0-a09a-45bd3e71d345 tempest-VolumesBackupsTest-624856523 None] Creating backup snapshot='backup.1a444022-9454-4029-a324-97aed3646e0c.snap.1655591535.3469276' {{(pid=123790) _backup_rbd /opt/stack/cinder/cinder/backup/drivers/ceph.py:814}}
Jun 18 22:32:15.901790 ncdv-master-1 cinder-backup[123790]: DEBUG cinder.backup.drivers.ceph [None req-b0d9615a-0420-44d0-a09a-45bd3e71d345 tempest-VolumesBackupsTest-624856523 None] Performing differential transfer from 'volume-e19dbd28-395a-445b-b3fc-c301aa82e185' to 'volume-e19dbd28-395a-445b-b3fc-c301aa82e185.backup.1a444022-9454-4029-a324-97aed3646e0c' {{(pid=123790) _rbd_diff_transfer /opt/stack/cinder/cinder/backup/drivers/ceph.py:656}}
Jun 18 22:32:15.902207 ncdv-master-1 cinder-backup[123790]: DEBUG cinder.backup.drivers.ceph [None req-b0d9615a-0420-44d0-a09a-45bd3e71d345 tempest-VolumesBackupsTest-624856523 None] Piping cmd1='rbd export-diff --id cinder --conf /tmp/brickrbd_wce9s310 --pool volumes volumes/volume-e19dbd28-395a-445b-b3fc-c301aa82e185@backup.1a444022-9454-4029-a324-97aed3646e0c.snap.1655591535.3469276 -' into... {{(pid=123790) _piped_execute /opt/stack/cinder/cinder/backup/drivers/ceph.py:613}}
Jun 18 22:32:15.902590 ncdv-master-1 cinder-backup[123790]: DEBUG cinder.backup.drivers.ceph [None req-b0d9615a-0420-44d0-a09a-45bd3e71d345 tempest-VolumesBackupsTest-624856523 None] cmd2='rbd import-diff --id cinder-bak --conf /etc/ceph/ceph.conf --pool backups - backups/volume-e19dbd28-395a-445b-b3fc-c301aa82e185.backup.1a444022-9454-4029-a324-97aed3646e0c' {{(pid=123790) _piped_execute /opt/stack/cinder/cinder/backup/drivers/ceph.py:614}}
Jun 18 22:32:21.839723 ncdv-master-1 cinder-backup[123790]: DEBUG cinder.backup.drivers.ceph [None req-b0d9615a-0420-44d0-a09a-45bd3e71d345 tempest-VolumesBackupsTest-624856523 None] Differential backup transfer completed in 5.9358s {{(pid=123790) _backup_rbd /opt/stack/cinder/cinder/backup/drivers/ceph.py:834}}
Jun 18 22:32:21.839723 ncdv-master-1 cinder-backup[123790]: DEBUG cinder.backup.driver [None req-b0d9615a-0420-44d0-a09a-45bd3e71d345 tempest-VolumesBackupsTest-624856523 None] Getting metadata type 'volume-base-metadata' {{(pid=123790) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:79}}
Jun 18 22:32:21.879688 ncdv-master-1 cinder-backup[123790]: DEBUG cinder.backup.driver [None req-b0d9615a-0420-44d0-a09a-45bd3e71d345 tempest-VolumesBackupsTest-624856523 None] Completed fetching metadata type 'volume-base-metadata' {{(pid=123790) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:98}}
Jun 18 22:32:21.880227 ncdv-master-1 cinder-backup[123790]: DEBUG cinder.backup.driver [None req-b0d9615a-0420-44d0-a09a-45bd3e71d345 tempest-VolumesBackupsTest-624856523 None] Getting metadata type 'volume-metadata' {{(pid=123790) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:109}}
Jun 18 22:32:21.899400 ncdv-master-1 cinder-backup[123790]: DEBUG cinder.backup.driver [None req-b0d9615a-0420-44d0-a09a-45bd3e71d345 tempest-VolumesBackupsTest-624856523 None] No metadata type 'volume-metadata' available {{(pid=123790) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:123}}
Jun 18 22:32:21.902009 ncdv-master-1 cinder-backup[123790]: DEBUG cinder.backup.driver [None req-b0d9615a-0420-44d0-a09a-45bd3e71d345 tempest-VolumesBackupsTest-624856523 None] Getting metadata type 'volume-glance-metadata' {{(pid=123790) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:132}}
Jun 18 22:32:21.921871 ncdv-master-1 cinder-backup[123790]: DEBUG cinder.backup.driver [None req-b0d9615a-0420-44d0-a09a-45bd3e71d345 tempest-VolumesBackupsTest-624856523 None] Completed fetching metadata type 'volume-glance-metadata' {{(pid=123790) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:145}}
Jun 18 22:32:21.924253 ncdv-master-1 cinder-backup[123790]: DEBUG cinder.backup.drivers.ceph [None req-b0d9615a-0420-44d0-a09a-45bd3e71d345 tempest-VolumesBackupsTest-624856523 None] Backing up metadata for volume e19dbd28-395a-445b-b3fc-c301aa82e185. {{(pid=123790) _backup_metadata /opt/stack/cinder/cinder/backup/drivers/ceph.py:999}}
Jun 18 22:32:22.008502 ncdv-master-1 cinder-backup[123790]: DEBUG cinder.backup.drivers.ceph [None req-b0d9615a-0420-44d0-a09a-45bd3e71d345 tempest-VolumesBackupsTest-624856523 None] Backup '1a444022-9454-4029-a324-97aed3646e0c' of volume e19dbd28-395a-445b-b3fc-c301aa82e185 finished. {{(pid=123790) backup /opt/stack/cinder/cinder/backup/drivers/ceph.py:1065}}
Jun 18 22:32:22.010954 ncdv-master-1 cinder-backup[123790]: DEBUG os_brick.initiator.connectors.rbd [None req-b0d9615a-0420-44d0-a09a-45bd3e71d345 tempest-VolumesBackupsTest-624856523 None] ==> disconnect_volume: call "{'self': <os_brick.initiator.connectors.rbd.RBDConnector object at 0x7fa8a8468340>, 'connection_properties': {'name': 'volumes/volume-e19dbd28-395a-445b-b3fc-c301aa82e185', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '***', 'volume_id': 'e19dbd28-395a-445b-b3fc-c301aa82e185', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'device_info': {'path': <os_brick.initiator.linuxrbd.RBDVolumeIOWrapper object at 0x7fa8a81bc640>}, 'force': True, ': True}" {{(pid=123790) trace_logging_wrapper /usr/local/lib/python3.8/dist-packages/os_brick/utils.py:167}}
Jun 18 22:32:22.072040 ncdv-master-1 cinder-backup[123790]: DEBUG os_brick.initiator.connectors.rbd [None req-b0d9615a-0420-44d0-a09a-45bd3e71d345 tempest-VolumesBackupsTest-624856523 None] <== disconnect_volume: return (54ms) None {{(pid=123790) trace_logging_wrapper /usr/local/lib/python3.8/dist-packages/os_brick/utils.py:194}}
Jun 18 22:32:22.172064 ncdv-master-1 cinder-backup[123790]: INFO cinder.backup.manager [None req-b0d9615a-0420-44d0-a09a-45bd3e71d345 tempest-VolumesBackupsTest-624856523 None] Create backup finished. backup: 1a444022-9454-4029-a324-97aed3646e0c.
Jun 18 22:32:24.332997 ncdv-master-1 cinder-backup[123790]: INFO cinder.backup.manager [None req-02c21caf-e6c1-4121-b808-a87c44ddc01b tempest-VolumesBackupsTest-624856523 None] Restore backup started, backup: 1a444022-9454-4029-a324-97aed3646e0c volume: 7ffe351c-051c-4b4c-9986-4301b09c4982.
Jun 18 22:32:24.382186 ncdv-master-1 cinder-backup[123790]: DEBUG os_brick.utils [None req-02c21caf-e6c1-4121-b808-a87c44ddc01b tempest-VolumesBackupsTest-624856523 None] ==> get_connector_properties: call "{'root_helper': 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf', 'my_ip': '10.222.0.30', 'multipath': False, 'enforce_multipath': False, 'host': None, 'execute': None}" {{(pid=123790) trace_logging_wrapper /usr/local/lib/python3.8/dist-packages/os_brick/utils.py:167}}
Jun 18 22:32:24.389312 ncdv-master-1 cinder-backup[123790]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=161870) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Jun 18 22:32:24.434631 ncdv-master-1 cinder-backup[123790]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.050s {{(pid=161870) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Jun 18 22:32:24.435120 ncdv-master-1 cinder-backup[123790]: DEBUG oslo.privsep.daemon [-] privsep: reply[362c318b-dcce-4562-947f-e0c08270694a]: (4, ('## DO NOT EDIT OR REMOVE THIS FILE!\n## If you remove this file, the iSCSI daemon will not start.\n## If you change the InitiatorName, existing access control lists\n## may reject this initiator.  The InitiatorName must be unique\n## for each iSCSI initiator.  Do NOT duplicate iSCSI InitiatorNames.\nInitiatorName=iqn.1993-08.org.debian:01:f965e8976dfc\n', '')) {{(pid=161870) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}}
Jun 18 22:32:24.437146 ncdv-master-1 cinder-backup[123790]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): systool -c fc_host -v {{(pid=161870) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Jun 18 22:32:24.461789 ncdv-master-1 cinder-backup[123790]: DEBUG oslo_concurrency.processutils [-] 'systool -c fc_host -v' failed. Not Retrying. {{(pid=161870) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:473}}
Jun 18 22:32:24.462840 ncdv-master-1 cinder-backup[123790]: DEBUG oslo.privsep.daemon [-] privsep: Exception during request[9a8c9507-67af-4c94-8c93-3a02464d4227]: [Errno 2] No such file or directory: 'systool' {{(pid=161870) _process_cmd /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:479}}
Jun 18 22:32:24.462840 ncdv-master-1 cinder-backup[123790]: Traceback (most recent call last):
Jun 18 22:32:24.462840 ncdv-master-1 cinder-backup[123790]:   File "/usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py", line 476, in _process_cmd
Jun 18 22:32:24.462840 ncdv-master-1 cinder-backup[123790]:     ret = func(*f_args, **f_kwargs)
Jun 18 22:32:24.462840 ncdv-master-1 cinder-backup[123790]:   File "/usr/local/lib/python3.8/dist-packages/oslo_privsep/priv_context.py", line 274, in _wrap
Jun 18 22:32:24.462840 ncdv-master-1 cinder-backup[123790]:     return func(*args, **kwargs)
Jun 18 22:32:24.462840 ncdv-master-1 cinder-backup[123790]:   File "/usr/local/lib/python3.8/dist-packages/os_brick/privileged/rootwrap.py", line 197, in execute_root
Jun 18 22:32:24.462840 ncdv-master-1 cinder-backup[123790]:     return custom_execute(*cmd, shell=False, run_as_root=False, **kwargs)
Jun 18 22:32:24.462840 ncdv-master-1 cinder-backup[123790]:   File "/usr/local/lib/python3.8/dist-packages/os_brick/privileged/rootwrap.py", line 145, in custom_execute
Jun 18 22:32:24.462840 ncdv-master-1 cinder-backup[123790]:     return putils.execute(on_execute=on_execute,
Jun 18 22:32:24.462840 ncdv-master-1 cinder-backup[123790]:   File "/usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py", line 395, in execute
Jun 18 22:32:24.462840 ncdv-master-1 cinder-backup[123790]:     obj = subprocess.Popen(cmd,
Jun 18 22:32:24.462840 ncdv-master-1 cinder-backup[123790]:   File "/usr/lib/python3.8/subprocess.py", line 858, in __init__
Jun 18 22:32:24.462840 ncdv-master-1 cinder-backup[123790]:     self._execute_child(args, executable, preexec_fn, close_fds,
Jun 18 22:32:24.462840 ncdv-master-1 cinder-backup[123790]:   File "/usr/lib/python3.8/subprocess.py", line 1704, in _execute_child
Jun 18 22:32:24.462840 ncdv-master-1 cinder-backup[123790]:     raise child_exception_type(errno_num, err_msg, err_filename)
Jun 18 22:32:24.462840 ncdv-master-1 cinder-backup[123790]: FileNotFoundError: [Errno 2] No such file or directory: 'systool'
Jun 18 22:32:24.464338 ncdv-master-1 cinder-backup[123790]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a8c9507-67af-4c94-8c93-3a02464d4227]: (5, 'builtins.FileNotFoundError', (2, 'No such file or directory')) {{(pid=161870) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}}
Jun 18 22:32:24.465877 ncdv-master-1 cinder-backup[123790]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): systool -c fc_host -v {{(pid=161870) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Jun 18 22:32:24.477674 ncdv-master-1 cinder-backup[123790]: DEBUG oslo_concurrency.processutils [-] 'systool -c fc_host -v' failed. Not Retrying. {{(pid=161870) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:473}}
Jun 18 22:32:24.478287 ncdv-master-1 cinder-backup[123790]: DEBUG oslo.privsep.daemon [-] privsep: Exception during request[3410df69-9acb-4380-a838-3604fce4fcc8]: [Errno 2] No such file or directory: 'systool' {{(pid=161870) _process_cmd /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:479}}
Jun 18 22:32:24.478287 ncdv-master-1 cinder-backup[123790]: Traceback (most recent call last):
Jun 18 22:32:24.478287 ncdv-master-1 cinder-backup[123790]:   File "/usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py", line 476, in _process_cmd
Jun 18 22:32:24.478287 ncdv-master-1 cinder-backup[123790]:     ret = func(*f_args, **f_kwargs)
Jun 18 22:32:24.478287 ncdv-master-1 cinder-backup[123790]:   File "/usr/local/lib/python3.8/dist-packages/oslo_privsep/priv_context.py", line 274, in _wrap
Jun 18 22:32:24.478287 ncdv-master-1 cinder-backup[123790]:     return func(*args, **kwargs)
Jun 18 22:32:24.478287 ncdv-master-1 cinder-backup[123790]:   File "/usr/local/lib/python3.8/dist-packages/os_brick/privileged/rootwrap.py", line 197, in execute_root
Jun 18 22:32:24.478287 ncdv-master-1 cinder-backup[123790]:     return custom_execute(*cmd, shell=False, run_as_root=False, **kwargs)
Jun 18 22:32:24.478287 ncdv-master-1 cinder-backup[123790]:   File "/usr/local/lib/python3.8/dist-packages/os_brick/privileged/rootwrap.py", line 145, in custom_execute
Jun 18 22:32:24.478287 ncdv-master-1 cinder-backup[123790]:     return putils.execute(on_execute=on_execute,
Jun 18 22:32:24.478287 ncdv-master-1 cinder-backup[123790]:   File "/usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py", line 395, in execute
Jun 18 22:32:24.478287 ncdv-master-1 cinder-backup[123790]:     obj = subprocess.Popen(cmd,
Jun 18 22:32:24.478287 ncdv-master-1 cinder-backup[123790]:   File "/usr/lib/python3.8/subprocess.py", line 858, in __init__
Jun 18 22:32:24.478287 ncdv-master-1 cinder-backup[123790]:     self._execute_child(args, executable, preexec_fn, close_fds,
Jun 18 22:32:24.478287 ncdv-master-1 cinder-backup[123790]:   File "/usr/lib/python3.8/subprocess.py", line 1704, in _execute_child
Jun 18 22:32:24.478287 ncdv-master-1 cinder-backup[123790]:     raise child_exception_type(errno_num, err_msg, err_filename)
Jun 18 22:32:24.478287 ncdv-master-1 cinder-backup[123790]: FileNotFoundError: [Errno 2] No such file or directory: 'systool'
Jun 18 22:32:24.479717 ncdv-master-1 cinder-backup[123790]: DEBUG oslo.privsep.daemon [-] privsep: reply[3410df69-9acb-4380-a838-3604fce4fcc8]: (5, 'builtins.FileNotFoundError', (2, 'No such file or directory')) {{(pid=161870) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}}
Jun 18 22:32:24.481241 ncdv-master-1 cinder-backup[123790]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=161870) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Jun 18 22:32:24.512756 ncdv-master-1 cinder-backup[123790]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.031s {{(pid=161870) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Jun 18 22:32:24.513307 ncdv-master-1 cinder-backup[123790]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f704561-b8f4-45cc-abac-a745eaabed29]: (4, ('/dev/sda1\n', '')) {{(pid=161870) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}}
Jun 18 22:32:24.515827 ncdv-master-1 cinder-backup[123790]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/sda1 -s UUID -o value {{(pid=161870) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Jun 18 22:32:24.559429 ncdv-master-1 cinder-backup[123790]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/sda1 -s UUID -o value" returned: 0 in 0.043s {{(pid=161870) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Jun 18 22:32:24.560108 ncdv-master-1 cinder-backup[123790]: DEBUG oslo.privsep.daemon [-] privsep: reply[48b285f9-2d9b-49c1-95c5-8c92e77926a2]: (4, ('02bb033c-a191-40c0-94fb-bb025c724b13\n', '')) {{(pid=161870) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}}
Jun 18 22:32:24.562297 ncdv-master-1 cinder-backup[123790]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /sys/class/dmi/id/product_uuid {{(pid=161870) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Jun 18 22:32:24.583200 ncdv-master-1 cinder-backup[123790]: DEBUG oslo_concurrency.processutils [-] CMD "cat /sys/class/dmi/id/product_uuid" returned: 0 in 0.021s {{(pid=161870) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Jun 18 22:32:24.583659 ncdv-master-1 cinder-backup[123790]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7323a02-71b7-4c5d-aafc-c4f8564ec1f0]: (4, ('cdfe4be3-957b-ec4d-8b08-ab749503be55\n', '')) {{(pid=161870) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}}
Jun 18 22:32:24.584563 ncdv-master-1 cinder-backup[123790]: DEBUG oslo_concurrency.processutils [None req-02c21caf-e6c1-4121-b808-a87c44ddc01b tempest-VolumesBackupsTest-624856523 None] Running cmd (subprocess): nvme version {{(pid=123790) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Jun 18 22:32:24.641292 ncdv-master-1 cinder-backup[123790]: DEBUG oslo_concurrency.processutils [None req-02c21caf-e6c1-4121-b808-a87c44ddc01b tempest-VolumesBackupsTest-624856523 None] CMD "nvme version" returned: 0 in 0.056s {{(pid=123790) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Jun 18 22:32:24.643293 ncdv-master-1 cinder-backup[123790]: DEBUG os_brick.initiator.connectors.lightos [None req-02c21caf-e6c1-4121-b808-a87c44ddc01b tempest-VolumesBackupsTest-624856523 None] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=123790) find_dsc /usr/local/lib/python3.8/dist-packages/os_brick/initiator/connectors/lightos.py:100}}
Jun 18 22:32:24.643666 ncdv-master-1 cinder-backup[123790]: DEBUG os_brick.initiator.connectors.lightos [None req-02c21caf-e6c1-4121-b808-a87c44ddc01b tempest-VolumesBackupsTest-624856523 None] LIGHTOS: did not find dsc, continuing anyway. {{(pid=123790) get_connector_properties /usr/local/lib/python3.8/dist-packages/os_brick/initiator/connectors/lightos.py:78}}
Jun 18 22:32:24.644218 ncdv-master-1 cinder-backup[123790]: DEBUG os_brick.initiator.connectors.lightos [None req-02c21caf-e6c1-4121-b808-a87c44ddc01b tempest-VolumesBackupsTest-624856523 None] LIGHTOS: finally hostnqn: nqn.2014-08.org.nvmexpress:uuid:84627872-5390-4220-b960-ed5945b5c24c dsc:  {{(pid=123790) get_connector_properties /usr/local/lib/python3.8/dist-packages/os_brick/initiator/connectors/lightos.py:81}}
Jun 18 22:32:24.644741 ncdv-master-1 cinder-backup[123790]: DEBUG os_brick.utils [None req-02c21caf-e6c1-4121-b808-a87c44ddc01b tempest-VolumesBackupsTest-624856523 None] <== get_connector_properties: return (261ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.222.0.30', 'host': 'ncdv-master-1', 'multipath': False, 'initiator': 'iqn.1993-08.org.debian:01:f965e8976dfc', 'do_local_attach': False, 'uuid': '02bb033c-a191-40c0-94fb-bb025c724b13', 'system uuid': 'cdfe4be3-957b-ec4d-8b08-ab749503be55', 'nqn': 'nqn.2014-08.org.nvmexpress:uuid:84627872-5390-4220-b960-ed5945b5c24c', 'found_dsc': ''} {{(pid=123790) trace_logging_wrapper /usr/local/lib/python3.8/dist-packages/os_brick/utils.py:194}}
Jun 18 22:32:26.092058 ncdv-master-1 cinder-backup[123790]: DEBUG os_brick.initiator.connector [None req-02c21caf-e6c1-4121-b808-a87c44ddc01b tempest-VolumesBackupsTest-624856523 None] Factory for rbd on None {{(pid=123790) factory /usr/local/lib/python3.8/dist-packages/os_brick/initiator/connector.py:284}}
Jun 18 22:32:26.094886 ncdv-master-1 cinder-backup[123790]: DEBUG os_brick.initiator.connectors.rbd [None req-02c21caf-e6c1-4121-b808-a87c44ddc01b tempest-VolumesBackupsTest-624856523 None] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.rbd.RBDConnector object at 0x7fa8a8158c40>, 'connection_properties': {'name': 'volumes/volume-7ffe351c-051c-4b4c-9986-4301b09c4982', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '***', 'volume_id': '7ffe351c-051c-4b4c-9986-4301b09c4982', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, ': False}}" {{(pid=123790) trace_logging_wrapper /usr/local/lib/python3.8/dist-packages/os_brick/utils.py:167}}
Jun 18 22:32:26.096666 ncdv-master-1 cinder-backup[123790]: DEBUG os_brick.initiator.linuxrbd [None req-02c21caf-e6c1-4121-b808-a87c44ddc01b tempest-VolumesBackupsTest-624856523 None] opening connection to ceph cluster (timeout=-1). {{(pid=123790) connect /usr/local/lib/python3.8/dist-packages/os_brick/initiator/linuxrbd.py:70}}
Jun 18 22:32:26.227312 ncdv-master-1 cinder-backup[123790]: DEBUG os_brick.initiator.connectors.rbd [None req-02c21caf-e6c1-4121-b808-a87c44ddc01b tempest-VolumesBackupsTest-624856523 None] <== connect_volume: return (130ms) {'path': <os_brick.initiator.linuxrbd.RBDVolumeIOWrapper object at 0x7fa8a7770a00>} {{(pid=123790) trace_logging_wrapper /usr/local/lib/python3.8/dist-packages/os_brick/utils.py:194}}
Jun 18 22:32:26.243715 ncdv-master-1 cinder-backup[123790]: DEBUG oslo_db.sqlalchemy.engines [None req-02c21caf-e6c1-4121-b808-a87c44ddc01b tempest-VolumesBackupsTest-624856523 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123790) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}}
Jun 18 22:32:26.271960 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writing DB stats cinder:SELECT=28,cinder:UPDATE=11,cinder:INSERT=1 {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 22:32:26.273049 ncdv-master-1 cinder-backup[123790]: DEBUG cinder.backup.drivers.ceph [None req-02c21caf-e6c1-4121-b808-a87c44ddc01b tempest-VolumesBackupsTest-624856523 None] Starting restore from Ceph backup=1a444022-9454-4029-a324-97aed3646e0c to volume=volume-7ffe351c-051c-4b4c-9986-4301b09c4982 {{(pid=123790) restore /opt/stack/cinder/cinder/backup/drivers/ceph.py:1345}}
Jun 18 22:32:26.438164 ncdv-master-1 cinder-backup[123790]: DEBUG cinder.backup.drivers.ceph [None req-02c21caf-e6c1-4121-b808-a87c44ddc01b tempest-VolumesBackupsTest-624856523 None] Looking for snapshot of backup base 'volume-e19dbd28-395a-445b-b3fc-c301aa82e185.backup.1a444022-9454-4029-a324-97aed3646e0c' {{(pid=123790) _get_backup_snap_name /opt/stack/cinder/cinder/backup/drivers/ceph.py:953}}
Jun 18 22:32:26.438164 ncdv-master-1 cinder-backup[123790]: DEBUG cinder.backup.drivers.ceph [None req-02c21caf-e6c1-4121-b808-a87c44ddc01b tempest-VolumesBackupsTest-624856523 None] Found snapshot 'backup.1a444022-9454-4029-a324-97aed3646e0c.snap.1655591535.3469276' {{(pid=123790) _get_backup_snap_name /opt/stack/cinder/cinder/backup/drivers/ceph.py:972}}
Jun 18 22:32:26.446616 ncdv-master-1 cinder-backup[123790]: DEBUG cinder.backup.drivers.ceph [None req-02c21caf-e6c1-4121-b808-a87c44ddc01b tempest-VolumesBackupsTest-624856523 None] Volume file is RBD. {{(pid=123790) _diff_restore_allowed /opt/stack/cinder/cinder/backup/drivers/ceph.py:1247}}
Jun 18 22:32:26.552680 ncdv-master-1 cinder-backup[123790]: DEBUG cinder.backup.drivers.ceph [None req-02c21caf-e6c1-4121-b808-a87c44ddc01b tempest-VolumesBackupsTest-624856523 None] Attempting differential restore. {{(pid=123790) _restore_volume /opt/stack/cinder/cinder/backup/drivers/ceph.py:1300}}
Jun 18 22:32:26.553442 ncdv-master-1 cinder-backup[123790]: DEBUG cinder.backup.drivers.ceph [None req-02c21caf-e6c1-4121-b808-a87c44ddc01b tempest-VolumesBackupsTest-624856523 None] Attempting incremental restore from base='volume-e19dbd28-395a-445b-b3fc-c301aa82e185.backup.1a444022-9454-4029-a324-97aed3646e0c' snap='backup.1a444022-9454-4029-a324-97aed3646e0c.snap.1655591535.3469276' {{(pid=123790) _diff_restore_rbd /opt/stack/cinder/cinder/backup/drivers/ceph.py:1146}}
Jun 18 22:32:26.554046 ncdv-master-1 cinder-backup[123790]: DEBUG cinder.backup.drivers.ceph [None req-02c21caf-e6c1-4121-b808-a87c44ddc01b tempest-VolumesBackupsTest-624856523 None] Performing differential transfer from 'volume-e19dbd28-395a-445b-b3fc-c301aa82e185.backup.1a444022-9454-4029-a324-97aed3646e0c' to 'volume-7ffe351c-051c-4b4c-9986-4301b09c4982' {{(pid=123790) _rbd_diff_transfer /opt/stack/cinder/cinder/backup/drivers/ceph.py:656}}
Jun 18 22:32:26.554626 ncdv-master-1 cinder-backup[123790]: DEBUG cinder.backup.drivers.ceph [None req-02c21caf-e6c1-4121-b808-a87c44ddc01b tempest-VolumesBackupsTest-624856523 None] Piping cmd1='rbd export-diff --id cinder-bak --conf /etc/ceph/ceph.conf --pool backups backups/volume-e19dbd28-395a-445b-b3fc-c301aa82e185.backup.1a444022-9454-4029-a324-97aed3646e0c@backup.1a444022-9454-4029-a324-97aed3646e0c.snap.1655591535.3469276 -' into... {{(pid=123790) _piped_execute /opt/stack/cinder/cinder/backup/drivers/ceph.py:613}}
Jun 18 22:32:26.555140 ncdv-master-1 cinder-backup[123790]: DEBUG cinder.backup.drivers.ceph [None req-02c21caf-e6c1-4121-b808-a87c44ddc01b tempest-VolumesBackupsTest-624856523 None] cmd2='rbd import-diff --id cinder --conf /tmp/brickrbd_aqvpksxj --pool volumes - volumes/volume-7ffe351c-051c-4b4c-9986-4301b09c4982' {{(pid=123790) _piped_execute /opt/stack/cinder/cinder/backup/drivers/ceph.py:614}}
Jun 18 22:32:32.097681 ncdv-master-1 cinder-backup[123790]: DEBUG cinder.backup.drivers.ceph [None req-02c21caf-e6c1-4121-b808-a87c44ddc01b tempest-VolumesBackupsTest-624856523 None] Restore transfer completed in 5.5430s {{(pid=123790) _diff_restore_rbd /opt/stack/cinder/cinder/backup/drivers/ceph.py:1168}}
Jun 18 22:32:32.099192 ncdv-master-1 cinder-backup[123790]: DEBUG cinder.backup.drivers.ceph [None req-02c21caf-e6c1-4121-b808-a87c44ddc01b tempest-VolumesBackupsTest-624856523 None] Restore target I/O object does not support fileno() - skipping call to fsync(). {{(pid=123790) restore /opt/stack/cinder/cinder/backup/drivers/ceph.py:1356}}
Jun 18 22:32:32.182005 ncdv-master-1 cinder-backup[123790]: DEBUG cinder.backup.driver [None req-02c21caf-e6c1-4121-b808-a87c44ddc01b tempest-VolumesBackupsTest-624856523 None] Restoring volume base metadata {{(pid=123790) _restore_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:177}}
Jun 18 22:32:32.210958 ncdv-master-1 cinder-backup[123790]: DEBUG cinder.backup.driver [None req-02c21caf-e6c1-4121-b808-a87c44ddc01b tempest-VolumesBackupsTest-624856523 None] No metadata of type 'volume-metadata' to restore {{(pid=123790) put /opt/stack/cinder/cinder/backup/driver.py:345}}
Jun 18 22:32:32.211807 ncdv-master-1 cinder-backup[123790]: DEBUG cinder.backup.driver [None req-02c21caf-e6c1-4121-b808-a87c44ddc01b tempest-VolumesBackupsTest-624856523 None] Restoring volume glance metadata {{(pid=123790) _restore_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:258}}
Jun 18 22:32:32.583675 ncdv-master-1 cinder-backup[123790]: DEBUG cinder.backup.drivers.ceph [None req-02c21caf-e6c1-4121-b808-a87c44ddc01b tempest-VolumesBackupsTest-624856523 None] Restore to volume 7ffe351c-051c-4b4c-9986-4301b09c4982 finished successfully. {{(pid=123790) restore /opt/stack/cinder/cinder/backup/drivers/ceph.py:1363}}
Jun 18 22:32:32.586247 ncdv-master-1 cinder-backup[123790]: DEBUG os_brick.initiator.connectors.rbd [None req-02c21caf-e6c1-4121-b808-a87c44ddc01b tempest-VolumesBackupsTest-624856523 None] ==> disconnect_volume: call "{'self': <os_brick.initiator.connectors.rbd.RBDConnector object at 0x7fa8a8158c40>, 'connection_properties': {'name': 'volumes/volume-7ffe351c-051c-4b4c-9986-4301b09c4982', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '***', 'volume_id': '7ffe351c-051c-4b4c-9986-4301b09c4982', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'device_info': {'path': <os_brick.initiator.linuxrbd.RBDVolumeIOWrapper object at 0x7fa8a7770a00>}, 'force': True, ': False}" {{(pid=123790) trace_logging_wrapper /usr/local/lib/python3.8/dist-packages/os_brick/utils.py:167}}
Jun 18 22:32:32.609908 ncdv-master-1 cinder-backup[123790]: DEBUG os_brick.initiator.connectors.rbd [None req-02c21caf-e6c1-4121-b808-a87c44ddc01b tempest-VolumesBackupsTest-624856523 None] <== disconnect_volume: return (19ms) None {{(pid=123790) trace_logging_wrapper /usr/local/lib/python3.8/dist-packages/os_brick/utils.py:194}}
Jun 18 22:32:32.734731 ncdv-master-1 cinder-backup[123790]: DEBUG cinder.backup.manager [None req-02c21caf-e6c1-4121-b808-a87c44ddc01b tempest-VolumesBackupsTest-624856523 None] Encryption key ID for volume 7ffe351c-051c-4b4c-9986-4301b09c4982 already matches encryption key ID in backup 1a444022-9454-4029-a324-97aed3646e0c. {{(pid=123790) _run_restore /opt/stack/cinder/cinder/backup/manager.py:824}}
Jun 18 22:32:32.812603 ncdv-master-1 cinder-backup[123790]: INFO cinder.backup.manager [None req-02c21caf-e6c1-4121-b808-a87c44ddc01b tempest-VolumesBackupsTest-624856523 None] Finished restoring backup 1a444022-9454-4029-a324-97aed3646e0c to volume 7ffe351c-051c-4b4c-9986-4301b09c4982.
Jun 18 22:32:35.700412 ncdv-master-1 cinder-backup[123790]: INFO cinder.backup.manager [None req-9aa46518-94ac-44a6-82ec-ee73c70bd31b tempest-VolumesBackupsTest-624856523 None] Delete backup started, backup: 1a444022-9454-4029-a324-97aed3646e0c.
Jun 18 22:32:35.706842 ncdv-master-1 cinder-backup[123790]: DEBUG cinder.backup.drivers.ceph [None req-9aa46518-94ac-44a6-82ec-ee73c70bd31b tempest-VolumesBackupsTest-624856523 None] Delete started for backup=1a444022-9454-4029-a324-97aed3646e0c {{(pid=123790) delete_backup /opt/stack/cinder/cinder/backup/drivers/ceph.py:1372}}
Jun 18 22:32:35.708054 ncdv-master-1 cinder-backup[123790]: DEBUG cinder.backup.drivers.ceph [None req-9aa46518-94ac-44a6-82ec-ee73c70bd31b tempest-VolumesBackupsTest-624856523 None] Trying diff format basename='volume-e19dbd28-395a-445b-b3fc-c301aa82e185.backup.1a444022-9454-4029-a324-97aed3646e0c' for backup base image of volume e19dbd28-395a-445b-b3fc-c301aa82e185. {{(pid=123790) _try_delete_base_image /opt/stack/cinder/cinder/backup/drivers/ceph.py:541}}
Jun 18 22:32:35.821250 ncdv-master-1 cinder-backup[123790]: DEBUG cinder.backup.drivers.ceph [None req-9aa46518-94ac-44a6-82ec-ee73c70bd31b tempest-VolumesBackupsTest-624856523 None] Looking for snapshot of backup base 'volume-e19dbd28-395a-445b-b3fc-c301aa82e185.backup.1a444022-9454-4029-a324-97aed3646e0c' {{(pid=123790) _get_backup_snap_name /opt/stack/cinder/cinder/backup/drivers/ceph.py:953}}
Jun 18 22:32:35.822410 ncdv-master-1 cinder-backup[123790]: DEBUG cinder.backup.drivers.ceph [None req-9aa46518-94ac-44a6-82ec-ee73c70bd31b tempest-VolumesBackupsTest-624856523 None] Found snapshot 'backup.1a444022-9454-4029-a324-97aed3646e0c.snap.1655591535.3469276' {{(pid=123790) _get_backup_snap_name /opt/stack/cinder/cinder/backup/drivers/ceph.py:972}}
Jun 18 22:32:35.831506 ncdv-master-1 cinder-backup[123790]: DEBUG cinder.backup.drivers.ceph [None req-9aa46518-94ac-44a6-82ec-ee73c70bd31b tempest-VolumesBackupsTest-624856523 None] Deleting backup snapshot='backup.1a444022-9454-4029-a324-97aed3646e0c.snap.1655591535.3469276' {{(pid=123790) _delete_backup_snapshot /opt/stack/cinder/cinder/backup/drivers/ceph.py:499}}
Jun 18 22:32:36.123471 ncdv-master-1 cinder-backup[123790]: INFO cinder.backup.drivers.ceph [None req-9aa46518-94ac-44a6-82ec-ee73c70bd31b tempest-VolumesBackupsTest-624856523 None] Deleting backup base image='volume-e19dbd28-395a-445b-b3fc-c301aa82e185.backup.1a444022-9454-4029-a324-97aed3646e0c' of volume e19dbd28-395a-445b-b3fc-c301aa82e185.
Jun 18 22:32:36.238980 ncdv-master-1 cinder-backup[123790]: DEBUG oslo_db.sqlalchemy.engines [None req-e84d75e5-5441-4d43-964b-5b6d3790e0a5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123790) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}}
Jun 18 22:32:36.912538 ncdv-master-1 cinder-backup[123790]: DEBUG cinder.backup.drivers.ceph [None req-9aa46518-94ac-44a6-82ec-ee73c70bd31b tempest-VolumesBackupsTest-624856523 None] Base backup image='volume-e19dbd28-395a-445b-b3fc-c301aa82e185.backup.1a444022-9454-4029-a324-97aed3646e0c' of volume e19dbd28-395a-445b-b3fc-c301aa82e185 deleted. {{(pid=123790) _try_delete_base_image /opt/stack/cinder/cinder/backup/drivers/ceph.py:589}}
Jun 18 22:32:37.061061 ncdv-master-1 cinder-backup[123790]: DEBUG cinder.backup.drivers.ceph [None req-9aa46518-94ac-44a6-82ec-ee73c70bd31b tempest-VolumesBackupsTest-624856523 None] Delete of backup '1a444022-9454-4029-a324-97aed3646e0c' for volume 'e19dbd28-395a-445b-b3fc-c301aa82e185' finished. {{(pid=123790) delete_backup /opt/stack/cinder/cinder/backup/drivers/ceph.py:1400}}
Jun 18 22:32:37.108608 ncdv-master-1 cinder-backup[123790]: DEBUG cinder.quota [None req-9aa46518-94ac-44a6-82ec-ee73c70bd31b tempest-VolumesBackupsTest-624856523 None] Created reservations ['c36fe3ae-b62e-4ecd-a3f0-6e320e72a9df', 'ac088af4-3003-49e2-9c58-846ea86a6017'] {{(pid=123790) reserve /opt/stack/cinder/cinder/quota.py:755}}
Jun 18 22:32:37.177546 ncdv-master-1 cinder-backup[123790]: INFO cinder.backup.manager [None req-9aa46518-94ac-44a6-82ec-ee73c70bd31b tempest-VolumesBackupsTest-624856523 None] Delete backup finished, backup 1a444022-9454-4029-a324-97aed3646e0c deleted.
Jun 18 22:32:46.245105 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writing DB stats cinder:SELECT=61,cinder:UPDATE=9,cinder:INSERT=6 {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 22:32:47.568152 ncdv-master-1 cinder-backup[123790]: INFO cinder.backup.manager [None req-4eef794b-7060-46f7-8693-f4c0f9327759 tempest-VolumesBackupsV39Test-288082446 None] Create backup started, backup: 95809608-10bb-4891-8b8c-6e85157a285c volume: f1b8d7ef-2b5d-425a-9510-9e9c811f8bfa.
Jun 18 22:32:47.576173 ncdv-master-1 cinder-backup[123790]: INFO cinder.backup.manager [None req-4eef794b-7060-46f7-8693-f4c0f9327759 tempest-VolumesBackupsV39Test-288082446 None] Call Volume Manager to get_backup_device for Backup(availability_zone=None,container=None,created_at=2022-06-18T22:32:47Z,data_timestamp=2022-06-18T22:32:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsV39Test-Backup-1981967244',encryption_key_id=None,fail_reason=None,host='ncdv-master-1',id=95809608-10bb-4891-8b8c-6e85157a285c,metadata={},num_dependent_backups=0,object_count=0,parent=None,parent_id=None,project_id='c5ee789f989a4382bac7b1a5ed79d4d3',restore_volume_id=None,service='cinder.backup.drivers.ceph.CephBackupDriver',service_metadata=None,size=1,snapshot_id=None,status='creating',temp_snapshot_id=None,temp_volume_id=None,updated_at=None,user_id='fb7707ec6a664b328adfa6efc791f6e4',volume_id=f1b8d7ef-2b5d-425a-9510-9e9c811f8bfa)
Jun 18 22:32:47.630022 ncdv-master-1 cinder-backup[123790]: DEBUG os_brick.utils [None req-4eef794b-7060-46f7-8693-f4c0f9327759 tempest-VolumesBackupsV39Test-288082446 None] ==> get_connector_properties: call "{'root_helper': 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf', 'my_ip': '10.222.0.30', 'multipath': False, 'enforce_multipath': False, 'host': None, 'execute': None}" {{(pid=123790) trace_logging_wrapper /usr/local/lib/python3.8/dist-packages/os_brick/utils.py:167}}
Jun 18 22:32:47.631896 ncdv-master-1 cinder-backup[123790]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=161870) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Jun 18 22:32:47.644335 ncdv-master-1 cinder-backup[123790]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.011s {{(pid=161870) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Jun 18 22:32:47.645317 ncdv-master-1 cinder-backup[123790]: DEBUG oslo.privsep.daemon [-] privsep: reply[e407c08b-953d-45a0-b449-aebad08bc5af]: (4, ('## DO NOT EDIT OR REMOVE THIS FILE!\n## If you remove this file, the iSCSI daemon will not start.\n## If you change the InitiatorName, existing access control lists\n## may reject this initiator.  The InitiatorName must be unique\n## for each iSCSI initiator.  Do NOT duplicate iSCSI InitiatorNames.\nInitiatorName=iqn.1993-08.org.debian:01:f965e8976dfc\n', '')) {{(pid=161870) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}}
Jun 18 22:32:47.654922 ncdv-master-1 cinder-backup[123790]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): systool -c fc_host -v {{(pid=161870) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Jun 18 22:32:47.665572 ncdv-master-1 cinder-backup[123790]: DEBUG oslo_concurrency.processutils [-] 'systool -c fc_host -v' failed. Not Retrying. {{(pid=161870) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:473}}
Jun 18 22:32:47.665866 ncdv-master-1 cinder-backup[123790]: DEBUG oslo.privsep.daemon [-] privsep: Exception during request[712ee343-4844-41b2-bba6-9aa4e7eb5ca5]: [Errno 2] No such file or directory: 'systool' {{(pid=161870) _process_cmd /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:479}}
Jun 18 22:32:47.665866 ncdv-master-1 cinder-backup[123790]: Traceback (most recent call last):
Jun 18 22:32:47.665866 ncdv-master-1 cinder-backup[123790]:   File "/usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py", line 476, in _process_cmd
Jun 18 22:32:47.665866 ncdv-master-1 cinder-backup[123790]:     ret = func(*f_args, **f_kwargs)
Jun 18 22:32:47.665866 ncdv-master-1 cinder-backup[123790]:   File "/usr/local/lib/python3.8/dist-packages/oslo_privsep/priv_context.py", line 274, in _wrap
Jun 18 22:32:47.665866 ncdv-master-1 cinder-backup[123790]:     return func(*args, **kwargs)
Jun 18 22:32:47.665866 ncdv-master-1 cinder-backup[123790]:   File "/usr/local/lib/python3.8/dist-packages/os_brick/privileged/rootwrap.py", line 197, in execute_root
Jun 18 22:32:47.665866 ncdv-master-1 cinder-backup[123790]:     return custom_execute(*cmd, shell=False, run_as_root=False, **kwargs)
Jun 18 22:32:47.665866 ncdv-master-1 cinder-backup[123790]:   File "/usr/local/lib/python3.8/dist-packages/os_brick/privileged/rootwrap.py", line 145, in custom_execute
Jun 18 22:32:47.665866 ncdv-master-1 cinder-backup[123790]:     return putils.execute(on_execute=on_execute,
Jun 18 22:32:47.665866 ncdv-master-1 cinder-backup[123790]:   File "/usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py", line 395, in execute
Jun 18 22:32:47.665866 ncdv-master-1 cinder-backup[123790]:     obj = subprocess.Popen(cmd,
Jun 18 22:32:47.665866 ncdv-master-1 cinder-backup[123790]:   File "/usr/lib/python3.8/subprocess.py", line 858, in __init__
Jun 18 22:32:47.665866 ncdv-master-1 cinder-backup[123790]:     self._execute_child(args, executable, preexec_fn, close_fds,
Jun 18 22:32:47.665866 ncdv-master-1 cinder-backup[123790]:   File "/usr/lib/python3.8/subprocess.py", line 1704, in _execute_child
Jun 18 22:32:47.665866 ncdv-master-1 cinder-backup[123790]:     raise child_exception_type(errno_num, err_msg, err_filename)
Jun 18 22:32:47.665866 ncdv-master-1 cinder-backup[123790]: FileNotFoundError: [Errno 2] No such file or directory: 'systool'
Jun 18 22:32:47.667179 ncdv-master-1 cinder-backup[123790]: DEBUG oslo.privsep.daemon [-] privsep: reply[712ee343-4844-41b2-bba6-9aa4e7eb5ca5]: (5, 'builtins.FileNotFoundError', (2, 'No such file or directory')) {{(pid=161870) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}}
Jun 18 22:32:47.670213 ncdv-master-1 cinder-backup[123790]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): systool -c fc_host -v {{(pid=161870) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Jun 18 22:32:47.674999 ncdv-master-1 cinder-backup[123790]: DEBUG oslo_concurrency.processutils [-] 'systool -c fc_host -v' failed. Not Retrying. {{(pid=161870) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:473}}
Jun 18 22:32:47.675735 ncdv-master-1 cinder-backup[123790]: DEBUG oslo.privsep.daemon [-] privsep: Exception during request[7479247a-8142-4b6c-a228-4e181bc78076]: [Errno 2] No such file or directory: 'systool' {{(pid=161870) _process_cmd /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:479}}
Jun 18 22:32:47.675735 ncdv-master-1 cinder-backup[123790]: Traceback (most recent call last):
Jun 18 22:32:47.675735 ncdv-master-1 cinder-backup[123790]:   File "/usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py", line 476, in _process_cmd
Jun 18 22:32:47.675735 ncdv-master-1 cinder-backup[123790]:     ret = func(*f_args, **f_kwargs)
Jun 18 22:32:47.675735 ncdv-master-1 cinder-backup[123790]:   File "/usr/local/lib/python3.8/dist-packages/oslo_privsep/priv_context.py", line 274, in _wrap
Jun 18 22:32:47.675735 ncdv-master-1 cinder-backup[123790]:     return func(*args, **kwargs)
Jun 18 22:32:47.675735 ncdv-master-1 cinder-backup[123790]:   File "/usr/local/lib/python3.8/dist-packages/os_brick/privileged/rootwrap.py", line 197, in execute_root
Jun 18 22:32:47.675735 ncdv-master-1 cinder-backup[123790]:     return custom_execute(*cmd, shell=False, run_as_root=False, **kwargs)
Jun 18 22:32:47.675735 ncdv-master-1 cinder-backup[123790]:   File "/usr/local/lib/python3.8/dist-packages/os_brick/privileged/rootwrap.py", line 145, in custom_execute
Jun 18 22:32:47.675735 ncdv-master-1 cinder-backup[123790]:     return putils.execute(on_execute=on_execute,
Jun 18 22:32:47.675735 ncdv-master-1 cinder-backup[123790]:   File "/usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py", line 395, in execute
Jun 18 22:32:47.675735 ncdv-master-1 cinder-backup[123790]:     obj = subprocess.Popen(cmd,
Jun 18 22:32:47.675735 ncdv-master-1 cinder-backup[123790]:   File "/usr/lib/python3.8/subprocess.py", line 858, in __init__
Jun 18 22:32:47.675735 ncdv-master-1 cinder-backup[123790]:     self._execute_child(args, executable, preexec_fn, close_fds,
Jun 18 22:32:47.675735 ncdv-master-1 cinder-backup[123790]:   File "/usr/lib/python3.8/subprocess.py", line 1704, in _execute_child
Jun 18 22:32:47.675735 ncdv-master-1 cinder-backup[123790]:     raise child_exception_type(errno_num, err_msg, err_filename)
Jun 18 22:32:47.675735 ncdv-master-1 cinder-backup[123790]: FileNotFoundError: [Errno 2] No such file or directory: 'systool'
Jun 18 22:32:47.677476 ncdv-master-1 cinder-backup[123790]: DEBUG oslo.privsep.daemon [-] privsep: reply[7479247a-8142-4b6c-a228-4e181bc78076]: (5, 'builtins.FileNotFoundError', (2, 'No such file or directory')) {{(pid=161870) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}}
Jun 18 22:32:47.679745 ncdv-master-1 cinder-backup[123790]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=161870) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Jun 18 22:32:47.689522 ncdv-master-1 cinder-backup[123790]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.010s {{(pid=161870) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Jun 18 22:32:47.689840 ncdv-master-1 cinder-backup[123790]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcea7c43-6a69-4634-82e2-001f7b87ac26]: (4, ('/dev/sda1\n', '')) {{(pid=161870) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}}
Jun 18 22:32:47.692113 ncdv-master-1 cinder-backup[123790]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/sda1 -s UUID -o value {{(pid=161870) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Jun 18 22:32:47.718404 ncdv-master-1 cinder-backup[123790]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/sda1 -s UUID -o value" returned: 0 in 0.026s {{(pid=161870) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Jun 18 22:32:47.718772 ncdv-master-1 cinder-backup[123790]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bf107a3-f203-4dab-93f5-905e457400bc]: (4, ('02bb033c-a191-40c0-94fb-bb025c724b13\n', '')) {{(pid=161870) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}}
Jun 18 22:32:47.719938 ncdv-master-1 cinder-backup[123790]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /sys/class/dmi/id/product_uuid {{(pid=161870) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Jun 18 22:32:47.734918 ncdv-master-1 cinder-backup[123790]: DEBUG oslo_concurrency.processutils [-] CMD "cat /sys/class/dmi/id/product_uuid" returned: 0 in 0.014s {{(pid=161870) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Jun 18 22:32:47.735732 ncdv-master-1 cinder-backup[123790]: DEBUG oslo.privsep.daemon [-] privsep: reply[30571636-530e-4889-a0b5-8c2264376c96]: (4, ('cdfe4be3-957b-ec4d-8b08-ab749503be55\n', '')) {{(pid=161870) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}}
Jun 18 22:32:47.736524 ncdv-master-1 cinder-backup[123790]: DEBUG oslo_concurrency.processutils [None req-4eef794b-7060-46f7-8693-f4c0f9327759 tempest-VolumesBackupsV39Test-288082446 None] Running cmd (subprocess): nvme version {{(pid=123790) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Jun 18 22:32:47.775842 ncdv-master-1 cinder-backup[123790]: DEBUG oslo_concurrency.processutils [None req-4eef794b-7060-46f7-8693-f4c0f9327759 tempest-VolumesBackupsV39Test-288082446 None] CMD "nvme version" returned: 0 in 0.039s {{(pid=123790) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Jun 18 22:32:47.778535 ncdv-master-1 cinder-backup[123790]: DEBUG os_brick.initiator.connectors.lightos [None req-4eef794b-7060-46f7-8693-f4c0f9327759 tempest-VolumesBackupsV39Test-288082446 None] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=123790) find_dsc /usr/local/lib/python3.8/dist-packages/os_brick/initiator/connectors/lightos.py:100}}
Jun 18 22:32:47.779790 ncdv-master-1 cinder-backup[123790]: DEBUG os_brick.initiator.connectors.lightos [None req-4eef794b-7060-46f7-8693-f4c0f9327759 tempest-VolumesBackupsV39Test-288082446 None] LIGHTOS: did not find dsc, continuing anyway. {{(pid=123790) get_connector_properties /usr/local/lib/python3.8/dist-packages/os_brick/initiator/connectors/lightos.py:78}}
Jun 18 22:32:47.780347 ncdv-master-1 cinder-backup[123790]: DEBUG os_brick.initiator.connectors.lightos [None req-4eef794b-7060-46f7-8693-f4c0f9327759 tempest-VolumesBackupsV39Test-288082446 None] LIGHTOS: finally hostnqn: nqn.2014-08.org.nvmexpress:uuid:84627872-5390-4220-b960-ed5945b5c24c dsc:  {{(pid=123790) get_connector_properties /usr/local/lib/python3.8/dist-packages/os_brick/initiator/connectors/lightos.py:81}}
Jun 18 22:32:47.781434 ncdv-master-1 cinder-backup[123790]: DEBUG os_brick.utils [None req-4eef794b-7060-46f7-8693-f4c0f9327759 tempest-VolumesBackupsV39Test-288082446 None] <== get_connector_properties: return (150ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.222.0.30', 'host': 'ncdv-master-1', 'multipath': False, 'initiator': 'iqn.1993-08.org.debian:01:f965e8976dfc', 'do_local_attach': False, 'uuid': '02bb033c-a191-40c0-94fb-bb025c724b13', 'system uuid': 'cdfe4be3-957b-ec4d-8b08-ab749503be55', 'nqn': 'nqn.2014-08.org.nvmexpress:uuid:84627872-5390-4220-b960-ed5945b5c24c', 'found_dsc': ''} {{(pid=123790) trace_logging_wrapper /usr/local/lib/python3.8/dist-packages/os_brick/utils.py:194}}
Jun 18 22:32:49.088877 ncdv-master-1 cinder-backup[123790]: DEBUG os_brick.initiator.connector [None req-4eef794b-7060-46f7-8693-f4c0f9327759 tempest-VolumesBackupsV39Test-288082446 None] Factory for rbd on None {{(pid=123790) factory /usr/local/lib/python3.8/dist-packages/os_brick/initiator/connector.py:284}}
Jun 18 22:32:49.093607 ncdv-master-1 cinder-backup[123790]: DEBUG os_brick.initiator.connectors.rbd [None req-4eef794b-7060-46f7-8693-f4c0f9327759 tempest-VolumesBackupsV39Test-288082446 None] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.rbd.RBDConnector object at 0x7fa8a845ab20>, 'connection_properties': {'name': 'volumes/volume-f1b8d7ef-2b5d-425a-9510-9e9c811f8bfa', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '***', 'volume_id': 'f1b8d7ef-2b5d-425a-9510-9e9c811f8bfa', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, ': False}}" {{(pid=123790) trace_logging_wrapper /usr/local/lib/python3.8/dist-packages/os_brick/utils.py:167}}
Jun 18 22:32:49.095644 ncdv-master-1 cinder-backup[123790]: DEBUG os_brick.initiator.linuxrbd [None req-4eef794b-7060-46f7-8693-f4c0f9327759 tempest-VolumesBackupsV39Test-288082446 None] opening connection to ceph cluster (timeout=-1). {{(pid=123790) connect /usr/local/lib/python3.8/dist-packages/os_brick/initiator/linuxrbd.py:70}}
Jun 18 22:32:49.178679 ncdv-master-1 cinder-backup[123790]: DEBUG os_brick.initiator.connectors.rbd [None req-4eef794b-7060-46f7-8693-f4c0f9327759 tempest-VolumesBackupsV39Test-288082446 None] <== connect_volume: return (84ms) {'path': <os_brick.initiator.linuxrbd.RBDVolumeIOWrapper object at 0x7fa8a7790220>} {{(pid=123790) trace_logging_wrapper /usr/local/lib/python3.8/dist-packages/os_brick/utils.py:194}}
Jun 18 22:32:49.188743 ncdv-master-1 cinder-backup[123790]: DEBUG oslo_db.sqlalchemy.engines [None req-4eef794b-7060-46f7-8693-f4c0f9327759 tempest-VolumesBackupsV39Test-288082446 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123790) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}}
Jun 18 22:32:49.219037 ncdv-master-1 cinder-backup[123790]: DEBUG cinder.backup.drivers.ceph [None req-4eef794b-7060-46f7-8693-f4c0f9327759 tempest-VolumesBackupsV39Test-288082446 None] Starting backup of volume='f1b8d7ef-2b5d-425a-9510-9e9c811f8bfa'. {{(pid=123790) backup /opt/stack/cinder/cinder/backup/drivers/ceph.py:1024}}
Jun 18 22:32:49.220341 ncdv-master-1 cinder-backup[123790]: DEBUG cinder.backup.drivers.ceph [None req-4eef794b-7060-46f7-8693-f4c0f9327759 tempest-VolumesBackupsV39Test-288082446 None] Volume file is RBD: attempting optimized backup {{(pid=123790) backup /opt/stack/cinder/cinder/backup/drivers/ceph.py:1035}}
Jun 18 22:32:49.248953 ncdv-master-1 cinder-backup[123790]: DEBUG cinder.backup.drivers.ceph [None req-4eef794b-7060-46f7-8693-f4c0f9327759 tempest-VolumesBackupsV39Test-288082446 None] Creating base image 'volume-f1b8d7ef-2b5d-425a-9510-9e9c811f8bfa.backup.95809608-10bb-4891-8b8c-6e85157a285c' {{(pid=123790) _create_base_image /opt/stack/cinder/cinder/backup/drivers/ceph.py:467}}
Jun 18 22:32:49.249798 ncdv-master-1 cinder-backup[123790]: DEBUG cinder.backup.drivers.ceph [None req-4eef794b-7060-46f7-8693-f4c0f9327759 tempest-VolumesBackupsV39Test-288082446 None] RBD also supports fast-diff, enabling it together with exclusive-lock and object-map {{(pid=123790) _get_rbd_support /opt/stack/cinder/cinder/backup/drivers/ceph.py:277}}
Jun 18 22:32:49.319261 ncdv-master-1 cinder-backup[123790]: DEBUG cinder.backup.drivers.ceph [None req-4eef794b-7060-46f7-8693-f4c0f9327759 tempest-VolumesBackupsV39Test-288082446 None] Using --from-snap 'None' for incremental backup of volume f1b8d7ef-2b5d-425a-9510-9e9c811f8bfa. {{(pid=123790) _backup_rbd /opt/stack/cinder/cinder/backup/drivers/ceph.py:808}}
Jun 18 22:32:49.319721 ncdv-master-1 cinder-backup[123790]: DEBUG cinder.backup.drivers.ceph [None req-4eef794b-7060-46f7-8693-f4c0f9327759 tempest-VolumesBackupsV39Test-288082446 None] Creating backup snapshot='backup.95809608-10bb-4891-8b8c-6e85157a285c.snap.1655591569.3193069' {{(pid=123790) _backup_rbd /opt/stack/cinder/cinder/backup/drivers/ceph.py:814}}
Jun 18 22:32:49.730703 ncdv-master-1 cinder-backup[123790]: DEBUG cinder.backup.drivers.ceph [None req-4eef794b-7060-46f7-8693-f4c0f9327759 tempest-VolumesBackupsV39Test-288082446 None] Performing differential transfer from 'volume-f1b8d7ef-2b5d-425a-9510-9e9c811f8bfa' to 'volume-f1b8d7ef-2b5d-425a-9510-9e9c811f8bfa.backup.95809608-10bb-4891-8b8c-6e85157a285c' {{(pid=123790) _rbd_diff_transfer /opt/stack/cinder/cinder/backup/drivers/ceph.py:656}}
Jun 18 22:32:49.731442 ncdv-master-1 cinder-backup[123790]: DEBUG cinder.backup.drivers.ceph [None req-4eef794b-7060-46f7-8693-f4c0f9327759 tempest-VolumesBackupsV39Test-288082446 None] Piping cmd1='rbd export-diff --id cinder --conf /tmp/brickrbd_f7vclc0g --pool volumes volumes/volume-f1b8d7ef-2b5d-425a-9510-9e9c811f8bfa@backup.95809608-10bb-4891-8b8c-6e85157a285c.snap.1655591569.3193069 -' into... {{(pid=123790) _piped_execute /opt/stack/cinder/cinder/backup/drivers/ceph.py:613}}
Jun 18 22:32:49.732056 ncdv-master-1 cinder-backup[123790]: DEBUG cinder.backup.drivers.ceph [None req-4eef794b-7060-46f7-8693-f4c0f9327759 tempest-VolumesBackupsV39Test-288082446 None] cmd2='rbd import-diff --id cinder-bak --conf /etc/ceph/ceph.conf --pool backups - backups/volume-f1b8d7ef-2b5d-425a-9510-9e9c811f8bfa.backup.95809608-10bb-4891-8b8c-6e85157a285c' {{(pid=123790) _piped_execute /opt/stack/cinder/cinder/backup/drivers/ceph.py:614}}
Jun 18 22:32:50.971705 ncdv-master-1 cinder-backup[123790]: DEBUG cinder.backup.drivers.ceph [None req-4eef794b-7060-46f7-8693-f4c0f9327759 tempest-VolumesBackupsV39Test-288082446 None] Differential backup transfer completed in 1.2416s {{(pid=123790) _backup_rbd /opt/stack/cinder/cinder/backup/drivers/ceph.py:834}}
Jun 18 22:32:50.972411 ncdv-master-1 cinder-backup[123790]: DEBUG cinder.backup.driver [None req-4eef794b-7060-46f7-8693-f4c0f9327759 tempest-VolumesBackupsV39Test-288082446 None] Getting metadata type 'volume-base-metadata' {{(pid=123790) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:79}}
Jun 18 22:32:50.988831 ncdv-master-1 cinder-backup[123790]: DEBUG cinder.backup.driver [None req-4eef794b-7060-46f7-8693-f4c0f9327759 tempest-VolumesBackupsV39Test-288082446 None] Completed fetching metadata type 'volume-base-metadata' {{(pid=123790) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:98}}
Jun 18 22:32:50.989617 ncdv-master-1 cinder-backup[123790]: DEBUG cinder.backup.driver [None req-4eef794b-7060-46f7-8693-f4c0f9327759 tempest-VolumesBackupsV39Test-288082446 None] Getting metadata type 'volume-metadata' {{(pid=123790) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:109}}
Jun 18 22:32:51.007997 ncdv-master-1 cinder-backup[123790]: DEBUG cinder.backup.driver [None req-4eef794b-7060-46f7-8693-f4c0f9327759 tempest-VolumesBackupsV39Test-288082446 None] No metadata type 'volume-metadata' available {{(pid=123790) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:123}}
Jun 18 22:32:51.008738 ncdv-master-1 cinder-backup[123790]: DEBUG cinder.backup.driver [None req-4eef794b-7060-46f7-8693-f4c0f9327759 tempest-VolumesBackupsV39Test-288082446 None] Getting metadata type 'volume-glance-metadata' {{(pid=123790) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:132}}
Jun 18 22:32:51.016717 ncdv-master-1 cinder-backup[123790]: DEBUG cinder.backup.driver [None req-4eef794b-7060-46f7-8693-f4c0f9327759 tempest-VolumesBackupsV39Test-288082446 None] No metadata type 'volume-glance-metadata' available {{(pid=123790) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:147}}
Jun 18 22:32:51.017326 ncdv-master-1 cinder-backup[123790]: DEBUG cinder.backup.drivers.ceph [None req-4eef794b-7060-46f7-8693-f4c0f9327759 tempest-VolumesBackupsV39Test-288082446 None] Backing up metadata for volume f1b8d7ef-2b5d-425a-9510-9e9c811f8bfa. {{(pid=123790) _backup_metadata /opt/stack/cinder/cinder/backup/drivers/ceph.py:999}}
Jun 18 22:32:51.077871 ncdv-master-1 cinder-backup[123790]: DEBUG cinder.backup.drivers.ceph [None req-4eef794b-7060-46f7-8693-f4c0f9327759 tempest-VolumesBackupsV39Test-288082446 None] Backup '95809608-10bb-4891-8b8c-6e85157a285c' of volume f1b8d7ef-2b5d-425a-9510-9e9c811f8bfa finished. {{(pid=123790) backup /opt/stack/cinder/cinder/backup/drivers/ceph.py:1065}}
Jun 18 22:32:51.079531 ncdv-master-1 cinder-backup[123790]: DEBUG os_brick.initiator.connectors.rbd [None req-4eef794b-7060-46f7-8693-f4c0f9327759 tempest-VolumesBackupsV39Test-288082446 None] ==> disconnect_volume: call "{'self': <os_brick.initiator.connectors.rbd.RBDConnector object at 0x7fa8a845ab20>, 'connection_properties': {'name': 'volumes/volume-f1b8d7ef-2b5d-425a-9510-9e9c811f8bfa', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '***', 'volume_id': 'f1b8d7ef-2b5d-425a-9510-9e9c811f8bfa', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'device_info': {'path': <os_brick.initiator.linuxrbd.RBDVolumeIOWrapper object at 0x7fa8a7790220>}, 'force': True, ': True}" {{(pid=123790) trace_logging_wrapper /usr/local/lib/python3.8/dist-packages/os_brick/utils.py:167}}
Jun 18 22:32:51.114046 ncdv-master-1 cinder-backup[123790]: DEBUG os_brick.initiator.connectors.rbd [None req-4eef794b-7060-46f7-8693-f4c0f9327759 tempest-VolumesBackupsV39Test-288082446 None] <== disconnect_volume: return (33ms) None {{(pid=123790) trace_logging_wrapper /usr/local/lib/python3.8/dist-packages/os_brick/utils.py:194}}
Jun 18 22:32:51.211534 ncdv-master-1 cinder-backup[123790]: INFO cinder.backup.manager [None req-4eef794b-7060-46f7-8693-f4c0f9327759 tempest-VolumesBackupsV39Test-288082446 None] Create backup finished. backup: 95809608-10bb-4891-8b8c-6e85157a285c.
Jun 18 22:32:51.964753 ncdv-master-1 cinder-backup[123790]: INFO cinder.backup.manager [None req-2a01b830-7b2c-4f48-b373-e0dcbc74ccc3 tempest-VolumesBackupsV39Test-288082446 None] Delete backup started, backup: 95809608-10bb-4891-8b8c-6e85157a285c.
Jun 18 22:32:51.967080 ncdv-master-1 cinder-backup[123790]: DEBUG cinder.backup.drivers.ceph [None req-2a01b830-7b2c-4f48-b373-e0dcbc74ccc3 tempest-VolumesBackupsV39Test-288082446 None] Delete started for backup=95809608-10bb-4891-8b8c-6e85157a285c {{(pid=123790) delete_backup /opt/stack/cinder/cinder/backup/drivers/ceph.py:1372}}
Jun 18 22:32:51.967504 ncdv-master-1 cinder-backup[123790]: DEBUG cinder.backup.drivers.ceph [None req-2a01b830-7b2c-4f48-b373-e0dcbc74ccc3 tempest-VolumesBackupsV39Test-288082446 None] Trying diff format basename='volume-f1b8d7ef-2b5d-425a-9510-9e9c811f8bfa.backup.95809608-10bb-4891-8b8c-6e85157a285c' for backup base image of volume f1b8d7ef-2b5d-425a-9510-9e9c811f8bfa. {{(pid=123790) _try_delete_base_image /opt/stack/cinder/cinder/backup/drivers/ceph.py:541}}
Jun 18 22:32:52.047903 ncdv-master-1 cinder-backup[123790]: DEBUG cinder.backup.drivers.ceph [None req-2a01b830-7b2c-4f48-b373-e0dcbc74ccc3 tempest-VolumesBackupsV39Test-288082446 None] Looking for snapshot of backup base 'volume-f1b8d7ef-2b5d-425a-9510-9e9c811f8bfa.backup.95809608-10bb-4891-8b8c-6e85157a285c' {{(pid=123790) _get_backup_snap_name /opt/stack/cinder/cinder/backup/drivers/ceph.py:953}}
Jun 18 22:32:52.048907 ncdv-master-1 cinder-backup[123790]: DEBUG cinder.backup.drivers.ceph [None req-2a01b830-7b2c-4f48-b373-e0dcbc74ccc3 tempest-VolumesBackupsV39Test-288082446 None] Found snapshot 'backup.95809608-10bb-4891-8b8c-6e85157a285c.snap.1655591569.3193069' {{(pid=123790) _get_backup_snap_name /opt/stack/cinder/cinder/backup/drivers/ceph.py:972}}
Jun 18 22:32:52.048907 ncdv-master-1 cinder-backup[123790]: DEBUG cinder.backup.drivers.ceph [None req-2a01b830-7b2c-4f48-b373-e0dcbc74ccc3 tempest-VolumesBackupsV39Test-288082446 None] Deleting backup snapshot='backup.95809608-10bb-4891-8b8c-6e85157a285c.snap.1655591569.3193069' {{(pid=123790) _delete_backup_snapshot /opt/stack/cinder/cinder/backup/drivers/ceph.py:499}}
Jun 18 22:32:53.041401 ncdv-master-1 cinder-backup[123790]: INFO cinder.backup.drivers.ceph [None req-2a01b830-7b2c-4f48-b373-e0dcbc74ccc3 tempest-VolumesBackupsV39Test-288082446 None] Deleting backup base image='volume-f1b8d7ef-2b5d-425a-9510-9e9c811f8bfa.backup.95809608-10bb-4891-8b8c-6e85157a285c' of volume f1b8d7ef-2b5d-425a-9510-9e9c811f8bfa.
Jun 18 22:32:53.372842 ncdv-master-1 cinder-backup[123790]: DEBUG cinder.backup.drivers.ceph [None req-2a01b830-7b2c-4f48-b373-e0dcbc74ccc3 tempest-VolumesBackupsV39Test-288082446 None] Base backup image='volume-f1b8d7ef-2b5d-425a-9510-9e9c811f8bfa.backup.95809608-10bb-4891-8b8c-6e85157a285c' of volume f1b8d7ef-2b5d-425a-9510-9e9c811f8bfa deleted. {{(pid=123790) _try_delete_base_image /opt/stack/cinder/cinder/backup/drivers/ceph.py:589}}
Jun 18 22:32:53.467078 ncdv-master-1 cinder-backup[123790]: DEBUG cinder.backup.drivers.ceph [None req-2a01b830-7b2c-4f48-b373-e0dcbc74ccc3 tempest-VolumesBackupsV39Test-288082446 None] Delete of backup '95809608-10bb-4891-8b8c-6e85157a285c' for volume 'f1b8d7ef-2b5d-425a-9510-9e9c811f8bfa' finished. {{(pid=123790) delete_backup /opt/stack/cinder/cinder/backup/drivers/ceph.py:1400}}
Jun 18 22:32:53.480457 ncdv-master-1 cinder-backup[123790]: DEBUG oslo_db.sqlalchemy.engines [None req-2a01b830-7b2c-4f48-b373-e0dcbc74ccc3 tempest-VolumesBackupsV39Test-288082446 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123790) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}}
Jun 18 22:32:53.510944 ncdv-master-1 cinder-backup[123790]: DEBUG cinder.quota [None req-2a01b830-7b2c-4f48-b373-e0dcbc74ccc3 tempest-VolumesBackupsV39Test-288082446 None] Created reservations ['341a80d9-d603-46fd-8fbe-285d7e7f8e92', '84e059a2-4bfb-48ae-9864-737123fe1d32'] {{(pid=123790) reserve /opt/stack/cinder/cinder/quota.py:755}}
Jun 18 22:32:53.560906 ncdv-master-1 cinder-backup[123790]: INFO cinder.backup.manager [None req-2a01b830-7b2c-4f48-b373-e0dcbc74ccc3 tempest-VolumesBackupsV39Test-288082446 None] Delete backup finished, backup 95809608-10bb-4891-8b8c-6e85157a285c deleted.
Jun 18 22:33:06.268972 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writing DB stats cinder:SELECT=19,cinder:UPDATE=7 {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 22:33:06.270112 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writing DB stats cinder:SELECT=56,cinder:UPDATE=12,cinder:INSERT=11 {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 22:33:08.784771 ncdv-master-1 cinder-backup[123790]: DEBUG oslo_service.periodic_task [None req-d82f921b-aced-4971-81d0-f3b75344497b None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=123790) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Jun 18 22:33:08.785479 ncdv-master-1 cinder-backup[123790]: DEBUG cinder.manager [None req-d82f921b-aced-4971-81d0-f3b75344497b None None] Notifying Schedulers of capabilities ... {{(pid=123790) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jun 18 22:33:26.270507 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 22:33:46.268450 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writing DB stats cinder:SELECT=10,cinder:UPDATE=3 {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 22:34:06.276467 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writing DB stats cinder:SELECT=6,cinder:UPDATE=1 {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 22:34:08.786330 ncdv-master-1 cinder-backup[123790]: DEBUG oslo_service.periodic_task [None req-d82f921b-aced-4971-81d0-f3b75344497b None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=123790) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Jun 18 22:34:08.787070 ncdv-master-1 cinder-backup[123790]: DEBUG cinder.manager [None req-d82f921b-aced-4971-81d0-f3b75344497b None None] Notifying Schedulers of capabilities ... {{(pid=123790) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jun 18 22:34:16.270928 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writing DB stats cinder:SELECT=4,cinder:UPDATE=2 {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 22:34:26.286204 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 22:34:39.495293 ncdv-master-1 cinder-backup[123790]: INFO cinder.backup.manager [None req-62910d72-3e9b-428d-9f03-8cbb6f237407 tempest-VolumesBackupsAdminTest-343096894 None] Create backup started, backup: dbb6a402-6bbb-4314-8339-efc34c5209b7 volume: 270411b1-acf4-4bd6-922a-7af233b7ff93.
Jun 18 22:34:39.504695 ncdv-master-1 cinder-backup[123790]: INFO cinder.backup.manager [None req-62910d72-3e9b-428d-9f03-8cbb6f237407 tempest-VolumesBackupsAdminTest-343096894 None] Call Volume Manager to get_backup_device for Backup(availability_zone=None,container=None,created_at=2022-06-18T22:34:39Z,data_timestamp=2022-06-18T22:34:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsAdminTest-Backup-1837978769',encryption_key_id=None,fail_reason=None,host='ncdv-master-1',id=dbb6a402-6bbb-4314-8339-efc34c5209b7,metadata={},num_dependent_backups=0,object_count=0,parent=None,parent_id=None,project_id='cf877d3d3b2044a089edd8b07f303d54',restore_volume_id=None,service='cinder.backup.drivers.ceph.CephBackupDriver',service_metadata=None,size=1,snapshot_id=None,status='creating',temp_snapshot_id=None,temp_volume_id=None,updated_at=None,user_id='a2605f28a07b465cb9fd2c543a69c38e',volume_id=270411b1-acf4-4bd6-922a-7af233b7ff93)
Jun 18 22:34:39.549993 ncdv-master-1 cinder-backup[123790]: DEBUG os_brick.utils [None req-62910d72-3e9b-428d-9f03-8cbb6f237407 tempest-VolumesBackupsAdminTest-343096894 None] ==> get_connector_properties: call "{'root_helper': 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf', 'my_ip': '10.222.0.30', 'multipath': False, 'enforce_multipath': False, 'host': None, 'execute': None}" {{(pid=123790) trace_logging_wrapper /usr/local/lib/python3.8/dist-packages/os_brick/utils.py:167}}
Jun 18 22:34:39.551675 ncdv-master-1 cinder-backup[123790]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=161870) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Jun 18 22:34:39.562405 ncdv-master-1 cinder-backup[123790]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.011s {{(pid=161870) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Jun 18 22:34:39.562754 ncdv-master-1 cinder-backup[123790]: DEBUG oslo.privsep.daemon [-] privsep: reply[02657b2e-f7e0-4af5-8cd7-5499af5b9b5b]: (4, ('## DO NOT EDIT OR REMOVE THIS FILE!\n## If you remove this file, the iSCSI daemon will not start.\n## If you change the InitiatorName, existing access control lists\n## may reject this initiator.  The InitiatorName must be unique\n## for each iSCSI initiator.  Do NOT duplicate iSCSI InitiatorNames.\nInitiatorName=iqn.1993-08.org.debian:01:f965e8976dfc\n', '')) {{(pid=161870) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}}
Jun 18 22:34:39.564130 ncdv-master-1 cinder-backup[123790]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): systool -c fc_host -v {{(pid=161870) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Jun 18 22:34:39.571730 ncdv-master-1 cinder-backup[123790]: DEBUG oslo_concurrency.processutils [-] 'systool -c fc_host -v' failed. Not Retrying. {{(pid=161870) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:473}}
Jun 18 22:34:39.572738 ncdv-master-1 cinder-backup[123790]: DEBUG oslo.privsep.daemon [-] privsep: Exception during request[f0962860-8191-4fe1-9cd0-2353ec40a8f0]: [Errno 2] No such file or directory: 'systool' {{(pid=161870) _process_cmd /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:479}}
Jun 18 22:34:39.572738 ncdv-master-1 cinder-backup[123790]: Traceback (most recent call last):
Jun 18 22:34:39.572738 ncdv-master-1 cinder-backup[123790]:   File "/usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py", line 476, in _process_cmd
Jun 18 22:34:39.572738 ncdv-master-1 cinder-backup[123790]:     ret = func(*f_args, **f_kwargs)
Jun 18 22:34:39.572738 ncdv-master-1 cinder-backup[123790]:   File "/usr/local/lib/python3.8/dist-packages/oslo_privsep/priv_context.py", line 274, in _wrap
Jun 18 22:34:39.572738 ncdv-master-1 cinder-backup[123790]:     return func(*args, **kwargs)
Jun 18 22:34:39.572738 ncdv-master-1 cinder-backup[123790]:   File "/usr/local/lib/python3.8/dist-packages/os_brick/privileged/rootwrap.py", line 197, in execute_root
Jun 18 22:34:39.572738 ncdv-master-1 cinder-backup[123790]:     return custom_execute(*cmd, shell=False, run_as_root=False, **kwargs)
Jun 18 22:34:39.572738 ncdv-master-1 cinder-backup[123790]:   File "/usr/local/lib/python3.8/dist-packages/os_brick/privileged/rootwrap.py", line 145, in custom_execute
Jun 18 22:34:39.572738 ncdv-master-1 cinder-backup[123790]:     return putils.execute(on_execute=on_execute,
Jun 18 22:34:39.572738 ncdv-master-1 cinder-backup[123790]:   File "/usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py", line 395, in execute
Jun 18 22:34:39.572738 ncdv-master-1 cinder-backup[123790]:     obj = subprocess.Popen(cmd,
Jun 18 22:34:39.572738 ncdv-master-1 cinder-backup[123790]:   File "/usr/lib/python3.8/subprocess.py", line 858, in __init__
Jun 18 22:34:39.572738 ncdv-master-1 cinder-backup[123790]:     self._execute_child(args, executable, preexec_fn, close_fds,
Jun 18 22:34:39.572738 ncdv-master-1 cinder-backup[123790]:   File "/usr/lib/python3.8/subprocess.py", line 1704, in _execute_child
Jun 18 22:34:39.572738 ncdv-master-1 cinder-backup[123790]:     raise child_exception_type(errno_num, err_msg, err_filename)
Jun 18 22:34:39.572738 ncdv-master-1 cinder-backup[123790]: FileNotFoundError: [Errno 2] No such file or directory: 'systool'
Jun 18 22:34:39.574232 ncdv-master-1 cinder-backup[123790]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0962860-8191-4fe1-9cd0-2353ec40a8f0]: (5, 'builtins.FileNotFoundError', (2, 'No such file or directory')) {{(pid=161870) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}}
Jun 18 22:34:39.576398 ncdv-master-1 cinder-backup[123790]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): systool -c fc_host -v {{(pid=161870) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Jun 18 22:34:39.584377 ncdv-master-1 cinder-backup[123790]: DEBUG oslo_concurrency.processutils [-] 'systool -c fc_host -v' failed. Not Retrying. {{(pid=161870) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:473}}
Jun 18 22:34:39.585382 ncdv-master-1 cinder-backup[123790]: DEBUG oslo.privsep.daemon [-] privsep: Exception during request[9891de9e-cac4-486b-b21b-41f69ded2582]: [Errno 2] No such file or directory: 'systool' {{(pid=161870) _process_cmd /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:479}}
Jun 18 22:34:39.585382 ncdv-master-1 cinder-backup[123790]: Traceback (most recent call last):
Jun 18 22:34:39.585382 ncdv-master-1 cinder-backup[123790]:   File "/usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py", line 476, in _process_cmd
Jun 18 22:34:39.585382 ncdv-master-1 cinder-backup[123790]:     ret = func(*f_args, **f_kwargs)
Jun 18 22:34:39.585382 ncdv-master-1 cinder-backup[123790]:   File "/usr/local/lib/python3.8/dist-packages/oslo_privsep/priv_context.py", line 274, in _wrap
Jun 18 22:34:39.585382 ncdv-master-1 cinder-backup[123790]:     return func(*args, **kwargs)
Jun 18 22:34:39.585382 ncdv-master-1 cinder-backup[123790]:   File "/usr/local/lib/python3.8/dist-packages/os_brick/privileged/rootwrap.py", line 197, in execute_root
Jun 18 22:34:39.585382 ncdv-master-1 cinder-backup[123790]:     return custom_execute(*cmd, shell=False, run_as_root=False, **kwargs)
Jun 18 22:34:39.585382 ncdv-master-1 cinder-backup[123790]:   File "/usr/local/lib/python3.8/dist-packages/os_brick/privileged/rootwrap.py", line 145, in custom_execute
Jun 18 22:34:39.585382 ncdv-master-1 cinder-backup[123790]:     return putils.execute(on_execute=on_execute,
Jun 18 22:34:39.585382 ncdv-master-1 cinder-backup[123790]:   File "/usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py", line 395, in execute
Jun 18 22:34:39.585382 ncdv-master-1 cinder-backup[123790]:     obj = subprocess.Popen(cmd,
Jun 18 22:34:39.585382 ncdv-master-1 cinder-backup[123790]:   File "/usr/lib/python3.8/subprocess.py", line 858, in __init__
Jun 18 22:34:39.585382 ncdv-master-1 cinder-backup[123790]:     self._execute_child(args, executable, preexec_fn, close_fds,
Jun 18 22:34:39.585382 ncdv-master-1 cinder-backup[123790]:   File "/usr/lib/python3.8/subprocess.py", line 1704, in _execute_child
Jun 18 22:34:39.585382 ncdv-master-1 cinder-backup[123790]:     raise child_exception_type(errno_num, err_msg, err_filename)
Jun 18 22:34:39.585382 ncdv-master-1 cinder-backup[123790]: FileNotFoundError: [Errno 2] No such file or directory: 'systool'
Jun 18 22:34:39.588228 ncdv-master-1 cinder-backup[123790]: DEBUG oslo.privsep.daemon [-] privsep: reply[9891de9e-cac4-486b-b21b-41f69ded2582]: (5, 'builtins.FileNotFoundError', (2, 'No such file or directory')) {{(pid=161870) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}}
Jun 18 22:34:39.591091 ncdv-master-1 cinder-backup[123790]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=161870) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Jun 18 22:34:39.613985 ncdv-master-1 cinder-backup[123790]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.022s {{(pid=161870) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Jun 18 22:34:39.614266 ncdv-master-1 cinder-backup[123790]: DEBUG oslo.privsep.daemon [-] privsep: reply[8334fe80-8be9-42a5-b9fe-8777c4c31587]: (4, ('/dev/sda1\n', '')) {{(pid=161870) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}}
Jun 18 22:34:39.618786 ncdv-master-1 cinder-backup[123790]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/sda1 -s UUID -o value {{(pid=161870) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Jun 18 22:34:39.632550 ncdv-master-1 cinder-backup[123790]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/sda1 -s UUID -o value" returned: 0 in 0.014s {{(pid=161870) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Jun 18 22:34:39.635396 ncdv-master-1 cinder-backup[123790]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bcde534-eb89-475e-bcf3-e3f47d669fea]: (4, ('02bb033c-a191-40c0-94fb-bb025c724b13\n', '')) {{(pid=161870) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}}
Jun 18 22:34:39.637157 ncdv-master-1 cinder-backup[123790]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /sys/class/dmi/id/product_uuid {{(pid=161870) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Jun 18 22:34:39.646377 ncdv-master-1 cinder-backup[123790]: DEBUG oslo_concurrency.processutils [-] CMD "cat /sys/class/dmi/id/product_uuid" returned: 0 in 0.009s {{(pid=161870) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Jun 18 22:34:39.646791 ncdv-master-1 cinder-backup[123790]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff4a71e2-7ff2-49df-b513-4c33b824f42e]: (4, ('cdfe4be3-957b-ec4d-8b08-ab749503be55\n', '')) {{(pid=161870) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}}
Jun 18 22:34:39.647631 ncdv-master-1 cinder-backup[123790]: DEBUG oslo_concurrency.processutils [None req-62910d72-3e9b-428d-9f03-8cbb6f237407 tempest-VolumesBackupsAdminTest-343096894 None] Running cmd (subprocess): nvme version {{(pid=123790) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Jun 18 22:34:39.670457 ncdv-master-1 cinder-backup[123790]: DEBUG oslo_concurrency.processutils [None req-62910d72-3e9b-428d-9f03-8cbb6f237407 tempest-VolumesBackupsAdminTest-343096894 None] CMD "nvme version" returned: 0 in 0.022s {{(pid=123790) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Jun 18 22:34:39.672865 ncdv-master-1 cinder-backup[123790]: DEBUG os_brick.initiator.connectors.lightos [None req-62910d72-3e9b-428d-9f03-8cbb6f237407 tempest-VolumesBackupsAdminTest-343096894 None] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=123790) find_dsc /usr/local/lib/python3.8/dist-packages/os_brick/initiator/connectors/lightos.py:100}}
Jun 18 22:34:39.673282 ncdv-master-1 cinder-backup[123790]: DEBUG os_brick.initiator.connectors.lightos [None req-62910d72-3e9b-428d-9f03-8cbb6f237407 tempest-VolumesBackupsAdminTest-343096894 None] LIGHTOS: did not find dsc, continuing anyway. {{(pid=123790) get_connector_properties /usr/local/lib/python3.8/dist-packages/os_brick/initiator/connectors/lightos.py:78}}
Jun 18 22:34:39.673697 ncdv-master-1 cinder-backup[123790]: DEBUG os_brick.initiator.connectors.lightos [None req-62910d72-3e9b-428d-9f03-8cbb6f237407 tempest-VolumesBackupsAdminTest-343096894 None] LIGHTOS: finally hostnqn: nqn.2014-08.org.nvmexpress:uuid:84627872-5390-4220-b960-ed5945b5c24c dsc:  {{(pid=123790) get_connector_properties /usr/local/lib/python3.8/dist-packages/os_brick/initiator/connectors/lightos.py:81}}
Jun 18 22:34:39.674518 ncdv-master-1 cinder-backup[123790]: DEBUG os_brick.utils [None req-62910d72-3e9b-428d-9f03-8cbb6f237407 tempest-VolumesBackupsAdminTest-343096894 None] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.222.0.30', 'host': 'ncdv-master-1', 'multipath': False, 'initiator': 'iqn.1993-08.org.debian:01:f965e8976dfc', 'do_local_attach': False, 'uuid': '02bb033c-a191-40c0-94fb-bb025c724b13', 'system uuid': 'cdfe4be3-957b-ec4d-8b08-ab749503be55', 'nqn': 'nqn.2014-08.org.nvmexpress:uuid:84627872-5390-4220-b960-ed5945b5c24c', 'found_dsc': ''} {{(pid=123790) trace_logging_wrapper /usr/local/lib/python3.8/dist-packages/os_brick/utils.py:194}}
Jun 18 22:34:40.548158 ncdv-master-1 cinder-backup[123790]: DEBUG os_brick.initiator.connector [None req-62910d72-3e9b-428d-9f03-8cbb6f237407 tempest-VolumesBackupsAdminTest-343096894 None] Factory for rbd on None {{(pid=123790) factory /usr/local/lib/python3.8/dist-packages/os_brick/initiator/connector.py:284}}
Jun 18 22:34:40.549825 ncdv-master-1 cinder-backup[123790]: DEBUG os_brick.initiator.connectors.rbd [None req-62910d72-3e9b-428d-9f03-8cbb6f237407 tempest-VolumesBackupsAdminTest-343096894 None] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.rbd.RBDConnector object at 0x7fa8a7786610>, 'connection_properties': {'name': 'volumes/volume-270411b1-acf4-4bd6-922a-7af233b7ff93', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '***', 'volume_id': '270411b1-acf4-4bd6-922a-7af233b7ff93', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, ': False}}" {{(pid=123790) trace_logging_wrapper /usr/local/lib/python3.8/dist-packages/os_brick/utils.py:167}}
Jun 18 22:34:40.550949 ncdv-master-1 cinder-backup[123790]: DEBUG os_brick.initiator.linuxrbd [None req-62910d72-3e9b-428d-9f03-8cbb6f237407 tempest-VolumesBackupsAdminTest-343096894 None] opening connection to ceph cluster (timeout=-1). {{(pid=123790) connect /usr/local/lib/python3.8/dist-packages/os_brick/initiator/linuxrbd.py:70}}
Jun 18 22:34:40.609922 ncdv-master-1 cinder-backup[123790]: DEBUG os_brick.initiator.connectors.rbd [None req-62910d72-3e9b-428d-9f03-8cbb6f237407 tempest-VolumesBackupsAdminTest-343096894 None] <== connect_volume: return (59ms) {'path': <os_brick.initiator.linuxrbd.RBDVolumeIOWrapper object at 0x7fa8a8212e20>} {{(pid=123790) trace_logging_wrapper /usr/local/lib/python3.8/dist-packages/os_brick/utils.py:194}}
Jun 18 22:34:40.620878 ncdv-master-1 cinder-backup[123790]: DEBUG oslo_db.sqlalchemy.engines [None req-62910d72-3e9b-428d-9f03-8cbb6f237407 tempest-VolumesBackupsAdminTest-343096894 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123790) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}}
Jun 18 22:34:40.642754 ncdv-master-1 cinder-backup[123790]: DEBUG cinder.backup.drivers.ceph [None req-62910d72-3e9b-428d-9f03-8cbb6f237407 tempest-VolumesBackupsAdminTest-343096894 None] Starting backup of volume='270411b1-acf4-4bd6-922a-7af233b7ff93'. {{(pid=123790) backup /opt/stack/cinder/cinder/backup/drivers/ceph.py:1024}}
Jun 18 22:34:40.644173 ncdv-master-1 cinder-backup[123790]: DEBUG cinder.backup.drivers.ceph [None req-62910d72-3e9b-428d-9f03-8cbb6f237407 tempest-VolumesBackupsAdminTest-343096894 None] Volume file is RBD: attempting optimized backup {{(pid=123790) backup /opt/stack/cinder/cinder/backup/drivers/ceph.py:1035}}
Jun 18 22:34:40.680953 ncdv-master-1 cinder-backup[123790]: DEBUG cinder.backup.drivers.ceph [None req-62910d72-3e9b-428d-9f03-8cbb6f237407 tempest-VolumesBackupsAdminTest-343096894 None] Creating base image 'volume-270411b1-acf4-4bd6-922a-7af233b7ff93.backup.dbb6a402-6bbb-4314-8339-efc34c5209b7' {{(pid=123790) _create_base_image /opt/stack/cinder/cinder/backup/drivers/ceph.py:467}}
Jun 18 22:34:40.681375 ncdv-master-1 cinder-backup[123790]: DEBUG cinder.backup.drivers.ceph [None req-62910d72-3e9b-428d-9f03-8cbb6f237407 tempest-VolumesBackupsAdminTest-343096894 None] RBD also supports fast-diff, enabling it together with exclusive-lock and object-map {{(pid=123790) _get_rbd_support /opt/stack/cinder/cinder/backup/drivers/ceph.py:277}}
Jun 18 22:34:40.717881 ncdv-master-1 cinder-backup[123790]: DEBUG cinder.backup.drivers.ceph [None req-62910d72-3e9b-428d-9f03-8cbb6f237407 tempest-VolumesBackupsAdminTest-343096894 None] Using --from-snap 'None' for incremental backup of volume 270411b1-acf4-4bd6-922a-7af233b7ff93. {{(pid=123790) _backup_rbd /opt/stack/cinder/cinder/backup/drivers/ceph.py:808}}
Jun 18 22:34:40.718676 ncdv-master-1 cinder-backup[123790]: DEBUG cinder.backup.drivers.ceph [None req-62910d72-3e9b-428d-9f03-8cbb6f237407 tempest-VolumesBackupsAdminTest-343096894 None] Creating backup snapshot='backup.dbb6a402-6bbb-4314-8339-efc34c5209b7.snap.1655591680.7182584' {{(pid=123790) _backup_rbd /opt/stack/cinder/cinder/backup/drivers/ceph.py:814}}
Jun 18 22:34:41.049784 ncdv-master-1 cinder-backup[123790]: DEBUG cinder.backup.drivers.ceph [None req-62910d72-3e9b-428d-9f03-8cbb6f237407 tempest-VolumesBackupsAdminTest-343096894 None] Performing differential transfer from 'volume-270411b1-acf4-4bd6-922a-7af233b7ff93' to 'volume-270411b1-acf4-4bd6-922a-7af233b7ff93.backup.dbb6a402-6bbb-4314-8339-efc34c5209b7' {{(pid=123790) _rbd_diff_transfer /opt/stack/cinder/cinder/backup/drivers/ceph.py:656}}
Jun 18 22:34:41.050521 ncdv-master-1 cinder-backup[123790]: DEBUG cinder.backup.drivers.ceph [None req-62910d72-3e9b-428d-9f03-8cbb6f237407 tempest-VolumesBackupsAdminTest-343096894 None] Piping cmd1='rbd export-diff --id cinder --conf /tmp/brickrbd__4oo9z4b --pool volumes volumes/volume-270411b1-acf4-4bd6-922a-7af233b7ff93@backup.dbb6a402-6bbb-4314-8339-efc34c5209b7.snap.1655591680.7182584 -' into... {{(pid=123790) _piped_execute /opt/stack/cinder/cinder/backup/drivers/ceph.py:613}}
Jun 18 22:34:41.051055 ncdv-master-1 cinder-backup[123790]: DEBUG cinder.backup.drivers.ceph [None req-62910d72-3e9b-428d-9f03-8cbb6f237407 tempest-VolumesBackupsAdminTest-343096894 None] cmd2='rbd import-diff --id cinder-bak --conf /etc/ceph/ceph.conf --pool backups - backups/volume-270411b1-acf4-4bd6-922a-7af233b7ff93.backup.dbb6a402-6bbb-4314-8339-efc34c5209b7' {{(pid=123790) _piped_execute /opt/stack/cinder/cinder/backup/drivers/ceph.py:614}}
Jun 18 22:34:42.077204 ncdv-master-1 cinder-backup[123790]: DEBUG cinder.backup.drivers.ceph [None req-62910d72-3e9b-428d-9f03-8cbb6f237407 tempest-VolumesBackupsAdminTest-343096894 None] Differential backup transfer completed in 1.0257s {{(pid=123790) _backup_rbd /opt/stack/cinder/cinder/backup/drivers/ceph.py:834}}
Jun 18 22:34:42.077888 ncdv-master-1 cinder-backup[123790]: DEBUG cinder.backup.driver [None req-62910d72-3e9b-428d-9f03-8cbb6f237407 tempest-VolumesBackupsAdminTest-343096894 None] Getting metadata type 'volume-base-metadata' {{(pid=123790) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:79}}
Jun 18 22:34:42.103245 ncdv-master-1 cinder-backup[123790]: DEBUG cinder.backup.driver [None req-62910d72-3e9b-428d-9f03-8cbb6f237407 tempest-VolumesBackupsAdminTest-343096894 None] Completed fetching metadata type 'volume-base-metadata' {{(pid=123790) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:98}}
Jun 18 22:34:42.104070 ncdv-master-1 cinder-backup[123790]: DEBUG cinder.backup.driver [None req-62910d72-3e9b-428d-9f03-8cbb6f237407 tempest-VolumesBackupsAdminTest-343096894 None] Getting metadata type 'volume-metadata' {{(pid=123790) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:109}}
Jun 18 22:34:42.115216 ncdv-master-1 cinder-backup[123790]: DEBUG cinder.backup.driver [None req-62910d72-3e9b-428d-9f03-8cbb6f237407 tempest-VolumesBackupsAdminTest-343096894 None] No metadata type 'volume-metadata' available {{(pid=123790) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:123}}
Jun 18 22:34:42.115600 ncdv-master-1 cinder-backup[123790]: DEBUG cinder.backup.driver [None req-62910d72-3e9b-428d-9f03-8cbb6f237407 tempest-VolumesBackupsAdminTest-343096894 None] Getting metadata type 'volume-glance-metadata' {{(pid=123790) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:132}}
Jun 18 22:34:42.137469 ncdv-master-1 cinder-backup[123790]: DEBUG cinder.backup.driver [None req-62910d72-3e9b-428d-9f03-8cbb6f237407 tempest-VolumesBackupsAdminTest-343096894 None] No metadata type 'volume-glance-metadata' available {{(pid=123790) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:147}}
Jun 18 22:34:42.138137 ncdv-master-1 cinder-backup[123790]: DEBUG cinder.backup.drivers.ceph [None req-62910d72-3e9b-428d-9f03-8cbb6f237407 tempest-VolumesBackupsAdminTest-343096894 None] Backing up metadata for volume 270411b1-acf4-4bd6-922a-7af233b7ff93. {{(pid=123790) _backup_metadata /opt/stack/cinder/cinder/backup/drivers/ceph.py:999}}
Jun 18 22:34:42.181705 ncdv-master-1 cinder-backup[123790]: DEBUG cinder.backup.drivers.ceph [None req-62910d72-3e9b-428d-9f03-8cbb6f237407 tempest-VolumesBackupsAdminTest-343096894 None] Backup 'dbb6a402-6bbb-4314-8339-efc34c5209b7' of volume 270411b1-acf4-4bd6-922a-7af233b7ff93 finished. {{(pid=123790) backup /opt/stack/cinder/cinder/backup/drivers/ceph.py:1065}}
Jun 18 22:34:42.184301 ncdv-master-1 cinder-backup[123790]: DEBUG os_brick.initiator.connectors.rbd [None req-62910d72-3e9b-428d-9f03-8cbb6f237407 tempest-VolumesBackupsAdminTest-343096894 None] ==> disconnect_volume: call "{'self': <os_brick.initiator.connectors.rbd.RBDConnector object at 0x7fa8a7786610>, 'connection_properties': {'name': 'volumes/volume-270411b1-acf4-4bd6-922a-7af233b7ff93', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '***', 'volume_id': '270411b1-acf4-4bd6-922a-7af233b7ff93', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'device_info': {'path': <os_brick.initiator.linuxrbd.RBDVolumeIOWrapper object at 0x7fa8a8212e20>}, 'force': True, ': True}" {{(pid=123790) trace_logging_wrapper /usr/local/lib/python3.8/dist-packages/os_brick/utils.py:167}}
Jun 18 22:34:42.203476 ncdv-master-1 cinder-backup[123790]: DEBUG os_brick.initiator.connectors.rbd [None req-62910d72-3e9b-428d-9f03-8cbb6f237407 tempest-VolumesBackupsAdminTest-343096894 None] <== disconnect_volume: return (18ms) None {{(pid=123790) trace_logging_wrapper /usr/local/lib/python3.8/dist-packages/os_brick/utils.py:194}}
Jun 18 22:34:42.280378 ncdv-master-1 cinder-backup[123790]: INFO cinder.backup.manager [None req-62910d72-3e9b-428d-9f03-8cbb6f237407 tempest-VolumesBackupsAdminTest-343096894 None] Create backup finished. backup: dbb6a402-6bbb-4314-8339-efc34c5209b7.
Jun 18 22:34:42.741261 ncdv-master-1 cinder-backup[123790]: INFO cinder.backup.manager [None req-cccf01f8-f52c-48bd-8af9-4a055786c2cc tempest-VolumesBackupsAdminTest-237939543 None] Export record started, backup: dbb6a402-6bbb-4314-8339-efc34c5209b7.
Jun 18 22:34:42.743542 ncdv-master-1 cinder-backup[123790]: INFO cinder.backup.manager [None req-cccf01f8-f52c-48bd-8af9-4a055786c2cc tempest-VolumesBackupsAdminTest-237939543 None] Export record finished, backup dbb6a402-6bbb-4314-8339-efc34c5209b7 exported.
Jun 18 22:34:42.917420 ncdv-master-1 cinder-backup[123790]: INFO cinder.backup.manager [None req-b708c73c-3069-40af-9294-acbbf79de597 tempest-VolumesBackupsAdminTest-237939543 None] Import record started, backup_url: eyJkcml2ZXJfaW5mbyI6IHt9LCAiaWQiOiAiMzQ0YzhiOTgtYWM1OS00YjYyLThiZmEtY2UyNzlkZTRhMDY1IiwgInVzZXJfaWQiOiAiYTI2MDVmMjhhMDdiNDY1Y2I5ZmQyYzU0M2E2OWMzOGUiLCAicHJvamVjdF9pZCI6ICJjZjg3N2QzZDNiMjA0NGEwODllZGQ4YjA3ZjMwM2Q1NCIsICJ2b2x1bWVfaWQiOiAiMjcwNDExYjEtYWNmNC00YmQ2LTkyMmEtN2FmMjMzYjdmZjkzIiwgImhvc3QiOiAibmNkdi1tYXN0ZXItMSIsICJhdmFpbGFiaWxpdHlfem9uZSI6IG51bGwsICJjb250YWluZXIiOiAiYmFja3VwcyIsICJwYXJlbnRfaWQiOiBudWxsLCAic3RhdHVzIjogImF2YWlsYWJsZSIsICJmYWlsX3JlYXNvbiI6IG51bGwsICJzaXplIjogMSwgImRpc3BsYXlfbmFtZSI6ICJ0ZW1wZXN0LVZvbHVtZXNCYWNrdXBzQWRtaW5UZXN0LUJhY2t1cC0xODM3OTc4NzY5IiwgImRpc3BsYXlfZGVzY3JpcHRpb24iOiBudWxsLCAic2VydmljZV9tZXRhZGF0YSI6ICJ7XCJiYXNlXCI6IFwidm9sdW1lLTI3MDQxMWIxLWFjZjQtNGJkNi05MjJhLTdhZjIzM2I3ZmY5My5iYWNrdXAuZGJiNmE0MDItNmJiYi00MzE0LTgzMzktZWZjMzRjNTIwOWI3XCJ9IiwgInNlcnZpY2UiOiAiY2luZGVyLmJhY2t1cC5kcml2ZXJzLmNlcGguQ2VwaEJhY2t1cERyaXZlciIsICJvYmplY3RfY291bnQiOiAwLCAidGVtcF92b2x1bWVfaWQiOiBudWxsLCAidGVtcF9zbmFwc2hvdF9pZCI6IG51bGwsICJudW1fZGVwZW5kZW50X2JhY2t1cHMiOiAwLCAic25hcHNob3RfaWQiOiBudWxsLCAiZGF0YV90aW1lc3RhbXAiOiAiMjAyMi0wNi0xOFQyMjozNDozOVoiLCAicmVzdG9yZV92b2x1bWVfaWQiOiBudWxsLCAibWV0YWRhdGEiOiB7fSwgImVuY3J5cHRpb25fa2V5X2lkIjogbnVsbCwgImNyZWF0ZWRfYXQiOiAiMjAyMi0wNi0xOFQyMjozNDozOVoiLCAidXBkYXRlZF9hdCI6ICIyMDIyLTA2LTE4VDIyOjM0OjQyWiIsICJkZWxldGVkX2F0IjogbnVsbCwgImRlbGV0ZWQiOiBmYWxzZX0=.
Jun 18 22:34:42.938802 ncdv-master-1 cinder-backup[123790]: DEBUG oslo_db.sqlalchemy.engines [None req-b708c73c-3069-40af-9294-acbbf79de597 tempest-VolumesBackupsAdminTest-237939543 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123790) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}}
Jun 18 22:34:42.984943 ncdv-master-1 cinder-backup[123790]: INFO cinder.backup.manager [None req-b708c73c-3069-40af-9294-acbbf79de597 tempest-VolumesBackupsAdminTest-237939543 None] Import record id 344c8b98-ac59-4b62-8bfa-ce279de4a065 metadata from driver finished.
Jun 18 22:34:45.357834 ncdv-master-1 cinder-backup[123790]: INFO cinder.backup.manager [None req-6adda952-02a0-449a-8d1e-c9295177852d tempest-VolumesBackupsAdminTest-343096894 None] Restore backup started, backup: dbb6a402-6bbb-4314-8339-efc34c5209b7 volume: f9aba5e1-bbea-44c2-a838-bb8250dc671d.
Jun 18 22:34:45.371308 ncdv-master-1 cinder-backup[123790]: DEBUG os_brick.utils [None req-6adda952-02a0-449a-8d1e-c9295177852d tempest-VolumesBackupsAdminTest-343096894 None] ==> get_connector_properties: call "{'root_helper': 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf', 'my_ip': '10.222.0.30', 'multipath': False, 'enforce_multipath': False, 'host': None, 'execute': None}" {{(pid=123790) trace_logging_wrapper /usr/local/lib/python3.8/dist-packages/os_brick/utils.py:167}}
Jun 18 22:34:45.375888 ncdv-master-1 cinder-backup[123790]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=161870) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Jun 18 22:34:45.383944 ncdv-master-1 cinder-backup[123790]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.011s {{(pid=161870) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Jun 18 22:34:45.384275 ncdv-master-1 cinder-backup[123790]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0a42b83-4c78-4234-9ade-9ecfd4e17dc6]: (4, ('## DO NOT EDIT OR REMOVE THIS FILE!\n## If you remove this file, the iSCSI daemon will not start.\n## If you change the InitiatorName, existing access control lists\n## may reject this initiator.  The InitiatorName must be unique\n## for each iSCSI initiator.  Do NOT duplicate iSCSI InitiatorNames.\nInitiatorName=iqn.1993-08.org.debian:01:f965e8976dfc\n', '')) {{(pid=161870) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}}
Jun 18 22:34:45.386303 ncdv-master-1 cinder-backup[123790]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): systool -c fc_host -v {{(pid=161870) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Jun 18 22:34:45.392644 ncdv-master-1 cinder-backup[123790]: DEBUG oslo_concurrency.processutils [-] 'systool -c fc_host -v' failed. Not Retrying. {{(pid=161870) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:473}}
Jun 18 22:34:45.393312 ncdv-master-1 cinder-backup[123790]: DEBUG oslo.privsep.daemon [-] privsep: Exception during request[dcde9778-f4ce-4950-b187-34043d90f575]: [Errno 2] No such file or directory: 'systool' {{(pid=161870) _process_cmd /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:479}}
Jun 18 22:34:45.393312 ncdv-master-1 cinder-backup[123790]: Traceback (most recent call last):
Jun 18 22:34:45.393312 ncdv-master-1 cinder-backup[123790]:   File "/usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py", line 476, in _process_cmd
Jun 18 22:34:45.393312 ncdv-master-1 cinder-backup[123790]:     ret = func(*f_args, **f_kwargs)
Jun 18 22:34:45.393312 ncdv-master-1 cinder-backup[123790]:   File "/usr/local/lib/python3.8/dist-packages/oslo_privsep/priv_context.py", line 274, in _wrap
Jun 18 22:34:45.393312 ncdv-master-1 cinder-backup[123790]:     return func(*args, **kwargs)
Jun 18 22:34:45.393312 ncdv-master-1 cinder-backup[123790]:   File "/usr/local/lib/python3.8/dist-packages/os_brick/privileged/rootwrap.py", line 197, in execute_root
Jun 18 22:34:45.393312 ncdv-master-1 cinder-backup[123790]:     return custom_execute(*cmd, shell=False, run_as_root=False, **kwargs)
Jun 18 22:34:45.393312 ncdv-master-1 cinder-backup[123790]:   File "/usr/local/lib/python3.8/dist-packages/os_brick/privileged/rootwrap.py", line 145, in custom_execute
Jun 18 22:34:45.393312 ncdv-master-1 cinder-backup[123790]:     return putils.execute(on_execute=on_execute,
Jun 18 22:34:45.393312 ncdv-master-1 cinder-backup[123790]:   File "/usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py", line 395, in execute
Jun 18 22:34:45.393312 ncdv-master-1 cinder-backup[123790]:     obj = subprocess.Popen(cmd,
Jun 18 22:34:45.393312 ncdv-master-1 cinder-backup[123790]:   File "/usr/lib/python3.8/subprocess.py", line 858, in __init__
Jun 18 22:34:45.393312 ncdv-master-1 cinder-backup[123790]:     self._execute_child(args, executable, preexec_fn, close_fds,
Jun 18 22:34:45.393312 ncdv-master-1 cinder-backup[123790]:   File "/usr/lib/python3.8/subprocess.py", line 1704, in _execute_child
Jun 18 22:34:45.393312 ncdv-master-1 cinder-backup[123790]:     raise child_exception_type(errno_num, err_msg, err_filename)
Jun 18 22:34:45.393312 ncdv-master-1 cinder-backup[123790]: FileNotFoundError: [Errno 2] No such file or directory: 'systool'
Jun 18 22:34:45.394809 ncdv-master-1 cinder-backup[123790]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcde9778-f4ce-4950-b187-34043d90f575]: (5, 'builtins.FileNotFoundError', (2, 'No such file or directory')) {{(pid=161870) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}}
Jun 18 22:34:45.396044 ncdv-master-1 cinder-backup[123790]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): systool -c fc_host -v {{(pid=161870) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Jun 18 22:34:45.402319 ncdv-master-1 cinder-backup[123790]: DEBUG oslo_concurrency.processutils [-] 'systool -c fc_host -v' failed. Not Retrying. {{(pid=161870) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:473}}
Jun 18 22:34:45.402686 ncdv-master-1 cinder-backup[123790]: DEBUG oslo.privsep.daemon [-] privsep: Exception during request[24a5da43-535c-44f1-bc0f-58a68ddca164]: [Errno 2] No such file or directory: 'systool' {{(pid=161870) _process_cmd /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:479}}
Jun 18 22:34:45.402686 ncdv-master-1 cinder-backup[123790]: Traceback (most recent call last):
Jun 18 22:34:45.402686 ncdv-master-1 cinder-backup[123790]:   File "/usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py", line 476, in _process_cmd
Jun 18 22:34:45.402686 ncdv-master-1 cinder-backup[123790]:     ret = func(*f_args, **f_kwargs)
Jun 18 22:34:45.402686 ncdv-master-1 cinder-backup[123790]:   File "/usr/local/lib/python3.8/dist-packages/oslo_privsep/priv_context.py", line 274, in _wrap
Jun 18 22:34:45.402686 ncdv-master-1 cinder-backup[123790]:     return func(*args, **kwargs)
Jun 18 22:34:45.402686 ncdv-master-1 cinder-backup[123790]:   File "/usr/local/lib/python3.8/dist-packages/os_brick/privileged/rootwrap.py", line 197, in execute_root
Jun 18 22:34:45.402686 ncdv-master-1 cinder-backup[123790]:     return custom_execute(*cmd, shell=False, run_as_root=False, **kwargs)
Jun 18 22:34:45.402686 ncdv-master-1 cinder-backup[123790]:   File "/usr/local/lib/python3.8/dist-packages/os_brick/privileged/rootwrap.py", line 145, in custom_execute
Jun 18 22:34:45.402686 ncdv-master-1 cinder-backup[123790]:     return putils.execute(on_execute=on_execute,
Jun 18 22:34:45.402686 ncdv-master-1 cinder-backup[123790]:   File "/usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py", line 395, in execute
Jun 18 22:34:45.402686 ncdv-master-1 cinder-backup[123790]:     obj = subprocess.Popen(cmd,
Jun 18 22:34:45.402686 ncdv-master-1 cinder-backup[123790]:   File "/usr/lib/python3.8/subprocess.py", line 858, in __init__
Jun 18 22:34:45.402686 ncdv-master-1 cinder-backup[123790]:     self._execute_child(args, executable, preexec_fn, close_fds,
Jun 18 22:34:45.402686 ncdv-master-1 cinder-backup[123790]:   File "/usr/lib/python3.8/subprocess.py", line 1704, in _execute_child
Jun 18 22:34:45.402686 ncdv-master-1 cinder-backup[123790]:     raise child_exception_type(errno_num, err_msg, err_filename)
Jun 18 22:34:45.402686 ncdv-master-1 cinder-backup[123790]: FileNotFoundError: [Errno 2] No such file or directory: 'systool'
Jun 18 22:34:45.403981 ncdv-master-1 cinder-backup[123790]: DEBUG oslo.privsep.daemon [-] privsep: reply[24a5da43-535c-44f1-bc0f-58a68ddca164]: (5, 'builtins.FileNotFoundError', (2, 'No such file or directory')) {{(pid=161870) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}}
Jun 18 22:34:45.404916 ncdv-master-1 cinder-backup[123790]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=161870) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Jun 18 22:34:45.414580 ncdv-master-1 cinder-backup[123790]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.009s {{(pid=161870) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Jun 18 22:34:45.415599 ncdv-master-1 cinder-backup[123790]: DEBUG oslo.privsep.daemon [-] privsep: reply[11567d8d-37d2-44c4-81ae-b5b696bd103a]: (4, ('/dev/sda1\n', '')) {{(pid=161870) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}}
Jun 18 22:34:45.416792 ncdv-master-1 cinder-backup[123790]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/sda1 -s UUID -o value {{(pid=161870) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Jun 18 22:34:45.425492 ncdv-master-1 cinder-backup[123790]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/sda1 -s UUID -o value" returned: 0 in 0.008s {{(pid=161870) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Jun 18 22:34:45.426061 ncdv-master-1 cinder-backup[123790]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bc3a66d-65d7-44a4-9991-a5462cc9282f]: (4, ('02bb033c-a191-40c0-94fb-bb025c724b13\n', '')) {{(pid=161870) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}}
Jun 18 22:34:45.427248 ncdv-master-1 cinder-backup[123790]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /sys/class/dmi/id/product_uuid {{(pid=161870) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Jun 18 22:34:45.434718 ncdv-master-1 cinder-backup[123790]: DEBUG oslo_concurrency.processutils [-] CMD "cat /sys/class/dmi/id/product_uuid" returned: 0 in 0.007s {{(pid=161870) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Jun 18 22:34:45.435032 ncdv-master-1 cinder-backup[123790]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fb0d1d8-e483-4a40-b15c-cbbd2e683a82]: (4, ('cdfe4be3-957b-ec4d-8b08-ab749503be55\n', '')) {{(pid=161870) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}}
Jun 18 22:34:45.436271 ncdv-master-1 cinder-backup[123790]: DEBUG oslo_concurrency.processutils [None req-6adda952-02a0-449a-8d1e-c9295177852d tempest-VolumesBackupsAdminTest-343096894 None] Running cmd (subprocess): nvme version {{(pid=123790) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Jun 18 22:34:45.457700 ncdv-master-1 cinder-backup[123790]: DEBUG oslo_concurrency.processutils [None req-6adda952-02a0-449a-8d1e-c9295177852d tempest-VolumesBackupsAdminTest-343096894 None] CMD "nvme version" returned: 0 in 0.021s {{(pid=123790) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Jun 18 22:34:45.459627 ncdv-master-1 cinder-backup[123790]: DEBUG os_brick.initiator.connectors.lightos [None req-6adda952-02a0-449a-8d1e-c9295177852d tempest-VolumesBackupsAdminTest-343096894 None] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=123790) find_dsc /usr/local/lib/python3.8/dist-packages/os_brick/initiator/connectors/lightos.py:100}}
Jun 18 22:34:45.460005 ncdv-master-1 cinder-backup[123790]: DEBUG os_brick.initiator.connectors.lightos [None req-6adda952-02a0-449a-8d1e-c9295177852d tempest-VolumesBackupsAdminTest-343096894 None] LIGHTOS: did not find dsc, continuing anyway. {{(pid=123790) get_connector_properties /usr/local/lib/python3.8/dist-packages/os_brick/initiator/connectors/lightos.py:78}}
Jun 18 22:34:45.460389 ncdv-master-1 cinder-backup[123790]: DEBUG os_brick.initiator.connectors.lightos [None req-6adda952-02a0-449a-8d1e-c9295177852d tempest-VolumesBackupsAdminTest-343096894 None] LIGHTOS: finally hostnqn: nqn.2014-08.org.nvmexpress:uuid:84627872-5390-4220-b960-ed5945b5c24c dsc:  {{(pid=123790) get_connector_properties /usr/local/lib/python3.8/dist-packages/os_brick/initiator/connectors/lightos.py:81}}
Jun 18 22:34:45.461049 ncdv-master-1 cinder-backup[123790]: DEBUG os_brick.utils [None req-6adda952-02a0-449a-8d1e-c9295177852d tempest-VolumesBackupsAdminTest-343096894 None] <== get_connector_properties: return (88ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.222.0.30', 'host': 'ncdv-master-1', 'multipath': False, 'initiator': 'iqn.1993-08.org.debian:01:f965e8976dfc', 'do_local_attach': False, 'uuid': '02bb033c-a191-40c0-94fb-bb025c724b13', 'system uuid': 'cdfe4be3-957b-ec4d-8b08-ab749503be55', 'nqn': 'nqn.2014-08.org.nvmexpress:uuid:84627872-5390-4220-b960-ed5945b5c24c', 'found_dsc': ''} {{(pid=123790) trace_logging_wrapper /usr/local/lib/python3.8/dist-packages/os_brick/utils.py:194}}
Jun 18 22:34:46.263978 ncdv-master-1 cinder-backup[123790]: DEBUG os_brick.initiator.connector [None req-6adda952-02a0-449a-8d1e-c9295177852d tempest-VolumesBackupsAdminTest-343096894 None] Factory for rbd on None {{(pid=123790) factory /usr/local/lib/python3.8/dist-packages/os_brick/initiator/connector.py:284}}
Jun 18 22:34:46.265531 ncdv-master-1 cinder-backup[123790]: DEBUG os_brick.initiator.connectors.rbd [None req-6adda952-02a0-449a-8d1e-c9295177852d tempest-VolumesBackupsAdminTest-343096894 None] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.rbd.RBDConnector object at 0x7fa8a82a8df0>, 'connection_properties': {'name': 'volumes/volume-f9aba5e1-bbea-44c2-a838-bb8250dc671d', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '***', 'volume_id': 'f9aba5e1-bbea-44c2-a838-bb8250dc671d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, ': False}}" {{(pid=123790) trace_logging_wrapper /usr/local/lib/python3.8/dist-packages/os_brick/utils.py:167}}
Jun 18 22:34:46.266558 ncdv-master-1 cinder-backup[123790]: DEBUG os_brick.initiator.linuxrbd [None req-6adda952-02a0-449a-8d1e-c9295177852d tempest-VolumesBackupsAdminTest-343096894 None] opening connection to ceph cluster (timeout=-1). {{(pid=123790) connect /usr/local/lib/python3.8/dist-packages/os_brick/initiator/linuxrbd.py:70}}
Jun 18 22:34:46.309632 ncdv-master-1 cinder-backup[123790]: DEBUG os_brick.initiator.connectors.rbd [None req-6adda952-02a0-449a-8d1e-c9295177852d tempest-VolumesBackupsAdminTest-343096894 None] <== connect_volume: return (43ms) {'path': <os_brick.initiator.linuxrbd.RBDVolumeIOWrapper object at 0x7fa8a839aee0>} {{(pid=123790) trace_logging_wrapper /usr/local/lib/python3.8/dist-packages/os_brick/utils.py:194}}
Jun 18 22:34:46.312673 ncdv-master-1 cinder-backup[123790]: DEBUG oslo_db.sqlalchemy.engines [None req-e84d75e5-5441-4d43-964b-5b6d3790e0a5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123790) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}}
Jun 18 22:34:46.316156 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writing DB stats cinder:SELECT=19,cinder:UPDATE=5 {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 22:34:46.335056 ncdv-master-1 cinder-backup[123790]: DEBUG cinder.backup.drivers.ceph [None req-6adda952-02a0-449a-8d1e-c9295177852d tempest-VolumesBackupsAdminTest-343096894 None] Starting restore from Ceph backup=dbb6a402-6bbb-4314-8339-efc34c5209b7 to volume=volume-f9aba5e1-bbea-44c2-a838-bb8250dc671d {{(pid=123790) restore /opt/stack/cinder/cinder/backup/drivers/ceph.py:1345}}
Jun 18 22:34:46.404459 ncdv-master-1 cinder-backup[123790]: DEBUG cinder.backup.drivers.ceph [None req-6adda952-02a0-449a-8d1e-c9295177852d tempest-VolumesBackupsAdminTest-343096894 None] Looking for snapshot of backup base 'volume-270411b1-acf4-4bd6-922a-7af233b7ff93.backup.dbb6a402-6bbb-4314-8339-efc34c5209b7' {{(pid=123790) _get_backup_snap_name /opt/stack/cinder/cinder/backup/drivers/ceph.py:953}}
Jun 18 22:34:46.405836 ncdv-master-1 cinder-backup[123790]: DEBUG cinder.backup.drivers.ceph [None req-6adda952-02a0-449a-8d1e-c9295177852d tempest-VolumesBackupsAdminTest-343096894 None] Found snapshot 'backup.dbb6a402-6bbb-4314-8339-efc34c5209b7.snap.1655591680.7182584' {{(pid=123790) _get_backup_snap_name /opt/stack/cinder/cinder/backup/drivers/ceph.py:972}}
Jun 18 22:34:46.414034 ncdv-master-1 cinder-backup[123790]: DEBUG cinder.backup.drivers.ceph [None req-6adda952-02a0-449a-8d1e-c9295177852d tempest-VolumesBackupsAdminTest-343096894 None] Volume file is RBD. {{(pid=123790) _diff_restore_allowed /opt/stack/cinder/cinder/backup/drivers/ceph.py:1247}}
Jun 18 22:34:46.452394 ncdv-master-1 cinder-backup[123790]: DEBUG cinder.backup.drivers.ceph [None req-6adda952-02a0-449a-8d1e-c9295177852d tempest-VolumesBackupsAdminTest-343096894 None] Attempting differential restore. {{(pid=123790) _restore_volume /opt/stack/cinder/cinder/backup/drivers/ceph.py:1300}}
Jun 18 22:34:46.452957 ncdv-master-1 cinder-backup[123790]: DEBUG cinder.backup.drivers.ceph [None req-6adda952-02a0-449a-8d1e-c9295177852d tempest-VolumesBackupsAdminTest-343096894 None] Attempting incremental restore from base='volume-270411b1-acf4-4bd6-922a-7af233b7ff93.backup.dbb6a402-6bbb-4314-8339-efc34c5209b7' snap='backup.dbb6a402-6bbb-4314-8339-efc34c5209b7.snap.1655591680.7182584' {{(pid=123790) _diff_restore_rbd /opt/stack/cinder/cinder/backup/drivers/ceph.py:1146}}
Jun 18 22:34:46.453462 ncdv-master-1 cinder-backup[123790]: DEBUG cinder.backup.drivers.ceph [None req-6adda952-02a0-449a-8d1e-c9295177852d tempest-VolumesBackupsAdminTest-343096894 None] Performing differential transfer from 'volume-270411b1-acf4-4bd6-922a-7af233b7ff93.backup.dbb6a402-6bbb-4314-8339-efc34c5209b7' to 'volume-f9aba5e1-bbea-44c2-a838-bb8250dc671d' {{(pid=123790) _rbd_diff_transfer /opt/stack/cinder/cinder/backup/drivers/ceph.py:656}}
Jun 18 22:34:46.453928 ncdv-master-1 cinder-backup[123790]: DEBUG cinder.backup.drivers.ceph [None req-6adda952-02a0-449a-8d1e-c9295177852d tempest-VolumesBackupsAdminTest-343096894 None] Piping cmd1='rbd export-diff --id cinder-bak --conf /etc/ceph/ceph.conf --pool backups backups/volume-270411b1-acf4-4bd6-922a-7af233b7ff93.backup.dbb6a402-6bbb-4314-8339-efc34c5209b7@backup.dbb6a402-6bbb-4314-8339-efc34c5209b7.snap.1655591680.7182584 -' into... {{(pid=123790) _piped_execute /opt/stack/cinder/cinder/backup/drivers/ceph.py:613}}
Jun 18 22:34:46.454349 ncdv-master-1 cinder-backup[123790]: DEBUG cinder.backup.drivers.ceph [None req-6adda952-02a0-449a-8d1e-c9295177852d tempest-VolumesBackupsAdminTest-343096894 None] cmd2='rbd import-diff --id cinder --conf /tmp/brickrbd_yg_ou2i8 --pool volumes - volumes/volume-f9aba5e1-bbea-44c2-a838-bb8250dc671d' {{(pid=123790) _piped_execute /opt/stack/cinder/cinder/backup/drivers/ceph.py:614}}
Jun 18 22:34:47.162583 ncdv-master-1 cinder-backup[123790]: DEBUG cinder.backup.drivers.ceph [None req-6adda952-02a0-449a-8d1e-c9295177852d tempest-VolumesBackupsAdminTest-343096894 None] Restore transfer completed in 0.7084s {{(pid=123790) _diff_restore_rbd /opt/stack/cinder/cinder/backup/drivers/ceph.py:1168}}
Jun 18 22:34:47.163802 ncdv-master-1 cinder-backup[123790]: DEBUG cinder.backup.drivers.ceph [None req-6adda952-02a0-449a-8d1e-c9295177852d tempest-VolumesBackupsAdminTest-343096894 None] Restore target I/O object does not support fileno() - skipping call to fsync(). {{(pid=123790) restore /opt/stack/cinder/cinder/backup/drivers/ceph.py:1356}}
Jun 18 22:34:47.189571 ncdv-master-1 cinder-backup[123790]: DEBUG cinder.backup.driver [None req-6adda952-02a0-449a-8d1e-c9295177852d tempest-VolumesBackupsAdminTest-343096894 None] Restoring volume base metadata {{(pid=123790) _restore_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:177}}
Jun 18 22:34:47.211868 ncdv-master-1 cinder-backup[123790]: DEBUG cinder.backup.driver [None req-6adda952-02a0-449a-8d1e-c9295177852d tempest-VolumesBackupsAdminTest-343096894 None] No metadata of type 'volume-metadata' to restore {{(pid=123790) put /opt/stack/cinder/cinder/backup/driver.py:345}}
Jun 18 22:34:47.212091 ncdv-master-1 cinder-backup[123790]: DEBUG cinder.backup.driver [None req-6adda952-02a0-449a-8d1e-c9295177852d tempest-VolumesBackupsAdminTest-343096894 None] No metadata of type 'volume-glance-metadata' to restore {{(pid=123790) put /opt/stack/cinder/cinder/backup/driver.py:345}}
Jun 18 22:34:47.218998 ncdv-master-1 cinder-backup[123790]: DEBUG cinder.backup.drivers.ceph [None req-6adda952-02a0-449a-8d1e-c9295177852d tempest-VolumesBackupsAdminTest-343096894 None] Restore to volume f9aba5e1-bbea-44c2-a838-bb8250dc671d finished successfully. {{(pid=123790) restore /opt/stack/cinder/cinder/backup/drivers/ceph.py:1363}}
Jun 18 22:34:47.220927 ncdv-master-1 cinder-backup[123790]: DEBUG os_brick.initiator.connectors.rbd [None req-6adda952-02a0-449a-8d1e-c9295177852d tempest-VolumesBackupsAdminTest-343096894 None] ==> disconnect_volume: call "{'self': <os_brick.initiator.connectors.rbd.RBDConnector object at 0x7fa8a82a8df0>, 'connection_properties': {'name': 'volumes/volume-f9aba5e1-bbea-44c2-a838-bb8250dc671d', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '***', 'volume_id': 'f9aba5e1-bbea-44c2-a838-bb8250dc671d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'device_info': {'path': <os_brick.initiator.linuxrbd.RBDVolumeIOWrapper object at 0x7fa8a839aee0>}, 'force': True, ': False}" {{(pid=123790) trace_logging_wrapper /usr/local/lib/python3.8/dist-packages/os_brick/utils.py:167}}
Jun 18 22:34:47.231632 ncdv-master-1 cinder-backup[123790]: DEBUG os_brick.initiator.connectors.rbd [None req-6adda952-02a0-449a-8d1e-c9295177852d tempest-VolumesBackupsAdminTest-343096894 None] <== disconnect_volume: return (10ms) None {{(pid=123790) trace_logging_wrapper /usr/local/lib/python3.8/dist-packages/os_brick/utils.py:194}}
Jun 18 22:34:47.285435 ncdv-master-1 cinder-backup[123790]: DEBUG cinder.backup.manager [None req-6adda952-02a0-449a-8d1e-c9295177852d tempest-VolumesBackupsAdminTest-343096894 None] Encryption key ID for volume f9aba5e1-bbea-44c2-a838-bb8250dc671d already matches encryption key ID in backup dbb6a402-6bbb-4314-8339-efc34c5209b7. {{(pid=123790) _run_restore /opt/stack/cinder/cinder/backup/manager.py:824}}
Jun 18 22:34:47.322607 ncdv-master-1 cinder-backup[123790]: INFO cinder.backup.manager [None req-6adda952-02a0-449a-8d1e-c9295177852d tempest-VolumesBackupsAdminTest-343096894 None] Finished restoring backup dbb6a402-6bbb-4314-8339-efc34c5209b7 to volume f9aba5e1-bbea-44c2-a838-bb8250dc671d.
Jun 18 22:34:47.691569 ncdv-master-1 cinder-backup[123790]: INFO cinder.backup.manager [None req-0bdd6400-6fd5-49f9-86a1-81a9fd76d7db tempest-VolumesBackupsAdminTest-237939543 None] Delete backup started, backup: 344c8b98-ac59-4b62-8bfa-ce279de4a065.
Jun 18 22:34:47.694769 ncdv-master-1 cinder-backup[123790]: DEBUG cinder.backup.drivers.ceph [None req-0bdd6400-6fd5-49f9-86a1-81a9fd76d7db tempest-VolumesBackupsAdminTest-237939543 None] Delete started for backup=344c8b98-ac59-4b62-8bfa-ce279de4a065 {{(pid=123790) delete_backup /opt/stack/cinder/cinder/backup/drivers/ceph.py:1372}}
Jun 18 22:34:47.695742 ncdv-master-1 cinder-backup[123790]: DEBUG cinder.backup.drivers.ceph [None req-0bdd6400-6fd5-49f9-86a1-81a9fd76d7db tempest-VolumesBackupsAdminTest-237939543 None] Trying diff format basename='volume-270411b1-acf4-4bd6-922a-7af233b7ff93.backup.dbb6a402-6bbb-4314-8339-efc34c5209b7' for backup base image of volume 270411b1-acf4-4bd6-922a-7af233b7ff93. {{(pid=123790) _try_delete_base_image /opt/stack/cinder/cinder/backup/drivers/ceph.py:541}}
Jun 18 22:34:47.756878 ncdv-master-1 cinder-backup[123790]: DEBUG cinder.backup.drivers.ceph [None req-0bdd6400-6fd5-49f9-86a1-81a9fd76d7db tempest-VolumesBackupsAdminTest-237939543 None] Looking for snapshot of backup base 'volume-270411b1-acf4-4bd6-922a-7af233b7ff93.backup.dbb6a402-6bbb-4314-8339-efc34c5209b7' {{(pid=123790) _get_backup_snap_name /opt/stack/cinder/cinder/backup/drivers/ceph.py:953}}
Jun 18 22:34:47.757542 ncdv-master-1 cinder-backup[123790]: DEBUG cinder.backup.drivers.ceph [None req-0bdd6400-6fd5-49f9-86a1-81a9fd76d7db tempest-VolumesBackupsAdminTest-237939543 None] Backup '344c8b98-ac59-4b62-8bfa-ce279de4a065' has no snapshot {{(pid=123790) _get_backup_snap_name /opt/stack/cinder/cinder/backup/drivers/ceph.py:963}}
Jun 18 22:34:47.757981 ncdv-master-1 cinder-backup[123790]: DEBUG cinder.backup.drivers.ceph [None req-0bdd6400-6fd5-49f9-86a1-81a9fd76d7db tempest-VolumesBackupsAdminTest-237939543 None] No backup snapshot to delete {{(pid=123790) _delete_backup_snapshot /opt/stack/cinder/cinder/backup/drivers/ceph.py:502}}
Jun 18 22:34:47.764942 ncdv-master-1 cinder-backup[123790]: INFO cinder.backup.drivers.ceph [None req-0bdd6400-6fd5-49f9-86a1-81a9fd76d7db tempest-VolumesBackupsAdminTest-237939543 None] Backup base image of volume 270411b1-acf4-4bd6-922a-7af233b7ff93 still has 1 snapshots so skipping base image delete.
Jun 18 22:34:47.820218 ncdv-master-1 cinder-backup[123790]: DEBUG cinder.backup.drivers.ceph [None req-0bdd6400-6fd5-49f9-86a1-81a9fd76d7db tempest-VolumesBackupsAdminTest-237939543 None] Metadata backup object 'backup.344c8b98-ac59-4b62-8bfa-ce279de4a065.meta' not found - ignoring {{(pid=123790) remove_if_exists /opt/stack/cinder/cinder/backup/drivers/ceph.py:162}}
Jun 18 22:34:47.823864 ncdv-master-1 cinder-backup[123790]: DEBUG cinder.backup.drivers.ceph [None req-0bdd6400-6fd5-49f9-86a1-81a9fd76d7db tempest-VolumesBackupsAdminTest-237939543 None] Delete of backup '344c8b98-ac59-4b62-8bfa-ce279de4a065' for volume '270411b1-acf4-4bd6-922a-7af233b7ff93' finished. {{(pid=123790) delete_backup /opt/stack/cinder/cinder/backup/drivers/ceph.py:1400}}
Jun 18 22:34:47.830547 ncdv-master-1 cinder-backup[123790]: DEBUG oslo_db.sqlalchemy.engines [None req-0bdd6400-6fd5-49f9-86a1-81a9fd76d7db tempest-VolumesBackupsAdminTest-237939543 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123790) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}}
Jun 18 22:34:47.856676 ncdv-master-1 cinder-backup[123790]: DEBUG cinder.quota [None req-0bdd6400-6fd5-49f9-86a1-81a9fd76d7db tempest-VolumesBackupsAdminTest-237939543 None] Created reservations ['3d1610fe-e085-4b6d-8456-995ab0379c3e', '1baf6711-c7fa-42a2-83bc-4f6021b48f3b'] {{(pid=123790) reserve /opt/stack/cinder/cinder/quota.py:755}}
Jun 18 22:34:47.883634 ncdv-master-1 cinder-backup[123790]: INFO cinder.backup.manager [None req-0bdd6400-6fd5-49f9-86a1-81a9fd76d7db tempest-VolumesBackupsAdminTest-237939543 None] Delete backup finished, backup 344c8b98-ac59-4b62-8bfa-ce279de4a065 deleted.
Jun 18 22:34:48.802486 ncdv-master-1 cinder-backup[123790]: INFO cinder.backup.manager [None req-84c02a40-a9ac-44ed-bb76-0c079ffc4e7c tempest-VolumesBackupsAdminTest-343096894 None] Delete backup started, backup: dbb6a402-6bbb-4314-8339-efc34c5209b7.
Jun 18 22:34:48.804750 ncdv-master-1 cinder-backup[123790]: DEBUG cinder.backup.drivers.ceph [None req-84c02a40-a9ac-44ed-bb76-0c079ffc4e7c tempest-VolumesBackupsAdminTest-343096894 None] Delete started for backup=dbb6a402-6bbb-4314-8339-efc34c5209b7 {{(pid=123790) delete_backup /opt/stack/cinder/cinder/backup/drivers/ceph.py:1372}}
Jun 18 22:34:48.805410 ncdv-master-1 cinder-backup[123790]: DEBUG cinder.backup.drivers.ceph [None req-84c02a40-a9ac-44ed-bb76-0c079ffc4e7c tempest-VolumesBackupsAdminTest-343096894 None] Trying diff format basename='volume-270411b1-acf4-4bd6-922a-7af233b7ff93.backup.dbb6a402-6bbb-4314-8339-efc34c5209b7' for backup base image of volume 270411b1-acf4-4bd6-922a-7af233b7ff93. {{(pid=123790) _try_delete_base_image /opt/stack/cinder/cinder/backup/drivers/ceph.py:541}}
Jun 18 22:34:48.866509 ncdv-master-1 cinder-backup[123790]: DEBUG cinder.backup.drivers.ceph [None req-84c02a40-a9ac-44ed-bb76-0c079ffc4e7c tempest-VolumesBackupsAdminTest-343096894 None] Looking for snapshot of backup base 'volume-270411b1-acf4-4bd6-922a-7af233b7ff93.backup.dbb6a402-6bbb-4314-8339-efc34c5209b7' {{(pid=123790) _get_backup_snap_name /opt/stack/cinder/cinder/backup/drivers/ceph.py:953}}
Jun 18 22:34:48.866889 ncdv-master-1 cinder-backup[123790]: DEBUG cinder.backup.drivers.ceph [None req-84c02a40-a9ac-44ed-bb76-0c079ffc4e7c tempest-VolumesBackupsAdminTest-343096894 None] Found snapshot 'backup.dbb6a402-6bbb-4314-8339-efc34c5209b7.snap.1655591680.7182584' {{(pid=123790) _get_backup_snap_name /opt/stack/cinder/cinder/backup/drivers/ceph.py:972}}
Jun 18 22:34:48.867250 ncdv-master-1 cinder-backup[123790]: DEBUG cinder.backup.drivers.ceph [None req-84c02a40-a9ac-44ed-bb76-0c079ffc4e7c tempest-VolumesBackupsAdminTest-343096894 None] Deleting backup snapshot='backup.dbb6a402-6bbb-4314-8339-efc34c5209b7.snap.1655591680.7182584' {{(pid=123790) _delete_backup_snapshot /opt/stack/cinder/cinder/backup/drivers/ceph.py:499}}
Jun 18 22:34:49.142182 ncdv-master-1 cinder-backup[123790]: INFO cinder.backup.drivers.ceph [None req-84c02a40-a9ac-44ed-bb76-0c079ffc4e7c tempest-VolumesBackupsAdminTest-343096894 None] Deleting backup base image='volume-270411b1-acf4-4bd6-922a-7af233b7ff93.backup.dbb6a402-6bbb-4314-8339-efc34c5209b7' of volume 270411b1-acf4-4bd6-922a-7af233b7ff93.
Jun 18 22:34:49.285810 ncdv-master-1 cinder-backup[123790]: DEBUG cinder.backup.drivers.ceph [None req-84c02a40-a9ac-44ed-bb76-0c079ffc4e7c tempest-VolumesBackupsAdminTest-343096894 None] Base backup image='volume-270411b1-acf4-4bd6-922a-7af233b7ff93.backup.dbb6a402-6bbb-4314-8339-efc34c5209b7' of volume 270411b1-acf4-4bd6-922a-7af233b7ff93 deleted. {{(pid=123790) _try_delete_base_image /opt/stack/cinder/cinder/backup/drivers/ceph.py:589}}
Jun 18 22:34:49.327294 ncdv-master-1 cinder-backup[123790]: DEBUG cinder.backup.drivers.ceph [None req-84c02a40-a9ac-44ed-bb76-0c079ffc4e7c tempest-VolumesBackupsAdminTest-343096894 None] Delete of backup 'dbb6a402-6bbb-4314-8339-efc34c5209b7' for volume '270411b1-acf4-4bd6-922a-7af233b7ff93' finished. {{(pid=123790) delete_backup /opt/stack/cinder/cinder/backup/drivers/ceph.py:1400}}
Jun 18 22:34:49.333575 ncdv-master-1 cinder-backup[123790]: DEBUG oslo_db.sqlalchemy.engines [None req-84c02a40-a9ac-44ed-bb76-0c079ffc4e7c tempest-VolumesBackupsAdminTest-343096894 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123790) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}}
Jun 18 22:34:49.358186 ncdv-master-1 cinder-backup[123790]: DEBUG cinder.quota [None req-84c02a40-a9ac-44ed-bb76-0c079ffc4e7c tempest-VolumesBackupsAdminTest-343096894 None] Created reservations ['82951cb2-69e1-4961-8eea-caec0236e1cf', 'fcd6e693-b52c-429c-a8a6-31ca6a265b11'] {{(pid=123790) reserve /opt/stack/cinder/cinder/quota.py:755}}
Jun 18 22:34:49.383706 ncdv-master-1 cinder-backup[123790]: INFO cinder.backup.manager [None req-84c02a40-a9ac-44ed-bb76-0c079ffc4e7c tempest-VolumesBackupsAdminTest-343096894 None] Delete backup finished, backup dbb6a402-6bbb-4314-8339-efc34c5209b7 deleted.
Jun 18 22:34:51.408238 ncdv-master-1 cinder-backup[123790]: INFO cinder.backup.manager [None req-ccae3e56-7d87-4105-9467-f75a12e5c388 tempest-VolumesBackupsAdminTest-343096894 None] Create backup started, backup: abaf452d-f2a9-4671-8327-53af7b73bfc5 volume: 3b14570d-fcc3-47d8-86e7-3c15b25f2617.
Jun 18 22:34:51.418032 ncdv-master-1 cinder-backup[123790]: INFO cinder.backup.manager [None req-ccae3e56-7d87-4105-9467-f75a12e5c388 tempest-VolumesBackupsAdminTest-343096894 None] Call Volume Manager to get_backup_device for Backup(availability_zone=None,container=None,created_at=2022-06-18T22:34:51Z,data_timestamp=2022-06-18T22:34:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsAdminTest-Backup-100500383',encryption_key_id=None,fail_reason=None,host='ncdv-master-1',id=abaf452d-f2a9-4671-8327-53af7b73bfc5,metadata={},num_dependent_backups=0,object_count=0,parent=None,parent_id=None,project_id='cf877d3d3b2044a089edd8b07f303d54',restore_volume_id=None,service='cinder.backup.drivers.ceph.CephBackupDriver',service_metadata=None,size=1,snapshot_id=None,status='creating',temp_snapshot_id=None,temp_volume_id=None,updated_at=None,user_id='a2605f28a07b465cb9fd2c543a69c38e',volume_id=3b14570d-fcc3-47d8-86e7-3c15b25f2617)
Jun 18 22:34:51.493092 ncdv-master-1 cinder-backup[123790]: DEBUG os_brick.utils [None req-ccae3e56-7d87-4105-9467-f75a12e5c388 tempest-VolumesBackupsAdminTest-343096894 None] ==> get_connector_properties: call "{'root_helper': 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf', 'my_ip': '10.222.0.30', 'multipath': False, 'enforce_multipath': False, 'host': None, 'execute': None}" {{(pid=123790) trace_logging_wrapper /usr/local/lib/python3.8/dist-packages/os_brick/utils.py:167}}
Jun 18 22:34:51.494510 ncdv-master-1 cinder-backup[123790]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=161870) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Jun 18 22:34:51.506051 ncdv-master-1 cinder-backup[123790]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.010s {{(pid=161870) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Jun 18 22:34:51.506854 ncdv-master-1 cinder-backup[123790]: DEBUG oslo.privsep.daemon [-] privsep: reply[01af52d8-8345-4c92-9bea-b134cc27660a]: (4, ('## DO NOT EDIT OR REMOVE THIS FILE!\n## If you remove this file, the iSCSI daemon will not start.\n## If you change the InitiatorName, existing access control lists\n## may reject this initiator.  The InitiatorName must be unique\n## for each iSCSI initiator.  Do NOT duplicate iSCSI InitiatorNames.\nInitiatorName=iqn.1993-08.org.debian:01:f965e8976dfc\n', '')) {{(pid=161870) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}}
Jun 18 22:34:51.508541 ncdv-master-1 cinder-backup[123790]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): systool -c fc_host -v {{(pid=161870) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Jun 18 22:34:51.519204 ncdv-master-1 cinder-backup[123790]: DEBUG oslo_concurrency.processutils [-] 'systool -c fc_host -v' failed. Not Retrying. {{(pid=161870) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:473}}
Jun 18 22:34:51.520761 ncdv-master-1 cinder-backup[123790]: DEBUG oslo.privsep.daemon [-] privsep: Exception during request[cd467215-a52e-4762-b86d-8caebc0f3df8]: [Errno 2] No such file or directory: 'systool' {{(pid=161870) _process_cmd /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:479}}
Jun 18 22:34:51.520761 ncdv-master-1 cinder-backup[123790]: Traceback (most recent call last):
Jun 18 22:34:51.520761 ncdv-master-1 cinder-backup[123790]:   File "/usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py", line 476, in _process_cmd
Jun 18 22:34:51.520761 ncdv-master-1 cinder-backup[123790]:     ret = func(*f_args, **f_kwargs)
Jun 18 22:34:51.520761 ncdv-master-1 cinder-backup[123790]:   File "/usr/local/lib/python3.8/dist-packages/oslo_privsep/priv_context.py", line 274, in _wrap
Jun 18 22:34:51.520761 ncdv-master-1 cinder-backup[123790]:     return func(*args, **kwargs)
Jun 18 22:34:51.520761 ncdv-master-1 cinder-backup[123790]:   File "/usr/local/lib/python3.8/dist-packages/os_brick/privileged/rootwrap.py", line 197, in execute_root
Jun 18 22:34:51.520761 ncdv-master-1 cinder-backup[123790]:     return custom_execute(*cmd, shell=False, run_as_root=False, **kwargs)
Jun 18 22:34:51.520761 ncdv-master-1 cinder-backup[123790]:   File "/usr/local/lib/python3.8/dist-packages/os_brick/privileged/rootwrap.py", line 145, in custom_execute
Jun 18 22:34:51.520761 ncdv-master-1 cinder-backup[123790]:     return putils.execute(on_execute=on_execute,
Jun 18 22:34:51.520761 ncdv-master-1 cinder-backup[123790]:   File "/usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py", line 395, in execute
Jun 18 22:34:51.520761 ncdv-master-1 cinder-backup[123790]:     obj = subprocess.Popen(cmd,
Jun 18 22:34:51.520761 ncdv-master-1 cinder-backup[123790]:   File "/usr/lib/python3.8/subprocess.py", line 858, in __init__
Jun 18 22:34:51.520761 ncdv-master-1 cinder-backup[123790]:     self._execute_child(args, executable, preexec_fn, close_fds,
Jun 18 22:34:51.520761 ncdv-master-1 cinder-backup[123790]:   File "/usr/lib/python3.8/subprocess.py", line 1704, in _execute_child
Jun 18 22:34:51.520761 ncdv-master-1 cinder-backup[123790]:     raise child_exception_type(errno_num, err_msg, err_filename)
Jun 18 22:34:51.520761 ncdv-master-1 cinder-backup[123790]: FileNotFoundError: [Errno 2] No such file or directory: 'systool'
Jun 18 22:34:51.522337 ncdv-master-1 cinder-backup[123790]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd467215-a52e-4762-b86d-8caebc0f3df8]: (5, 'builtins.FileNotFoundError', (2, 'No such file or directory')) {{(pid=161870) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}}
Jun 18 22:34:51.523372 ncdv-master-1 cinder-backup[123790]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): systool -c fc_host -v {{(pid=161870) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Jun 18 22:34:51.534639 ncdv-master-1 cinder-backup[123790]: DEBUG oslo_concurrency.processutils [-] 'systool -c fc_host -v' failed. Not Retrying. {{(pid=161870) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:473}}
Jun 18 22:34:51.534639 ncdv-master-1 cinder-backup[123790]: DEBUG oslo.privsep.daemon [-] privsep: Exception during request[7da044a1-8b1c-4f57-bc50-211ae27ba895]: [Errno 2] No such file or directory: 'systool' {{(pid=161870) _process_cmd /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:479}}
Jun 18 22:34:51.534639 ncdv-master-1 cinder-backup[123790]: Traceback (most recent call last):
Jun 18 22:34:51.534639 ncdv-master-1 cinder-backup[123790]:   File "/usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py", line 476, in _process_cmd
Jun 18 22:34:51.534639 ncdv-master-1 cinder-backup[123790]:     ret = func(*f_args, **f_kwargs)
Jun 18 22:34:51.534639 ncdv-master-1 cinder-backup[123790]:   File "/usr/local/lib/python3.8/dist-packages/oslo_privsep/priv_context.py", line 274, in _wrap
Jun 18 22:34:51.534639 ncdv-master-1 cinder-backup[123790]:     return func(*args, **kwargs)
Jun 18 22:34:51.534639 ncdv-master-1 cinder-backup[123790]:   File "/usr/local/lib/python3.8/dist-packages/os_brick/privileged/rootwrap.py", line 197, in execute_root
Jun 18 22:34:51.534639 ncdv-master-1 cinder-backup[123790]:     return custom_execute(*cmd, shell=False, run_as_root=False, **kwargs)
Jun 18 22:34:51.534639 ncdv-master-1 cinder-backup[123790]:   File "/usr/local/lib/python3.8/dist-packages/os_brick/privileged/rootwrap.py", line 145, in custom_execute
Jun 18 22:34:51.534639 ncdv-master-1 cinder-backup[123790]:     return putils.execute(on_execute=on_execute,
Jun 18 22:34:51.534639 ncdv-master-1 cinder-backup[123790]:   File "/usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py", line 395, in execute
Jun 18 22:34:51.534639 ncdv-master-1 cinder-backup[123790]:     obj = subprocess.Popen(cmd,
Jun 18 22:34:51.534639 ncdv-master-1 cinder-backup[123790]:   File "/usr/lib/python3.8/subprocess.py", line 858, in __init__
Jun 18 22:34:51.534639 ncdv-master-1 cinder-backup[123790]:     self._execute_child(args, executable, preexec_fn, close_fds,
Jun 18 22:34:51.534639 ncdv-master-1 cinder-backup[123790]:   File "/usr/lib/python3.8/subprocess.py", line 1704, in _execute_child
Jun 18 22:34:51.534639 ncdv-master-1 cinder-backup[123790]:     raise child_exception_type(errno_num, err_msg, err_filename)
Jun 18 22:34:51.534639 ncdv-master-1 cinder-backup[123790]: FileNotFoundError: [Errno 2] No such file or directory: 'systool'
Jun 18 22:34:51.534639 ncdv-master-1 cinder-backup[123790]: DEBUG oslo.privsep.daemon [-] privsep: reply[7da044a1-8b1c-4f57-bc50-211ae27ba895]: (5, 'builtins.FileNotFoundError', (2, 'No such file or directory')) {{(pid=161870) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}}
Jun 18 22:34:51.539641 ncdv-master-1 cinder-backup[123790]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=161870) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Jun 18 22:34:51.547316 ncdv-master-1 cinder-backup[123790]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.010s {{(pid=161870) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Jun 18 22:34:51.547632 ncdv-master-1 cinder-backup[123790]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0b1727f-ec51-44d7-b85d-cd78621b4d27]: (4, ('/dev/sda1\n', '')) {{(pid=161870) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}}
Jun 18 22:34:51.550848 ncdv-master-1 cinder-backup[123790]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/sda1 -s UUID -o value {{(pid=161870) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Jun 18 22:34:51.568656 ncdv-master-1 cinder-backup[123790]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/sda1 -s UUID -o value" returned: 0 in 0.017s {{(pid=161870) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Jun 18 22:34:51.568979 ncdv-master-1 cinder-backup[123790]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d8623f6-467d-4ea4-b54e-5cda81ee74a9]: (4, ('02bb033c-a191-40c0-94fb-bb025c724b13\n', '')) {{(pid=161870) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}}
Jun 18 22:34:51.570217 ncdv-master-1 cinder-backup[123790]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /sys/class/dmi/id/product_uuid {{(pid=161870) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Jun 18 22:34:51.583404 ncdv-master-1 cinder-backup[123790]: DEBUG oslo_concurrency.processutils [-] CMD "cat /sys/class/dmi/id/product_uuid" returned: 0 in 0.009s {{(pid=161870) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Jun 18 22:34:51.583686 ncdv-master-1 cinder-backup[123790]: DEBUG oslo.privsep.daemon [-] privsep: reply[ceb8543e-423b-471e-a499-5608276aff4c]: (4, ('cdfe4be3-957b-ec4d-8b08-ab749503be55\n', '')) {{(pid=161870) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}}
Jun 18 22:34:51.584456 ncdv-master-1 cinder-backup[123790]: DEBUG oslo_concurrency.processutils [None req-ccae3e56-7d87-4105-9467-f75a12e5c388 tempest-VolumesBackupsAdminTest-343096894 None] Running cmd (subprocess): nvme version {{(pid=123790) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Jun 18 22:34:51.611284 ncdv-master-1 cinder-backup[123790]: DEBUG oslo_concurrency.processutils [None req-ccae3e56-7d87-4105-9467-f75a12e5c388 tempest-VolumesBackupsAdminTest-343096894 None] CMD "nvme version" returned: 0 in 0.026s {{(pid=123790) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Jun 18 22:34:51.613657 ncdv-master-1 cinder-backup[123790]: DEBUG os_brick.initiator.connectors.lightos [None req-ccae3e56-7d87-4105-9467-f75a12e5c388 tempest-VolumesBackupsAdminTest-343096894 None] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=123790) find_dsc /usr/local/lib/python3.8/dist-packages/os_brick/initiator/connectors/lightos.py:100}}
Jun 18 22:34:51.614217 ncdv-master-1 cinder-backup[123790]: DEBUG os_brick.initiator.connectors.lightos [None req-ccae3e56-7d87-4105-9467-f75a12e5c388 tempest-VolumesBackupsAdminTest-343096894 None] LIGHTOS: did not find dsc, continuing anyway. {{(pid=123790) get_connector_properties /usr/local/lib/python3.8/dist-packages/os_brick/initiator/connectors/lightos.py:78}}
Jun 18 22:34:51.614906 ncdv-master-1 cinder-backup[123790]: DEBUG os_brick.initiator.connectors.lightos [None req-ccae3e56-7d87-4105-9467-f75a12e5c388 tempest-VolumesBackupsAdminTest-343096894 None] LIGHTOS: finally hostnqn: nqn.2014-08.org.nvmexpress:uuid:84627872-5390-4220-b960-ed5945b5c24c dsc:  {{(pid=123790) get_connector_properties /usr/local/lib/python3.8/dist-packages/os_brick/initiator/connectors/lightos.py:81}}
Jun 18 22:34:51.615757 ncdv-master-1 cinder-backup[123790]: DEBUG os_brick.utils [None req-ccae3e56-7d87-4105-9467-f75a12e5c388 tempest-VolumesBackupsAdminTest-343096894 None] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.222.0.30', 'host': 'ncdv-master-1', 'multipath': False, 'initiator': 'iqn.1993-08.org.debian:01:f965e8976dfc', 'do_local_attach': False, 'uuid': '02bb033c-a191-40c0-94fb-bb025c724b13', 'system uuid': 'cdfe4be3-957b-ec4d-8b08-ab749503be55', 'nqn': 'nqn.2014-08.org.nvmexpress:uuid:84627872-5390-4220-b960-ed5945b5c24c', 'found_dsc': ''} {{(pid=123790) trace_logging_wrapper /usr/local/lib/python3.8/dist-packages/os_brick/utils.py:194}}
Jun 18 22:34:52.429139 ncdv-master-1 cinder-backup[123790]: DEBUG os_brick.initiator.connector [None req-ccae3e56-7d87-4105-9467-f75a12e5c388 tempest-VolumesBackupsAdminTest-343096894 None] Factory for rbd on None {{(pid=123790) factory /usr/local/lib/python3.8/dist-packages/os_brick/initiator/connector.py:284}}
Jun 18 22:34:52.430750 ncdv-master-1 cinder-backup[123790]: DEBUG os_brick.initiator.connectors.rbd [None req-ccae3e56-7d87-4105-9467-f75a12e5c388 tempest-VolumesBackupsAdminTest-343096894 None] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.rbd.RBDConnector object at 0x7fa8a7785250>, 'connection_properties': {'name': 'volumes/volume-3b14570d-fcc3-47d8-86e7-3c15b25f2617', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '***', 'volume_id': '3b14570d-fcc3-47d8-86e7-3c15b25f2617', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, ': False}}" {{(pid=123790) trace_logging_wrapper /usr/local/lib/python3.8/dist-packages/os_brick/utils.py:167}}
Jun 18 22:34:52.432075 ncdv-master-1 cinder-backup[123790]: DEBUG os_brick.initiator.linuxrbd [None req-ccae3e56-7d87-4105-9467-f75a12e5c388 tempest-VolumesBackupsAdminTest-343096894 None] opening connection to ceph cluster (timeout=-1). {{(pid=123790) connect /usr/local/lib/python3.8/dist-packages/os_brick/initiator/linuxrbd.py:70}}
Jun 18 22:34:52.493995 ncdv-master-1 cinder-backup[123790]: DEBUG os_brick.initiator.connectors.rbd [None req-ccae3e56-7d87-4105-9467-f75a12e5c388 tempest-VolumesBackupsAdminTest-343096894 None] <== connect_volume: return (62ms) {'path': <os_brick.initiator.linuxrbd.RBDVolumeIOWrapper object at 0x7fa8a8199940>} {{(pid=123790) trace_logging_wrapper /usr/local/lib/python3.8/dist-packages/os_brick/utils.py:194}}
Jun 18 22:34:52.503353 ncdv-master-1 cinder-backup[123790]: DEBUG oslo_db.sqlalchemy.engines [None req-ccae3e56-7d87-4105-9467-f75a12e5c388 tempest-VolumesBackupsAdminTest-343096894 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123790) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}}
Jun 18 22:34:52.542538 ncdv-master-1 cinder-backup[123790]: DEBUG cinder.backup.drivers.ceph [None req-ccae3e56-7d87-4105-9467-f75a12e5c388 tempest-VolumesBackupsAdminTest-343096894 None] Starting backup of volume='3b14570d-fcc3-47d8-86e7-3c15b25f2617'. {{(pid=123790) backup /opt/stack/cinder/cinder/backup/drivers/ceph.py:1024}}
Jun 18 22:34:52.543480 ncdv-master-1 cinder-backup[123790]: DEBUG cinder.backup.drivers.ceph [None req-ccae3e56-7d87-4105-9467-f75a12e5c388 tempest-VolumesBackupsAdminTest-343096894 None] Volume file is RBD: attempting optimized backup {{(pid=123790) backup /opt/stack/cinder/cinder/backup/drivers/ceph.py:1035}}
Jun 18 22:34:52.577653 ncdv-master-1 cinder-backup[123790]: DEBUG cinder.backup.drivers.ceph [None req-ccae3e56-7d87-4105-9467-f75a12e5c388 tempest-VolumesBackupsAdminTest-343096894 None] Creating base image 'volume-3b14570d-fcc3-47d8-86e7-3c15b25f2617.backup.abaf452d-f2a9-4671-8327-53af7b73bfc5' {{(pid=123790) _create_base_image /opt/stack/cinder/cinder/backup/drivers/ceph.py:467}}
Jun 18 22:34:52.578052 ncdv-master-1 cinder-backup[123790]: DEBUG cinder.backup.drivers.ceph [None req-ccae3e56-7d87-4105-9467-f75a12e5c388 tempest-VolumesBackupsAdminTest-343096894 None] RBD also supports fast-diff, enabling it together with exclusive-lock and object-map {{(pid=123790) _get_rbd_support /opt/stack/cinder/cinder/backup/drivers/ceph.py:277}}
Jun 18 22:34:52.619966 ncdv-master-1 cinder-backup[123790]: DEBUG cinder.backup.drivers.ceph [None req-ccae3e56-7d87-4105-9467-f75a12e5c388 tempest-VolumesBackupsAdminTest-343096894 None] Using --from-snap 'None' for incremental backup of volume 3b14570d-fcc3-47d8-86e7-3c15b25f2617. {{(pid=123790) _backup_rbd /opt/stack/cinder/cinder/backup/drivers/ceph.py:808}}
Jun 18 22:34:52.620395 ncdv-master-1 cinder-backup[123790]: DEBUG cinder.backup.drivers.ceph [None req-ccae3e56-7d87-4105-9467-f75a12e5c388 tempest-VolumesBackupsAdminTest-343096894 None] Creating backup snapshot='backup.abaf452d-f2a9-4671-8327-53af7b73bfc5.snap.1655591692.6199925' {{(pid=123790) _backup_rbd /opt/stack/cinder/cinder/backup/drivers/ceph.py:814}}
Jun 18 22:34:53.180844 ncdv-master-1 cinder-backup[123790]: DEBUG cinder.backup.drivers.ceph [None req-ccae3e56-7d87-4105-9467-f75a12e5c388 tempest-VolumesBackupsAdminTest-343096894 None] Performing differential transfer from 'volume-3b14570d-fcc3-47d8-86e7-3c15b25f2617' to 'volume-3b14570d-fcc3-47d8-86e7-3c15b25f2617.backup.abaf452d-f2a9-4671-8327-53af7b73bfc5' {{(pid=123790) _rbd_diff_transfer /opt/stack/cinder/cinder/backup/drivers/ceph.py:656}}
Jun 18 22:34:53.181793 ncdv-master-1 cinder-backup[123790]: DEBUG cinder.backup.drivers.ceph [None req-ccae3e56-7d87-4105-9467-f75a12e5c388 tempest-VolumesBackupsAdminTest-343096894 None] Piping cmd1='rbd export-diff --id cinder --conf /tmp/brickrbd_ybxizrp6 --pool volumes volumes/volume-3b14570d-fcc3-47d8-86e7-3c15b25f2617@backup.abaf452d-f2a9-4671-8327-53af7b73bfc5.snap.1655591692.6199925 -' into... {{(pid=123790) _piped_execute /opt/stack/cinder/cinder/backup/drivers/ceph.py:613}}
Jun 18 22:34:53.182563 ncdv-master-1 cinder-backup[123790]: DEBUG cinder.backup.drivers.ceph [None req-ccae3e56-7d87-4105-9467-f75a12e5c388 tempest-VolumesBackupsAdminTest-343096894 None] cmd2='rbd import-diff --id cinder-bak --conf /etc/ceph/ceph.conf --pool backups - backups/volume-3b14570d-fcc3-47d8-86e7-3c15b25f2617.backup.abaf452d-f2a9-4671-8327-53af7b73bfc5' {{(pid=123790) _piped_execute /opt/stack/cinder/cinder/backup/drivers/ceph.py:614}}
Jun 18 22:34:54.221765 ncdv-master-1 cinder-backup[123790]: DEBUG cinder.backup.drivers.ceph [None req-ccae3e56-7d87-4105-9467-f75a12e5c388 tempest-VolumesBackupsAdminTest-343096894 None] Differential backup transfer completed in 1.0404s {{(pid=123790) _backup_rbd /opt/stack/cinder/cinder/backup/drivers/ceph.py:834}}
Jun 18 22:34:54.222497 ncdv-master-1 cinder-backup[123790]: DEBUG cinder.backup.driver [None req-ccae3e56-7d87-4105-9467-f75a12e5c388 tempest-VolumesBackupsAdminTest-343096894 None] Getting metadata type 'volume-base-metadata' {{(pid=123790) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:79}}
Jun 18 22:34:54.242744 ncdv-master-1 cinder-backup[123790]: DEBUG cinder.backup.driver [None req-ccae3e56-7d87-4105-9467-f75a12e5c388 tempest-VolumesBackupsAdminTest-343096894 None] Completed fetching metadata type 'volume-base-metadata' {{(pid=123790) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:98}}
Jun 18 22:34:54.243760 ncdv-master-1 cinder-backup[123790]: DEBUG cinder.backup.driver [None req-ccae3e56-7d87-4105-9467-f75a12e5c388 tempest-VolumesBackupsAdminTest-343096894 None] Getting metadata type 'volume-metadata' {{(pid=123790) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:109}}
Jun 18 22:34:54.255083 ncdv-master-1 cinder-backup[123790]: DEBUG cinder.backup.driver [None req-ccae3e56-7d87-4105-9467-f75a12e5c388 tempest-VolumesBackupsAdminTest-343096894 None] No metadata type 'volume-metadata' available {{(pid=123790) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:123}}
Jun 18 22:34:54.255332 ncdv-master-1 cinder-backup[123790]: DEBUG cinder.backup.driver [None req-ccae3e56-7d87-4105-9467-f75a12e5c388 tempest-VolumesBackupsAdminTest-343096894 None] Getting metadata type 'volume-glance-metadata' {{(pid=123790) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:132}}
Jun 18 22:34:54.263357 ncdv-master-1 cinder-backup[123790]: DEBUG cinder.backup.driver [None req-ccae3e56-7d87-4105-9467-f75a12e5c388 tempest-VolumesBackupsAdminTest-343096894 None] No metadata type 'volume-glance-metadata' available {{(pid=123790) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:147}}
Jun 18 22:34:54.263917 ncdv-master-1 cinder-backup[123790]: DEBUG cinder.backup.drivers.ceph [None req-ccae3e56-7d87-4105-9467-f75a12e5c388 tempest-VolumesBackupsAdminTest-343096894 None] Backing up metadata for volume 3b14570d-fcc3-47d8-86e7-3c15b25f2617. {{(pid=123790) _backup_metadata /opt/stack/cinder/cinder/backup/drivers/ceph.py:999}}
Jun 18 22:34:54.316925 ncdv-master-1 cinder-backup[123790]: DEBUG cinder.backup.drivers.ceph [None req-ccae3e56-7d87-4105-9467-f75a12e5c388 tempest-VolumesBackupsAdminTest-343096894 None] Backup 'abaf452d-f2a9-4671-8327-53af7b73bfc5' of volume 3b14570d-fcc3-47d8-86e7-3c15b25f2617 finished. {{(pid=123790) backup /opt/stack/cinder/cinder/backup/drivers/ceph.py:1065}}
Jun 18 22:34:54.319305 ncdv-master-1 cinder-backup[123790]: DEBUG os_brick.initiator.connectors.rbd [None req-ccae3e56-7d87-4105-9467-f75a12e5c388 tempest-VolumesBackupsAdminTest-343096894 None] ==> disconnect_volume: call "{'self': <os_brick.initiator.connectors.rbd.RBDConnector object at 0x7fa8a7785250>, 'connection_properties': {'name': 'volumes/volume-3b14570d-fcc3-47d8-86e7-3c15b25f2617', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '***', 'volume_id': '3b14570d-fcc3-47d8-86e7-3c15b25f2617', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'device_info': {'path': <os_brick.initiator.linuxrbd.RBDVolumeIOWrapper object at 0x7fa8a8199940>}, 'force': True, ': True}" {{(pid=123790) trace_logging_wrapper /usr/local/lib/python3.8/dist-packages/os_brick/utils.py:167}}
Jun 18 22:34:54.339295 ncdv-master-1 cinder-backup[123790]: DEBUG os_brick.initiator.connectors.rbd [None req-ccae3e56-7d87-4105-9467-f75a12e5c388 tempest-VolumesBackupsAdminTest-343096894 None] <== disconnect_volume: return (18ms) None {{(pid=123790) trace_logging_wrapper /usr/local/lib/python3.8/dist-packages/os_brick/utils.py:194}}
Jun 18 22:34:54.415335 ncdv-master-1 cinder-backup[123790]: INFO cinder.backup.manager [None req-ccae3e56-7d87-4105-9467-f75a12e5c388 tempest-VolumesBackupsAdminTest-343096894 None] Create backup finished. backup: abaf452d-f2a9-4671-8327-53af7b73bfc5.
Jun 18 22:34:54.589920 ncdv-master-1 cinder-backup[123790]: INFO cinder.backup.manager [None req-a93b3e27-4288-4d2f-ba94-372902654d66 tempest-VolumesBackupsAdminTest-237939543 None] Reset backup status started, backup_id: abaf452d-f2a9-4671-8327-53af7b73bfc5, status: error.
Jun 18 22:34:54.590536 ncdv-master-1 cinder-backup[123790]: INFO cinder.backup.manager [None req-a93b3e27-4288-4d2f-ba94-372902654d66 tempest-VolumesBackupsAdminTest-237939543 None] Backup service: cinder.backup.drivers.ceph.CephBackupDriver.
Jun 18 22:34:54.699755 ncdv-master-1 cinder-backup[123790]: INFO cinder.backup.manager [None req-869ad826-2283-4829-bef9-37086803b403 tempest-VolumesBackupsAdminTest-343096894 None] Delete backup started, backup: abaf452d-f2a9-4671-8327-53af7b73bfc5.
Jun 18 22:34:54.702396 ncdv-master-1 cinder-backup[123790]: DEBUG cinder.backup.drivers.ceph [None req-869ad826-2283-4829-bef9-37086803b403 tempest-VolumesBackupsAdminTest-343096894 None] Delete started for backup=abaf452d-f2a9-4671-8327-53af7b73bfc5 {{(pid=123790) delete_backup /opt/stack/cinder/cinder/backup/drivers/ceph.py:1372}}
Jun 18 22:34:54.702818 ncdv-master-1 cinder-backup[123790]: DEBUG cinder.backup.drivers.ceph [None req-869ad826-2283-4829-bef9-37086803b403 tempest-VolumesBackupsAdminTest-343096894 None] Trying diff format basename='volume-3b14570d-fcc3-47d8-86e7-3c15b25f2617.backup.abaf452d-f2a9-4671-8327-53af7b73bfc5' for backup base image of volume 3b14570d-fcc3-47d8-86e7-3c15b25f2617. {{(pid=123790) _try_delete_base_image /opt/stack/cinder/cinder/backup/drivers/ceph.py:541}}
Jun 18 22:34:54.773479 ncdv-master-1 cinder-backup[123790]: DEBUG cinder.backup.drivers.ceph [None req-869ad826-2283-4829-bef9-37086803b403 tempest-VolumesBackupsAdminTest-343096894 None] Looking for snapshot of backup base 'volume-3b14570d-fcc3-47d8-86e7-3c15b25f2617.backup.abaf452d-f2a9-4671-8327-53af7b73bfc5' {{(pid=123790) _get_backup_snap_name /opt/stack/cinder/cinder/backup/drivers/ceph.py:953}}
Jun 18 22:34:54.773734 ncdv-master-1 cinder-backup[123790]: DEBUG cinder.backup.drivers.ceph [None req-869ad826-2283-4829-bef9-37086803b403 tempest-VolumesBackupsAdminTest-343096894 None] Found snapshot 'backup.abaf452d-f2a9-4671-8327-53af7b73bfc5.snap.1655591692.6199925' {{(pid=123790) _get_backup_snap_name /opt/stack/cinder/cinder/backup/drivers/ceph.py:972}}
Jun 18 22:34:54.774095 ncdv-master-1 cinder-backup[123790]: DEBUG cinder.backup.drivers.ceph [None req-869ad826-2283-4829-bef9-37086803b403 tempest-VolumesBackupsAdminTest-343096894 None] Deleting backup snapshot='backup.abaf452d-f2a9-4671-8327-53af7b73bfc5.snap.1655591692.6199925' {{(pid=123790) _delete_backup_snapshot /opt/stack/cinder/cinder/backup/drivers/ceph.py:499}}
Jun 18 22:34:54.926832 ncdv-master-1 cinder-backup[123790]: INFO cinder.backup.drivers.ceph [None req-869ad826-2283-4829-bef9-37086803b403 tempest-VolumesBackupsAdminTest-343096894 None] Deleting backup base image='volume-3b14570d-fcc3-47d8-86e7-3c15b25f2617.backup.abaf452d-f2a9-4671-8327-53af7b73bfc5' of volume 3b14570d-fcc3-47d8-86e7-3c15b25f2617.
Jun 18 22:34:55.083356 ncdv-master-1 cinder-backup[123790]: DEBUG cinder.backup.drivers.ceph [None req-869ad826-2283-4829-bef9-37086803b403 tempest-VolumesBackupsAdminTest-343096894 None] Base backup image='volume-3b14570d-fcc3-47d8-86e7-3c15b25f2617.backup.abaf452d-f2a9-4671-8327-53af7b73bfc5' of volume 3b14570d-fcc3-47d8-86e7-3c15b25f2617 deleted. {{(pid=123790) _try_delete_base_image /opt/stack/cinder/cinder/backup/drivers/ceph.py:589}}
Jun 18 22:34:55.133522 ncdv-master-1 cinder-backup[123790]: DEBUG cinder.backup.drivers.ceph [None req-869ad826-2283-4829-bef9-37086803b403 tempest-VolumesBackupsAdminTest-343096894 None] Delete of backup 'abaf452d-f2a9-4671-8327-53af7b73bfc5' for volume '3b14570d-fcc3-47d8-86e7-3c15b25f2617' finished. {{(pid=123790) delete_backup /opt/stack/cinder/cinder/backup/drivers/ceph.py:1400}}
Jun 18 22:34:55.145240 ncdv-master-1 cinder-backup[123790]: DEBUG oslo_db.sqlalchemy.engines [None req-869ad826-2283-4829-bef9-37086803b403 tempest-VolumesBackupsAdminTest-343096894 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123790) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}}
Jun 18 22:34:55.191878 ncdv-master-1 cinder-backup[123790]: DEBUG cinder.quota [None req-869ad826-2283-4829-bef9-37086803b403 tempest-VolumesBackupsAdminTest-343096894 None] Created reservations ['ffaeba40-62f5-45ab-954e-94b0c356e3db', '50686d22-ce64-45a1-902c-9eb4005c633e'] {{(pid=123790) reserve /opt/stack/cinder/cinder/quota.py:755}}
Jun 18 22:34:55.233251 ncdv-master-1 cinder-backup[123790]: INFO cinder.backup.manager [None req-869ad826-2283-4829-bef9-37086803b403 tempest-VolumesBackupsAdminTest-343096894 None] Delete backup finished, backup abaf452d-f2a9-4671-8327-53af7b73bfc5 deleted.
Jun 18 22:35:06.268223 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writing DB stats cinder:SELECT=62,cinder:UPDATE=17,cinder:INSERT=3 {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 22:35:08.785406 ncdv-master-1 cinder-backup[123790]: DEBUG oslo_service.periodic_task [None req-d82f921b-aced-4971-81d0-f3b75344497b None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=123790) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Jun 18 22:35:08.786594 ncdv-master-1 cinder-backup[123790]: DEBUG cinder.manager [None req-d82f921b-aced-4971-81d0-f3b75344497b None None] Notifying Schedulers of capabilities ... {{(pid=123790) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jun 18 22:35:26.273768 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writing DB stats cinder:SELECT=45,cinder:UPDATE=15,cinder:INSERT=4 {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 22:35:46.269922 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 22:36:06.276444 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writing DB stats cinder:SELECT=5,cinder:UPDATE=2 {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 22:36:08.783535 ncdv-master-1 cinder-backup[123790]: DEBUG oslo_service.periodic_task [None req-d82f921b-aced-4971-81d0-f3b75344497b None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=123790) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Jun 18 22:36:08.784213 ncdv-master-1 cinder-backup[123790]: DEBUG cinder.manager [None req-d82f921b-aced-4971-81d0-f3b75344497b None None] Notifying Schedulers of capabilities ... {{(pid=123790) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jun 18 22:36:26.275104 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writing DB stats cinder:SELECT=7,cinder:UPDATE=2 {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 22:36:46.267806 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writing DB stats cinder:SELECT=1 {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 22:36:46.269385 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writing DB stats cinder:SELECT=6,cinder:UPDATE=3 {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 22:37:08.783940 ncdv-master-1 cinder-backup[123790]: DEBUG oslo_service.periodic_task [None req-d82f921b-aced-4971-81d0-f3b75344497b None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=123790) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Jun 18 22:37:08.785122 ncdv-master-1 cinder-backup[123790]: DEBUG cinder.manager [None req-d82f921b-aced-4971-81d0-f3b75344497b None None] Notifying Schedulers of capabilities ... {{(pid=123790) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jun 18 22:37:16.270085 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writing DB stats cinder:SELECT=3 {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 22:37:16.276227 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writing DB stats cinder:SELECT=6,cinder:UPDATE=3 {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 22:37:46.279594 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writing DB stats cinder:SELECT=3 {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 22:37:46.280816 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writing DB stats cinder:SELECT=6,cinder:UPDATE=3 {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 22:38:06.281818 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writing DB stats cinder:SELECT=5,cinder:UPDATE=2 {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 22:38:08.781761 ncdv-master-1 cinder-backup[123790]: DEBUG oslo_service.periodic_task [None req-d82f921b-aced-4971-81d0-f3b75344497b None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=123790) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Jun 18 22:38:08.782432 ncdv-master-1 cinder-backup[123790]: DEBUG cinder.manager [None req-d82f921b-aced-4971-81d0-f3b75344497b None None] Notifying Schedulers of capabilities ... {{(pid=123790) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jun 18 22:38:16.293550 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 22:38:36.281054 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writing DB stats cinder:SELECT=1 {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 22:38:46.273227 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writing DB stats cinder:SELECT=9,cinder:UPDATE=3 {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 22:39:06.276705 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writing DB stats cinder:SELECT=2 {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 22:39:08.781506 ncdv-master-1 cinder-backup[123790]: DEBUG oslo_service.periodic_task [None req-d82f921b-aced-4971-81d0-f3b75344497b None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=123790) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Jun 18 22:39:08.782705 ncdv-master-1 cinder-backup[123790]: DEBUG cinder.manager [None req-d82f921b-aced-4971-81d0-f3b75344497b None None] Notifying Schedulers of capabilities ... {{(pid=123790) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jun 18 22:39:16.281664 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writing DB stats cinder:SELECT=5,cinder:UPDATE=2 {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 22:39:36.295377 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 22:39:56.287460 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writing DB stats cinder:SELECT=7,cinder:UPDATE=2 {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 22:40:08.779210 ncdv-master-1 cinder-backup[123790]: DEBUG oslo_service.periodic_task [None req-d82f921b-aced-4971-81d0-f3b75344497b None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=123790) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Jun 18 22:40:08.780292 ncdv-master-1 cinder-backup[123790]: DEBUG cinder.manager [None req-d82f921b-aced-4971-81d0-f3b75344497b None None] Notifying Schedulers of capabilities ... {{(pid=123790) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jun 18 22:40:16.291151 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writing DB stats cinder:SELECT=5,cinder:UPDATE=2 {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 22:40:36.303580 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writing DB stats cinder:SELECT=8,cinder:UPDATE=2 {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 22:40:46.306640 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writing DB stats cinder:UPDATE=2,cinder:SELECT=4 {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 22:41:06.303640 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writing DB stats cinder:UPDATE=1 {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 22:41:08.777888 ncdv-master-1 cinder-backup[123790]: DEBUG oslo_service.periodic_task [None req-d82f921b-aced-4971-81d0-f3b75344497b None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=123790) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Jun 18 22:41:08.778539 ncdv-master-1 cinder-backup[123790]: DEBUG cinder.manager [None req-d82f921b-aced-4971-81d0-f3b75344497b None None] Notifying Schedulers of capabilities ... {{(pid=123790) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jun 18 22:41:16.290918 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writing DB stats cinder:SELECT=8,cinder:UPDATE=2 {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 22:41:46.296705 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writing DB stats cinder:SELECT=4 {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 22:41:46.298111 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writing DB stats cinder:SELECT=5,cinder:UPDATE=3 {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 22:42:06.309186 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writing DB stats cinder:SELECT=4,cinder:UPDATE=2 {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 22:42:08.775379 ncdv-master-1 cinder-backup[123790]: DEBUG oslo_service.periodic_task [None req-d82f921b-aced-4971-81d0-f3b75344497b None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=123790) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Jun 18 22:42:08.776059 ncdv-master-1 cinder-backup[123790]: DEBUG cinder.manager [None req-d82f921b-aced-4971-81d0-f3b75344497b None None] Notifying Schedulers of capabilities ... {{(pid=123790) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jun 18 22:42:26.309728 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writing DB stats cinder:SELECT=6,cinder:UPDATE=1 {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 22:42:46.304373 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 22:43:06.307847 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writing DB stats cinder:SELECT=6,cinder:UPDATE=3 {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 22:43:08.781300 ncdv-master-1 cinder-backup[123790]: DEBUG oslo_service.periodic_task [None req-d82f921b-aced-4971-81d0-f3b75344497b None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=123790) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Jun 18 22:43:08.782310 ncdv-master-1 cinder-backup[123790]: DEBUG cinder.manager [None req-d82f921b-aced-4971-81d0-f3b75344497b None None] Notifying Schedulers of capabilities ... {{(pid=123790) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jun 18 22:43:26.313778 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 22:43:26.319723 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 22:43:46.340084 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writing DB stats cinder:SELECT=4,cinder:UPDATE=1 {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 22:44:06.316483 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writing DB stats cinder:SELECT=2 {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 22:44:06.319095 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writing DB stats cinder:SELECT=6,cinder:UPDATE=3 {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 22:44:08.780494 ncdv-master-1 cinder-backup[123790]: DEBUG oslo_service.periodic_task [None req-d82f921b-aced-4971-81d0-f3b75344497b None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=123790) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Jun 18 22:44:08.781225 ncdv-master-1 cinder-backup[123790]: DEBUG cinder.manager [None req-d82f921b-aced-4971-81d0-f3b75344497b None None] Notifying Schedulers of capabilities ... {{(pid=123790) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jun 18 22:44:36.318341 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 22:44:36.328514 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 22:44:46.329813 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writing DB stats cinder:UPDATE=1 {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 22:45:06.339891 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 22:45:08.777832 ncdv-master-1 cinder-backup[123790]: DEBUG oslo_service.periodic_task [None req-d82f921b-aced-4971-81d0-f3b75344497b None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=123790) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Jun 18 22:45:08.778539 ncdv-master-1 cinder-backup[123790]: DEBUG cinder.manager [None req-d82f921b-aced-4971-81d0-f3b75344497b None None] Notifying Schedulers of capabilities ... {{(pid=123790) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jun 18 22:45:26.337762 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 22:45:46.336965 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writing DB stats cinder:SELECT=6,cinder:UPDATE=3 {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 22:45:46.340469 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writing DB stats cinder:SELECT=2 {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 22:46:08.783061 ncdv-master-1 cinder-backup[123790]: DEBUG oslo_service.periodic_task [None req-d82f921b-aced-4971-81d0-f3b75344497b None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=123790) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Jun 18 22:46:08.783802 ncdv-master-1 cinder-backup[123790]: DEBUG cinder.manager [None req-d82f921b-aced-4971-81d0-f3b75344497b None None] Notifying Schedulers of capabilities ... {{(pid=123790) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jun 18 22:46:26.332647 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 22:46:26.337262 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 22:46:46.336091 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writing DB stats cinder:SELECT=4,cinder:UPDATE=1 {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 22:46:56.349378 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writing DB stats cinder:SELECT=5,cinder:UPDATE=2 {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 22:47:08.779293 ncdv-master-1 cinder-backup[123790]: DEBUG oslo_service.periodic_task [None req-d82f921b-aced-4971-81d0-f3b75344497b None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=123790) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Jun 18 22:47:08.780041 ncdv-master-1 cinder-backup[123790]: DEBUG cinder.manager [None req-d82f921b-aced-4971-81d0-f3b75344497b None None] Notifying Schedulers of capabilities ... {{(pid=123790) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jun 18 22:47:16.350003 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writing DB stats cinder:SELECT=4,cinder:UPDATE=1 {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 22:47:36.348114 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writing DB stats cinder:SELECT=6,cinder:UPDATE=3 {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 22:47:46.359504 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 22:48:06.361480 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 22:48:08.776599 ncdv-master-1 cinder-backup[123790]: DEBUG oslo_service.periodic_task [None req-d82f921b-aced-4971-81d0-f3b75344497b None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=123790) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Jun 18 22:48:08.777710 ncdv-master-1 cinder-backup[123790]: DEBUG cinder.manager [None req-d82f921b-aced-4971-81d0-f3b75344497b None None] Notifying Schedulers of capabilities ... {{(pid=123790) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jun 18 22:48:16.368226 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writing DB stats cinder:SELECT=2,cinder:UPDATE=1 {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 22:48:46.361934 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 22:48:56.374870 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writing DB stats cinder:SELECT=4,cinder:UPDATE=3 {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 22:49:06.370980 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 22:49:08.775534 ncdv-master-1 cinder-backup[123790]: DEBUG oslo_service.periodic_task [None req-d82f921b-aced-4971-81d0-f3b75344497b None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=123790) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Jun 18 22:49:08.776599 ncdv-master-1 cinder-backup[123790]: DEBUG cinder.manager [None req-d82f921b-aced-4971-81d0-f3b75344497b None None] Notifying Schedulers of capabilities ... {{(pid=123790) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jun 18 22:49:36.367472 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 22:49:46.368440 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writing DB stats cinder:SELECT=7,cinder:UPDATE=2 {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 22:50:06.372192 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writing DB stats cinder:SELECT=4,cinder:UPDATE=1 {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 22:50:08.775324 ncdv-master-1 cinder-backup[123790]: DEBUG oslo_service.periodic_task [None req-d82f921b-aced-4971-81d0-f3b75344497b None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=123790) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Jun 18 22:50:08.776299 ncdv-master-1 cinder-backup[123790]: DEBUG cinder.manager [None req-d82f921b-aced-4971-81d0-f3b75344497b None None] Notifying Schedulers of capabilities ... {{(pid=123790) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jun 18 22:50:16.387210 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 22:50:26.389465 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 22:50:56.383242 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writing DB stats cinder:SELECT=9,cinder:UPDATE=1 {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 22:51:06.387385 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writing DB stats cinder:UPDATE=3,cinder:SELECT=4 {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 22:51:08.773553 ncdv-master-1 cinder-backup[123790]: DEBUG oslo_service.periodic_task [None req-d82f921b-aced-4971-81d0-f3b75344497b None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=123790) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Jun 18 22:51:08.774218 ncdv-master-1 cinder-backup[123790]: DEBUG cinder.manager [None req-d82f921b-aced-4971-81d0-f3b75344497b None None] Notifying Schedulers of capabilities ... {{(pid=123790) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jun 18 22:51:26.392368 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 22:51:36.404263 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writing DB stats cinder:SELECT=7,cinder:UPDATE=2 {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 22:52:06.394900 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writing DB stats cinder:SELECT=5,cinder:UPDATE=2 {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 22:52:08.779482 ncdv-master-1 cinder-backup[123790]: DEBUG oslo_service.periodic_task [None req-d82f921b-aced-4971-81d0-f3b75344497b None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=123790) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Jun 18 22:52:08.780609 ncdv-master-1 cinder-backup[123790]: DEBUG cinder.manager [None req-d82f921b-aced-4971-81d0-f3b75344497b None None] Notifying Schedulers of capabilities ... {{(pid=123790) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jun 18 22:52:16.390513 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 22:52:36.398015 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writing DB stats cinder:SELECT=4,cinder:UPDATE=2 {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 22:52:46.408642 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writing DB stats cinder:SELECT=5,cinder:UPDATE=2 {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 22:52:56.408779 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writing DB stats cinder:SELECT=2 {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 22:53:08.778106 ncdv-master-1 cinder-backup[123790]: DEBUG oslo_service.periodic_task [None req-d82f921b-aced-4971-81d0-f3b75344497b None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=123790) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Jun 18 22:53:08.779355 ncdv-master-1 cinder-backup[123790]: DEBUG cinder.manager [None req-d82f921b-aced-4971-81d0-f3b75344497b None None] Notifying Schedulers of capabilities ... {{(pid=123790) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jun 18 22:53:26.405743 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writing DB stats cinder:SELECT=7,cinder:UPDATE=2 {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 22:53:26.412472 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writing DB stats cinder:SELECT=5,cinder:UPDATE=2 {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 22:54:06.412258 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writing DB stats cinder:SELECT=4,cinder:UPDATE=2 {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 22:54:06.414462 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 22:54:08.783993 ncdv-master-1 cinder-backup[123790]: DEBUG oslo_service.periodic_task [None req-d82f921b-aced-4971-81d0-f3b75344497b None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=123790) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Jun 18 22:54:08.784615 ncdv-master-1 cinder-backup[123790]: DEBUG cinder.manager [None req-d82f921b-aced-4971-81d0-f3b75344497b None None] Notifying Schedulers of capabilities ... {{(pid=123790) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jun 18 22:54:26.414304 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writing DB stats cinder:SELECT=2 {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 22:54:46.411884 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 22:55:06.419991 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writing DB stats cinder:SELECT=7,cinder:UPDATE=4 {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 22:55:08.788745 ncdv-master-1 cinder-backup[123790]: DEBUG oslo_service.periodic_task [None req-d82f921b-aced-4971-81d0-f3b75344497b None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=123790) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Jun 18 22:55:08.789416 ncdv-master-1 cinder-backup[123790]: DEBUG cinder.manager [None req-d82f921b-aced-4971-81d0-f3b75344497b None None] Notifying Schedulers of capabilities ... {{(pid=123790) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jun 18 22:55:16.423277 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writing DB stats cinder:SELECT=4,cinder:UPDATE=1 {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 22:55:36.422697 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 22:55:56.423557 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writing DB stats cinder:SELECT=7,cinder:UPDATE=3 {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 22:56:08.794207 ncdv-master-1 cinder-backup[123790]: DEBUG oslo_service.periodic_task [None req-d82f921b-aced-4971-81d0-f3b75344497b None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=123790) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Jun 18 22:56:08.795244 ncdv-master-1 cinder-backup[123790]: DEBUG cinder.manager [None req-d82f921b-aced-4971-81d0-f3b75344497b None None] Notifying Schedulers of capabilities ... {{(pid=123790) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jun 18 22:56:16.423856 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 22:56:16.426223 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writing DB stats cinder:SELECT=1 {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 22:56:36.433664 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writing DB stats cinder:SELECT=2 {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 22:56:46.435770 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writing DB stats cinder:SELECT=7,cinder:UPDATE=3 {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 22:56:56.438885 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writing DB stats cinder:SELECT=2,cinder:UPDATE=1 {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 22:57:08.792493 ncdv-master-1 cinder-backup[123790]: DEBUG oslo_service.periodic_task [None req-d82f921b-aced-4971-81d0-f3b75344497b None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=123790) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Jun 18 22:57:08.793223 ncdv-master-1 cinder-backup[123790]: DEBUG cinder.manager [None req-d82f921b-aced-4971-81d0-f3b75344497b None None] Notifying Schedulers of capabilities ... {{(pid=123790) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jun 18 22:57:26.436742 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 22:57:36.444338 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 22:58:06.445947 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 22:58:06.447319 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writing DB stats cinder:SELECT=4,cinder:UPDATE=1 {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 22:58:08.798010 ncdv-master-1 cinder-backup[123790]: DEBUG oslo_service.periodic_task [None req-d82f921b-aced-4971-81d0-f3b75344497b None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=123790) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Jun 18 22:58:08.798894 ncdv-master-1 cinder-backup[123790]: DEBUG cinder.manager [None req-d82f921b-aced-4971-81d0-f3b75344497b None None] Notifying Schedulers of capabilities ... {{(pid=123790) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jun 18 22:58:46.445435 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 22:58:46.447621 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writing DB stats cinder:SELECT=7,cinder:UPDATE=3 {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 22:59:08.795867 ncdv-master-1 cinder-backup[123790]: DEBUG oslo_service.periodic_task [None req-d82f921b-aced-4971-81d0-f3b75344497b None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=123790) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Jun 18 22:59:08.797149 ncdv-master-1 cinder-backup[123790]: DEBUG cinder.manager [None req-d82f921b-aced-4971-81d0-f3b75344497b None None] Notifying Schedulers of capabilities ... {{(pid=123790) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jun 18 22:59:16.456196 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writing DB stats cinder:SELECT=5,cinder:UPDATE=3 {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 22:59:26.455101 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 22:59:46.447646 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 23:00:06.454688 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writing DB stats cinder:SELECT=2 {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 23:00:06.459108 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writing DB stats cinder:SELECT=7,cinder:UPDATE=3 {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 23:00:08.799449 ncdv-master-1 cinder-backup[123790]: DEBUG oslo_service.periodic_task [None req-d82f921b-aced-4971-81d0-f3b75344497b None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=123790) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Jun 18 23:00:08.800166 ncdv-master-1 cinder-backup[123790]: DEBUG cinder.manager [None req-d82f921b-aced-4971-81d0-f3b75344497b None None] Notifying Schedulers of capabilities ... {{(pid=123790) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jun 18 23:00:46.452819 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 23:00:46.456269 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writing DB stats cinder:SELECT=7,cinder:UPDATE=2 {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 23:01:06.454400 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writing DB stats cinder:SELECT=2,cinder:UPDATE=1 {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 23:01:08.795679 ncdv-master-1 cinder-backup[123790]: DEBUG oslo_service.periodic_task [None req-d82f921b-aced-4971-81d0-f3b75344497b None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=123790) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Jun 18 23:01:08.796394 ncdv-master-1 cinder-backup[123790]: DEBUG cinder.manager [None req-d82f921b-aced-4971-81d0-f3b75344497b None None] Notifying Schedulers of capabilities ... {{(pid=123790) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jun 18 23:01:16.466226 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 23:01:36.468248 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writing DB stats cinder:UPDATE=2,cinder:SELECT=6 {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 23:01:46.480504 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writing DB stats cinder:SELECT=5,cinder:UPDATE=2 {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 23:02:06.475163 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writing DB stats cinder:SELECT=3,cinder:UPDATE=2 {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 23:02:08.801314 ncdv-master-1 cinder-backup[123790]: DEBUG oslo_service.periodic_task [None req-d82f921b-aced-4971-81d0-f3b75344497b None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=123790) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Jun 18 23:02:08.801910 ncdv-master-1 cinder-backup[123790]: DEBUG cinder.manager [None req-d82f921b-aced-4971-81d0-f3b75344497b None None] Notifying Schedulers of capabilities ... {{(pid=123790) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jun 18 23:02:26.467201 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 23:02:46.467906 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writing DB stats cinder:SELECT=2 {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 23:02:46.475863 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 23:03:06.480325 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writing DB stats cinder:SELECT=4,cinder:UPDATE=2 {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 23:03:08.806456 ncdv-master-1 cinder-backup[123790]: DEBUG oslo_service.periodic_task [None req-d82f921b-aced-4971-81d0-f3b75344497b None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=123790) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Jun 18 23:03:08.807179 ncdv-master-1 cinder-backup[123790]: DEBUG cinder.manager [None req-d82f921b-aced-4971-81d0-f3b75344497b None None] Notifying Schedulers of capabilities ... {{(pid=123790) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jun 18 23:03:26.478217 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writing DB stats cinder:SELECT=8,cinder:UPDATE=2 {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 23:03:56.478873 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 23:03:56.490549 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writing DB stats cinder:SELECT=5,cinder:UPDATE=2 {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 23:04:08.812298 ncdv-master-1 cinder-backup[123790]: DEBUG oslo_service.periodic_task [None req-d82f921b-aced-4971-81d0-f3b75344497b None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=123790) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Jun 18 23:04:08.813078 ncdv-master-1 cinder-backup[123790]: DEBUG cinder.manager [None req-d82f921b-aced-4971-81d0-f3b75344497b None None] Notifying Schedulers of capabilities ... {{(pid=123790) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jun 18 23:04:16.491122 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 23:04:26.488463 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 23:04:56.487570 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 23:05:06.481958 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writing DB stats cinder:SELECT=7,cinder:UPDATE=2 {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 23:05:08.809188 ncdv-master-1 cinder-backup[123790]: DEBUG oslo_service.periodic_task [None req-d82f921b-aced-4971-81d0-f3b75344497b None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=123790) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Jun 18 23:05:08.809188 ncdv-master-1 cinder-backup[123790]: DEBUG cinder.manager [None req-d82f921b-aced-4971-81d0-f3b75344497b None None] Notifying Schedulers of capabilities ... {{(pid=123790) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jun 18 23:05:36.477782 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writing DB stats cinder:SELECT=6,cinder:UPDATE=3 {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 23:05:46.482970 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writing DB stats cinder:SELECT=6,cinder:UPDATE=1 {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 23:06:06.487483 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 23:06:08.805095 ncdv-master-1 cinder-backup[123790]: DEBUG oslo_service.periodic_task [None req-d82f921b-aced-4971-81d0-f3b75344497b None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=123790) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Jun 18 23:06:08.805720 ncdv-master-1 cinder-backup[123790]: DEBUG cinder.manager [None req-d82f921b-aced-4971-81d0-f3b75344497b None None] Notifying Schedulers of capabilities ... {{(pid=123790) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jun 18 23:06:16.484641 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writing DB stats cinder:SELECT=8,cinder:UPDATE=2 {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 23:06:46.483507 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writing DB stats cinder:SELECT=7,cinder:UPDATE=2 {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 23:06:56.483326 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writing DB stats cinder:SELECT=5,cinder:UPDATE=2 {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 23:07:08.802801 ncdv-master-1 cinder-backup[123790]: DEBUG oslo_service.periodic_task [None req-d82f921b-aced-4971-81d0-f3b75344497b None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=123790) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Jun 18 23:07:08.803953 ncdv-master-1 cinder-backup[123790]: DEBUG cinder.manager [None req-d82f921b-aced-4971-81d0-f3b75344497b None None] Notifying Schedulers of capabilities ... {{(pid=123790) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jun 18 23:07:16.482985 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writing DB stats cinder:SELECT=2 {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 23:07:26.479518 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writing DB stats cinder:SELECT=7,cinder:UPDATE=3 {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 23:07:46.490497 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 23:07:56.490353 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writing DB stats cinder:UPDATE=1,cinder:SELECT=2 {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 23:08:08.801941 ncdv-master-1 cinder-backup[123790]: DEBUG oslo_service.periodic_task [None req-d82f921b-aced-4971-81d0-f3b75344497b None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=123790) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Jun 18 23:08:08.803145 ncdv-master-1 cinder-backup[123790]: DEBUG cinder.manager [None req-d82f921b-aced-4971-81d0-f3b75344497b None None] Notifying Schedulers of capabilities ... {{(pid=123790) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jun 18 23:08:16.490506 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 23:08:36.495723 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writing DB stats cinder:SELECT=5,cinder:UPDATE=3 {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 23:08:46.503385 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writing DB stats cinder:SELECT=6,cinder:UPDATE=1 {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 23:09:06.508529 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writing DB stats cinder:SELECT=3,cinder:UPDATE=2 {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 23:09:08.801074 ncdv-master-1 cinder-backup[123790]: DEBUG oslo_service.periodic_task [None req-d82f921b-aced-4971-81d0-f3b75344497b None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=123790) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Jun 18 23:09:08.802210 ncdv-master-1 cinder-backup[123790]: DEBUG cinder.manager [None req-d82f921b-aced-4971-81d0-f3b75344497b None None] Notifying Schedulers of capabilities ... {{(pid=123790) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jun 18 23:09:26.505272 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writing DB stats cinder:SELECT=7,cinder:UPDATE=2 {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 23:09:26.507660 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writing DB stats cinder:SELECT=2 {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 23:10:06.507739 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writing DB stats cinder:SELECT=4,cinder:UPDATE=3 {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 23:10:06.511846 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writing DB stats cinder:SELECT=9,cinder:UPDATE=1 {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 23:10:08.800623 ncdv-master-1 cinder-backup[123790]: DEBUG oslo_service.periodic_task [None req-d82f921b-aced-4971-81d0-f3b75344497b None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=123790) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Jun 18 23:10:08.801787 ncdv-master-1 cinder-backup[123790]: DEBUG cinder.manager [None req-d82f921b-aced-4971-81d0-f3b75344497b None None] Notifying Schedulers of capabilities ... {{(pid=123790) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jun 18 23:10:36.508622 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writing DB stats cinder:SELECT=2 {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 23:10:36.523416 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writing DB stats cinder:SELECT=7,cinder:UPDATE=4 {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 23:11:06.515319 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 23:11:08.799776 ncdv-master-1 cinder-backup[123790]: DEBUG oslo_service.periodic_task [None req-d82f921b-aced-4971-81d0-f3b75344497b None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=123790) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Jun 18 23:11:08.800868 ncdv-master-1 cinder-backup[123790]: DEBUG cinder.manager [None req-d82f921b-aced-4971-81d0-f3b75344497b None None] Notifying Schedulers of capabilities ... {{(pid=123790) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jun 18 23:11:16.511821 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 23:11:26.521550 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writing DB stats cinder:SELECT=2,cinder:UPDATE=1 {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 23:11:46.516341 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writing DB stats cinder:SELECT=4,cinder:UPDATE=1 {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 23:12:06.521875 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writing DB stats cinder:SELECT=8,cinder:UPDATE=2 {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 23:12:08.798409 ncdv-master-1 cinder-backup[123790]: DEBUG oslo_service.periodic_task [None req-d82f921b-aced-4971-81d0-f3b75344497b None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=123790) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Jun 18 23:12:08.799421 ncdv-master-1 cinder-backup[123790]: DEBUG cinder.manager [None req-d82f921b-aced-4971-81d0-f3b75344497b None None] Notifying Schedulers of capabilities ... {{(pid=123790) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jun 18 23:12:26.529300 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writing DB stats cinder:SELECT=5,cinder:UPDATE=2 {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 23:12:46.534185 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 23:13:06.536585 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writing DB stats cinder:SELECT=5,cinder:UPDATE=2 {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 23:13:08.797206 ncdv-master-1 cinder-backup[123790]: DEBUG oslo_service.periodic_task [None req-d82f921b-aced-4971-81d0-f3b75344497b None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=123790) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Jun 18 23:13:08.797894 ncdv-master-1 cinder-backup[123790]: DEBUG cinder.manager [None req-d82f921b-aced-4971-81d0-f3b75344497b None None] Notifying Schedulers of capabilities ... {{(pid=123790) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jun 18 23:13:26.536943 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writing DB stats cinder:SELECT=9,cinder:UPDATE=3 {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 23:13:56.538545 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writing DB stats cinder:SELECT=7,cinder:UPDATE=2 {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 23:14:06.538292 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writing DB stats cinder:SELECT=5,cinder:UPDATE=2 {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 23:14:08.793927 ncdv-master-1 cinder-backup[123790]: DEBUG oslo_service.periodic_task [None req-d82f921b-aced-4971-81d0-f3b75344497b None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=123790) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Jun 18 23:14:08.794641 ncdv-master-1 cinder-backup[123790]: DEBUG cinder.manager [None req-d82f921b-aced-4971-81d0-f3b75344497b None None] Notifying Schedulers of capabilities ... {{(pid=123790) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jun 18 23:14:26.542938 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writing DB stats cinder:SELECT=1 {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 23:14:36.545600 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 23:14:46.549573 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writing DB stats cinder:SELECT=4,cinder:UPDATE=2 {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 23:15:06.545168 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writing DB stats cinder:SELECT=2 {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 23:15:06.555536 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writing DB stats cinder:SELECT=6,cinder:UPDATE=3 {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 23:15:08.799112 ncdv-master-1 cinder-backup[123790]: DEBUG oslo_service.periodic_task [None req-d82f921b-aced-4971-81d0-f3b75344497b None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=123790) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Jun 18 23:15:08.801460 ncdv-master-1 cinder-backup[123790]: DEBUG cinder.manager [None req-d82f921b-aced-4971-81d0-f3b75344497b None None] Notifying Schedulers of capabilities ... {{(pid=123790) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jun 18 23:15:26.556512 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writing DB stats cinder:SELECT=3 {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 23:15:26.569316 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 23:15:56.569530 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writing DB stats cinder:SELECT=7,cinder:UPDATE=2 {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 23:16:06.590516 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writing DB stats cinder:SELECT=5,cinder:UPDATE=2 {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 23:16:08.800925 ncdv-master-1 cinder-backup[123790]: DEBUG oslo_service.periodic_task [None req-d82f921b-aced-4971-81d0-f3b75344497b None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=123790) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Jun 18 23:16:08.801660 ncdv-master-1 cinder-backup[123790]: DEBUG cinder.manager [None req-d82f921b-aced-4971-81d0-f3b75344497b None None] Notifying Schedulers of capabilities ... {{(pid=123790) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jun 18 23:16:26.579209 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writing DB stats cinder:SELECT=2 {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 23:16:26.592914 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writing DB stats cinder:SELECT=7,cinder:UPDATE=2 {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 23:16:56.592045 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writing DB stats cinder:UPDATE=2,cinder:SELECT=3 {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 23:16:56.604236 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 23:17:08.798338 ncdv-master-1 cinder-backup[123790]: DEBUG oslo_service.periodic_task [None req-d82f921b-aced-4971-81d0-f3b75344497b None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=123790) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Jun 18 23:17:08.799490 ncdv-master-1 cinder-backup[123790]: DEBUG cinder.manager [None req-d82f921b-aced-4971-81d0-f3b75344497b None None] Notifying Schedulers of capabilities ... {{(pid=123790) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jun 18 23:17:26.599478 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writing DB stats cinder:SELECT=2,cinder:UPDATE=1 {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 23:17:36.596912 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writing DB stats cinder:SELECT=8,cinder:UPDATE=2 {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 23:18:06.595313 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writing DB stats cinder:SELECT=3 {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 23:18:06.596752 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writing DB stats cinder:SELECT=6,cinder:UPDATE=3 {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 23:18:08.797014 ncdv-master-1 cinder-backup[123790]: DEBUG oslo_service.periodic_task [None req-d82f921b-aced-4971-81d0-f3b75344497b None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=123790) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Jun 18 23:18:08.797744 ncdv-master-1 cinder-backup[123790]: DEBUG cinder.manager [None req-d82f921b-aced-4971-81d0-f3b75344497b None None] Notifying Schedulers of capabilities ... {{(pid=123790) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jun 18 23:18:26.605562 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writing DB stats cinder:SELECT=1 {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 23:18:36.608248 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writing DB stats cinder:SELECT=8,cinder:UPDATE=3 {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 23:19:06.604164 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writing DB stats cinder:SELECT=5,cinder:UPDATE=2 {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 23:19:08.803957 ncdv-master-1 cinder-backup[123790]: DEBUG oslo_service.periodic_task [None req-d82f921b-aced-4971-81d0-f3b75344497b None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=123790) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Jun 18 23:19:08.805131 ncdv-master-1 cinder-backup[123790]: DEBUG cinder.manager [None req-d82f921b-aced-4971-81d0-f3b75344497b None None] Notifying Schedulers of capabilities ... {{(pid=123790) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jun 18 23:19:16.601427 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writing DB stats cinder:SELECT=7,cinder:UPDATE=2 {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 23:19:36.608787 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writing DB stats cinder:SELECT=1 {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 23:19:46.609079 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writing DB stats cinder:SELECT=7,cinder:UPDATE=3 {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 23:20:08.803339 ncdv-master-1 cinder-backup[123790]: DEBUG oslo_service.periodic_task [None req-d82f921b-aced-4971-81d0-f3b75344497b None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=123790) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Jun 18 23:20:08.804475 ncdv-master-1 cinder-backup[123790]: DEBUG cinder.manager [None req-d82f921b-aced-4971-81d0-f3b75344497b None None] Notifying Schedulers of capabilities ... {{(pid=123790) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jun 18 23:20:16.616186 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 23:20:26.611682 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writing DB stats cinder:SELECT=7,cinder:UPDATE=2 {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 23:20:46.609801 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writing DB stats cinder:SELECT=1 {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 23:20:56.610724 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writing DB stats cinder:SELECT=7,cinder:UPDATE=2 {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 23:21:08.802991 ncdv-master-1 cinder-backup[123790]: DEBUG oslo_service.periodic_task [None req-d82f921b-aced-4971-81d0-f3b75344497b None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=123790) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Jun 18 23:21:08.804092 ncdv-master-1 cinder-backup[123790]: DEBUG cinder.manager [None req-d82f921b-aced-4971-81d0-f3b75344497b None None] Notifying Schedulers of capabilities ... {{(pid=123790) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jun 18 23:21:16.617100 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writing DB stats cinder:SELECT=2 {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 23:21:16.619081 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writing DB stats cinder:SELECT=6,cinder:UPDATE=3 {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 23:21:56.616956 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 23:21:56.618902 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writing DB stats cinder:SELECT=4,cinder:UPDATE=3 {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 23:22:08.803123 ncdv-master-1 cinder-backup[123790]: DEBUG oslo_service.periodic_task [None req-d82f921b-aced-4971-81d0-f3b75344497b None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=123790) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Jun 18 23:22:08.804230 ncdv-master-1 cinder-backup[123790]: DEBUG cinder.manager [None req-d82f921b-aced-4971-81d0-f3b75344497b None None] Notifying Schedulers of capabilities ... {{(pid=123790) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jun 18 23:22:16.618945 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writing DB stats cinder:SELECT=2 {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 23:22:26.634086 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writing DB stats cinder:SELECT=7,cinder:UPDATE=3 {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 23:22:46.628885 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writing DB stats cinder:UPDATE=2,cinder:SELECT=4 {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 23:22:56.646688 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writing DB stats cinder:SELECT=5,cinder:UPDATE=2 {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 23:23:08.802313 ncdv-master-1 cinder-backup[123790]: DEBUG oslo_service.periodic_task [None req-d82f921b-aced-4971-81d0-f3b75344497b None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=123790) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Jun 18 23:23:08.803436 ncdv-master-1 cinder-backup[123790]: DEBUG cinder.manager [None req-d82f921b-aced-4971-81d0-f3b75344497b None None] Notifying Schedulers of capabilities ... {{(pid=123790) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jun 18 23:23:16.637239 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writing DB stats cinder:SELECT=2 {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 23:23:26.642704 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 23:23:46.653994 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writing DB stats cinder:SELECT=5,cinder:UPDATE=3 {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 23:24:06.650163 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 23:24:08.801468 ncdv-master-1 cinder-backup[123790]: DEBUG oslo_service.periodic_task [None req-d82f921b-aced-4971-81d0-f3b75344497b None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=123790) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Jun 18 23:24:08.802607 ncdv-master-1 cinder-backup[123790]: DEBUG cinder.manager [None req-d82f921b-aced-4971-81d0-f3b75344497b None None] Notifying Schedulers of capabilities ... {{(pid=123790) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jun 18 23:24:26.660741 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writing DB stats cinder:SELECT=7,cinder:UPDATE=2 {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 23:24:46.652951 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writing DB stats cinder:SELECT=5,cinder:UPDATE=3 {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 23:25:06.659034 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 23:25:08.800775 ncdv-master-1 cinder-backup[123790]: DEBUG oslo_service.periodic_task [None req-d82f921b-aced-4971-81d0-f3b75344497b None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=123790) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Jun 18 23:25:08.801966 ncdv-master-1 cinder-backup[123790]: DEBUG cinder.manager [None req-d82f921b-aced-4971-81d0-f3b75344497b None None] Notifying Schedulers of capabilities ... {{(pid=123790) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jun 18 23:25:16.667673 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 23:25:46.666614 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writing DB stats cinder:SELECT=5,cinder:UPDATE=3 {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 23:25:56.667083 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 23:26:08.799988 ncdv-master-1 cinder-backup[123790]: DEBUG oslo_service.periodic_task [None req-d82f921b-aced-4971-81d0-f3b75344497b None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=123790) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Jun 18 23:26:08.801208 ncdv-master-1 cinder-backup[123790]: DEBUG cinder.manager [None req-d82f921b-aced-4971-81d0-f3b75344497b None None] Notifying Schedulers of capabilities ... {{(pid=123790) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jun 18 23:26:26.676965 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writing DB stats cinder:SELECT=6,cinder:UPDATE=1 {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 23:26:36.677451 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writing DB stats cinder:SELECT=6,cinder:UPDATE=3 {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 23:27:06.682355 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 23:27:16.679086 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 23:27:36.695231 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writing DB stats cinder:SELECT=6,cinder:UPDATE=3 {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 23:27:46.688843 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writing DB stats cinder:SELECT=2 {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 23:28:08.801068 ncdv-master-1 cinder-backup[123790]: DEBUG oslo_service.periodic_task [None req-d82f921b-aced-4971-81d0-f3b75344497b None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=123790) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Jun 18 23:28:08.802209 ncdv-master-1 cinder-backup[123790]: DEBUG cinder.manager [None req-d82f921b-aced-4971-81d0-f3b75344497b None None] Notifying Schedulers of capabilities ... {{(pid=123790) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jun 18 23:28:16.691778 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 23:28:16.702587 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writing DB stats cinder:SELECT=6,cinder:UPDATE=1 {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 23:28:56.700095 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writing DB stats cinder:UPDATE=1,cinder:SELECT=7 {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 23:28:56.703791 ncdv-master-1 cinder-backup[123790]: DEBUG dbcounter [-] [123790] Writing DB stats cinder:SELECT=4,cinder:UPDATE=3 {{(pid=123790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jun 18 23:29:08.799892 ncdv-master-1 cinder-backup[123790]: DEBUG oslo_service.periodic_task [None req-d82f921b-aced-4971-81d0-f3b75344497b None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=123790) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Jun 18 23:29:08.801020 ncdv-master-1 cinder-backup[123790]: DEBUG cinder.manager [None req-d82f921b-aced-4971-81d0-f3b75344497b None None] Notifying Schedulers of capabilities ... {{(pid=123790) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}