-- Logs begin at Sat 2021-12-18 20:01:14 UTC, end at Sat 2021-12-18 22:15:13 UTC. -- Dec 18 20:37:46.610458 ncdv-master-1 systemd[1]: Started Devstack devstack@c-vol.service. Dec 18 20:37:49.929471 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=133974) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Dec 18 20:37:49.930055 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=133974) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Dec 18 20:37:50.295155 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_db.sqlalchemy.engines [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=133974) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 18 20:37:50.598436 ncdv-master-1 cinder-volume[133974]: INFO cinder.rpc [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Dec 18 20:37:50.602799 ncdv-master-1 cinder-volume[133974]: INFO cinder.rpc [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Dec 18 20:37:50.611962 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_db.sqlalchemy.engines [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=133974) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 18 20:37:50.685887 ncdv-master-1 cinder-volume[133974]: INFO cinder.volume.manager [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] Determined volume DB was empty at startup. Dec 18 20:37:50.686752 ncdv-master-1 cinder-volume[133974]: DEBUG cinder.volume.manager [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] Cinder Volume DB check: vol_db_empty=True {{(pid=133974) __init__ /opt/stack/cinder/cinder/volume/manager.py:281}} Dec 18 20:37:50.695999 ncdv-master-1 cinder-volume[133974]: INFO cinder.volume.manager [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] Service not found for updating active_backend_id, assuming default for driver init. Dec 18 20:37:50.696978 ncdv-master-1 cinder-volume[133974]: WARNING stevedore.named [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Dec 18 20:37:50.697535 ncdv-master-1 cinder-volume[133974]: WARNING castellan.key_manager [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Dec 18 20:37:50.698848 ncdv-master-1 cinder-volume[133974]: WARNING cinder.keymgr.conf_key_mgr [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Dec 18 20:37:50.717614 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_db.sqlalchemy.engines [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=133974) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 18 20:37:50.722984 ncdv-master-1 cinder-volume[133974]: INFO cinder.rpc [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Dec 18 20:37:50.727409 ncdv-master-1 cinder-volume[133974]: INFO cinder.rpc [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] Automatically selected cinder-volume RPC version 3.16 as minimum service version. Dec 18 20:37:50.728230 ncdv-master-1 cinder-volume[133974]: WARNING stevedore.named [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Dec 18 20:37:50.728749 ncdv-master-1 cinder-volume[133974]: WARNING castellan.key_manager [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Dec 18 20:37:50.730617 ncdv-master-1 cinder-volume[133974]: INFO cinder.volume.manager [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] Image-volume cache enabled for host ncdv-master-1@ceph. Dec 18 20:37:50.736720 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_db.sqlalchemy.engines [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=133974) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 18 20:37:50.755464 ncdv-master-1 cinder-volume[133974]: INFO oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] Starting 1 workers Dec 18 20:37:50.761077 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] Started child 134148 {{(pid=133974) _start_child /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:575}} Dec 18 20:37:50.762102 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] Full set of CONF: {{(pid=133974) wait /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:649}} Dec 18 20:37:50.762499 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] ******************************************************************************** {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Dec 18 20:37:50.762812 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] Configuration options gathered from: {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Dec 18 20:37:50.763174 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Dec 18 20:37:50.763770 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Dec 18 20:37:50.764055 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] ================================================================================ {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Dec 18 20:37:50.764772 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] allow_availability_zone_fallback = False {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:37:50.765152 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] allow_compression_on_image_upload = False {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:37:50.765676 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] allowed_direct_url_schemes = [] {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:37:50.766062 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] api_rate_limit = True {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:37:50.766514 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] auth_strategy = keystone {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:37:50.767103 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] az_cache_duration = 3600 {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:37:50.768116 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] backend_availability_zone = None {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:37:50.768512 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] backend_host = None {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:37:50.768850 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] backend_name = None {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:37:50.769226 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] backend_stats_polling_interval = 60 {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:37:50.769591 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] backup_api_class = cinder.backup.api.API {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:37:50.769967 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:37:50.770956 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] backup_name_template = backup-%s {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:37:50.771106 ncdv-master-1 cinder-volume[134148]: INFO cinder.service [-] Starting cinder-volume node (version 19.1.0) Dec 18 20:37:50.772073 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] backup_use_same_host = False {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:37:50.772594 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] backup_use_temp_snapshot = False {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:37:50.773115 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] chap_password = **** {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:37:50.773638 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] chap_username = {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:37:50.774209 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:37:50.774804 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] cinder_internal_tenant_project_id = 0dd4d15f423642fa8da604b758048203 {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:37:50.775348 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] cinder_internal_tenant_user_id = 62bd53b4d64643d28ac7f4ea0ea45f90 {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:37:50.775871 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] cloned_volume_same_az = True {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:37:50.776354 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] cluster = None {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:37:50.776907 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] compression_format = gzip {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:37:50.777565 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] compute_api_class = cinder.compute.nova.API {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:37:50.778143 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] config_dir = [] {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:37:50.778714 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:37:50.779282 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] config_source = [] {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:37:50.780205 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:37:50.781173 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] control_exchange = openstack {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:37:50.781754 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] debug = True {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:37:50.782384 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] default_availability_zone = None {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:37:50.782903 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] default_group_type = None {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:37:50.784349 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:37:50.785504 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] default_volume_type = ceph {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:37:50.786237 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] driver_client_cert = None {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:37:50.787069 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] driver_client_cert_key = None {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:37:50.788107 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] driver_data_namespace = None {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:37:50.789016 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] driver_ssl_cert_path = None {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:37:50.790288 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] driver_ssl_cert_verify = False {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:37:50.791720 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] driver_use_ssl = False {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:37:50.792271 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] enable_force_upload = False {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:37:50.792782 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] enable_new_services = True {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:37:50.793290 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] enable_unsupported_driver = False {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:37:50.793838 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] enabled_backends = ['ceph'] {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:37:50.794373 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] enforce_multipath_for_image_xfer = False {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:37:50.794851 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] filter_function = None {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:37:50.795354 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] glance_api_insecure = False {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:37:50.795870 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] glance_api_servers = ['http://10.222.0.13/image'] {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:37:50.796357 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] glance_api_ssl_compression = False {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:37:50.796944 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] glance_ca_certificates_file = None {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:37:50.797606 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] glance_catalog_info = image:glance:publicURL {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:37:50.798089 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] glance_certfile = None {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:37:50.799065 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:37:50.802301 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] glance_keyfile = None {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:37:50.802774 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] glance_num_retries = 3 {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:37:50.803131 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] glance_request_timeout = None {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:37:50.803749 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] goodness_function = None {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:37:50.804139 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] graceful_shutdown_timeout = 5 {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:37:50.804509 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] group_api_class = cinder.group.api.API {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:37:50.804854 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] host = ncdv-master-1 {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:37:50.805473 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] iet_conf = /etc/iet/ietd.conf {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:37:50.806006 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] image_compress_on_upload = True {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:37:50.806574 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] image_conversion_address_space_limit = 1 {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:37:50.807059 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] image_conversion_cpu_limit = 60 {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:37:50.807845 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:37:50.808718 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] image_upload_use_cinder_backend = False {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:37:50.809636 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] image_upload_use_internal_tenant = False {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:37:50.810040 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-7880d46d-7ae6-487f-8799-495bae3c792b None None] Starting volume driver RBDDriver (1.2.0) Dec 18 20:37:50.810356 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] image_volume_cache_enabled = False {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:37:50.810879 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] image_volume_cache_max_count = 0 {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:37:50.812147 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] image_volume_cache_max_size_gb = 0 {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:37:50.812924 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-7880d46d-7ae6-487f-8799-495bae3c792b None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 20:37:50.813049 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] init_host_max_objects_retrieval = 0 {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:37:50.813539 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] instance_format = [instance: %(uuid)s] {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:37:50.814063 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:37:50.818691 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] iscsi_iotype = fileio {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:37:50.819545 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] iscsi_secondary_ip_addresses = [] {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:37:50.820066 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] iscsi_target_flags = {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:37:50.820731 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] iscsi_write_cache = on {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:37:50.821314 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] iser_helper = tgtadm {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:37:50.822614 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] iser_ip_address = 10.222.0.13 {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:37:50.823200 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] iser_port = 3260 {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:37:50.823765 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:37:50.824286 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] log_config_append = None {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:37:50.824808 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:37:50.825296 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] log_dir = None {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:37:50.826165 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] log_file = None {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:37:50.826959 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] log_options = True {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:37:50.827473 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] log_rotate_interval = 1 {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:37:50.828192 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] log_rotate_interval_type = days {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:37:50.828979 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] log_rotation_type = none {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:37:50.829544 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:37:50.830023 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:37:50.831080 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:37:50.832346 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:37:50.832784 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:37:50.833309 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] max_age = 0 {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:37:50.833807 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] max_logfile_count = 30 {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:37:50.834344 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] max_logfile_size_mb = 200 {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:37:50.834898 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] max_over_subscription_ratio = 20.0 {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:37:50.835303 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] message_reap_interval = 86400 {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:37:50.835676 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] message_ttl = 2592000 {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:37:50.836085 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] migration_create_volume_timeout_secs = 300 {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:37:50.836441 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] monkey_patch = False {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:37:50.836795 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] monkey_patch_modules = [] {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:37:50.837104 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] my_ip = 10.222.0.13 {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:37:50.837453 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] no_snapshot_gb_quota = False {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:37:50.837797 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] num_iser_scan_tries = 3 {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:37:50.838326 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] num_shell_tries = 3 {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:37:50.838835 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] num_volume_device_scan_tries = 3 {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:37:50.839718 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] nvmet_ns_id = 10 {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:37:50.840224 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] nvmet_port_id = 1 {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:37:50.841721 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] osapi_max_limit = 1000 {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:37:50.843540 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] osapi_volume_ext_list = [] {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:37:50.843540 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:37:50.843540 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] osapi_volume_listen = 0.0.0.0 {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:37:50.843810 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] osapi_volume_listen_port = 8776 {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:37:50.843991 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] osapi_volume_use_ssl = False {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:37:50.844371 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] osapi_volume_workers = 2 {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:37:50.844714 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] per_volume_size_limit = -1 {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:37:50.845059 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] periodic_fuzzy_delay = 60 {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:37:50.845417 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] periodic_interval = 60 {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:37:50.846428 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] public_endpoint = None {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:37:50.846935 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] publish_errors = False {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:37:50.847400 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] quota_backup_gigabytes = 1000 {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:37:50.847924 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] quota_backups = 10 {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:37:50.848511 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] quota_consistencygroups = 10 {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:37:50.848999 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:37:50.849485 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] quota_gigabytes = 1000 {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:37:50.850057 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] quota_groups = 10 {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:37:50.850595 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] quota_snapshots = 10 {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:37:50.850971 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] quota_volumes = 10 {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:37:50.851692 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] rate_limit_burst = 0 {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:37:50.852082 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] rate_limit_except_level = CRITICAL {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:37:50.852530 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] rate_limit_interval = 0 {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:37:50.853162 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] reinit_driver_count = 3 {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:37:50.854898 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] replication_device = **** {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:37:50.855415 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] report_discard_supported = False {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:37:50.857301 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] report_interval = 10 {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:37:50.857755 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] reservation_clean_interval = 86400 {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:37:50.858076 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] reservation_expire = 86400 {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:37:50.858831 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] reserved_percentage = 0 {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:37:50.859406 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:37:50.859858 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:37:50.860270 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] rpc_response_timeout = 120 {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:37:50.860634 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] run_external_periodic_tasks = True {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:37:50.860991 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:37:50.861233 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-7880d46d-7ae6-487f-8799-495bae3c792b None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 20:37:50.864258 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] scst_target_driver = iscsi {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:37:50.864914 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] scst_target_iqn_name = None {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:37:50.865222 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] service_down_time = 60 {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:37:50.865611 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] snapshot_name_template = snapshot-%s {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:37:50.866009 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] snapshot_same_host = True {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:37:50.866376 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] split_loggers = False {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:37:50.866671 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] state_path = /opt/stack/data/cinder {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:37:50.867028 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] storage_availability_zone = nova {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:37:50.867419 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] storage_protocol = iscsi {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:37:50.867779 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] syslog_log_facility = LOG_USER {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:37:50.868133 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] target_helper = lioadm {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:37:50.868635 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] target_ip_address = 10.222.0.13 {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:37:50.868985 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] target_port = 3260 {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:37:50.869337 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:37:50.869696 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] target_protocol = iscsi {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:37:50.870059 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] trace_flags = None {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:37:50.870778 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] transfer_api_class = cinder.transfer.api.API {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:37:50.871145 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] transport_url = **** {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:37:50.871502 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] until_refresh = 0 {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:37:50.871835 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] use_chap_auth = False {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:37:50.872179 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] use_default_quota_class = True {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:37:50.872684 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] use_eventlog = False {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:37:50.873162 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] use_journal = False {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:37:50.873515 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] use_json = False {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:37:50.873857 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] use_multipath_for_image_xfer = False {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:37:50.874238 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] use_stderr = False {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:37:50.874595 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] use_syslog = False {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:37:50.874974 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] verify_glance_signatures = enabled {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:37:50.875325 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] volume_api_class = cinder.volume.api.API {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:37:50.875657 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] volume_backend_name = None {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:37:50.876040 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] volume_clear = zero {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:37:50.876375 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] volume_clear_ionice = None {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:37:50.876712 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] volume_clear_size = 0 {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:37:50.877116 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:37:50.877466 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] volume_copy_bps_limit = 0 {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:37:50.877827 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] volume_dd_blocksize = 1M {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:37:50.878178 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:37:50.879253 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] volume_name_template = volume-%s {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:37:50.879990 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] volume_service_inithost_offload = False {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:37:50.880509 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] volume_usage_audit_period = month {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:37:50.881117 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:37:50.881465 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] watch_log_file = False {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:37:50.881837 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] zoning_mode = None {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:37:50.882349 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:50.882909 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:50.883317 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] oslo_policy.enforce_new_defaults = False {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:50.885097 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] oslo_policy.enforce_scope = False {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:50.885653 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] oslo_policy.policy_default_rule = default {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:50.886204 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:50.887261 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] oslo_policy.policy_file = policy.yaml {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:50.887807 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:50.888303 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:50.888662 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:50.889077 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:50.889446 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:50.889841 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] oslo_concurrency.disable_process_locking = False {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:50.890220 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:50.890975 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] keystone_authtoken.admin_password = **** {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:50.891362 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] keystone_authtoken.admin_tenant_name = admin {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:50.891707 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] keystone_authtoken.admin_token = **** {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:50.892046 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] keystone_authtoken.admin_user = None {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:50.892419 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] keystone_authtoken.auth_admin_prefix = {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:50.893303 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:50.893666 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] keystone_authtoken.auth_port = 35357 {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:50.894180 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] keystone_authtoken.auth_protocol = https {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:50.895014 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] keystone_authtoken.auth_section = None {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:50.895519 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] keystone_authtoken.auth_type = password {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:50.896033 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] keystone_authtoken.auth_uri = None {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:50.896534 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] keystone_authtoken.auth_version = None {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:50.897032 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] keystone_authtoken.cache = None {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:50.897550 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:50.897889 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] keystone_authtoken.certfile = None {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:50.898267 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] keystone_authtoken.delay_auth_decision = False {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:50.899244 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:50.899734 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] keystone_authtoken.http_connect_timeout = None {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:50.900239 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:50.900744 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] keystone_authtoken.identity_uri = None {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:50.901234 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] keystone_authtoken.include_service_catalog = True {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:50.901838 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] keystone_authtoken.insecure = False {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:50.902441 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] keystone_authtoken.interface = public {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:50.902938 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] keystone_authtoken.keyfile = None {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:50.903288 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-7880d46d-7ae6-487f-8799-495bae3c792b None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 20:37:50.903590 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:50.904105 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:50.904608 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:50.905107 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:50.905603 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:50.906072 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] keystone_authtoken.memcache_secret_key = **** {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:50.906587 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] keystone_authtoken.memcache_security_strategy = None {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:50.907218 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:50.907746 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:50.908907 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] keystone_authtoken.region_name = None {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:50.909428 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:50.909933 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] keystone_authtoken.service_token_roles_required = False {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:50.910505 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] keystone_authtoken.service_type = None {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:50.911012 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] keystone_authtoken.token_cache_time = 300 {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:50.911496 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] keystone_authtoken.www_authenticate_uri = None {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:50.912090 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] cache.backend = dogpile.cache.null {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:50.912591 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] cache.backend_argument = **** {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:50.913914 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] cache.config_prefix = cache.oslo {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:50.914465 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] cache.debug_cache_backend = False {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:50.914960 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] cache.enabled = False {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:50.915481 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] cache.expiration_time = 600 {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:50.915984 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] cache.memcache_dead_retry = 300 {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:50.916490 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:50.917009 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:50.917501 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] cache.memcache_pool_maxsize = 10 {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:50.917974 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] cache.memcache_pool_unused_timeout = 60 {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:50.918935 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] cache.memcache_servers = ['localhost:11211'] {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:50.919356 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] cache.memcache_socket_timeout = 1.0 {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:50.919733 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] cache.proxies = [] {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:50.920081 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] cache.tls_allowed_ciphers = None {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:50.920453 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] cache.tls_cafile = None {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:50.920813 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] cache.tls_certfile = None {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:50.921155 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] cache.tls_enabled = False {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:50.921491 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] cache.tls_keyfile = None {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:50.921904 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] coordination.backend_url = etcd3+http://10.222.0.13:2379 {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:50.922344 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] database.backend = sqlalchemy {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:50.922628 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] database.connection = **** {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:50.923133 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] database.connection_debug = 0 {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:50.923621 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] database.connection_parameters = {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:50.924147 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] database.connection_recycle_time = 3600 {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:50.925449 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] database.connection_trace = False {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:50.925945 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] database.db_inc_retry_interval = True {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:50.926471 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] database.db_max_retries = 20 {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:50.926986 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] database.db_max_retry_interval = 10 {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:50.927467 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] database.db_retry_interval = 1 {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:50.927849 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] database.max_overflow = 50 {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:50.929000 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] database.max_pool_size = 5 {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:50.929000 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] database.max_retries = 10 {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:50.929000 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] database.mysql_enable_ndb = False {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:50.929219 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] database.mysql_sql_mode = TRADITIONAL {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:50.929836 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] database.pool_timeout = None {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:50.930406 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] database.retry_interval = 10 {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:50.930575 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] database.slave_connection = **** {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:50.930930 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] database.sqlite_synchronous = True {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:50.931279 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] database.use_db_reconnect = False {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:50.931678 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:50.932020 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:50.932369 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] oslo_messaging_metrics.metrics_process_name = {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:50.932722 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:50.933064 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:50.933466 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] profiler.connection_string = messaging:// {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:50.933753 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] profiler.enabled = False {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:50.934125 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] profiler.es_doc_type = notification {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:50.934847 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] profiler.es_scroll_size = 10000 {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:50.935365 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] profiler.es_scroll_time = 2m {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:50.935861 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] profiler.filter_error_trace = False {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:50.936219 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] profiler.hmac_keys = SECRET_KEY {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:50.936580 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] profiler.sentinel_service_name = mymaster {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:50.937217 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] profiler.socket_timeout = 0.1 {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:50.937585 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] profiler.trace_sqlalchemy = False {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:50.937998 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] privsep_osbrick.capabilities = [21] {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:50.938386 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] privsep_osbrick.group = None {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:50.938888 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] privsep_osbrick.helper_command = None {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:50.940220 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] privsep_osbrick.logger_name = oslo_privsep.daemon {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:50.940747 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] privsep_osbrick.thread_pool_size = 4 {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:50.941257 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] privsep_osbrick.user = None {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:50.943071 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:50.943425 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] cinder_sys_admin.group = None {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:50.943765 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] cinder_sys_admin.helper_command = None {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:50.944117 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:50.944471 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:50.944833 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] cinder_sys_admin.user = None {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:50.944991 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.driver [None req-7880d46d-7ae6-487f-8799-495bae3c792b None None] Driver hasn't implemented _init_vendor_properties() Dec 18 20:37:50.945187 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] service_user.auth_section = None {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:50.945523 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.driver [None req-7880d46d-7ae6-487f-8799-495bae3c792b None None] Initialized capabilities list: {'vendor_name': 'Open Source', 'driver_version': '1.2.0', 'storage_protocol': 'ceph', 'total_capacity_gb': 19.94, 'free_capacity_gb': 19.94, 'reserved_percentage': 0, 'multiattach': True, 'thin_provisioning_support': True, 'max_over_subscription_ratio': '20.0', 'location_info': 'ceph:/etc/ceph/ceph.conf:e7c44f79-aa86-465d-8345-ce16ab5c8677:cinder:volumes', 'backend_state': 'up', 'volume_backend_name': 'ceph', 'replication_enabled': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=134148) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:820}} Dec 18 20:37:50.945646 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] service_user.auth_type = None {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:50.945857 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] service_user.cafile = None {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:50.946194 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] service_user.certfile = None {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:50.948023 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] service_user.collect_timing = False {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:50.948023 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] service_user.insecure = False {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:50.948288 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] service_user.keyfile = None {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:50.948622 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] service_user.send_service_user_token = False {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:50.948964 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] service_user.split_loggers = False {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:50.949299 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] service_user.timeout = None {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:50.949728 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] backend_defaults.backend_availability_zone = None {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:50.950095 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:50.951591 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:50.951591 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] backend_defaults.chap_password = **** {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:50.951591 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] backend_defaults.chap_username = {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:50.951591 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:50.951942 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] backend_defaults.deferred_deletion_delay = 0 {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:50.952224 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] backend_defaults.deferred_deletion_purge_interval = 60 {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:50.952563 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] backend_defaults.driver_client_cert = None {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:50.952920 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] backend_defaults.driver_client_cert_key = None {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:50.953413 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] backend_defaults.driver_data_namespace = None {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:50.953749 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] backend_defaults.driver_ssl_cert_path = None {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:50.954112 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:50.954545 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] backend_defaults.driver_use_ssl = False {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:50.954873 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] backend_defaults.enable_deferred_deletion = False {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:50.955914 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] backend_defaults.enable_unsupported_driver = False {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:50.956125 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:50.957215 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] backend_defaults.extra_capabilities = {} {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:50.957470 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] backend_defaults.filter_function = None {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:50.957817 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] backend_defaults.goodness_function = None {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:50.958200 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] backend_defaults.iet_conf = /etc/iet/ietd.conf {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:50.958580 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:50.958933 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:50.959272 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] backend_defaults.image_volume_cache_enabled = False {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:50.959945 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:50.960293 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:50.960668 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] backend_defaults.iscsi_iotype = fileio {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:50.961016 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] backend_defaults.iscsi_secondary_ip_addresses = [] {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:50.961383 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] backend_defaults.iscsi_target_flags = {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:50.961762 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] backend_defaults.iscsi_write_cache = on {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:50.962114 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] backend_defaults.iser_helper = tgtadm {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:50.962502 ncdv-master-1 cinder-volume[134148]: DEBUG oslo_db.sqlalchemy.engines [None req-7880d46d-7ae6-487f-8799-495bae3c792b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134148) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 18 20:37:50.962691 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] backend_defaults.iser_ip_address = 10.222.0.13 {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:50.963044 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] backend_defaults.iser_port = 3260 {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:50.964226 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:50.964226 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:50.964226 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:50.964495 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] backend_defaults.num_shell_tries = 3 {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:50.964836 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:50.965183 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] backend_defaults.nvmet_ns_id = 10 {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:50.965529 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] backend_defaults.nvmet_port_id = 1 {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:50.967182 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] backend_defaults.rados_connect_timeout = -1 {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:50.967729 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] backend_defaults.rados_connection_interval = 5 {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:50.968346 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] backend_defaults.rados_connection_retries = 3 {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:50.968926 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] backend_defaults.rbd_ceph_conf = {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:50.969604 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] backend_defaults.rbd_cluster_name = ceph {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:50.969991 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] backend_defaults.rbd_exclusive_cinder_pool = True {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:50.970395 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] backend_defaults.rbd_flatten_volume_from_snapshot = False {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:50.971462 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] backend_defaults.rbd_max_clone_depth = 5 {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:50.972004 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] backend_defaults.rbd_pool = rbd {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:50.972368 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] backend_defaults.rbd_secret_uuid = None {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:50.973577 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] backend_defaults.rbd_store_chunk_size = 4 {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:50.973577 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] backend_defaults.rbd_user = None {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:50.973577 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] backend_defaults.replication_connect_timeout = 5 {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:50.973822 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] backend_defaults.replication_device = **** {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:50.974142 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] backend_defaults.report_discard_supported = False {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:50.975259 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] backend_defaults.report_dynamic_total_capacity = True {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:50.975259 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] backend_defaults.reserved_percentage = 0 {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:50.975259 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] backend_defaults.scst_target_driver = iscsi {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:50.975630 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] backend_defaults.scst_target_iqn_name = None {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:50.976578 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] backend_defaults.storage_protocol = iscsi {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:50.976578 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:50.976949 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] backend_defaults.target_helper = tgtadm {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:50.978206 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] backend_defaults.target_ip_address = 10.222.0.13 {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:50.978206 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] backend_defaults.target_port = 3260 {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:50.978409 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:50.978794 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] backend_defaults.target_protocol = iscsi {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:50.979145 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] backend_defaults.trace_flags = None {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:50.979625 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] backend_defaults.unique_fqdn_network = True {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:50.979983 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] backend_defaults.use_chap_auth = False {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:50.981016 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:50.981016 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] backend_defaults.volume_backend_name = None {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:50.981016 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] backend_defaults.volume_clear = zero {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:50.981388 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] backend_defaults.volume_clear_ionice = None {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:50.981716 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] backend_defaults.volume_clear_size = 0 {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:50.982084 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:50.982475 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:50.982842 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:50.984020 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:50.984020 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:50.984173 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] oslo_reports.file_event_handler = None {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:50.984448 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] oslo_reports.file_event_handler_interval = 1 {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:50.985401 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] oslo_reports.log_dir = None {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:50.985401 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] ceph.backend_availability_zone = None {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:50.985579 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] ceph.backend_host = None {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:50.985868 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] ceph.backend_native_threads_pool_size = None {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:50.986216 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] ceph.backup_use_temp_snapshot = None {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:50.986632 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] ceph.chap_password = **** {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:50.987300 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] ceph.chap_username = None {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:50.987649 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] ceph.chiscsi_conf = None {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:50.987998 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] ceph.deferred_deletion_delay = None {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:50.988448 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] ceph.deferred_deletion_purge_interval = None {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:50.988809 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] ceph.driver_client_cert = None {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:50.989147 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] ceph.driver_client_cert_key = None {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:50.989524 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] ceph.driver_data_namespace = None {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:50.989869 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] ceph.driver_ssl_cert_path = None {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:50.990216 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] ceph.driver_ssl_cert_verify = None {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:50.990594 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] ceph.driver_use_ssl = None {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:50.990937 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] ceph.enable_deferred_deletion = None {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:50.992857 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] ceph.enable_unsupported_driver = None {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:50.992857 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] ceph.enforce_multipath_for_image_xfer = None {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:50.992857 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] ceph.extra_capabilities = None {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:50.992857 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] ceph.filter_function = None {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:50.992857 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] ceph.goodness_function = None {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:50.993628 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] ceph.iet_conf = None {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:50.993628 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] ceph.image_upload_use_cinder_backend = None {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:50.993628 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] ceph.image_upload_use_internal_tenant = None {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:50.994047 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] ceph.image_volume_cache_enabled = True {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:50.994316 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] ceph.image_volume_cache_max_count = None {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:50.994662 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] ceph.image_volume_cache_max_size_gb = None {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:50.995007 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] ceph.iscsi_iotype = None {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:50.995352 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] ceph.iscsi_secondary_ip_addresses = None {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:50.995693 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] ceph.iscsi_target_flags = None {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:50.996036 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] ceph.iscsi_write_cache = None {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:50.996388 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] ceph.iser_helper = None {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:50.996733 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] ceph.iser_ip_address = None {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:50.997220 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] ceph.iser_port = None {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:50.998005 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] ceph.iser_target_prefix = None {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:50.999757 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] ceph.max_over_subscription_ratio = None {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:51.000147 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] ceph.num_iser_scan_tries = None {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:51.000519 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] ceph.num_shell_tries = None {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:51.000885 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] ceph.num_volume_device_scan_tries = None {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:51.001276 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] ceph.nvmet_ns_id = None {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:51.002086 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] ceph.nvmet_port_id = None {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:51.002086 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] ceph.rados_connect_timeout = -1 {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:51.002477 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] ceph.rados_connection_interval = None {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:51.002803 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] ceph.rados_connection_retries = None {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:51.003264 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] ceph.rbd_ceph_conf = /etc/ceph/ceph.conf {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:51.003620 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] ceph.rbd_cluster_name = None {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:51.003971 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] ceph.rbd_exclusive_cinder_pool = None {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:51.004357 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] ceph.rbd_flatten_volume_from_snapshot = False {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:51.004729 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] ceph.rbd_max_clone_depth = 5 {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:51.005094 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] ceph.rbd_pool = volumes {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:51.005458 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] ceph.rbd_secret_uuid = 946d1715-d12c-4dbf-8a79-181222df6e2e {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:51.005897 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] ceph.rbd_store_chunk_size = 4 {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:51.006212 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] ceph.rbd_user = cinder {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:51.006587 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] ceph.replication_connect_timeout = None {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:51.006940 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] ceph.replication_device = **** {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:51.007420 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] ceph.report_discard_supported = None {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:51.007778 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] ceph.report_dynamic_total_capacity = None {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:51.008124 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] ceph.reserved_percentage = None {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:51.008472 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] ceph.scst_target_driver = None {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:51.008815 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] ceph.scst_target_iqn_name = None {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:51.009161 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] ceph.storage_protocol = None {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:51.009508 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] ceph.suppress_requests_ssl_warnings = None {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:51.009850 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] ceph.target_helper = None {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:51.010196 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] ceph.target_ip_address = None {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:51.011524 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] ceph.target_port = None {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:51.011889 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] ceph.target_prefix = None {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:51.012238 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] ceph.target_protocol = None {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:51.012588 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] ceph.trace_flags = None {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:51.012935 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] ceph.unique_fqdn_network = None {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:51.013280 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] ceph.use_chap_auth = None {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:51.013634 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] ceph.use_multipath_for_image_xfer = None {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:51.013993 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] ceph.volume_backend_name = ceph {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:51.015166 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] ceph.volume_clear = None {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:51.015166 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] ceph.volume_clear_ionice = None {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:51.015166 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] ceph.volume_clear_size = None {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:51.015576 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] ceph.volume_copy_blkio_cgroup_name = None {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:51.015928 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] ceph.volume_copy_bps_limit = None {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:51.018504 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] ceph.volume_dd_blocksize = None {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:51.018504 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] ceph.volume_driver = cinder.volume.drivers.rbd.RBDDriver {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:51.018504 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] ceph.volumes_dir = None {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:51.018504 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:51.019026 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:51.019628 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:51.020215 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:51.020796 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.db.sqlalchemy.api [None req-7880d46d-7ae6-487f-8799-495bae3c792b None None] Building query based on filter {{(pid=134148) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3156}} Dec 18 20:37:51.020888 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:51.021399 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:51.022110 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:51.022626 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:51.024091 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:51.024091 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:51.024389 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:51.024993 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:51.025631 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:51.026047 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:51.026445 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:51.026841 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:51.027216 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:51.027696 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:51.028071 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:51.028442 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:51.028815 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:51.029205 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] oslo_messaging_rabbit.ssl = False {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:51.029580 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:51.029966 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:51.031198 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:51.031198 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] oslo_messaging_rabbit.ssl_version = {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:51.031198 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] oslo_messaging_notifications.driver = [] {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:51.031444 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] oslo_messaging_notifications.retry = -1 {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:51.031836 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:51.032191 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] oslo_messaging_notifications.transport_url = **** {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:51.032532 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:51.032831 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] key_manager.fixed_key = **** {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:51.033874 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:51.034429 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] barbican.barbican_api_version = None {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:51.035003 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] barbican.barbican_endpoint = None {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:51.035405 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] barbican.barbican_endpoint_type = public {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:51.035757 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] barbican.barbican_region_name = None {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:51.036108 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] barbican.cafile = None {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:51.036455 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] barbican.certfile = None {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:51.036824 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] barbican.collect_timing = False {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:51.037177 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] barbican.insecure = False {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:51.037551 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] barbican.keyfile = None {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:51.037906 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] barbican.number_of_retries = 60 {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:51.038296 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] barbican.retry_delay = 1 {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:51.038674 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] barbican.send_service_user_token = False {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:51.039022 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] barbican.split_loggers = False {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:51.039363 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] barbican.timeout = None {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:51.039888 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] barbican.verify_ssl = True {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:51.040384 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] barbican.verify_ssl_path = None {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:51.040906 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] barbican_service_user.auth_section = None {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:51.041431 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] barbican_service_user.auth_type = None {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:51.041779 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] barbican_service_user.cafile = None {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:51.042133 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] barbican_service_user.certfile = None {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:51.042513 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] barbican_service_user.collect_timing = False {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:51.042868 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] barbican_service_user.insecure = False {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:51.043215 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] barbican_service_user.keyfile = None {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:51.043567 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] barbican_service_user.split_loggers = False {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:51.043910 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] barbican_service_user.timeout = None {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:51.044277 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] vault.approle_role_id = None {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:51.044619 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] vault.approle_secret_id = None {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:51.044962 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] vault.cafile = None {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:51.045303 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] vault.certfile = None {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:51.045654 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] vault.collect_timing = False {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:51.046006 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] vault.insecure = False {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:51.046385 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] vault.keyfile = None {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:51.046753 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] vault.kv_mountpoint = secret {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:51.047128 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] vault.kv_version = 2 {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:51.047473 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] vault.namespace = None {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:51.047833 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] vault.root_token_id = None {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:51.048206 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] vault.split_loggers = False {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:51.048586 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] vault.ssl_ca_crt_file = None {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:51.048917 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] vault.timeout = None {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:51.049285 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] vault.use_ssl = False {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:51.049661 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:37:51.050105 ncdv-master-1 cinder-volume[133974]: DEBUG oslo_service.service [None req-5d0b14bb-fe74-4fdc-8c40-28006422cbfe None None] ******************************************************************************** {{(pid=133974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Dec 18 20:37:51.053262 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.image.image_utils [None req-7880d46d-7ae6-487f-8799-495bae3c792b None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=134148) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:955}} Dec 18 20:37:51.062902 ncdv-master-1 cinder-volume[134148]: INFO cinder.keymgr.migration [None req-131b0853-0da1-4939-83ca-9d666d17c515 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Dec 18 20:37:51.067069 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-7880d46d-7ae6-487f-8799-495bae3c792b None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 20:37:51.091583 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-7880d46d-7ae6-487f-8799-495bae3c792b None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 20:37:51.119960 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.manager [None req-7880d46d-7ae6-487f-8799-495bae3c792b None None] Notifying Schedulers of capabilities ... {{(pid=134148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 18 20:37:51.159879 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-7880d46d-7ae6-487f-8799-495bae3c792b None None] Driver initialization completed successfully. Dec 18 20:37:51.169007 ncdv-master-1 cinder-volume[134148]: INFO cinder.manager [None req-7880d46d-7ae6-487f-8799-495bae3c792b None None] Initiating service 3 cleanup Dec 18 20:37:51.174960 ncdv-master-1 cinder-volume[134148]: INFO cinder.manager [None req-7880d46d-7ae6-487f-8799-495bae3c792b None None] Service 3 cleanup completed. Dec 18 20:37:51.175464 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.service [None req-7880d46d-7ae6-487f-8799-495bae3c792b None None] Creating RPC server for service cinder-volume {{(pid=134148) start /opt/stack/cinder/cinder/service.py:231}} Dec 18 20:37:51.181912 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.service [None req-7880d46d-7ae6-487f-8799-495bae3c792b None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=134148) start /opt/stack/cinder/cinder/service.py:237}} Dec 18 20:37:51.250956 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-7880d46d-7ae6-487f-8799-495bae3c792b None None] Initializing RPC dependent components of volume driver RBDDriver (1.2.0) Dec 18 20:37:51.252630 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-7880d46d-7ae6-487f-8799-495bae3c792b None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 20:37:51.281916 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-7880d46d-7ae6-487f-8799-495bae3c792b None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 20:37:51.332638 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-7880d46d-7ae6-487f-8799-495bae3c792b None None] Driver post RPC initialization completed successfully. Dec 18 20:39:34.335925 ncdv-master-1 cinder-volume[134148]: DEBUG oslo_service.periodic_task [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134148) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Dec 18 20:39:34.336695 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 20:39:34.357689 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 20:39:34.381520 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.manager [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] Notifying Schedulers of capabilities ... {{(pid=134148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 18 20:40:34.336242 ncdv-master-1 cinder-volume[134148]: DEBUG oslo_service.periodic_task [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134148) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Dec 18 20:40:34.336871 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 20:40:34.357904 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 20:40:34.380913 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.manager [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] Notifying Schedulers of capabilities ... {{(pid=134148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 18 20:41:34.335939 ncdv-master-1 cinder-volume[134148]: DEBUG oslo_service.periodic_task [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134148) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Dec 18 20:41:34.336593 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 20:41:34.357698 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 20:41:34.378523 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.manager [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] Notifying Schedulers of capabilities ... {{(pid=134148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 18 20:42:34.332705 ncdv-master-1 cinder-volume[134148]: DEBUG oslo_service.periodic_task [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134148) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Dec 18 20:42:34.333380 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 20:42:34.354754 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 20:42:34.388301 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.manager [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] Notifying Schedulers of capabilities ... {{(pid=134148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 18 20:43:34.333938 ncdv-master-1 cinder-volume[134148]: DEBUG oslo_service.periodic_task [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134148) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Dec 18 20:43:34.334697 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 20:43:34.356066 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 20:43:34.377652 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.manager [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] Notifying Schedulers of capabilities ... {{(pid=134148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 18 20:44:34.332140 ncdv-master-1 cinder-volume[134148]: DEBUG oslo_service.periodic_task [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134148) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Dec 18 20:44:34.332815 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 20:44:34.353688 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 20:44:34.374982 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.manager [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] Notifying Schedulers of capabilities ... {{(pid=134148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 18 20:45:34.329925 ncdv-master-1 cinder-volume[134148]: DEBUG oslo_service.periodic_task [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134148) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Dec 18 20:45:34.330637 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 20:45:34.351052 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 20:45:34.372693 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.manager [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] Notifying Schedulers of capabilities ... {{(pid=134148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 18 20:46:34.327902 ncdv-master-1 cinder-volume[134148]: DEBUG oslo_service.periodic_task [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134148) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Dec 18 20:46:34.328603 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 20:46:34.361998 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 20:46:34.410900 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.manager [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] Notifying Schedulers of capabilities ... {{(pid=134148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 18 20:47:34.326518 ncdv-master-1 cinder-volume[134148]: DEBUG oslo_service.periodic_task [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134148) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Dec 18 20:47:34.328001 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 20:47:34.399460 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 20:47:34.485143 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.manager [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] Notifying Schedulers of capabilities ... {{(pid=134148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 18 20:48:30.823512 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.flows.manager.create_volume [None req-314903f4-9818-4dfd-a452-1c72dc1fa228 tempest-VolumesAdminNegativeTest-2110717882 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134148) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Dec 18 20:48:30.835819 ncdv-master-1 cinder-volume[134148]: DEBUG oslo_db.sqlalchemy.engines [None req-314903f4-9818-4dfd-a452-1c72dc1fa228 tempest-VolumesAdminNegativeTest-2110717882 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134148) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 18 20:48:30.844807 ncdv-master-1 cinder-volume[134148]: INFO cinder.rpc [None req-314903f4-9818-4dfd-a452-1c72dc1fa228 tempest-VolumesAdminNegativeTest-2110717882 None] Automatically selected cinder-backup objects version 1.39 as minimum service version. Dec 18 20:48:30.850859 ncdv-master-1 cinder-volume[134148]: INFO cinder.rpc [None req-314903f4-9818-4dfd-a452-1c72dc1fa228 tempest-VolumesAdminNegativeTest-2110717882 None] Automatically selected cinder-backup RPC version 2.2 as minimum service version. Dec 18 20:48:30.852092 ncdv-master-1 cinder-volume[134148]: WARNING stevedore.named [None req-314903f4-9818-4dfd-a452-1c72dc1fa228 tempest-VolumesAdminNegativeTest-2110717882 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Dec 18 20:48:30.852616 ncdv-master-1 cinder-volume[134148]: WARNING castellan.key_manager [None req-314903f4-9818-4dfd-a452-1c72dc1fa228 tempest-VolumesAdminNegativeTest-2110717882 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Dec 18 20:48:30.891579 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-314903f4-9818-4dfd-a452-1c72dc1fa228 tempest-VolumesAdminNegativeTest-2110717882 None] Flow 'volume_create_manager' (29cbe26a-f2af-43c2-839b-89e744f65028) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 18 20:48:30.895920 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-314903f4-9818-4dfd-a452-1c72dc1fa228 tempest-VolumesAdminNegativeTest-2110717882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b68a481-8ce3-4c8b-b7da-5a8624666e3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 20:48:30.903856 ncdv-master-1 cinder-volume[134148]: DEBUG oslo_db.sqlalchemy.engines [None req-314903f4-9818-4dfd-a452-1c72dc1fa228 tempest-VolumesAdminNegativeTest-2110717882 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134148) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 18 20:48:30.960515 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-314903f4-9818-4dfd-a452-1c72dc1fa228 tempest-VolumesAdminNegativeTest-2110717882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b68a481-8ce3-4c8b-b7da-5a8624666e3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-12-18T20:48:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1538482018',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=cd7ff98c-6407-4674-9e06-de293ba3baf9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47584e2b5b674fc295b6a63ffe8df191',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-12-18T20:48:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-12-18T20:48:31Z,use_quota=True,user_id='c971aa1884174ed0acec9d140f2eda87',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f2e1fe1-9fd6-411e-9ed9-368f463ccb6f),volume_type_id=1f2e1fe1-9fd6-411e-9ed9-368f463ccb6f)' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 20:48:30.963424 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-314903f4-9818-4dfd-a452-1c72dc1fa228 tempest-VolumesAdminNegativeTest-2110717882 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (908ab1e9-97ec-4e81-aa5c-92bab85d4dac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 20:48:30.965972 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-314903f4-9818-4dfd-a452-1c72dc1fa228 tempest-VolumesAdminNegativeTest-2110717882 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (908ab1e9-97ec-4e81-aa5c-92bab85d4dac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 20:48:30.968716 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-314903f4-9818-4dfd-a452-1c72dc1fa228 tempest-VolumesAdminNegativeTest-2110717882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cafc2db6-7b03-457d-8177-4f0ce119baec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 20:48:30.971113 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-314903f4-9818-4dfd-a452-1c72dc1fa228 tempest-VolumesAdminNegativeTest-2110717882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cafc2db6-7b03-457d-8177-4f0ce119baec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cd7ff98c-6407-4674-9e06-de293ba3baf9', 'volume_name': 'volume-cd7ff98c-6407-4674-9e06-de293ba3baf9', 'volume_size': 1}' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 20:48:30.974233 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-314903f4-9818-4dfd-a452-1c72dc1fa228 tempest-VolumesAdminNegativeTest-2110717882 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14837199-f2a9-411f-828a-fd81aa2476a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 20:48:30.980883 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-314903f4-9818-4dfd-a452-1c72dc1fa228 tempest-VolumesAdminNegativeTest-2110717882 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14837199-f2a9-411f-828a-fd81aa2476a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 20:48:30.983467 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-314903f4-9818-4dfd-a452-1c72dc1fa228 tempest-VolumesAdminNegativeTest-2110717882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8bbc24f-2342-4302-9192-759d8ff8bfe3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 20:48:30.984443 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.flows.manager.create_volume [None req-314903f4-9818-4dfd-a452-1c72dc1fa228 tempest-VolumesAdminNegativeTest-2110717882 None] Volume cd7ff98c-6407-4674-9e06-de293ba3baf9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cd7ff98c-6407-4674-9e06-de293ba3baf9', 'volume_size': 1} Dec 18 20:48:30.984892 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-314903f4-9818-4dfd-a452-1c72dc1fa228 tempest-VolumesAdminNegativeTest-2110717882 None] creating volume 'volume-cd7ff98c-6407-4674-9e06-de293ba3baf9' {{(pid=134148) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Dec 18 20:48:30.985880 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-314903f4-9818-4dfd-a452-1c72dc1fa228 tempest-VolumesAdminNegativeTest-2110717882 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 20:48:31.139471 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-314903f4-9818-4dfd-a452-1c72dc1fa228 tempest-VolumesAdminNegativeTest-2110717882 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134148) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 18 20:48:31.140297 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-314903f4-9818-4dfd-a452-1c72dc1fa228 tempest-VolumesAdminNegativeTest-2110717882 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134148) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 18 20:48:31.142589 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-314903f4-9818-4dfd-a452-1c72dc1fa228 tempest-VolumesAdminNegativeTest-2110717882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8bbc24f-2342-4302-9192-759d8ff8bfe3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cd7ff98c-6407-4674-9e06-de293ba3baf9', 'volume_size': 1}' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 20:48:31.144786 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-314903f4-9818-4dfd-a452-1c72dc1fa228 tempest-VolumesAdminNegativeTest-2110717882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5060adce-4215-49df-a5f4-c036f5dc4c1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 20:48:31.155440 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.flows.manager.create_volume [None req-314903f4-9818-4dfd-a452-1c72dc1fa228 tempest-VolumesAdminNegativeTest-2110717882 None] Volume volume-cd7ff98c-6407-4674-9e06-de293ba3baf9 (cd7ff98c-6407-4674-9e06-de293ba3baf9): created successfully Dec 18 20:48:31.157454 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-314903f4-9818-4dfd-a452-1c72dc1fa228 tempest-VolumesAdminNegativeTest-2110717882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5060adce-4215-49df-a5f4-c036f5dc4c1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 20:48:31.161249 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-314903f4-9818-4dfd-a452-1c72dc1fa228 tempest-VolumesAdminNegativeTest-2110717882 None] Flow 'volume_create_manager' (29cbe26a-f2af-43c2-839b-89e744f65028) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134148) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 18 20:48:31.172155 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-314903f4-9818-4dfd-a452-1c72dc1fa228 tempest-VolumesAdminNegativeTest-2110717882 None] Created volume successfully. Dec 18 20:48:32.965897 ncdv-master-1 cinder-volume[134148]: DEBUG oslo_concurrency.processutils [req-93b5b63c-689d-42e5-a760-7404f561c1cb req-b43076c5-ea84-41dd-8063-ca8f66c0a032 tempest-VolumesAdminNegativeTest-2110717882 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=134148) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Dec 18 20:48:33.827662 ncdv-master-1 cinder-volume[134148]: DEBUG oslo_concurrency.processutils [req-93b5b63c-689d-42e5-a760-7404f561c1cb req-b43076c5-ea84-41dd-8063-ca8f66c0a032 tempest-VolumesAdminNegativeTest-2110717882 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.862s {{(pid=134148) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Dec 18 20:48:33.828500 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [req-93b5b63c-689d-42e5-a760-7404f561c1cb req-b43076c5-ea84-41dd-8063-ca8f66c0a032 tempest-VolumesAdminNegativeTest-2110717882 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-cd7ff98c-6407-4674-9e06-de293ba3baf9', 'hosts': ['10.222.0.13'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '946d1715-d12c-4dbf-8a79-181222df6e2e', 'volume_id': 'cd7ff98c-6407-4674-9e06-de293ba3baf9', 'discard': True}} {{(pid=134148) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Dec 18 20:48:33.900077 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [req-93b5b63c-689d-42e5-a760-7404f561c1cb req-b43076c5-ea84-41dd-8063-ca8f66c0a032 tempest-VolumesAdminNegativeTest-2110717882 None] Connection info returned from driver {'name': 'volumes/volume-cd7ff98c-6407-4674-9e06-de293ba3baf9', 'hosts': ['10.222.0.13'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'cd7ff98c-6407-4674-9e06-de293ba3baf9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '60729c82-3aa1-4682-ad13-c8e8847e56a8'} {{(pid=134148) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4812}} Dec 18 20:48:34.043215 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [req-93b5b63c-689d-42e5-a760-7404f561c1cb req-b43076c5-ea84-41dd-8063-ca8f66c0a032 tempest-VolumesAdminNegativeTest-2110717882 None] attachment_update completed successfully. Dec 18 20:48:34.335159 ncdv-master-1 cinder-volume[134148]: DEBUG oslo_service.periodic_task [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134148) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Dec 18 20:48:34.336569 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 20:48:34.410903 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 20:48:34.498325 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.manager [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] Notifying Schedulers of capabilities ... {{(pid=134148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 18 20:48:41.573390 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [req-b4a21f15-abe9-40b9-a6f5-f7ba97f0e807 req-5c14f1cb-041a-41e6-9887-b3ec64e5fbcb tempest-VolumesAdminNegativeTest-2110717882 None] Terminate volume connection completed successfully. Dec 18 20:48:41.574102 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [req-b4a21f15-abe9-40b9-a6f5-f7ba97f0e807 req-5c14f1cb-041a-41e6-9887-b3ec64e5fbcb tempest-VolumesAdminNegativeTest-2110717882 None] Deleting attachment 60729c82-3aa1-4682-ad13-c8e8847e56a8. {{(pid=134148) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4948}} Dec 18 20:48:43.220983 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.flows.manager.create_volume [None req-7b9140f1-91cc-4fae-9611-f15463f1cc7f tempest-VolumesAdminNegativeTest-2110717882 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134148) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Dec 18 20:48:43.226773 ncdv-master-1 cinder-volume[134148]: WARNING stevedore.named [None req-7b9140f1-91cc-4fae-9611-f15463f1cc7f tempest-VolumesAdminNegativeTest-2110717882 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Dec 18 20:48:43.228154 ncdv-master-1 cinder-volume[134148]: WARNING castellan.key_manager [None req-7b9140f1-91cc-4fae-9611-f15463f1cc7f tempest-VolumesAdminNegativeTest-2110717882 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Dec 18 20:48:43.262489 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-7b9140f1-91cc-4fae-9611-f15463f1cc7f tempest-VolumesAdminNegativeTest-2110717882 None] Flow 'volume_create_manager' (378ffdd9-2123-413f-93fb-0458d11703d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 18 20:48:43.269699 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-7b9140f1-91cc-4fae-9611-f15463f1cc7f tempest-VolumesAdminNegativeTest-2110717882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a495dec-ed9b-4742-9179-62ffbffef149) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 20:48:43.283864 ncdv-master-1 cinder-volume[134148]: DEBUG oslo_db.sqlalchemy.engines [None req-7b9140f1-91cc-4fae-9611-f15463f1cc7f tempest-VolumesAdminNegativeTest-2110717882 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134148) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 18 20:48:43.315387 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-7b9140f1-91cc-4fae-9611-f15463f1cc7f tempest-VolumesAdminNegativeTest-2110717882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a495dec-ed9b-4742-9179-62ffbffef149) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-12-18T20:48:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-558048953',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=973f4497-ef23-44b8-912b-4395a8af4097,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47584e2b5b674fc295b6a63ffe8df191',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-12-18T20:48:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-12-18T20:48:43Z,use_quota=True,user_id='c971aa1884174ed0acec9d140f2eda87',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f2e1fe1-9fd6-411e-9ed9-368f463ccb6f),volume_type_id=1f2e1fe1-9fd6-411e-9ed9-368f463ccb6f)' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 20:48:43.322774 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-7b9140f1-91cc-4fae-9611-f15463f1cc7f tempest-VolumesAdminNegativeTest-2110717882 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (087c2193-dd8c-4902-b71b-2f46ef7b91d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 20:48:43.327294 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-7b9140f1-91cc-4fae-9611-f15463f1cc7f tempest-VolumesAdminNegativeTest-2110717882 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (087c2193-dd8c-4902-b71b-2f46ef7b91d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 20:48:43.337380 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-7b9140f1-91cc-4fae-9611-f15463f1cc7f tempest-VolumesAdminNegativeTest-2110717882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f925e98-c2a7-4ea2-bbe8-981bd5ff3a91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 20:48:43.344578 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-7b9140f1-91cc-4fae-9611-f15463f1cc7f tempest-VolumesAdminNegativeTest-2110717882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f925e98-c2a7-4ea2-bbe8-981bd5ff3a91) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '973f4497-ef23-44b8-912b-4395a8af4097', 'volume_name': 'volume-973f4497-ef23-44b8-912b-4395a8af4097', 'volume_size': 1}' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 20:48:43.347897 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-7b9140f1-91cc-4fae-9611-f15463f1cc7f tempest-VolumesAdminNegativeTest-2110717882 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec6f5758-e1b8-4243-b097-b2145ea80f27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 20:48:43.350501 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-7b9140f1-91cc-4fae-9611-f15463f1cc7f tempest-VolumesAdminNegativeTest-2110717882 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec6f5758-e1b8-4243-b097-b2145ea80f27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 20:48:43.354194 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-7b9140f1-91cc-4fae-9611-f15463f1cc7f tempest-VolumesAdminNegativeTest-2110717882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb0aaf43-df17-49fc-a487-aa1765d651f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 20:48:43.355499 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.flows.manager.create_volume [None req-7b9140f1-91cc-4fae-9611-f15463f1cc7f tempest-VolumesAdminNegativeTest-2110717882 None] Volume 973f4497-ef23-44b8-912b-4395a8af4097: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-973f4497-ef23-44b8-912b-4395a8af4097', 'volume_size': 1} Dec 18 20:48:43.356087 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-7b9140f1-91cc-4fae-9611-f15463f1cc7f tempest-VolumesAdminNegativeTest-2110717882 None] creating volume 'volume-973f4497-ef23-44b8-912b-4395a8af4097' {{(pid=134148) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Dec 18 20:48:43.357970 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-7b9140f1-91cc-4fae-9611-f15463f1cc7f tempest-VolumesAdminNegativeTest-2110717882 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 20:48:43.489129 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-7b9140f1-91cc-4fae-9611-f15463f1cc7f tempest-VolumesAdminNegativeTest-2110717882 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134148) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 18 20:48:43.489886 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-7b9140f1-91cc-4fae-9611-f15463f1cc7f tempest-VolumesAdminNegativeTest-2110717882 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134148) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 18 20:48:43.492411 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-7b9140f1-91cc-4fae-9611-f15463f1cc7f tempest-VolumesAdminNegativeTest-2110717882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb0aaf43-df17-49fc-a487-aa1765d651f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-973f4497-ef23-44b8-912b-4395a8af4097', 'volume_size': 1}' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 20:48:43.495653 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-7b9140f1-91cc-4fae-9611-f15463f1cc7f tempest-VolumesAdminNegativeTest-2110717882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59c1ea46-08fa-48e1-8c57-b63a23c385fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 20:48:43.508939 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.flows.manager.create_volume [None req-7b9140f1-91cc-4fae-9611-f15463f1cc7f tempest-VolumesAdminNegativeTest-2110717882 None] Volume volume-973f4497-ef23-44b8-912b-4395a8af4097 (973f4497-ef23-44b8-912b-4395a8af4097): created successfully Dec 18 20:48:43.511572 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-7b9140f1-91cc-4fae-9611-f15463f1cc7f tempest-VolumesAdminNegativeTest-2110717882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59c1ea46-08fa-48e1-8c57-b63a23c385fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 20:48:43.515428 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-7b9140f1-91cc-4fae-9611-f15463f1cc7f tempest-VolumesAdminNegativeTest-2110717882 None] Flow 'volume_create_manager' (378ffdd9-2123-413f-93fb-0458d11703d7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134148) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 18 20:48:43.525505 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-7b9140f1-91cc-4fae-9611-f15463f1cc7f tempest-VolumesAdminNegativeTest-2110717882 None] Created volume successfully. Dec 18 20:48:45.018894 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.coordination [None req-bb9619a5-1d66-48f9-ab7d-06337bf4d436 tempest-VolumesAdminNegativeTest-2110717882 None] Lock "b'cinder-973f4497-ef23-44b8-912b-4395a8af4097-delete_volume'" acquired by "delete_volume" :: waited 0.031s {{(pid=134148) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 18 20:48:45.118334 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-bb9619a5-1d66-48f9-ab7d-06337bf4d436 tempest-VolumesAdminNegativeTest-2110717882 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 20:48:45.231246 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-bb9619a5-1d66-48f9-ab7d-06337bf4d436 tempest-VolumesAdminNegativeTest-2110717882 None] volume has no backup snaps {{(pid=134148) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Dec 18 20:48:45.247003 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-bb9619a5-1d66-48f9-ab7d-06337bf4d436 tempest-VolumesAdminNegativeTest-2110717882 None] Volume volume-973f4497-ef23-44b8-912b-4395a8af4097 is not a clone. {{(pid=134148) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Dec 18 20:48:45.281735 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-bb9619a5-1d66-48f9-ab7d-06337bf4d436 tempest-VolumesAdminNegativeTest-2110717882 None] deleting rbd volume volume-973f4497-ef23-44b8-912b-4395a8af4097 {{(pid=134148) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Dec 18 20:48:45.733250 ncdv-master-1 cinder-volume[134148]: WARNING cinder.quota [None req-bb9619a5-1d66-48f9-ab7d-06337bf4d436 tempest-VolumesAdminNegativeTest-2110717882 None] Deprecated: Default quota for resource: volumes_ceph is set by the default quota flag: quota_volumes_ceph, it is now deprecated. Please use the default quota class for default quota. Dec 18 20:48:45.739785 ncdv-master-1 cinder-volume[134148]: WARNING cinder.quota [None req-bb9619a5-1d66-48f9-ab7d-06337bf4d436 tempest-VolumesAdminNegativeTest-2110717882 None] Deprecated: Default quota for resource: gigabytes_ceph is set by the default quota flag: quota_gigabytes_ceph, it is now deprecated. Please use the default quota class for default quota. Dec 18 20:48:45.793841 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.quota [None req-bb9619a5-1d66-48f9-ab7d-06337bf4d436 tempest-VolumesAdminNegativeTest-2110717882 None] Created reservations ['0ada6978-bccb-4ddc-9b1c-42aca670eb97', 'ed4e81a0-2145-4a8d-abf9-4fbc32846cb1', '00560d73-d519-4e38-be84-f48a8759271c', 'd74cee47-d6a2-4f89-889c-16fbb5d81d6a'] {{(pid=134148) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 18 20:48:45.912640 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-bb9619a5-1d66-48f9-ab7d-06337bf4d436 tempest-VolumesAdminNegativeTest-2110717882 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 20:48:45.986162 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-bb9619a5-1d66-48f9-ab7d-06337bf4d436 tempest-VolumesAdminNegativeTest-2110717882 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 20:48:46.049058 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.manager [None req-bb9619a5-1d66-48f9-ab7d-06337bf4d436 tempest-VolumesAdminNegativeTest-2110717882 None] Notifying Schedulers of capabilities ... {{(pid=134148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 18 20:48:46.054737 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-bb9619a5-1d66-48f9-ab7d-06337bf4d436 tempest-VolumesAdminNegativeTest-2110717882 None] Deleted volume successfully. Dec 18 20:48:46.075027 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.coordination [None req-bb9619a5-1d66-48f9-ab7d-06337bf4d436 tempest-VolumesAdminNegativeTest-2110717882 None] Lock "b'cinder-973f4497-ef23-44b8-912b-4395a8af4097-delete_volume'" released by "delete_volume" :: held 1.056s {{(pid=134148) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 18 20:48:46.370944 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.coordination [None req-cec7dfb2-cfd5-4d9d-9da0-57894169d142 tempest-VolumesAdminNegativeTest-2110717882 None] Lock "b'cinder-cd7ff98c-6407-4674-9e06-de293ba3baf9-delete_volume'" acquired by "delete_volume" :: waited 0.018s {{(pid=134148) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 18 20:48:46.450537 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-cec7dfb2-cfd5-4d9d-9da0-57894169d142 tempest-VolumesAdminNegativeTest-2110717882 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 20:48:46.549293 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-cec7dfb2-cfd5-4d9d-9da0-57894169d142 tempest-VolumesAdminNegativeTest-2110717882 None] volume has no backup snaps {{(pid=134148) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Dec 18 20:48:46.550234 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-cec7dfb2-cfd5-4d9d-9da0-57894169d142 tempest-VolumesAdminNegativeTest-2110717882 None] Volume volume-cd7ff98c-6407-4674-9e06-de293ba3baf9 is not a clone. {{(pid=134148) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Dec 18 20:48:46.564432 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-cec7dfb2-cfd5-4d9d-9da0-57894169d142 tempest-VolumesAdminNegativeTest-2110717882 None] deleting rbd volume volume-cd7ff98c-6407-4674-9e06-de293ba3baf9 {{(pid=134148) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Dec 18 20:48:47.009079 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.quota [None req-cec7dfb2-cfd5-4d9d-9da0-57894169d142 tempest-VolumesAdminNegativeTest-2110717882 None] Created reservations ['60481ef1-f4a0-4baf-9bc0-10115e45b756', 'b1865a62-573a-4cda-a58e-cee86c308ea1', '73a0903a-243a-48d7-b070-de1a7d6c0617', '7aaa4d87-3ec1-4c09-baa4-abd2b0ba75e0'] {{(pid=134148) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 18 20:48:47.085931 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-cec7dfb2-cfd5-4d9d-9da0-57894169d142 tempest-VolumesAdminNegativeTest-2110717882 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 20:48:47.190799 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-cec7dfb2-cfd5-4d9d-9da0-57894169d142 tempest-VolumesAdminNegativeTest-2110717882 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 20:48:47.288098 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.manager [None req-cec7dfb2-cfd5-4d9d-9da0-57894169d142 tempest-VolumesAdminNegativeTest-2110717882 None] Notifying Schedulers of capabilities ... {{(pid=134148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 18 20:48:47.299531 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-cec7dfb2-cfd5-4d9d-9da0-57894169d142 tempest-VolumesAdminNegativeTest-2110717882 None] Deleted volume successfully. Dec 18 20:48:47.326049 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.coordination [None req-cec7dfb2-cfd5-4d9d-9da0-57894169d142 tempest-VolumesAdminNegativeTest-2110717882 None] Lock "b'cinder-cd7ff98c-6407-4674-9e06-de293ba3baf9-delete_volume'" released by "delete_volume" :: held 0.955s {{(pid=134148) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 18 20:48:59.868318 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.flows.manager.create_volume [None req-e34cd2cb-004e-40a7-aa1d-da38c79c1a4e tempest-LiveMigrationTest-700829217 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134148) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Dec 18 20:48:59.872518 ncdv-master-1 cinder-volume[134148]: WARNING stevedore.named [None req-e34cd2cb-004e-40a7-aa1d-da38c79c1a4e tempest-LiveMigrationTest-700829217 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Dec 18 20:48:59.873452 ncdv-master-1 cinder-volume[134148]: WARNING castellan.key_manager [None req-e34cd2cb-004e-40a7-aa1d-da38c79c1a4e tempest-LiveMigrationTest-700829217 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Dec 18 20:48:59.894432 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-e34cd2cb-004e-40a7-aa1d-da38c79c1a4e tempest-LiveMigrationTest-700829217 None] Flow 'volume_create_manager' (c9afa5a5-7054-47fb-85fc-7627ca2e7c7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 18 20:48:59.899386 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-e34cd2cb-004e-40a7-aa1d-da38c79c1a4e tempest-LiveMigrationTest-700829217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b21940f3-48f3-41c5-8ac3-acebe052ef07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 20:48:59.934056 ncdv-master-1 cinder-volume[134148]: DEBUG oslo_db.sqlalchemy.engines [None req-e34cd2cb-004e-40a7-aa1d-da38c79c1a4e tempest-LiveMigrationTest-700829217 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134148) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 18 20:48:59.992541 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-e34cd2cb-004e-40a7-aa1d-da38c79c1a4e tempest-LiveMigrationTest-700829217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b21940f3-48f3-41c5-8ac3-acebe052ef07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-12-18T20:49:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-LiveMigrationTest-volume-294448049',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=f629430d-e738-4808-bf49-6063505a3490,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0870e14bc2934bae9138d4818b260729',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-12-18T20:49:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-12-18T20:49:00Z,use_quota=True,user_id='5aaf1ced6baf4e1d9c940cfe96b2c254',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f2e1fe1-9fd6-411e-9ed9-368f463ccb6f),volume_type_id=1f2e1fe1-9fd6-411e-9ed9-368f463ccb6f)' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 20:49:00.005069 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-e34cd2cb-004e-40a7-aa1d-da38c79c1a4e tempest-LiveMigrationTest-700829217 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6bd17f1d-a46a-44a9-b51a-e882aeb43c50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 20:49:00.016628 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-e34cd2cb-004e-40a7-aa1d-da38c79c1a4e tempest-LiveMigrationTest-700829217 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6bd17f1d-a46a-44a9-b51a-e882aeb43c50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 20:49:00.024751 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-e34cd2cb-004e-40a7-aa1d-da38c79c1a4e tempest-LiveMigrationTest-700829217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1291314-e620-4286-80eb-4b9ce5b4bc2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 20:49:00.029740 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-e34cd2cb-004e-40a7-aa1d-da38c79c1a4e tempest-LiveMigrationTest-700829217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1291314-e620-4286-80eb-4b9ce5b4bc2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f629430d-e738-4808-bf49-6063505a3490', 'volume_name': 'volume-f629430d-e738-4808-bf49-6063505a3490', 'volume_size': 1}' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 20:49:00.034603 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-e34cd2cb-004e-40a7-aa1d-da38c79c1a4e tempest-LiveMigrationTest-700829217 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e2edc51-bcc7-41b6-b6ed-1eec60f6de51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 20:49:00.037249 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-e34cd2cb-004e-40a7-aa1d-da38c79c1a4e tempest-LiveMigrationTest-700829217 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e2edc51-bcc7-41b6-b6ed-1eec60f6de51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 20:49:00.039753 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-e34cd2cb-004e-40a7-aa1d-da38c79c1a4e tempest-LiveMigrationTest-700829217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b18a2ba-4ca5-4c82-832a-a0980652679e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 20:49:00.040794 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.flows.manager.create_volume [None req-e34cd2cb-004e-40a7-aa1d-da38c79c1a4e tempest-LiveMigrationTest-700829217 None] Volume f629430d-e738-4808-bf49-6063505a3490: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f629430d-e738-4808-bf49-6063505a3490', 'volume_size': 1} Dec 18 20:49:00.041394 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-e34cd2cb-004e-40a7-aa1d-da38c79c1a4e tempest-LiveMigrationTest-700829217 None] creating volume 'volume-f629430d-e738-4808-bf49-6063505a3490' {{(pid=134148) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Dec 18 20:49:00.042632 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-e34cd2cb-004e-40a7-aa1d-da38c79c1a4e tempest-LiveMigrationTest-700829217 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 20:49:00.165315 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-e34cd2cb-004e-40a7-aa1d-da38c79c1a4e tempest-LiveMigrationTest-700829217 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134148) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 18 20:49:00.166135 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-e34cd2cb-004e-40a7-aa1d-da38c79c1a4e tempest-LiveMigrationTest-700829217 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134148) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 18 20:49:00.168956 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-e34cd2cb-004e-40a7-aa1d-da38c79c1a4e tempest-LiveMigrationTest-700829217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b18a2ba-4ca5-4c82-832a-a0980652679e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f629430d-e738-4808-bf49-6063505a3490', 'volume_size': 1}' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 20:49:00.172296 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-e34cd2cb-004e-40a7-aa1d-da38c79c1a4e tempest-LiveMigrationTest-700829217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8409c0c-b46c-4a55-b405-2b862632b468) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 20:49:00.189736 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.flows.manager.create_volume [None req-e34cd2cb-004e-40a7-aa1d-da38c79c1a4e tempest-LiveMigrationTest-700829217 None] Volume volume-f629430d-e738-4808-bf49-6063505a3490 (f629430d-e738-4808-bf49-6063505a3490): created successfully Dec 18 20:49:00.199359 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-e34cd2cb-004e-40a7-aa1d-da38c79c1a4e tempest-LiveMigrationTest-700829217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8409c0c-b46c-4a55-b405-2b862632b468) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 20:49:00.207745 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-e34cd2cb-004e-40a7-aa1d-da38c79c1a4e tempest-LiveMigrationTest-700829217 None] Flow 'volume_create_manager' (c9afa5a5-7054-47fb-85fc-7627ca2e7c7e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134148) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 18 20:49:00.222660 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-e34cd2cb-004e-40a7-aa1d-da38c79c1a4e tempest-LiveMigrationTest-700829217 None] Created volume successfully. Dec 18 20:49:01.999111 ncdv-master-1 cinder-volume[134148]: DEBUG oslo_concurrency.processutils [req-46a4ed97-0328-4e42-ace6-c68e2d603093 req-61b492e4-aca9-4205-8ca5-2583f0640501 tempest-LiveMigrationTest-700829217 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=134148) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Dec 18 20:49:03.057292 ncdv-master-1 cinder-volume[134148]: DEBUG oslo_concurrency.processutils [req-46a4ed97-0328-4e42-ace6-c68e2d603093 req-61b492e4-aca9-4205-8ca5-2583f0640501 tempest-LiveMigrationTest-700829217 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.058s {{(pid=134148) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Dec 18 20:49:03.058728 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [req-46a4ed97-0328-4e42-ace6-c68e2d603093 req-61b492e4-aca9-4205-8ca5-2583f0640501 tempest-LiveMigrationTest-700829217 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-f629430d-e738-4808-bf49-6063505a3490', 'hosts': ['10.222.0.13'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '946d1715-d12c-4dbf-8a79-181222df6e2e', 'volume_id': 'f629430d-e738-4808-bf49-6063505a3490', 'discard': True}} {{(pid=134148) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Dec 18 20:49:03.083398 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [req-46a4ed97-0328-4e42-ace6-c68e2d603093 req-61b492e4-aca9-4205-8ca5-2583f0640501 tempest-LiveMigrationTest-700829217 None] Connection info returned from driver {'name': 'volumes/volume-f629430d-e738-4808-bf49-6063505a3490', 'hosts': ['10.222.0.13'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'f629430d-e738-4808-bf49-6063505a3490', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '21dc9f10-f155-46a6-8036-8ef45da30c42'} {{(pid=134148) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4812}} Dec 18 20:49:03.200901 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [req-46a4ed97-0328-4e42-ace6-c68e2d603093 req-61b492e4-aca9-4205-8ca5-2583f0640501 tempest-LiveMigrationTest-700829217 None] attachment_update completed successfully. Dec 18 20:49:03.414925 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.flows.manager.create_volume [None req-da87c96e-2140-43ae-b662-bb004d3fd05d tempest-LiveAutoBlockMigrationV225Test-1918466308 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134148) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Dec 18 20:49:03.420084 ncdv-master-1 cinder-volume[134148]: WARNING stevedore.named [None req-da87c96e-2140-43ae-b662-bb004d3fd05d tempest-LiveAutoBlockMigrationV225Test-1918466308 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Dec 18 20:49:03.420681 ncdv-master-1 cinder-volume[134148]: WARNING castellan.key_manager [None req-da87c96e-2140-43ae-b662-bb004d3fd05d tempest-LiveAutoBlockMigrationV225Test-1918466308 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Dec 18 20:49:03.436617 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-da87c96e-2140-43ae-b662-bb004d3fd05d tempest-LiveAutoBlockMigrationV225Test-1918466308 None] Flow 'volume_create_manager' (3a6804fc-7fc3-4322-a354-82a14ec258b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 18 20:49:03.441261 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-da87c96e-2140-43ae-b662-bb004d3fd05d tempest-LiveAutoBlockMigrationV225Test-1918466308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b09b308-2925-4d43-aeaf-f9c5a8b92701) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 20:49:03.449433 ncdv-master-1 cinder-volume[134148]: DEBUG oslo_db.sqlalchemy.engines [None req-da87c96e-2140-43ae-b662-bb004d3fd05d tempest-LiveAutoBlockMigrationV225Test-1918466308 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134148) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 18 20:49:03.467391 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-da87c96e-2140-43ae-b662-bb004d3fd05d tempest-LiveAutoBlockMigrationV225Test-1918466308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b09b308-2925-4d43-aeaf-f9c5a8b92701) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-12-18T20:49:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-LiveAutoBlockMigrationV225Test-volume-2112047448',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=2f2dfe88-6eae-4206-aa00-4d39eb37326e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a84b125f83d34481adc5617b5ca62e2e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-12-18T20:49:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-12-18T20:49:03Z,use_quota=True,user_id='8042de28328d4b26b910f1be4b499879',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f2e1fe1-9fd6-411e-9ed9-368f463ccb6f),volume_type_id=1f2e1fe1-9fd6-411e-9ed9-368f463ccb6f)' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 20:49:03.470234 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-da87c96e-2140-43ae-b662-bb004d3fd05d tempest-LiveAutoBlockMigrationV225Test-1918466308 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1793a2e4-99ac-4c82-b6d9-6e70b7098a83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 20:49:03.472436 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-da87c96e-2140-43ae-b662-bb004d3fd05d tempest-LiveAutoBlockMigrationV225Test-1918466308 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1793a2e4-99ac-4c82-b6d9-6e70b7098a83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 20:49:03.475481 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-da87c96e-2140-43ae-b662-bb004d3fd05d tempest-LiveAutoBlockMigrationV225Test-1918466308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (448590d2-65b1-4020-8f39-b91208cea136) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 20:49:03.477918 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-da87c96e-2140-43ae-b662-bb004d3fd05d tempest-LiveAutoBlockMigrationV225Test-1918466308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (448590d2-65b1-4020-8f39-b91208cea136) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2f2dfe88-6eae-4206-aa00-4d39eb37326e', 'volume_name': 'volume-2f2dfe88-6eae-4206-aa00-4d39eb37326e', 'volume_size': 1}' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 20:49:03.480379 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-da87c96e-2140-43ae-b662-bb004d3fd05d tempest-LiveAutoBlockMigrationV225Test-1918466308 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a568feb-cfa9-438d-aaf6-90a2f577928a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 20:49:03.482552 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-da87c96e-2140-43ae-b662-bb004d3fd05d tempest-LiveAutoBlockMigrationV225Test-1918466308 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a568feb-cfa9-438d-aaf6-90a2f577928a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 20:49:03.485102 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-da87c96e-2140-43ae-b662-bb004d3fd05d tempest-LiveAutoBlockMigrationV225Test-1918466308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38ce041f-f9af-4394-bdfd-5424382c69c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 20:49:03.485969 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.flows.manager.create_volume [None req-da87c96e-2140-43ae-b662-bb004d3fd05d tempest-LiveAutoBlockMigrationV225Test-1918466308 None] Volume 2f2dfe88-6eae-4206-aa00-4d39eb37326e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2f2dfe88-6eae-4206-aa00-4d39eb37326e', 'volume_size': 1} Dec 18 20:49:03.486487 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-da87c96e-2140-43ae-b662-bb004d3fd05d tempest-LiveAutoBlockMigrationV225Test-1918466308 None] creating volume 'volume-2f2dfe88-6eae-4206-aa00-4d39eb37326e' {{(pid=134148) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Dec 18 20:49:03.488383 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-da87c96e-2140-43ae-b662-bb004d3fd05d tempest-LiveAutoBlockMigrationV225Test-1918466308 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 20:49:03.594829 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-da87c96e-2140-43ae-b662-bb004d3fd05d tempest-LiveAutoBlockMigrationV225Test-1918466308 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134148) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 18 20:49:03.595524 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-da87c96e-2140-43ae-b662-bb004d3fd05d tempest-LiveAutoBlockMigrationV225Test-1918466308 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134148) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 18 20:49:03.598389 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-da87c96e-2140-43ae-b662-bb004d3fd05d tempest-LiveAutoBlockMigrationV225Test-1918466308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38ce041f-f9af-4394-bdfd-5424382c69c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2f2dfe88-6eae-4206-aa00-4d39eb37326e', 'volume_size': 1}' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 20:49:03.601828 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-da87c96e-2140-43ae-b662-bb004d3fd05d tempest-LiveAutoBlockMigrationV225Test-1918466308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6f49a97-7df7-45ab-b422-f29b3477f1b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 20:49:03.621591 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.flows.manager.create_volume [None req-da87c96e-2140-43ae-b662-bb004d3fd05d tempest-LiveAutoBlockMigrationV225Test-1918466308 None] Volume volume-2f2dfe88-6eae-4206-aa00-4d39eb37326e (2f2dfe88-6eae-4206-aa00-4d39eb37326e): created successfully Dec 18 20:49:03.628963 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-da87c96e-2140-43ae-b662-bb004d3fd05d tempest-LiveAutoBlockMigrationV225Test-1918466308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6f49a97-7df7-45ab-b422-f29b3477f1b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 20:49:03.635728 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-da87c96e-2140-43ae-b662-bb004d3fd05d tempest-LiveAutoBlockMigrationV225Test-1918466308 None] Flow 'volume_create_manager' (3a6804fc-7fc3-4322-a354-82a14ec258b6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134148) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 18 20:49:03.655046 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-da87c96e-2140-43ae-b662-bb004d3fd05d tempest-LiveAutoBlockMigrationV225Test-1918466308 None] Created volume successfully. Dec 18 20:49:05.143518 ncdv-master-1 cinder-volume[134148]: DEBUG oslo_concurrency.processutils [req-bccc95da-208f-4121-b00e-ae0b389102aa req-17775a0b-4942-48bf-a8cb-a10930e6b4be tempest-LiveAutoBlockMigrationV225Test-1918466308 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=134148) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Dec 18 20:49:06.360324 ncdv-master-1 cinder-volume[134148]: DEBUG oslo_concurrency.processutils [req-bccc95da-208f-4121-b00e-ae0b389102aa req-17775a0b-4942-48bf-a8cb-a10930e6b4be tempest-LiveAutoBlockMigrationV225Test-1918466308 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.218s {{(pid=134148) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Dec 18 20:49:06.361190 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [req-bccc95da-208f-4121-b00e-ae0b389102aa req-17775a0b-4942-48bf-a8cb-a10930e6b4be tempest-LiveAutoBlockMigrationV225Test-1918466308 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-2f2dfe88-6eae-4206-aa00-4d39eb37326e', 'hosts': ['10.222.0.13'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '946d1715-d12c-4dbf-8a79-181222df6e2e', 'volume_id': '2f2dfe88-6eae-4206-aa00-4d39eb37326e', 'discard': True}} {{(pid=134148) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Dec 18 20:49:06.421718 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [req-bccc95da-208f-4121-b00e-ae0b389102aa req-17775a0b-4942-48bf-a8cb-a10930e6b4be tempest-LiveAutoBlockMigrationV225Test-1918466308 None] Connection info returned from driver {'name': 'volumes/volume-2f2dfe88-6eae-4206-aa00-4d39eb37326e', 'hosts': ['10.222.0.13'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '2f2dfe88-6eae-4206-aa00-4d39eb37326e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'a17e82f4-abaa-4972-b054-9a6dc90b06b5'} {{(pid=134148) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4812}} Dec 18 20:49:06.570944 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [req-bccc95da-208f-4121-b00e-ae0b389102aa req-17775a0b-4942-48bf-a8cb-a10930e6b4be tempest-LiveAutoBlockMigrationV225Test-1918466308 None] attachment_update completed successfully. Dec 18 20:49:14.720410 ncdv-master-1 cinder-volume[134148]: DEBUG oslo_concurrency.processutils [req-a566bb05-f8dd-4044-b71e-10b8b138af8d req-a8ab179f-658f-4739-b0f5-ee11824e38f6 tempest-LiveMigrationTest-150705056 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=134148) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Dec 18 20:49:15.614732 ncdv-master-1 cinder-volume[134148]: DEBUG oslo_concurrency.processutils [req-a566bb05-f8dd-4044-b71e-10b8b138af8d req-a8ab179f-658f-4739-b0f5-ee11824e38f6 tempest-LiveMigrationTest-150705056 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.894s {{(pid=134148) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Dec 18 20:49:15.615516 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [req-a566bb05-f8dd-4044-b71e-10b8b138af8d req-a8ab179f-658f-4739-b0f5-ee11824e38f6 tempest-LiveMigrationTest-150705056 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-f629430d-e738-4808-bf49-6063505a3490', 'hosts': ['10.222.0.13'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '946d1715-d12c-4dbf-8a79-181222df6e2e', 'volume_id': 'f629430d-e738-4808-bf49-6063505a3490', 'discard': True}} {{(pid=134148) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Dec 18 20:49:15.666459 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [req-a566bb05-f8dd-4044-b71e-10b8b138af8d req-a8ab179f-658f-4739-b0f5-ee11824e38f6 tempest-LiveMigrationTest-150705056 None] Connection info returned from driver {'name': 'volumes/volume-f629430d-e738-4808-bf49-6063505a3490', 'hosts': ['10.222.0.13'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'f629430d-e738-4808-bf49-6063505a3490', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '7c607f70-8191-4cb7-8289-c1fe475884c9'} {{(pid=134148) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4812}} Dec 18 20:49:15.809198 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [req-a566bb05-f8dd-4044-b71e-10b8b138af8d req-a8ab179f-658f-4739-b0f5-ee11824e38f6 tempest-LiveMigrationTest-150705056 None] attachment_update completed successfully. Dec 18 20:49:16.965302 ncdv-master-1 cinder-volume[134148]: DEBUG oslo_concurrency.processutils [req-5eadd404-98f6-445b-bc1a-5058029eb83e req-70ee9156-8caf-4be9-852c-7baa200273c3 tempest-LiveAutoBlockMigrationV225Test-1140448609 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=134148) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Dec 18 20:49:18.643295 ncdv-master-1 cinder-volume[134148]: DEBUG oslo_concurrency.processutils [req-5eadd404-98f6-445b-bc1a-5058029eb83e req-70ee9156-8caf-4be9-852c-7baa200273c3 tempest-LiveAutoBlockMigrationV225Test-1140448609 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.677s {{(pid=134148) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Dec 18 20:49:18.645443 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [req-5eadd404-98f6-445b-bc1a-5058029eb83e req-70ee9156-8caf-4be9-852c-7baa200273c3 tempest-LiveAutoBlockMigrationV225Test-1140448609 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-2f2dfe88-6eae-4206-aa00-4d39eb37326e', 'hosts': ['10.222.0.13'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '946d1715-d12c-4dbf-8a79-181222df6e2e', 'volume_id': '2f2dfe88-6eae-4206-aa00-4d39eb37326e', 'discard': True}} {{(pid=134148) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Dec 18 20:49:18.714683 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [req-5eadd404-98f6-445b-bc1a-5058029eb83e req-70ee9156-8caf-4be9-852c-7baa200273c3 tempest-LiveAutoBlockMigrationV225Test-1140448609 None] Connection info returned from driver {'name': 'volumes/volume-2f2dfe88-6eae-4206-aa00-4d39eb37326e', 'hosts': ['10.222.0.13'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '2f2dfe88-6eae-4206-aa00-4d39eb37326e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '44139f25-bab4-4aed-acc8-8fc408e764ae'} {{(pid=134148) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4812}} Dec 18 20:49:18.852235 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [req-5eadd404-98f6-445b-bc1a-5058029eb83e req-70ee9156-8caf-4be9-852c-7baa200273c3 tempest-LiveAutoBlockMigrationV225Test-1140448609 None] attachment_update completed successfully. Dec 18 20:49:27.764516 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [req-a566bb05-f8dd-4044-b71e-10b8b138af8d req-f7394beb-7ddd-493b-a982-28247870865e tempest-LiveMigrationTest-150705056 None] Terminate volume connection completed successfully. Dec 18 20:49:27.765189 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [req-a566bb05-f8dd-4044-b71e-10b8b138af8d req-f7394beb-7ddd-493b-a982-28247870865e tempest-LiveMigrationTest-150705056 None] Deleting attachment 21dc9f10-f155-46a6-8036-8ef45da30c42. {{(pid=134148) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4948}} Dec 18 20:49:30.108863 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [req-5eadd404-98f6-445b-bc1a-5058029eb83e req-eb7d7330-149d-4050-8b22-1557a853478c tempest-LiveAutoBlockMigrationV225Test-1140448609 None] Terminate volume connection completed successfully. Dec 18 20:49:30.111869 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [req-5eadd404-98f6-445b-bc1a-5058029eb83e req-eb7d7330-149d-4050-8b22-1557a853478c tempest-LiveAutoBlockMigrationV225Test-1140448609 None] Deleting attachment a17e82f4-abaa-4972-b054-9a6dc90b06b5. {{(pid=134148) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4948}} Dec 18 20:49:34.337198 ncdv-master-1 cinder-volume[134148]: DEBUG oslo_service.periodic_task [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134148) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Dec 18 20:49:34.338613 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 20:49:34.411395 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 20:49:34.485913 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.manager [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] Notifying Schedulers of capabilities ... {{(pid=134148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 18 20:49:36.605780 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [req-c18295ef-1a4f-48df-8667-51200c71656f req-74eec80a-801a-4e2a-a1bd-cc36d162aef1 tempest-LiveMigrationTest-700829217 None] Terminate volume connection completed successfully. Dec 18 20:49:36.606415 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [req-c18295ef-1a4f-48df-8667-51200c71656f req-74eec80a-801a-4e2a-a1bd-cc36d162aef1 tempest-LiveMigrationTest-700829217 None] Deleting attachment 7c607f70-8191-4cb7-8289-c1fe475884c9. {{(pid=134148) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4948}} Dec 18 20:49:38.817785 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.flows.manager.create_volume [None req-ae2cd4e8-0c2f-4732-968f-0df119f04f6b tempest-LiveMigrationTest-700829217 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134148) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Dec 18 20:49:38.825291 ncdv-master-1 cinder-volume[134148]: WARNING stevedore.named [None req-ae2cd4e8-0c2f-4732-968f-0df119f04f6b tempest-LiveMigrationTest-700829217 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Dec 18 20:49:38.826627 ncdv-master-1 cinder-volume[134148]: WARNING castellan.key_manager [None req-ae2cd4e8-0c2f-4732-968f-0df119f04f6b tempest-LiveMigrationTest-700829217 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Dec 18 20:49:38.846175 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-ae2cd4e8-0c2f-4732-968f-0df119f04f6b tempest-LiveMigrationTest-700829217 None] Flow 'volume_create_manager' (225ebd3e-cfa3-4575-bf2a-f17f3f71daa6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 18 20:49:38.851615 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-ae2cd4e8-0c2f-4732-968f-0df119f04f6b tempest-LiveMigrationTest-700829217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1344de46-1073-446b-b676-1d8c4d49693c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 20:49:38.859541 ncdv-master-1 cinder-volume[134148]: DEBUG oslo_db.sqlalchemy.engines [None req-ae2cd4e8-0c2f-4732-968f-0df119f04f6b tempest-LiveMigrationTest-700829217 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134148) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 18 20:49:38.888175 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [req-0b87916a-d748-4f2b-8cca-993258aecdc9 req-3ff2513a-fbf8-430b-b4c7-56c2a97b9d72 tempest-LiveAutoBlockMigrationV225Test-1918466308 None] Terminate volume connection completed successfully. Dec 18 20:49:38.888870 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [req-0b87916a-d748-4f2b-8cca-993258aecdc9 req-3ff2513a-fbf8-430b-b4c7-56c2a97b9d72 tempest-LiveAutoBlockMigrationV225Test-1918466308 None] Deleting attachment 44139f25-bab4-4aed-acc8-8fc408e764ae. {{(pid=134148) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4948}} Dec 18 20:49:38.898325 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-ae2cd4e8-0c2f-4732-968f-0df119f04f6b tempest-LiveMigrationTest-700829217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1344de46-1073-446b-b676-1d8c4d49693c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-12-18T20:49:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-802105297',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=9f5f7417-3abc-4462-988f-ef519750d753,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0870e14bc2934bae9138d4818b260729',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-12-18T20:49:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-12-18T20:49:39Z,use_quota=True,user_id='5aaf1ced6baf4e1d9c940cfe96b2c254',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f2e1fe1-9fd6-411e-9ed9-368f463ccb6f),volume_type_id=1f2e1fe1-9fd6-411e-9ed9-368f463ccb6f)' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 20:49:38.902717 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-ae2cd4e8-0c2f-4732-968f-0df119f04f6b tempest-LiveMigrationTest-700829217 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c84ec38-0e6d-4305-b44b-6f053b101afd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 20:49:38.906143 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-ae2cd4e8-0c2f-4732-968f-0df119f04f6b tempest-LiveMigrationTest-700829217 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c84ec38-0e6d-4305-b44b-6f053b101afd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 20:49:38.909805 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-ae2cd4e8-0c2f-4732-968f-0df119f04f6b tempest-LiveMigrationTest-700829217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba28b932-7a18-4f54-ab1c-551aef75ca72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 20:49:39.065608 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-ae2cd4e8-0c2f-4732-968f-0df119f04f6b tempest-LiveMigrationTest-700829217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba28b932-7a18-4f54-ab1c-551aef75ca72) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '9f5f7417-3abc-4462-988f-ef519750d753', 'volume_name': 'volume-9f5f7417-3abc-4462-988f-ef519750d753', 'volume_size': 1, 'image_id': '394b3891-80f2-44c9-a9aa-56fe23a5acb3', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b04c3d19c79d4c208395e97f9d293618', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '394b3891-80f2-44c9-a9aa-56fe23a5acb3', 'created_at': datetime.datetime(2021, 12, 18, 20, 38, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 12, 18, 20, 38, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/394b3891-80f2-44c9-a9aa-56fe23a5acb3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 20:49:39.068674 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-ae2cd4e8-0c2f-4732-968f-0df119f04f6b tempest-LiveMigrationTest-700829217 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3304698-d235-45da-b6ed-6f883cc872f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 20:49:39.071144 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-ae2cd4e8-0c2f-4732-968f-0df119f04f6b tempest-LiveMigrationTest-700829217 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3304698-d235-45da-b6ed-6f883cc872f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 20:49:39.075028 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-ae2cd4e8-0c2f-4732-968f-0df119f04f6b tempest-LiveMigrationTest-700829217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6fd61458-2b71-4558-943a-3c09b4220048) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 20:49:39.081115 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.flows.manager.create_volume [None req-ae2cd4e8-0c2f-4732-968f-0df119f04f6b tempest-LiveMigrationTest-700829217 None] Volume 9f5f7417-3abc-4462-988f-ef519750d753: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-9f5f7417-3abc-4462-988f-ef519750d753', 'volume_size': 1, 'image_id': '394b3891-80f2-44c9-a9aa-56fe23a5acb3', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b04c3d19c79d4c208395e97f9d293618', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '394b3891-80f2-44c9-a9aa-56fe23a5acb3', 'created_at': datetime.datetime(2021, 12, 18, 20, 38, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 12, 18, 20, 38, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/394b3891-80f2-44c9-a9aa-56fe23a5acb3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Dec 18 20:49:39.090412 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.flows.manager.create_volume [None req-ae2cd4e8-0c2f-4732-968f-0df119f04f6b tempest-LiveMigrationTest-700829217 None] Cloning 9f5f7417-3abc-4462-988f-ef519750d753 from image 394b3891-80f2-44c9-a9aa-56fe23a5acb3 at location (None, None). {{(pid=134148) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1047}} Dec 18 20:49:39.110521 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.coordination [None req-ae2cd4e8-0c2f-4732-968f-0df119f04f6b tempest-LiveMigrationTest-700829217 None] Lock "b'cinder-394b3891-80f2-44c9-a9aa-56fe23a5acb3'" acquired by "_prepare_image_cache_entry" :: waited 0.019s {{(pid=134148) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 18 20:49:39.131825 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.flows.manager.create_volume [None req-ae2cd4e8-0c2f-4732-968f-0df119f04f6b tempest-LiveMigrationTest-700829217 None] Preparing cache entry for image = 394b3891-80f2-44c9-a9aa-56fe23a5acb3 on host ncdv-master-1@ceph#ceph. {{(pid=134148) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:875}} Dec 18 20:49:39.133350 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.flows.manager.create_volume [None req-ae2cd4e8-0c2f-4732-968f-0df119f04f6b tempest-LiveMigrationTest-700829217 None] Attempting to retrieve cache entry for image = 394b3891-80f2-44c9-a9aa-56fe23a5acb3 on host ncdv-master-1@ceph#ceph. {{(pid=134148) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:811}} Dec 18 20:49:40.667155 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.flows.manager.create_volume [None req-0dab3317-58f9-4d2b-bef3-f13cf784390e tempest-LiveAutoBlockMigrationV225Test-1918466308 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134148) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Dec 18 20:49:40.677673 ncdv-master-1 cinder-volume[134148]: WARNING stevedore.named [None req-0dab3317-58f9-4d2b-bef3-f13cf784390e tempest-LiveAutoBlockMigrationV225Test-1918466308 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Dec 18 20:49:40.678129 ncdv-master-1 cinder-volume[134148]: WARNING castellan.key_manager [None req-0dab3317-58f9-4d2b-bef3-f13cf784390e tempest-LiveAutoBlockMigrationV225Test-1918466308 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Dec 18 20:49:40.707350 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-0dab3317-58f9-4d2b-bef3-f13cf784390e tempest-LiveAutoBlockMigrationV225Test-1918466308 None] Flow 'volume_create_manager' (a45784a7-a389-4567-ac47-2702c0225605) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 18 20:49:40.710737 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-0dab3317-58f9-4d2b-bef3-f13cf784390e tempest-LiveAutoBlockMigrationV225Test-1918466308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fbf41838-75a4-48e5-a38b-e20b96df9edc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 20:49:40.730020 ncdv-master-1 cinder-volume[134148]: DEBUG oslo_db.sqlalchemy.engines [None req-0dab3317-58f9-4d2b-bef3-f13cf784390e tempest-LiveAutoBlockMigrationV225Test-1918466308 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134148) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 18 20:49:40.745429 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-0dab3317-58f9-4d2b-bef3-f13cf784390e tempest-LiveAutoBlockMigrationV225Test-1918466308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fbf41838-75a4-48e5-a38b-e20b96df9edc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-12-18T20:49:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-993584206',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=087215d3-1650-420d-a00a-220eba1b1657,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a84b125f83d34481adc5617b5ca62e2e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-12-18T20:49:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-12-18T20:49:41Z,use_quota=True,user_id='8042de28328d4b26b910f1be4b499879',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f2e1fe1-9fd6-411e-9ed9-368f463ccb6f),volume_type_id=1f2e1fe1-9fd6-411e-9ed9-368f463ccb6f)' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 20:49:40.749720 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-0dab3317-58f9-4d2b-bef3-f13cf784390e tempest-LiveAutoBlockMigrationV225Test-1918466308 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c99ac4e0-06ae-452f-b309-bf8ea39f7e0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 20:49:40.753113 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-0dab3317-58f9-4d2b-bef3-f13cf784390e tempest-LiveAutoBlockMigrationV225Test-1918466308 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c99ac4e0-06ae-452f-b309-bf8ea39f7e0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 20:49:40.756241 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-0dab3317-58f9-4d2b-bef3-f13cf784390e tempest-LiveAutoBlockMigrationV225Test-1918466308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (544394ab-63f1-4dbc-9017-3d7244a97b18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 20:49:40.927196 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-0dab3317-58f9-4d2b-bef3-f13cf784390e tempest-LiveAutoBlockMigrationV225Test-1918466308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (544394ab-63f1-4dbc-9017-3d7244a97b18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '087215d3-1650-420d-a00a-220eba1b1657', 'volume_name': 'volume-087215d3-1650-420d-a00a-220eba1b1657', 'volume_size': 1, 'image_id': '394b3891-80f2-44c9-a9aa-56fe23a5acb3', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b04c3d19c79d4c208395e97f9d293618', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '394b3891-80f2-44c9-a9aa-56fe23a5acb3', 'created_at': datetime.datetime(2021, 12, 18, 20, 38, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 12, 18, 20, 38, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/394b3891-80f2-44c9-a9aa-56fe23a5acb3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 20:49:40.931506 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-0dab3317-58f9-4d2b-bef3-f13cf784390e tempest-LiveAutoBlockMigrationV225Test-1918466308 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c296ae7f-0fdf-4d66-819a-c9f9ecc39c40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 20:49:40.935760 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-0dab3317-58f9-4d2b-bef3-f13cf784390e tempest-LiveAutoBlockMigrationV225Test-1918466308 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c296ae7f-0fdf-4d66-819a-c9f9ecc39c40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 20:49:40.941020 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-0dab3317-58f9-4d2b-bef3-f13cf784390e tempest-LiveAutoBlockMigrationV225Test-1918466308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d15066c-79e4-440a-b7a8-e5e514379989) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 20:49:40.942790 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.flows.manager.create_volume [None req-0dab3317-58f9-4d2b-bef3-f13cf784390e tempest-LiveAutoBlockMigrationV225Test-1918466308 None] Volume 087215d3-1650-420d-a00a-220eba1b1657: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-087215d3-1650-420d-a00a-220eba1b1657', 'volume_size': 1, 'image_id': '394b3891-80f2-44c9-a9aa-56fe23a5acb3', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b04c3d19c79d4c208395e97f9d293618', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '394b3891-80f2-44c9-a9aa-56fe23a5acb3', 'created_at': datetime.datetime(2021, 12, 18, 20, 38, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 12, 18, 20, 38, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/394b3891-80f2-44c9-a9aa-56fe23a5acb3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Dec 18 20:49:40.943939 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.flows.manager.create_volume [None req-0dab3317-58f9-4d2b-bef3-f13cf784390e tempest-LiveAutoBlockMigrationV225Test-1918466308 None] Cloning 087215d3-1650-420d-a00a-220eba1b1657 from image 394b3891-80f2-44c9-a9aa-56fe23a5acb3 at location (None, None). {{(pid=134148) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1047}} Dec 18 20:49:59.456112 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.image.image_utils [None req-ae2cd4e8-0c2f-4732-968f-0df119f04f6b tempest-LiveMigrationTest-700829217 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_394b3891-80f2-44c9-a9aa-56fe23a5acb3_tfr7d3lrncdv-master-1@ceph, size 616.00 MB, duration 20.31 sec {{(pid=134148) fetch /opt/stack/cinder/cinder/image/image_utils.py:580}} Dec 18 20:49:59.457758 ncdv-master-1 cinder-volume[134148]: INFO cinder.image.image_utils [None req-ae2cd4e8-0c2f-4732-968f-0df119f04f6b tempest-LiveMigrationTest-700829217 None] Image download 616.00 MB at 30.32 MB/s Dec 18 20:49:59.538153 ncdv-master-1 cinder-volume[134148]: DEBUG oslo_concurrency.processutils [None req-ae2cd4e8-0c2f-4732-968f-0df119f04f6b tempest-LiveMigrationTest-700829217 None] Running cmd (subprocess): /usr/bin/python3.8 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_394b3891-80f2-44c9-a9aa-56fe23a5acb3_tfr7d3lrncdv-master-1@ceph {{(pid=134148) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Dec 18 20:49:59.773399 ncdv-master-1 sudo[144747]: ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_394b3891-80f2-44c9-a9aa-56fe23a5acb3_tfr7d3lrncdv-master-1@ceph Dec 18 20:49:59.774313 ncdv-master-1 sudo[144747]: pam_unix(sudo:session): session opened for user root by (uid=0) Dec 18 20:50:01.376806 ncdv-master-1 sudo[144747]: pam_unix(sudo:session): session closed for user root Dec 18 20:50:01.378971 ncdv-master-1 cinder-volume[134148]: DEBUG oslo_concurrency.processutils [None req-ae2cd4e8-0c2f-4732-968f-0df119f04f6b tempest-LiveMigrationTest-700829217 None] CMD "/usr/bin/python3.8 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_394b3891-80f2-44c9-a9aa-56fe23a5acb3_tfr7d3lrncdv-master-1@ceph" returned: 0 in 1.841s {{(pid=134148) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Dec 18 20:50:01.387954 ncdv-master-1 cinder-volume[134148]: WARNING py.warnings [None req-ae2cd4e8-0c2f-4732-968f-0df119f04f6b tempest-LiveMigrationTest-700829217 None] /usr/local/lib/python3.8/dist-packages/oslo_utils/imageutils.py:71: FutureWarning: The human format is deprecated and the format parameter will be removed. Use explicitly json instead in version 'xena' Dec 18 20:50:01.387954 ncdv-master-1 cinder-volume[134148]: debtcollector.deprecate( Dec 18 20:50:01.387954 ncdv-master-1 cinder-volume[134148]: Dec 18 20:50:01.388688 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.image.image_utils [None req-ae2cd4e8-0c2f-4732-968f-0df119f04f6b tempest-LiveMigrationTest-700829217 None] Temporary image 394b3891-80f2-44c9-a9aa-56fe23a5acb3 is fetched for user 5aaf1ced6baf4e1d9c940cfe96b2c254. {{(pid=134148) fetch /opt/stack/cinder/cinder/image/image_utils.py:1088}} Dec 18 20:50:01.519192 ncdv-master-1 cinder-volume[134148]: DEBUG oslo_concurrency.processutils [None req-ae2cd4e8-0c2f-4732-968f-0df119f04f6b tempest-LiveMigrationTest-700829217 None] Running cmd (subprocess): /usr/bin/python3.8 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_394b3891-80f2-44c9-a9aa-56fe23a5acb3_tfr7d3lrncdv-master-1@ceph {{(pid=134148) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Dec 18 20:50:01.950632 ncdv-master-1 sudo[144806]: ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_394b3891-80f2-44c9-a9aa-56fe23a5acb3_tfr7d3lrncdv-master-1@ceph Dec 18 20:50:01.951508 ncdv-master-1 sudo[144806]: pam_unix(sudo:session): session opened for user root by (uid=0) Dec 18 20:50:03.030478 ncdv-master-1 sudo[144806]: pam_unix(sudo:session): session closed for user root Dec 18 20:50:03.034137 ncdv-master-1 cinder-volume[134148]: DEBUG oslo_concurrency.processutils [None req-ae2cd4e8-0c2f-4732-968f-0df119f04f6b tempest-LiveMigrationTest-700829217 None] CMD "/usr/bin/python3.8 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_394b3891-80f2-44c9-a9aa-56fe23a5acb3_tfr7d3lrncdv-master-1@ceph" returned: 0 in 1.514s {{(pid=134148) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Dec 18 20:50:03.035099 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-ae2cd4e8-0c2f-4732-968f-0df119f04f6b tempest-LiveMigrationTest-700829217 None] creating volume 'volume-9f5f7417-3abc-4462-988f-ef519750d753' {{(pid=134148) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Dec 18 20:50:03.037016 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-ae2cd4e8-0c2f-4732-968f-0df119f04f6b tempest-LiveMigrationTest-700829217 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 20:50:03.189524 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-ae2cd4e8-0c2f-4732-968f-0df119f04f6b tempest-LiveMigrationTest-700829217 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134148) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 18 20:50:03.190595 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-ae2cd4e8-0c2f-4732-968f-0df119f04f6b tempest-LiveMigrationTest-700829217 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134148) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 18 20:50:03.220296 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.volume_utils [None req-ae2cd4e8-0c2f-4732-968f-0df119f04f6b tempest-LiveMigrationTest-700829217 None] Attempting download of 394b3891-80f2-44c9-a9aa-56fe23a5acb3 ((None, None)) to volume 9f5f7417-3abc-4462-988f-ef519750d753. {{(pid=134148) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1228}} Dec 18 20:50:03.280454 ncdv-master-1 cinder-volume[134148]: DEBUG oslo_concurrency.processutils [None req-ae2cd4e8-0c2f-4732-968f-0df119f04f6b tempest-LiveMigrationTest-700829217 None] Running cmd (subprocess): /usr/bin/python3.8 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_download_394b3891-80f2-44c9-a9aa-56fe23a5acb3__e3ejtgp {{(pid=134148) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Dec 18 20:50:03.416062 ncdv-master-1 sudo[144882]: ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_download_394b3891-80f2-44c9-a9aa-56fe23a5acb3__e3ejtgp Dec 18 20:50:03.416887 ncdv-master-1 sudo[144882]: pam_unix(sudo:session): session opened for user root by (uid=0) Dec 18 20:50:04.385946 ncdv-master-1 sudo[144882]: pam_unix(sudo:session): session closed for user root Dec 18 20:50:04.389375 ncdv-master-1 cinder-volume[134148]: DEBUG oslo_concurrency.processutils [None req-ae2cd4e8-0c2f-4732-968f-0df119f04f6b tempest-LiveMigrationTest-700829217 None] CMD "/usr/bin/python3.8 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_download_394b3891-80f2-44c9-a9aa-56fe23a5acb3__e3ejtgp" returned: 0 in 1.107s {{(pid=134148) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Dec 18 20:50:04.392444 ncdv-master-1 cinder-volume[134148]: DEBUG oslo_concurrency.processutils [None req-ae2cd4e8-0c2f-4732-968f-0df119f04f6b tempest-LiveMigrationTest-700829217 None] Running cmd (subprocess): /usr/bin/python3.8 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_394b3891-80f2-44c9-a9aa-56fe23a5acb3_tfr7d3lrncdv-master-1@ceph {{(pid=134148) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Dec 18 20:50:04.656582 ncdv-master-1 sudo[144910]: ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_394b3891-80f2-44c9-a9aa-56fe23a5acb3_tfr7d3lrncdv-master-1@ceph Dec 18 20:50:04.660172 ncdv-master-1 sudo[144910]: pam_unix(sudo:session): session opened for user root by (uid=0) Dec 18 20:50:05.777768 ncdv-master-1 sudo[144910]: pam_unix(sudo:session): session closed for user root Dec 18 20:50:05.780027 ncdv-master-1 cinder-volume[134148]: DEBUG oslo_concurrency.processutils [None req-ae2cd4e8-0c2f-4732-968f-0df119f04f6b tempest-LiveMigrationTest-700829217 None] CMD "/usr/bin/python3.8 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_394b3891-80f2-44c9-a9aa-56fe23a5acb3_tfr7d3lrncdv-master-1@ceph" returned: 0 in 1.387s {{(pid=134148) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Dec 18 20:50:05.782575 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.image.image_utils [None req-ae2cd4e8-0c2f-4732-968f-0df119f04f6b tempest-LiveMigrationTest-700829217 None] 394b3891-80f2-44c9-a9aa-56fe23a5acb3 was vhdx, converting to raw {{(pid=134148) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:793}} Dec 18 20:50:05.784677 ncdv-master-1 cinder-volume[134148]: DEBUG oslo_concurrency.processutils [None req-ae2cd4e8-0c2f-4732-968f-0df119f04f6b tempest-LiveMigrationTest-700829217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f vhdx /opt/stack/data/cinder/conversion/image_fetch_394b3891-80f2-44c9-a9aa-56fe23a5acb3_tfr7d3lrncdv-master-1@ceph /opt/stack/data/cinder/conversion/tmprq5zoyuy {{(pid=134148) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Dec 18 20:50:05.872415 ncdv-master-1 sudo[144990]: ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f vhdx /opt/stack/data/cinder/conversion/image_fetch_394b3891-80f2-44c9-a9aa-56fe23a5acb3_tfr7d3lrncdv-master-1@ceph /opt/stack/data/cinder/conversion/tmprq5zoyuy Dec 18 20:50:05.883945 ncdv-master-1 sudo[144990]: pam_unix(sudo:session): session opened for user root by (uid=0) Dec 18 20:50:08.674517 ncdv-master-1 sudo[144990]: pam_unix(sudo:session): session closed for user root Dec 18 20:50:08.677812 ncdv-master-1 cinder-volume[134148]: DEBUG oslo_concurrency.processutils [None req-ae2cd4e8-0c2f-4732-968f-0df119f04f6b tempest-LiveMigrationTest-700829217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f vhdx /opt/stack/data/cinder/conversion/image_fetch_394b3891-80f2-44c9-a9aa-56fe23a5acb3_tfr7d3lrncdv-master-1@ceph /opt/stack/data/cinder/conversion/tmprq5zoyuy" returned: 0 in 2.894s {{(pid=134148) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Dec 18 20:50:08.681315 ncdv-master-1 cinder-volume[134148]: DEBUG oslo_concurrency.processutils [None req-ae2cd4e8-0c2f-4732-968f-0df119f04f6b tempest-LiveMigrationTest-700829217 None] Running cmd (subprocess): /usr/bin/python3.8 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_394b3891-80f2-44c9-a9aa-56fe23a5acb3_tfr7d3lrncdv-master-1@ceph {{(pid=134148) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Dec 18 20:50:08.876248 ncdv-master-1 sudo[145096]: ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_394b3891-80f2-44c9-a9aa-56fe23a5acb3_tfr7d3lrncdv-master-1@ceph Dec 18 20:50:08.877886 ncdv-master-1 sudo[145096]: pam_unix(sudo:session): session opened for user root by (uid=0) Dec 18 20:50:09.790173 ncdv-master-1 sudo[145096]: pam_unix(sudo:session): session closed for user root Dec 18 20:50:09.792247 ncdv-master-1 cinder-volume[134148]: DEBUG oslo_concurrency.processutils [None req-ae2cd4e8-0c2f-4732-968f-0df119f04f6b tempest-LiveMigrationTest-700829217 None] CMD "/usr/bin/python3.8 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_394b3891-80f2-44c9-a9aa-56fe23a5acb3_tfr7d3lrncdv-master-1@ceph" returned: 0 in 1.111s {{(pid=134148) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Dec 18 20:50:09.793678 ncdv-master-1 cinder-volume[134148]: WARNING py.warnings [None req-ae2cd4e8-0c2f-4732-968f-0df119f04f6b tempest-LiveMigrationTest-700829217 None] /usr/local/lib/python3.8/dist-packages/oslo_utils/imageutils.py:71: FutureWarning: The human format is deprecated and the format parameter will be removed. Use explicitly json instead in version 'xena' Dec 18 20:50:09.793678 ncdv-master-1 cinder-volume[134148]: debtcollector.deprecate( Dec 18 20:50:09.793678 ncdv-master-1 cinder-volume[134148]: Dec 18 20:50:09.794823 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.image.image_utils [None req-ae2cd4e8-0c2f-4732-968f-0df119f04f6b tempest-LiveMigrationTest-700829217 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_394b3891-80f2-44c9-a9aa-56fe23a5acb3_tfr7d3lrncdv-master-1@ceph, size 700.00 MB, duration 2.90 sec, destination /opt/stack/data/cinder/conversion/tmprq5zoyuy {{(pid=134148) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:412}} Dec 18 20:50:09.795696 ncdv-master-1 cinder-volume[134148]: INFO cinder.image.image_utils [None req-ae2cd4e8-0c2f-4732-968f-0df119f04f6b tempest-LiveMigrationTest-700829217 None] Converted 700.00 MB image at 241.61 MB/s Dec 18 20:50:09.797266 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-ae2cd4e8-0c2f-4732-968f-0df119f04f6b tempest-LiveMigrationTest-700829217 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 20:50:09.874159 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-ae2cd4e8-0c2f-4732-968f-0df119f04f6b tempest-LiveMigrationTest-700829217 None] volume has no backup snaps {{(pid=134148) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Dec 18 20:50:09.874957 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-ae2cd4e8-0c2f-4732-968f-0df119f04f6b tempest-LiveMigrationTest-700829217 None] Volume volume-9f5f7417-3abc-4462-988f-ef519750d753 is not a clone. {{(pid=134148) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Dec 18 20:50:09.883925 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-ae2cd4e8-0c2f-4732-968f-0df119f04f6b tempest-LiveMigrationTest-700829217 None] deleting rbd volume volume-9f5f7417-3abc-4462-988f-ef519750d753 {{(pid=134148) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Dec 18 20:50:10.205182 ncdv-master-1 cinder-volume[134148]: DEBUG oslo_concurrency.processutils [None req-ae2cd4e8-0c2f-4732-968f-0df119f04f6b tempest-LiveMigrationTest-700829217 None] Running cmd (subprocess): rbd import --pool volumes --order 22 /opt/stack/data/cinder/conversion/tmprq5zoyuy volume-9f5f7417-3abc-4462-988f-ef519750d753 --new-format --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=134148) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Dec 18 20:50:16.586002 ncdv-master-1 cinder-volume[134148]: DEBUG oslo_concurrency.processutils [None req-ae2cd4e8-0c2f-4732-968f-0df119f04f6b tempest-LiveMigrationTest-700829217 None] CMD "rbd import --pool volumes --order 22 /opt/stack/data/cinder/conversion/tmprq5zoyuy volume-9f5f7417-3abc-4462-988f-ef519750d753 --new-format --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 6.381s {{(pid=134148) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Dec 18 20:50:16.963009 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-ae2cd4e8-0c2f-4732-968f-0df119f04f6b tempest-LiveMigrationTest-700829217 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 20:50:17.228851 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-ae2cd4e8-0c2f-4732-968f-0df119f04f6b tempest-LiveMigrationTest-700829217 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134148) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 18 20:50:17.229239 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-ae2cd4e8-0c2f-4732-968f-0df119f04f6b tempest-LiveMigrationTest-700829217 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134148) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 18 20:50:17.229678 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.volume_utils [None req-ae2cd4e8-0c2f-4732-968f-0df119f04f6b tempest-LiveMigrationTest-700829217 None] Downloaded image 394b3891-80f2-44c9-a9aa-56fe23a5acb3 ((None, None)) to volume 9f5f7417-3abc-4462-988f-ef519750d753 successfully. {{(pid=134148) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1268}} Dec 18 20:50:17.381428 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.image.image_utils [None req-ae2cd4e8-0c2f-4732-968f-0df119f04f6b tempest-LiveMigrationTest-700829217 None] Temporary image 394b3891-80f2-44c9-a9aa-56fe23a5acb3 for user 5aaf1ced6baf4e1d9c940cfe96b2c254 is deleted. {{(pid=134148) fetch /opt/stack/cinder/cinder/image/image_utils.py:1092}} Dec 18 20:50:17.672062 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.quota [None req-ae2cd4e8-0c2f-4732-968f-0df119f04f6b tempest-LiveMigrationTest-700829217 None] Created reservations ['af05daa7-a73d-4a2b-af45-ae3ac1fa1102', 'ab174ac5-579e-4498-bfca-cf4b0b0b563f', '41554823-93cc-49ea-9f68-b9a496d707c8', '51d6d0c8-7146-4380-a8f6-fac49b67eb0e'] {{(pid=134148) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 18 20:50:17.760154 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-ae2cd4e8-0c2f-4732-968f-0df119f04f6b tempest-LiveMigrationTest-700829217 None] Creating image volume entry: {'deleted': False, 'encryption_key_id': None, 'shared_targets': True, 'provider_auth': None, 'availability_zone': 'nova', 'volume_metadata': [], 'cluster_name': None, 'user_id': '5aaf1ced6baf4e1d9c940cfe96b2c254', 'scheduled_at': datetime.datetime(2021, 12, 18, 20, 49, 39, tzinfo=datetime.timezone.utc), 'display_description': None, 'metadata': {}, 'volume_admin_metadata': [], 'size': 1, 'updated_at': datetime.datetime(2021, 12, 18, 20, 49, 39, tzinfo=datetime.timezone.utc), 'launched_at': None, 'replication_driver_data': None, 'service_uuid': None, 'consistencygroup_id': None, 'group_id': None, 'replication_extended_status': None, 'provider_location': None, 'host': 'ncdv-master-1@ceph#ceph', 'provider_id': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'terminated_at': None, 'created_at': datetime.datetime(2021, 12, 18, 20, 49, 38, tzinfo=datetime.timezone.utc), 'ec2_id': None, 'bootable': False, 'volume_type_id': '1f2e1fe1-9fd6-411e-9ed9-368f463ccb6f', 'display_name': 'image-394b3891-80f2-44c9-a9aa-56fe23a5acb3', 'previous_status': None, 'provider_geometry': None, 'multiattach': False, 'volume_glance_metadata': [{'key': 'signature_verified', 'value': 'False'}], 'replication_status': None, 'deleted_at': None, 'attach_status': 'detached', 'status': 'creating', 'source_volid': '9f5f7417-3abc-4462-988f-ef519750d753'}. {{(pid=134148) _clone_image_volume /opt/stack/cinder/cinder/volume/manager.py:1616}} Dec 18 20:50:17.886382 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.flows.manager.create_volume [None req-ae2cd4e8-0c2f-4732-968f-0df119f04f6b tempest-LiveMigrationTest-700829217 None] Volume reschedule parameters: False retry: None {{(pid=134148) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Dec 18 20:50:17.894216 ncdv-master-1 cinder-volume[134148]: WARNING stevedore.named [None req-ae2cd4e8-0c2f-4732-968f-0df119f04f6b tempest-LiveMigrationTest-700829217 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Dec 18 20:50:17.896549 ncdv-master-1 cinder-volume[134148]: WARNING castellan.key_manager [None req-ae2cd4e8-0c2f-4732-968f-0df119f04f6b tempest-LiveMigrationTest-700829217 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Dec 18 20:50:17.930345 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-ae2cd4e8-0c2f-4732-968f-0df119f04f6b tempest-LiveMigrationTest-700829217 None] Flow 'volume_create_manager' (1e939d72-0f54-45b2-9b25-4b83f2e9f9a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 18 20:50:17.934646 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-ae2cd4e8-0c2f-4732-968f-0df119f04f6b tempest-LiveMigrationTest-700829217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff23bd36-989b-410f-bf7a-d78d9c51fa4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 20:50:17.956238 ncdv-master-1 cinder-volume[134148]: DEBUG oslo_db.sqlalchemy.engines [None req-ae2cd4e8-0c2f-4732-968f-0df119f04f6b tempest-LiveMigrationTest-700829217 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134148) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 18 20:50:17.977058 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-ae2cd4e8-0c2f-4732-968f-0df119f04f6b tempest-LiveMigrationTest-700829217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff23bd36-989b-410f-bf7a-d78d9c51fa4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-12-18T20:49:38Z,deleted=False,deleted_at=None,display_description=None,display_name='image-394b3891-80f2-44c9-a9aa-56fe23a5acb3',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=e6411a45-48fa-4beb-a5a0-eb6a6ca3f525,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0dd4d15f423642fa8da604b758048203',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-12-18T20:49:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=9f5f7417-3abc-4462-988f-ef519750d753,status='creating',terminated_at=None,updated_at=2021-12-18T20:49:39Z,use_quota=True,user_id='5aaf1ced6baf4e1d9c940cfe96b2c254',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f2e1fe1-9fd6-411e-9ed9-368f463ccb6f),volume_type_id=1f2e1fe1-9fd6-411e-9ed9-368f463ccb6f)' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 20:50:17.990904 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-ae2cd4e8-0c2f-4732-968f-0df119f04f6b tempest-LiveMigrationTest-700829217 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63470f4a-2a9f-4d56-8145-1b4bdbbb59c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 20:50:17.995564 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-ae2cd4e8-0c2f-4732-968f-0df119f04f6b tempest-LiveMigrationTest-700829217 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63470f4a-2a9f-4d56-8145-1b4bdbbb59c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 20:50:18.002309 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-ae2cd4e8-0c2f-4732-968f-0df119f04f6b tempest-LiveMigrationTest-700829217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5efe6c9e-3150-4600-bda3-60dcab680057) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 20:50:18.036067 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-ae2cd4e8-0c2f-4732-968f-0df119f04f6b tempest-LiveMigrationTest-700829217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5efe6c9e-3150-4600-bda3-60dcab680057) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'e6411a45-48fa-4beb-a5a0-eb6a6ca3f525', 'volume_name': 'volume-e6411a45-48fa-4beb-a5a0-eb6a6ca3f525', 'volume_size': 1, 'source_volid': '9f5f7417-3abc-4462-988f-ef519750d753', 'source_volstatus': 'downloading'}' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 20:50:18.039678 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-ae2cd4e8-0c2f-4732-968f-0df119f04f6b tempest-LiveMigrationTest-700829217 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1fd8e544-56d1-4522-9150-8c6473d21354) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 20:50:18.046183 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-ae2cd4e8-0c2f-4732-968f-0df119f04f6b tempest-LiveMigrationTest-700829217 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1fd8e544-56d1-4522-9150-8c6473d21354) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 20:50:18.054939 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-ae2cd4e8-0c2f-4732-968f-0df119f04f6b tempest-LiveMigrationTest-700829217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc4b0c1b-3419-4a59-9abb-acf3142843f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 20:50:18.056181 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.flows.manager.create_volume [None req-ae2cd4e8-0c2f-4732-968f-0df119f04f6b tempest-LiveMigrationTest-700829217 None] Volume e6411a45-48fa-4beb-a5a0-eb6a6ca3f525: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-e6411a45-48fa-4beb-a5a0-eb6a6ca3f525', 'volume_size': 1, 'source_volid': '9f5f7417-3abc-4462-988f-ef519750d753', 'source_volstatus': 'downloading'} Dec 18 20:50:18.094858 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-ae2cd4e8-0c2f-4732-968f-0df119f04f6b tempest-LiveMigrationTest-700829217 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 20:50:18.197064 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-ae2cd4e8-0c2f-4732-968f-0df119f04f6b tempest-LiveMigrationTest-700829217 None] creating snapshot='volume-e6411a45-48fa-4beb-a5a0-eb6a6ca3f525.clone_snap' {{(pid=134148) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:725}} Dec 18 20:50:19.231012 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-ae2cd4e8-0c2f-4732-968f-0df119f04f6b tempest-LiveMigrationTest-700829217 None] cloning 'volume-9f5f7417-3abc-4462-988f-ef519750d753@volume-e6411a45-48fa-4beb-a5a0-eb6a6ca3f525.clone_snap' to 'volume-e6411a45-48fa-4beb-a5a0-eb6a6ca3f525' {{(pid=134148) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:731}} Dec 18 20:50:19.400774 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-ae2cd4e8-0c2f-4732-968f-0df119f04f6b tempest-LiveMigrationTest-700829217 None] Volume volume-9f5f7417-3abc-4462-988f-ef519750d753 is not a clone. {{(pid=134148) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Dec 18 20:50:19.402015 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-ae2cd4e8-0c2f-4732-968f-0df119f04f6b tempest-LiveMigrationTest-700829217 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134148) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 18 20:50:19.402547 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-ae2cd4e8-0c2f-4732-968f-0df119f04f6b tempest-LiveMigrationTest-700829217 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134148) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 18 20:50:19.451783 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-ae2cd4e8-0c2f-4732-968f-0df119f04f6b tempest-LiveMigrationTest-700829217 None] clone created successfully {{(pid=134148) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:803}} Dec 18 20:50:19.464780 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-ae2cd4e8-0c2f-4732-968f-0df119f04f6b tempest-LiveMigrationTest-700829217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc4b0c1b-3419-4a59-9abb-acf3142843f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e6411a45-48fa-4beb-a5a0-eb6a6ca3f525', 'volume_size': 1, 'source_volid': '9f5f7417-3abc-4462-988f-ef519750d753', 'source_volstatus': 'downloading'}' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 20:50:19.468951 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-ae2cd4e8-0c2f-4732-968f-0df119f04f6b tempest-LiveMigrationTest-700829217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a58c4d08-b284-420c-a219-910babed54b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 20:50:19.504373 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.flows.manager.create_volume [None req-ae2cd4e8-0c2f-4732-968f-0df119f04f6b tempest-LiveMigrationTest-700829217 None] Volume volume-e6411a45-48fa-4beb-a5a0-eb6a6ca3f525 (e6411a45-48fa-4beb-a5a0-eb6a6ca3f525): created successfully Dec 18 20:50:19.506580 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-ae2cd4e8-0c2f-4732-968f-0df119f04f6b tempest-LiveMigrationTest-700829217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a58c4d08-b284-420c-a219-910babed54b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 20:50:19.512862 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-ae2cd4e8-0c2f-4732-968f-0df119f04f6b tempest-LiveMigrationTest-700829217 None] Flow 'volume_create_manager' (1e939d72-0f54-45b2-9b25-4b83f2e9f9a2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134148) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 18 20:50:19.535980 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-ae2cd4e8-0c2f-4732-968f-0df119f04f6b tempest-LiveMigrationTest-700829217 None] Created volume successfully. Dec 18 20:50:19.601153 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.image.cache [None req-ae2cd4e8-0c2f-4732-968f-0df119f04f6b tempest-LiveMigrationTest-700829217 None] Creating new image-volume cache entry for image 394b3891-80f2-44c9-a9aa-56fe23a5acb3 on ncdv-master-1@ceph#ceph {{(pid=134148) create_cache_entry /opt/stack/cinder/cinder/image/cache.py:104}} Dec 18 20:50:19.614795 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.image.cache [None req-ae2cd4e8-0c2f-4732-968f-0df119f04f6b tempest-LiveMigrationTest-700829217 None] New image-volume cache entry created: {'id': 1, 'image_id': '394b3891-80f2-44c9-a9aa-56fe23a5acb3', 'volume_id': 'e6411a45-48fa-4beb-a5a0-eb6a6ca3f525', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2021, 12, 18, 20, 38, 21), 'last_used': datetime.datetime(2021, 12, 18, 20, 50, 19, 605425)}. {{(pid=134148) create_cache_entry /opt/stack/cinder/cinder/image/cache.py:129}} Dec 18 20:50:19.620899 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.coordination [None req-ae2cd4e8-0c2f-4732-968f-0df119f04f6b tempest-LiveMigrationTest-700829217 None] Lock "b'cinder-394b3891-80f2-44c9-a9aa-56fe23a5acb3'" released by "_prepare_image_cache_entry" :: held 40.510s {{(pid=134148) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 18 20:50:19.621419 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.volume_utils [None req-ae2cd4e8-0c2f-4732-968f-0df119f04f6b tempest-LiveMigrationTest-700829217 None] Marking volume 9f5f7417-3abc-4462-988f-ef519750d753 as bootable. {{(pid=134148) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1178}} Dec 18 20:50:19.640142 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.flows.manager.create_volume [None req-ae2cd4e8-0c2f-4732-968f-0df119f04f6b tempest-LiveMigrationTest-700829217 None] Copying metadata from image 394b3891-80f2-44c9-a9aa-56fe23a5acb3 to 9f5f7417-3abc-4462-988f-ef519750d753. {{(pid=134148) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:444}} Dec 18 20:50:19.640775 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.flows.manager.create_volume [None req-ae2cd4e8-0c2f-4732-968f-0df119f04f6b tempest-LiveMigrationTest-700829217 None] Creating volume glance metadata for volume 9f5f7417-3abc-4462-988f-ef519750d753 backed by image 394b3891-80f2-44c9-a9aa-56fe23a5acb3 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '394b3891-80f2-44c9-a9aa-56fe23a5acb3', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=134148) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:667}} Dec 18 20:50:19.805262 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-ae2cd4e8-0c2f-4732-968f-0df119f04f6b tempest-LiveMigrationTest-700829217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6fd61458-2b71-4558-943a-3c09b4220048) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9f5f7417-3abc-4462-988f-ef519750d753', 'volume_size': 1, 'image_id': '394b3891-80f2-44c9-a9aa-56fe23a5acb3', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b04c3d19c79d4c208395e97f9d293618', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '394b3891-80f2-44c9-a9aa-56fe23a5acb3', 'created_at': datetime.datetime(2021, 12, 18, 20, 38, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 12, 18, 20, 38, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/394b3891-80f2-44c9-a9aa-56fe23a5acb3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 20:50:19.812968 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-ae2cd4e8-0c2f-4732-968f-0df119f04f6b tempest-LiveMigrationTest-700829217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51528f46-e23f-40c6-9dd1-1a0a478648f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 20:50:19.834242 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.flows.manager.create_volume [None req-ae2cd4e8-0c2f-4732-968f-0df119f04f6b tempest-LiveMigrationTest-700829217 None] Volume volume-9f5f7417-3abc-4462-988f-ef519750d753 (9f5f7417-3abc-4462-988f-ef519750d753): created successfully Dec 18 20:50:19.836287 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-ae2cd4e8-0c2f-4732-968f-0df119f04f6b tempest-LiveMigrationTest-700829217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51528f46-e23f-40c6-9dd1-1a0a478648f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 20:50:19.839293 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-ae2cd4e8-0c2f-4732-968f-0df119f04f6b tempest-LiveMigrationTest-700829217 None] Flow 'volume_create_manager' (225ebd3e-cfa3-4575-bf2a-f17f3f71daa6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134148) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 18 20:50:19.853157 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-ae2cd4e8-0c2f-4732-968f-0df119f04f6b tempest-LiveMigrationTest-700829217 None] Created volume successfully. Dec 18 20:50:20.286607 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.coordination [None req-0dab3317-58f9-4d2b-bef3-f13cf784390e tempest-LiveAutoBlockMigrationV225Test-1918466308 None] Lock "b'cinder-394b3891-80f2-44c9-a9aa-56fe23a5acb3'" acquired by "_prepare_image_cache_entry" :: waited 39.341s {{(pid=134148) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 18 20:50:20.302671 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.image.cache [None req-0dab3317-58f9-4d2b-bef3-f13cf784390e tempest-LiveAutoBlockMigrationV225Test-1918466308 None] Found image-volume cache entry: {'id': 1, 'image_id': '394b3891-80f2-44c9-a9aa-56fe23a5acb3', 'volume_id': 'e6411a45-48fa-4beb-a5a0-eb6a6ca3f525', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2021, 12, 18, 20, 38, 21), 'last_used': datetime.datetime(2021, 12, 18, 20, 50, 20, 293029)}. {{(pid=134148) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Dec 18 20:50:20.303767 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.image.cache [None req-0dab3317-58f9-4d2b-bef3-f13cf784390e tempest-LiveAutoBlockMigrationV225Test-1918466308 None] Image-volume cache entry image_update_at = 2021-12-18 20:38:21+00:00, requested image updated_at = 2021-12-18 20:38:21+00:00. {{(pid=134148) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Dec 18 20:50:20.304416 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.flows.manager.create_volume [None req-0dab3317-58f9-4d2b-bef3-f13cf784390e tempest-LiveAutoBlockMigrationV225Test-1918466308 None] Found cache entry for image = 394b3891-80f2-44c9-a9aa-56fe23a5acb3 on host ncdv-master-1@ceph#ceph. {{(pid=134148) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:870}} Dec 18 20:50:20.314367 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.coordination [None req-0dab3317-58f9-4d2b-bef3-f13cf784390e tempest-LiveAutoBlockMigrationV225Test-1918466308 None] Lock "b'cinder-394b3891-80f2-44c9-a9aa-56fe23a5acb3'" released by "_prepare_image_cache_entry" :: held 0.028s {{(pid=134148) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 18 20:50:20.315532 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.flows.manager.create_volume [None req-0dab3317-58f9-4d2b-bef3-f13cf784390e tempest-LiveAutoBlockMigrationV225Test-1918466308 None] Attempting to retrieve cache entry for image = 394b3891-80f2-44c9-a9aa-56fe23a5acb3 on host ncdv-master-1@ceph#ceph. {{(pid=134148) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:811}} Dec 18 20:50:20.328630 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.image.cache [None req-0dab3317-58f9-4d2b-bef3-f13cf784390e tempest-LiveAutoBlockMigrationV225Test-1918466308 None] Found image-volume cache entry: {'id': 1, 'image_id': '394b3891-80f2-44c9-a9aa-56fe23a5acb3', 'volume_id': 'e6411a45-48fa-4beb-a5a0-eb6a6ca3f525', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2021, 12, 18, 20, 38, 21), 'last_used': datetime.datetime(2021, 12, 18, 20, 50, 20, 322459)}. {{(pid=134148) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Dec 18 20:50:20.330825 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.image.cache [None req-0dab3317-58f9-4d2b-bef3-f13cf784390e tempest-LiveAutoBlockMigrationV225Test-1918466308 None] Image-volume cache entry image_update_at = 2021-12-18 20:38:21+00:00, requested image updated_at = 2021-12-18 20:38:21+00:00. {{(pid=134148) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Dec 18 20:50:20.331382 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.flows.manager.create_volume [None req-0dab3317-58f9-4d2b-bef3-f13cf784390e tempest-LiveAutoBlockMigrationV225Test-1918466308 None] Creating from source image-volume e6411a45-48fa-4beb-a5a0-eb6a6ca3f525 {{(pid=134148) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:825}} Dec 18 20:50:20.355342 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-0dab3317-58f9-4d2b-bef3-f13cf784390e tempest-LiveAutoBlockMigrationV225Test-1918466308 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 20:50:20.449760 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-0dab3317-58f9-4d2b-bef3-f13cf784390e tempest-LiveAutoBlockMigrationV225Test-1918466308 None] creating snapshot='volume-087215d3-1650-420d-a00a-220eba1b1657.clone_snap' {{(pid=134148) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:725}} Dec 18 20:50:21.284970 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-0dab3317-58f9-4d2b-bef3-f13cf784390e tempest-LiveAutoBlockMigrationV225Test-1918466308 None] cloning 'volume-e6411a45-48fa-4beb-a5a0-eb6a6ca3f525@volume-087215d3-1650-420d-a00a-220eba1b1657.clone_snap' to 'volume-087215d3-1650-420d-a00a-220eba1b1657' {{(pid=134148) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:731}} Dec 18 20:50:21.493433 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-0dab3317-58f9-4d2b-bef3-f13cf784390e tempest-LiveAutoBlockMigrationV225Test-1918466308 None] Volume volume-9f5f7417-3abc-4462-988f-ef519750d753 is not a clone. {{(pid=134148) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Dec 18 20:50:21.495417 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-0dab3317-58f9-4d2b-bef3-f13cf784390e tempest-LiveAutoBlockMigrationV225Test-1918466308 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134148) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 18 20:50:21.496032 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-0dab3317-58f9-4d2b-bef3-f13cf784390e tempest-LiveAutoBlockMigrationV225Test-1918466308 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134148) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 18 20:50:21.525130 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-0dab3317-58f9-4d2b-bef3-f13cf784390e tempest-LiveAutoBlockMigrationV225Test-1918466308 None] clone created successfully {{(pid=134148) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:803}} Dec 18 20:50:21.526240 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.volume_utils [None req-0dab3317-58f9-4d2b-bef3-f13cf784390e tempest-LiveAutoBlockMigrationV225Test-1918466308 None] Marking volume 087215d3-1650-420d-a00a-220eba1b1657 as bootable. {{(pid=134148) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1178}} Dec 18 20:50:21.538897 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.flows.manager.create_volume [None req-0dab3317-58f9-4d2b-bef3-f13cf784390e tempest-LiveAutoBlockMigrationV225Test-1918466308 None] Copying metadata from image 394b3891-80f2-44c9-a9aa-56fe23a5acb3 to 087215d3-1650-420d-a00a-220eba1b1657. {{(pid=134148) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:444}} Dec 18 20:50:21.540034 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.flows.manager.create_volume [None req-0dab3317-58f9-4d2b-bef3-f13cf784390e tempest-LiveAutoBlockMigrationV225Test-1918466308 None] Creating volume glance metadata for volume 087215d3-1650-420d-a00a-220eba1b1657 backed by image 394b3891-80f2-44c9-a9aa-56fe23a5acb3 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '394b3891-80f2-44c9-a9aa-56fe23a5acb3', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=134148) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:667}} Dec 18 20:50:21.633445 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-0dab3317-58f9-4d2b-bef3-f13cf784390e tempest-LiveAutoBlockMigrationV225Test-1918466308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d15066c-79e4-440a-b7a8-e5e514379989) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-087215d3-1650-420d-a00a-220eba1b1657', 'volume_size': 1, 'image_id': '394b3891-80f2-44c9-a9aa-56fe23a5acb3', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b04c3d19c79d4c208395e97f9d293618', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '394b3891-80f2-44c9-a9aa-56fe23a5acb3', 'created_at': datetime.datetime(2021, 12, 18, 20, 38, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 12, 18, 20, 38, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/394b3891-80f2-44c9-a9aa-56fe23a5acb3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 20:50:21.637056 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-0dab3317-58f9-4d2b-bef3-f13cf784390e tempest-LiveAutoBlockMigrationV225Test-1918466308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (729cd40a-2acd-47c9-9d8c-e5ba07da48f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 20:50:21.647339 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.flows.manager.create_volume [None req-0dab3317-58f9-4d2b-bef3-f13cf784390e tempest-LiveAutoBlockMigrationV225Test-1918466308 None] Volume volume-087215d3-1650-420d-a00a-220eba1b1657 (087215d3-1650-420d-a00a-220eba1b1657): created successfully Dec 18 20:50:21.653208 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-0dab3317-58f9-4d2b-bef3-f13cf784390e tempest-LiveAutoBlockMigrationV225Test-1918466308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (729cd40a-2acd-47c9-9d8c-e5ba07da48f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 20:50:21.659598 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-0dab3317-58f9-4d2b-bef3-f13cf784390e tempest-LiveAutoBlockMigrationV225Test-1918466308 None] Flow 'volume_create_manager' (a45784a7-a389-4567-ac47-2702c0225605) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134148) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 18 20:50:21.669529 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-0dab3317-58f9-4d2b-bef3-f13cf784390e tempest-LiveAutoBlockMigrationV225Test-1918466308 None] Created volume successfully. Dec 18 20:50:24.904055 ncdv-master-1 cinder-volume[134148]: DEBUG oslo_concurrency.processutils [req-f009b382-05af-4b1e-bf5f-800ceae8144d req-017e743f-b21a-433c-9f18-6f508bbdd98f tempest-LiveMigrationTest-700829217 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=134148) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Dec 18 20:50:25.905121 ncdv-master-1 cinder-volume[134148]: DEBUG oslo_concurrency.processutils [req-f009b382-05af-4b1e-bf5f-800ceae8144d req-017e743f-b21a-433c-9f18-6f508bbdd98f tempest-LiveMigrationTest-700829217 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.001s {{(pid=134148) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Dec 18 20:50:25.906576 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [req-f009b382-05af-4b1e-bf5f-800ceae8144d req-017e743f-b21a-433c-9f18-6f508bbdd98f tempest-LiveMigrationTest-700829217 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-9f5f7417-3abc-4462-988f-ef519750d753', 'hosts': ['10.222.0.13'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '946d1715-d12c-4dbf-8a79-181222df6e2e', 'volume_id': '9f5f7417-3abc-4462-988f-ef519750d753', 'discard': True}} {{(pid=134148) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Dec 18 20:50:25.935549 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [req-f009b382-05af-4b1e-bf5f-800ceae8144d req-017e743f-b21a-433c-9f18-6f508bbdd98f tempest-LiveMigrationTest-700829217 None] Connection info returned from driver {'name': 'volumes/volume-9f5f7417-3abc-4462-988f-ef519750d753', 'hosts': ['10.222.0.13'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '9f5f7417-3abc-4462-988f-ef519750d753', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '2ab417c4-6f38-4b3a-9207-380dacd3a2b4'} {{(pid=134148) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4812}} Dec 18 20:50:26.002535 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [req-f009b382-05af-4b1e-bf5f-800ceae8144d req-017e743f-b21a-433c-9f18-6f508bbdd98f tempest-LiveMigrationTest-700829217 None] attachment_update completed successfully. Dec 18 20:50:28.639624 ncdv-master-1 cinder-volume[134148]: DEBUG oslo_concurrency.processutils [req-4f0c2e19-4858-46b5-983f-161c0fce57ad req-32d6a67a-0a13-48a4-8acd-db0c51d8c22f tempest-LiveAutoBlockMigrationV225Test-1918466308 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=134148) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Dec 18 20:50:29.623159 ncdv-master-1 cinder-volume[134148]: DEBUG oslo_concurrency.processutils [req-4f0c2e19-4858-46b5-983f-161c0fce57ad req-32d6a67a-0a13-48a4-8acd-db0c51d8c22f tempest-LiveAutoBlockMigrationV225Test-1918466308 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.983s {{(pid=134148) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Dec 18 20:50:29.625564 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [req-4f0c2e19-4858-46b5-983f-161c0fce57ad req-32d6a67a-0a13-48a4-8acd-db0c51d8c22f tempest-LiveAutoBlockMigrationV225Test-1918466308 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-087215d3-1650-420d-a00a-220eba1b1657', 'hosts': ['10.222.0.13'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '946d1715-d12c-4dbf-8a79-181222df6e2e', 'volume_id': '087215d3-1650-420d-a00a-220eba1b1657', 'discard': True}} {{(pid=134148) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Dec 18 20:50:29.686162 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [req-4f0c2e19-4858-46b5-983f-161c0fce57ad req-32d6a67a-0a13-48a4-8acd-db0c51d8c22f tempest-LiveAutoBlockMigrationV225Test-1918466308 None] Connection info returned from driver {'name': 'volumes/volume-087215d3-1650-420d-a00a-220eba1b1657', 'hosts': ['10.222.0.13'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '087215d3-1650-420d-a00a-220eba1b1657', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '8696dae7-c5a4-4dab-ba04-f360f1c631fb'} {{(pid=134148) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4812}} Dec 18 20:50:29.756177 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [req-4f0c2e19-4858-46b5-983f-161c0fce57ad req-32d6a67a-0a13-48a4-8acd-db0c51d8c22f tempest-LiveAutoBlockMigrationV225Test-1918466308 None] attachment_update completed successfully. Dec 18 20:50:34.335640 ncdv-master-1 cinder-volume[134148]: DEBUG oslo_service.periodic_task [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134148) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Dec 18 20:50:34.336688 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 20:50:34.369131 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 20:50:34.419137 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.manager [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] Notifying Schedulers of capabilities ... {{(pid=134148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 18 20:50:48.407092 ncdv-master-1 cinder-volume[134148]: DEBUG oslo_concurrency.processutils [req-454a85c8-7ea5-48e4-8df0-72d99cdd519c req-c8633e6f-423a-4395-aa4e-ddd30ba539d4 tempest-LiveAutoBlockMigrationV225Test-1140448609 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=134148) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Dec 18 20:50:48.481035 ncdv-master-1 cinder-volume[134148]: DEBUG oslo_concurrency.processutils [req-b2a41261-7d39-4f49-91e9-21c2806ef437 req-5537988f-d1f3-4341-9a44-74978e377c4b tempest-LiveMigrationTest-150705056 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=134148) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Dec 18 20:50:49.452056 ncdv-master-1 cinder-volume[134148]: DEBUG oslo_concurrency.processutils [req-454a85c8-7ea5-48e4-8df0-72d99cdd519c req-c8633e6f-423a-4395-aa4e-ddd30ba539d4 tempest-LiveAutoBlockMigrationV225Test-1140448609 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.045s {{(pid=134148) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Dec 18 20:50:49.453721 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [req-454a85c8-7ea5-48e4-8df0-72d99cdd519c req-c8633e6f-423a-4395-aa4e-ddd30ba539d4 tempest-LiveAutoBlockMigrationV225Test-1140448609 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-087215d3-1650-420d-a00a-220eba1b1657', 'hosts': ['10.222.0.13'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '946d1715-d12c-4dbf-8a79-181222df6e2e', 'volume_id': '087215d3-1650-420d-a00a-220eba1b1657', 'discard': True}} {{(pid=134148) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Dec 18 20:50:49.520116 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [req-454a85c8-7ea5-48e4-8df0-72d99cdd519c req-c8633e6f-423a-4395-aa4e-ddd30ba539d4 tempest-LiveAutoBlockMigrationV225Test-1140448609 None] Connection info returned from driver {'name': 'volumes/volume-087215d3-1650-420d-a00a-220eba1b1657', 'hosts': ['10.222.0.13'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '087215d3-1650-420d-a00a-220eba1b1657', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'dbadf6d2-454d-4def-8db0-b3850f821261'} {{(pid=134148) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4812}} Dec 18 20:50:49.628199 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [req-454a85c8-7ea5-48e4-8df0-72d99cdd519c req-c8633e6f-423a-4395-aa4e-ddd30ba539d4 tempest-LiveAutoBlockMigrationV225Test-1140448609 None] attachment_update completed successfully. Dec 18 20:50:49.754326 ncdv-master-1 cinder-volume[134148]: DEBUG oslo_concurrency.processutils [req-b2a41261-7d39-4f49-91e9-21c2806ef437 req-5537988f-d1f3-4341-9a44-74978e377c4b tempest-LiveMigrationTest-150705056 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.280s {{(pid=134148) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Dec 18 20:50:49.755297 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [req-b2a41261-7d39-4f49-91e9-21c2806ef437 req-5537988f-d1f3-4341-9a44-74978e377c4b tempest-LiveMigrationTest-150705056 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-9f5f7417-3abc-4462-988f-ef519750d753', 'hosts': ['10.222.0.13'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '946d1715-d12c-4dbf-8a79-181222df6e2e', 'volume_id': '9f5f7417-3abc-4462-988f-ef519750d753', 'discard': True}} {{(pid=134148) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Dec 18 20:50:49.787906 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [req-b2a41261-7d39-4f49-91e9-21c2806ef437 req-5537988f-d1f3-4341-9a44-74978e377c4b tempest-LiveMigrationTest-150705056 None] Connection info returned from driver {'name': 'volumes/volume-9f5f7417-3abc-4462-988f-ef519750d753', 'hosts': ['10.222.0.13'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '9f5f7417-3abc-4462-988f-ef519750d753', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'df95f7f9-82d9-45e5-a6a0-3cb7fe696071'} {{(pid=134148) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4812}} Dec 18 20:50:49.925934 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [req-b2a41261-7d39-4f49-91e9-21c2806ef437 req-5537988f-d1f3-4341-9a44-74978e377c4b tempest-LiveMigrationTest-150705056 None] attachment_update completed successfully. Dec 18 20:50:59.687438 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [req-b2a41261-7d39-4f49-91e9-21c2806ef437 req-930931df-80aa-4707-84ae-403b346cad23 tempest-LiveMigrationTest-150705056 None] Terminate volume connection completed successfully. Dec 18 20:50:59.690576 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [req-b2a41261-7d39-4f49-91e9-21c2806ef437 req-930931df-80aa-4707-84ae-403b346cad23 tempest-LiveMigrationTest-150705056 None] Deleting attachment 2ab417c4-6f38-4b3a-9207-380dacd3a2b4. {{(pid=134148) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4948}} Dec 18 20:51:02.597725 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [req-454a85c8-7ea5-48e4-8df0-72d99cdd519c req-2151e357-4630-4738-903a-fc130c70bcd6 tempest-LiveAutoBlockMigrationV225Test-1140448609 None] Terminate volume connection completed successfully. Dec 18 20:51:02.599224 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [req-454a85c8-7ea5-48e4-8df0-72d99cdd519c req-2151e357-4630-4738-903a-fc130c70bcd6 tempest-LiveAutoBlockMigrationV225Test-1140448609 None] Deleting attachment 8696dae7-c5a4-4dab-ba04-f360f1c631fb. {{(pid=134148) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4948}} Dec 18 20:51:09.942299 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [req-d736d1a8-fa11-4f2d-a79b-6e9ce8d1df35 req-40386f0b-1c3a-49ed-b1ef-14a486521456 tempest-LiveMigrationTest-700829217 None] Terminate volume connection completed successfully. Dec 18 20:51:09.943016 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [req-d736d1a8-fa11-4f2d-a79b-6e9ce8d1df35 req-40386f0b-1c3a-49ed-b1ef-14a486521456 tempest-LiveMigrationTest-700829217 None] Deleting attachment df95f7f9-82d9-45e5-a6a0-3cb7fe696071. {{(pid=134148) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4948}} Dec 18 20:51:10.156048 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.coordination [req-d736d1a8-fa11-4f2d-a79b-6e9ce8d1df35 req-a2ed6690-5b3b-475c-a1db-7425f3f43fe6 tempest-LiveMigrationTest-700829217 None] Lock "b'cinder-9f5f7417-3abc-4462-988f-ef519750d753-delete_volume'" acquired by "delete_volume" :: waited 0.016s {{(pid=134148) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 18 20:51:10.203384 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [req-d736d1a8-fa11-4f2d-a79b-6e9ce8d1df35 req-a2ed6690-5b3b-475c-a1db-7425f3f43fe6 tempest-LiveMigrationTest-700829217 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 20:51:10.317625 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [req-d736d1a8-fa11-4f2d-a79b-6e9ce8d1df35 req-a2ed6690-5b3b-475c-a1db-7425f3f43fe6 tempest-LiveMigrationTest-700829217 None] volume has no backup snaps {{(pid=134148) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Dec 18 20:51:10.319211 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [req-d736d1a8-fa11-4f2d-a79b-6e9ce8d1df35 req-a2ed6690-5b3b-475c-a1db-7425f3f43fe6 tempest-LiveMigrationTest-700829217 None] volume has clone snapshot(s) {{(pid=134148) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1208}} Dec 18 20:51:10.323505 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [req-d736d1a8-fa11-4f2d-a79b-6e9ce8d1df35 req-a2ed6690-5b3b-475c-a1db-7425f3f43fe6 tempest-LiveMigrationTest-700829217 None] Volume volume-9f5f7417-3abc-4462-988f-ef519750d753 is not a clone. {{(pid=134148) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Dec 18 20:51:10.447991 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.quota [req-d736d1a8-fa11-4f2d-a79b-6e9ce8d1df35 req-a2ed6690-5b3b-475c-a1db-7425f3f43fe6 tempest-LiveMigrationTest-700829217 None] Created reservations ['1b789b49-97a1-47da-b785-16f4daa4da66', '00ec9697-4cda-4268-a835-9d9ccb4b7110', '32d9d9cc-9e9e-48ea-9562-b632a2eee8d7', '136318d9-db8e-447b-84c2-7e19da259c3d'] {{(pid=134148) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 18 20:51:10.503947 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [req-d736d1a8-fa11-4f2d-a79b-6e9ce8d1df35 req-a2ed6690-5b3b-475c-a1db-7425f3f43fe6 tempest-LiveMigrationTest-700829217 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 20:51:10.549545 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [req-d736d1a8-fa11-4f2d-a79b-6e9ce8d1df35 req-a2ed6690-5b3b-475c-a1db-7425f3f43fe6 tempest-LiveMigrationTest-700829217 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 20:51:10.593529 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.manager [req-d736d1a8-fa11-4f2d-a79b-6e9ce8d1df35 req-a2ed6690-5b3b-475c-a1db-7425f3f43fe6 tempest-LiveMigrationTest-700829217 None] Notifying Schedulers of capabilities ... {{(pid=134148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 18 20:51:10.602199 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [req-d736d1a8-fa11-4f2d-a79b-6e9ce8d1df35 req-a2ed6690-5b3b-475c-a1db-7425f3f43fe6 tempest-LiveMigrationTest-700829217 None] Deleted volume successfully. Dec 18 20:51:10.621868 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.coordination [req-d736d1a8-fa11-4f2d-a79b-6e9ce8d1df35 req-a2ed6690-5b3b-475c-a1db-7425f3f43fe6 tempest-LiveMigrationTest-700829217 None] Lock "b'cinder-9f5f7417-3abc-4462-988f-ef519750d753-delete_volume'" released by "delete_volume" :: held 0.466s {{(pid=134148) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 18 20:51:11.880697 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.coordination [None req-07bbf7ee-853a-4482-abae-140d3d7e0178 tempest-LiveMigrationTest-700829217 None] Lock "b'cinder-f629430d-e738-4808-bf49-6063505a3490-delete_volume'" acquired by "delete_volume" :: waited 0.027s {{(pid=134148) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 18 20:51:11.937578 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-07bbf7ee-853a-4482-abae-140d3d7e0178 tempest-LiveMigrationTest-700829217 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 20:51:12.014858 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-07bbf7ee-853a-4482-abae-140d3d7e0178 tempest-LiveMigrationTest-700829217 None] volume has no backup snaps {{(pid=134148) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Dec 18 20:51:12.015298 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-07bbf7ee-853a-4482-abae-140d3d7e0178 tempest-LiveMigrationTest-700829217 None] Volume volume-f629430d-e738-4808-bf49-6063505a3490 is not a clone. {{(pid=134148) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Dec 18 20:51:12.024414 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-07bbf7ee-853a-4482-abae-140d3d7e0178 tempest-LiveMigrationTest-700829217 None] deleting rbd volume volume-f629430d-e738-4808-bf49-6063505a3490 {{(pid=134148) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Dec 18 20:51:12.424982 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.quota [None req-07bbf7ee-853a-4482-abae-140d3d7e0178 tempest-LiveMigrationTest-700829217 None] Created reservations ['6b4f2d12-c761-4624-bd07-76c7f857e96a', '2be8df1f-2b7e-428d-9fe3-7fbc20689f11', '468ed3a2-66a5-4c1e-8ada-b2eda74972f6', 'd3cb7416-b701-47bb-9965-99d1b6598afa'] {{(pid=134148) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 18 20:51:12.476666 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-07bbf7ee-853a-4482-abae-140d3d7e0178 tempest-LiveMigrationTest-700829217 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 20:51:12.557460 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-07bbf7ee-853a-4482-abae-140d3d7e0178 tempest-LiveMigrationTest-700829217 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 20:51:12.604888 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.manager [None req-07bbf7ee-853a-4482-abae-140d3d7e0178 tempest-LiveMigrationTest-700829217 None] Notifying Schedulers of capabilities ... {{(pid=134148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 18 20:51:12.615139 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-07bbf7ee-853a-4482-abae-140d3d7e0178 tempest-LiveMigrationTest-700829217 None] Deleted volume successfully. Dec 18 20:51:12.633407 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [req-26991c53-5fa1-4b07-a862-01831e168e6f req-d7cf4bd6-ba6d-4031-b092-ad631fe37e9e tempest-LiveAutoBlockMigrationV225Test-1918466308 None] Terminate volume connection completed successfully. Dec 18 20:51:12.634036 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [req-26991c53-5fa1-4b07-a862-01831e168e6f req-d7cf4bd6-ba6d-4031-b092-ad631fe37e9e tempest-LiveAutoBlockMigrationV225Test-1918466308 None] Deleting attachment dbadf6d2-454d-4def-8db0-b3850f821261. {{(pid=134148) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4948}} Dec 18 20:51:12.636755 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.coordination [None req-07bbf7ee-853a-4482-abae-140d3d7e0178 tempest-LiveMigrationTest-700829217 None] Lock "b'cinder-f629430d-e738-4808-bf49-6063505a3490-delete_volume'" released by "delete_volume" :: held 0.756s {{(pid=134148) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 18 20:51:12.803228 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.coordination [req-26991c53-5fa1-4b07-a862-01831e168e6f req-3b157644-9e4d-4b81-8904-f2dfc592d834 tempest-LiveAutoBlockMigrationV225Test-1918466308 None] Lock "b'cinder-087215d3-1650-420d-a00a-220eba1b1657-delete_volume'" acquired by "delete_volume" :: waited 0.014s {{(pid=134148) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 18 20:51:12.868367 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [req-26991c53-5fa1-4b07-a862-01831e168e6f req-3b157644-9e4d-4b81-8904-f2dfc592d834 tempest-LiveAutoBlockMigrationV225Test-1918466308 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 20:51:13.000543 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [req-26991c53-5fa1-4b07-a862-01831e168e6f req-3b157644-9e4d-4b81-8904-f2dfc592d834 tempest-LiveAutoBlockMigrationV225Test-1918466308 None] volume has no backup snaps {{(pid=134148) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Dec 18 20:51:13.015847 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [req-26991c53-5fa1-4b07-a862-01831e168e6f req-3b157644-9e4d-4b81-8904-f2dfc592d834 tempest-LiveAutoBlockMigrationV225Test-1918466308 None] deleting rbd volume volume-087215d3-1650-420d-a00a-220eba1b1657 {{(pid=134148) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Dec 18 20:51:13.440627 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [req-26991c53-5fa1-4b07-a862-01831e168e6f req-3b157644-9e4d-4b81-8904-f2dfc592d834 tempest-LiveAutoBlockMigrationV225Test-1918466308 None] volume is a clone so cleaning references {{(pid=134148) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1266}} Dec 18 20:51:13.481272 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [req-26991c53-5fa1-4b07-a862-01831e168e6f req-3b157644-9e4d-4b81-8904-f2dfc592d834 tempest-LiveAutoBlockMigrationV225Test-1918466308 None] deleting parent snapshot volume-087215d3-1650-420d-a00a-220eba1b1657.clone_snap {{(pid=134148) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1158}} Dec 18 20:51:14.368041 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.coordination [None req-0038e632-5217-43f4-9415-9fe0b7dae796 tempest-LiveAutoBlockMigrationV225Test-1918466308 None] Lock "b'cinder-2f2dfe88-6eae-4206-aa00-4d39eb37326e-delete_volume'" acquired by "delete_volume" :: waited 0.045s {{(pid=134148) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 18 20:51:14.442993 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.quota [req-26991c53-5fa1-4b07-a862-01831e168e6f req-3b157644-9e4d-4b81-8904-f2dfc592d834 tempest-LiveAutoBlockMigrationV225Test-1918466308 None] Created reservations ['4985f252-e8e8-4890-bc1d-6573b3965d1f', 'a3d7a652-56a6-4576-be54-d5f455647887', '6a282c64-5817-430f-804e-a7a4a7426604', '851aa8c4-cc63-487e-b51c-b9a6595145a0'] {{(pid=134148) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 18 20:51:14.476402 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-0038e632-5217-43f4-9415-9fe0b7dae796 tempest-LiveAutoBlockMigrationV225Test-1918466308 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 20:51:14.548644 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-0038e632-5217-43f4-9415-9fe0b7dae796 tempest-LiveAutoBlockMigrationV225Test-1918466308 None] volume has no backup snaps {{(pid=134148) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Dec 18 20:51:14.549106 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-0038e632-5217-43f4-9415-9fe0b7dae796 tempest-LiveAutoBlockMigrationV225Test-1918466308 None] Volume volume-2f2dfe88-6eae-4206-aa00-4d39eb37326e is not a clone. {{(pid=134148) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Dec 18 20:51:14.560561 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-0038e632-5217-43f4-9415-9fe0b7dae796 tempest-LiveAutoBlockMigrationV225Test-1918466308 None] deleting rbd volume volume-2f2dfe88-6eae-4206-aa00-4d39eb37326e {{(pid=134148) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Dec 18 20:51:14.628290 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [req-26991c53-5fa1-4b07-a862-01831e168e6f req-3b157644-9e4d-4b81-8904-f2dfc592d834 tempest-LiveAutoBlockMigrationV225Test-1918466308 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 20:51:14.692585 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [req-26991c53-5fa1-4b07-a862-01831e168e6f req-3b157644-9e4d-4b81-8904-f2dfc592d834 tempest-LiveAutoBlockMigrationV225Test-1918466308 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 20:51:14.763232 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.manager [req-26991c53-5fa1-4b07-a862-01831e168e6f req-3b157644-9e4d-4b81-8904-f2dfc592d834 tempest-LiveAutoBlockMigrationV225Test-1918466308 None] Notifying Schedulers of capabilities ... {{(pid=134148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 18 20:51:14.769474 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [req-26991c53-5fa1-4b07-a862-01831e168e6f req-3b157644-9e4d-4b81-8904-f2dfc592d834 tempest-LiveAutoBlockMigrationV225Test-1918466308 None] Deleted volume successfully. Dec 18 20:51:14.787540 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.coordination [req-26991c53-5fa1-4b07-a862-01831e168e6f req-3b157644-9e4d-4b81-8904-f2dfc592d834 tempest-LiveAutoBlockMigrationV225Test-1918466308 None] Lock "b'cinder-087215d3-1650-420d-a00a-220eba1b1657-delete_volume'" released by "delete_volume" :: held 1.984s {{(pid=134148) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 18 20:51:14.943561 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.quota [None req-0038e632-5217-43f4-9415-9fe0b7dae796 tempest-LiveAutoBlockMigrationV225Test-1918466308 None] Created reservations ['c55336be-e0ab-42b5-9a04-2ec2dbfb6dd1', '6cb1a3d1-8ae3-4c44-88f6-62ab418ba962', 'b81d6231-e2cd-4dc1-92b9-e92d9fcb6719', '181ad9ca-4173-49c1-ae68-545dcf59efd8'] {{(pid=134148) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 18 20:51:15.034076 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-0038e632-5217-43f4-9415-9fe0b7dae796 tempest-LiveAutoBlockMigrationV225Test-1918466308 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 20:51:15.081628 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-0038e632-5217-43f4-9415-9fe0b7dae796 tempest-LiveAutoBlockMigrationV225Test-1918466308 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 20:51:15.166961 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.manager [None req-0038e632-5217-43f4-9415-9fe0b7dae796 tempest-LiveAutoBlockMigrationV225Test-1918466308 None] Notifying Schedulers of capabilities ... {{(pid=134148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 18 20:51:15.188730 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-0038e632-5217-43f4-9415-9fe0b7dae796 tempest-LiveAutoBlockMigrationV225Test-1918466308 None] Deleted volume successfully. Dec 18 20:51:15.225500 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.coordination [None req-0038e632-5217-43f4-9415-9fe0b7dae796 tempest-LiveAutoBlockMigrationV225Test-1918466308 None] Lock "b'cinder-2f2dfe88-6eae-4206-aa00-4d39eb37326e-delete_volume'" released by "delete_volume" :: held 0.857s {{(pid=134148) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 18 20:51:34.334771 ncdv-master-1 cinder-volume[134148]: DEBUG oslo_service.periodic_task [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134148) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Dec 18 20:51:34.335423 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 20:51:34.427459 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 20:51:34.517584 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.manager [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] Notifying Schedulers of capabilities ... {{(pid=134148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 18 20:52:12.145401 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.flows.manager.create_volume [None req-fd525b80-ce65-43af-9d51-64f6fc8743eb tempest-TaggedBootDevicesTest-22902861 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134148) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Dec 18 20:52:12.153696 ncdv-master-1 cinder-volume[134148]: WARNING stevedore.named [None req-fd525b80-ce65-43af-9d51-64f6fc8743eb tempest-TaggedBootDevicesTest-22902861 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Dec 18 20:52:12.154005 ncdv-master-1 cinder-volume[134148]: WARNING castellan.key_manager [None req-fd525b80-ce65-43af-9d51-64f6fc8743eb tempest-TaggedBootDevicesTest-22902861 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Dec 18 20:52:12.194831 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-fd525b80-ce65-43af-9d51-64f6fc8743eb tempest-TaggedBootDevicesTest-22902861 None] Flow 'volume_create_manager' (7adac53b-69f7-4050-a2aa-76f45ba406f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 18 20:52:12.209205 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-fd525b80-ce65-43af-9d51-64f6fc8743eb tempest-TaggedBootDevicesTest-22902861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a606cecf-d619-40c5-86ff-b97c0a0f1d08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 20:52:12.221960 ncdv-master-1 cinder-volume[134148]: DEBUG oslo_db.sqlalchemy.engines [None req-fd525b80-ce65-43af-9d51-64f6fc8743eb tempest-TaggedBootDevicesTest-22902861 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134148) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 18 20:52:12.268727 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-fd525b80-ce65-43af-9d51-64f6fc8743eb tempest-TaggedBootDevicesTest-22902861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a606cecf-d619-40c5-86ff-b97c0a0f1d08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-12-18T20:52:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-754740384',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=ac480cea-f87c-451e-96df-24febe018123,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='405bfbeb7b7d47c48b706aa32c6702bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-12-18T20:52:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-12-18T20:52:12Z,use_quota=True,user_id='9073865992504246b9d1699da089c86f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f2e1fe1-9fd6-411e-9ed9-368f463ccb6f),volume_type_id=1f2e1fe1-9fd6-411e-9ed9-368f463ccb6f)' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 20:52:12.271891 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-fd525b80-ce65-43af-9d51-64f6fc8743eb tempest-TaggedBootDevicesTest-22902861 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0cbd56e-1213-4098-b581-aacf7fd153ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 20:52:12.274866 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-fd525b80-ce65-43af-9d51-64f6fc8743eb tempest-TaggedBootDevicesTest-22902861 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0cbd56e-1213-4098-b581-aacf7fd153ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 20:52:12.300686 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-fd525b80-ce65-43af-9d51-64f6fc8743eb tempest-TaggedBootDevicesTest-22902861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9242c18-bbef-402e-8bda-cdac63ae7cfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 20:52:12.438765 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-fd525b80-ce65-43af-9d51-64f6fc8743eb tempest-TaggedBootDevicesTest-22902861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9242c18-bbef-402e-8bda-cdac63ae7cfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'ac480cea-f87c-451e-96df-24febe018123', 'volume_name': 'volume-ac480cea-f87c-451e-96df-24febe018123', 'volume_size': 1, 'image_id': '394b3891-80f2-44c9-a9aa-56fe23a5acb3', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b04c3d19c79d4c208395e97f9d293618', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '394b3891-80f2-44c9-a9aa-56fe23a5acb3', 'created_at': datetime.datetime(2021, 12, 18, 20, 38, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 12, 18, 20, 38, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/394b3891-80f2-44c9-a9aa-56fe23a5acb3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 20:52:12.441409 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-fd525b80-ce65-43af-9d51-64f6fc8743eb tempest-TaggedBootDevicesTest-22902861 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ec7ddf6-d23b-4aaa-8e15-dc0fdb751f06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 20:52:12.443703 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-fd525b80-ce65-43af-9d51-64f6fc8743eb tempest-TaggedBootDevicesTest-22902861 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ec7ddf6-d23b-4aaa-8e15-dc0fdb751f06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 20:52:12.461192 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-fd525b80-ce65-43af-9d51-64f6fc8743eb tempest-TaggedBootDevicesTest-22902861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2331213-9c9b-486c-8042-0d02e28723c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 20:52:12.467081 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.flows.manager.create_volume [None req-fd525b80-ce65-43af-9d51-64f6fc8743eb tempest-TaggedBootDevicesTest-22902861 None] Volume ac480cea-f87c-451e-96df-24febe018123: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-ac480cea-f87c-451e-96df-24febe018123', 'volume_size': 1, 'image_id': '394b3891-80f2-44c9-a9aa-56fe23a5acb3', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b04c3d19c79d4c208395e97f9d293618', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '394b3891-80f2-44c9-a9aa-56fe23a5acb3', 'created_at': datetime.datetime(2021, 12, 18, 20, 38, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 12, 18, 20, 38, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/394b3891-80f2-44c9-a9aa-56fe23a5acb3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Dec 18 20:52:12.467770 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.flows.manager.create_volume [None req-fd525b80-ce65-43af-9d51-64f6fc8743eb tempest-TaggedBootDevicesTest-22902861 None] Cloning ac480cea-f87c-451e-96df-24febe018123 from image 394b3891-80f2-44c9-a9aa-56fe23a5acb3 at location (None, None). {{(pid=134148) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1047}} Dec 18 20:52:12.497479 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.coordination [None req-fd525b80-ce65-43af-9d51-64f6fc8743eb tempest-TaggedBootDevicesTest-22902861 None] Lock "b'cinder-394b3891-80f2-44c9-a9aa-56fe23a5acb3'" acquired by "_prepare_image_cache_entry" :: waited 0.025s {{(pid=134148) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 18 20:52:12.514436 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.image.cache [None req-fd525b80-ce65-43af-9d51-64f6fc8743eb tempest-TaggedBootDevicesTest-22902861 None] Found image-volume cache entry: {'id': 1, 'image_id': '394b3891-80f2-44c9-a9aa-56fe23a5acb3', 'volume_id': 'e6411a45-48fa-4beb-a5a0-eb6a6ca3f525', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2021, 12, 18, 20, 38, 21), 'last_used': datetime.datetime(2021, 12, 18, 20, 52, 12, 503490)}. {{(pid=134148) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Dec 18 20:52:12.515176 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.image.cache [None req-fd525b80-ce65-43af-9d51-64f6fc8743eb tempest-TaggedBootDevicesTest-22902861 None] Image-volume cache entry image_update_at = 2021-12-18 20:38:21+00:00, requested image updated_at = 2021-12-18 20:38:21+00:00. {{(pid=134148) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Dec 18 20:52:12.515741 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.flows.manager.create_volume [None req-fd525b80-ce65-43af-9d51-64f6fc8743eb tempest-TaggedBootDevicesTest-22902861 None] Found cache entry for image = 394b3891-80f2-44c9-a9aa-56fe23a5acb3 on host ncdv-master-1@ceph#ceph. {{(pid=134148) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:870}} Dec 18 20:52:12.522573 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.coordination [None req-fd525b80-ce65-43af-9d51-64f6fc8743eb tempest-TaggedBootDevicesTest-22902861 None] Lock "b'cinder-394b3891-80f2-44c9-a9aa-56fe23a5acb3'" released by "_prepare_image_cache_entry" :: held 0.025s {{(pid=134148) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 18 20:52:12.523788 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.flows.manager.create_volume [None req-fd525b80-ce65-43af-9d51-64f6fc8743eb tempest-TaggedBootDevicesTest-22902861 None] Attempting to retrieve cache entry for image = 394b3891-80f2-44c9-a9aa-56fe23a5acb3 on host ncdv-master-1@ceph#ceph. {{(pid=134148) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:811}} Dec 18 20:52:12.536140 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.image.cache [None req-fd525b80-ce65-43af-9d51-64f6fc8743eb tempest-TaggedBootDevicesTest-22902861 None] Found image-volume cache entry: {'id': 1, 'image_id': '394b3891-80f2-44c9-a9aa-56fe23a5acb3', 'volume_id': 'e6411a45-48fa-4beb-a5a0-eb6a6ca3f525', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2021, 12, 18, 20, 38, 21), 'last_used': datetime.datetime(2021, 12, 18, 20, 52, 12, 528019)}. {{(pid=134148) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Dec 18 20:52:12.537285 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.image.cache [None req-fd525b80-ce65-43af-9d51-64f6fc8743eb tempest-TaggedBootDevicesTest-22902861 None] Image-volume cache entry image_update_at = 2021-12-18 20:38:21+00:00, requested image updated_at = 2021-12-18 20:38:21+00:00. {{(pid=134148) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Dec 18 20:52:12.537983 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.flows.manager.create_volume [None req-fd525b80-ce65-43af-9d51-64f6fc8743eb tempest-TaggedBootDevicesTest-22902861 None] Creating from source image-volume e6411a45-48fa-4beb-a5a0-eb6a6ca3f525 {{(pid=134148) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:825}} Dec 18 20:52:12.551578 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-fd525b80-ce65-43af-9d51-64f6fc8743eb tempest-TaggedBootDevicesTest-22902861 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 20:52:12.688531 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-fd525b80-ce65-43af-9d51-64f6fc8743eb tempest-TaggedBootDevicesTest-22902861 None] creating snapshot='volume-ac480cea-f87c-451e-96df-24febe018123.clone_snap' {{(pid=134148) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:725}} Dec 18 20:52:13.388582 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-fd525b80-ce65-43af-9d51-64f6fc8743eb tempest-TaggedBootDevicesTest-22902861 None] cloning 'volume-e6411a45-48fa-4beb-a5a0-eb6a6ca3f525@volume-ac480cea-f87c-451e-96df-24febe018123.clone_snap' to 'volume-ac480cea-f87c-451e-96df-24febe018123' {{(pid=134148) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:731}} Dec 18 20:52:13.591101 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-fd525b80-ce65-43af-9d51-64f6fc8743eb tempest-TaggedBootDevicesTest-22902861 None] Volume volume-9f5f7417-3abc-4462-988f-ef519750d753.deleted is not a clone. {{(pid=134148) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Dec 18 20:52:13.592704 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-fd525b80-ce65-43af-9d51-64f6fc8743eb tempest-TaggedBootDevicesTest-22902861 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134148) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 18 20:52:13.593303 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-fd525b80-ce65-43af-9d51-64f6fc8743eb tempest-TaggedBootDevicesTest-22902861 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134148) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 18 20:52:13.625782 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-fd525b80-ce65-43af-9d51-64f6fc8743eb tempest-TaggedBootDevicesTest-22902861 None] clone created successfully {{(pid=134148) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:803}} Dec 18 20:52:13.626899 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.volume_utils [None req-fd525b80-ce65-43af-9d51-64f6fc8743eb tempest-TaggedBootDevicesTest-22902861 None] Marking volume ac480cea-f87c-451e-96df-24febe018123 as bootable. {{(pid=134148) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1178}} Dec 18 20:52:13.640566 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.flows.manager.create_volume [None req-fd525b80-ce65-43af-9d51-64f6fc8743eb tempest-TaggedBootDevicesTest-22902861 None] Copying metadata from image 394b3891-80f2-44c9-a9aa-56fe23a5acb3 to ac480cea-f87c-451e-96df-24febe018123. {{(pid=134148) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:444}} Dec 18 20:52:13.642077 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.flows.manager.create_volume [None req-fd525b80-ce65-43af-9d51-64f6fc8743eb tempest-TaggedBootDevicesTest-22902861 None] Creating volume glance metadata for volume ac480cea-f87c-451e-96df-24febe018123 backed by image 394b3891-80f2-44c9-a9aa-56fe23a5acb3 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '394b3891-80f2-44c9-a9aa-56fe23a5acb3', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=134148) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:667}} Dec 18 20:52:13.758446 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-fd525b80-ce65-43af-9d51-64f6fc8743eb tempest-TaggedBootDevicesTest-22902861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2331213-9c9b-486c-8042-0d02e28723c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ac480cea-f87c-451e-96df-24febe018123', 'volume_size': 1, 'image_id': '394b3891-80f2-44c9-a9aa-56fe23a5acb3', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b04c3d19c79d4c208395e97f9d293618', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '394b3891-80f2-44c9-a9aa-56fe23a5acb3', 'created_at': datetime.datetime(2021, 12, 18, 20, 38, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 12, 18, 20, 38, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/394b3891-80f2-44c9-a9aa-56fe23a5acb3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 20:52:13.763283 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-fd525b80-ce65-43af-9d51-64f6fc8743eb tempest-TaggedBootDevicesTest-22902861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7257102a-8ea2-45ec-81aa-37c1cd4ab158) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 20:52:13.772771 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.flows.manager.create_volume [None req-fd525b80-ce65-43af-9d51-64f6fc8743eb tempest-TaggedBootDevicesTest-22902861 None] Volume volume-ac480cea-f87c-451e-96df-24febe018123 (ac480cea-f87c-451e-96df-24febe018123): created successfully Dec 18 20:52:13.775018 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-fd525b80-ce65-43af-9d51-64f6fc8743eb tempest-TaggedBootDevicesTest-22902861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7257102a-8ea2-45ec-81aa-37c1cd4ab158) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 20:52:13.778619 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-fd525b80-ce65-43af-9d51-64f6fc8743eb tempest-TaggedBootDevicesTest-22902861 None] Flow 'volume_create_manager' (7adac53b-69f7-4050-a2aa-76f45ba406f9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134148) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 18 20:52:13.792255 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-fd525b80-ce65-43af-9d51-64f6fc8743eb tempest-TaggedBootDevicesTest-22902861 None] Created volume successfully. Dec 18 20:52:14.800106 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.flows.manager.create_volume [None req-bf049b0e-1b2b-42be-9103-48f044736eeb tempest-TaggedBootDevicesTest-22902861 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134148) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Dec 18 20:52:14.805908 ncdv-master-1 cinder-volume[134148]: WARNING stevedore.named [None req-bf049b0e-1b2b-42be-9103-48f044736eeb tempest-TaggedBootDevicesTest-22902861 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Dec 18 20:52:14.807377 ncdv-master-1 cinder-volume[134148]: WARNING castellan.key_manager [None req-bf049b0e-1b2b-42be-9103-48f044736eeb tempest-TaggedBootDevicesTest-22902861 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Dec 18 20:52:14.824249 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-bf049b0e-1b2b-42be-9103-48f044736eeb tempest-TaggedBootDevicesTest-22902861 None] Flow 'volume_create_manager' (3ef0f6b4-6860-43c5-aa46-45f98b5213e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 18 20:52:14.828674 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-bf049b0e-1b2b-42be-9103-48f044736eeb tempest-TaggedBootDevicesTest-22902861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27fab2cb-1a64-461d-915f-6a27b45a9b0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 20:52:14.836656 ncdv-master-1 cinder-volume[134148]: DEBUG oslo_db.sqlalchemy.engines [None req-bf049b0e-1b2b-42be-9103-48f044736eeb tempest-TaggedBootDevicesTest-22902861 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134148) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 18 20:52:14.851791 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-bf049b0e-1b2b-42be-9103-48f044736eeb tempest-TaggedBootDevicesTest-22902861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27fab2cb-1a64-461d-915f-6a27b45a9b0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-12-18T20:52:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-1706318820',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=26094cb4-a4fa-43a4-86c4-5a3342be6fa8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='405bfbeb7b7d47c48b706aa32c6702bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-12-18T20:52:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-12-18T20:52:15Z,use_quota=True,user_id='9073865992504246b9d1699da089c86f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f2e1fe1-9fd6-411e-9ed9-368f463ccb6f),volume_type_id=1f2e1fe1-9fd6-411e-9ed9-368f463ccb6f)' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 20:52:14.855499 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-bf049b0e-1b2b-42be-9103-48f044736eeb tempest-TaggedBootDevicesTest-22902861 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89f97397-579a-4ff8-86d6-d6407752d500) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 20:52:14.857886 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-bf049b0e-1b2b-42be-9103-48f044736eeb tempest-TaggedBootDevicesTest-22902861 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89f97397-579a-4ff8-86d6-d6407752d500) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 20:52:14.863454 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-bf049b0e-1b2b-42be-9103-48f044736eeb tempest-TaggedBootDevicesTest-22902861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6deb81d0-f99f-4b0f-8f0b-6243216a8527) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 20:52:14.865934 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-bf049b0e-1b2b-42be-9103-48f044736eeb tempest-TaggedBootDevicesTest-22902861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6deb81d0-f99f-4b0f-8f0b-6243216a8527) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '26094cb4-a4fa-43a4-86c4-5a3342be6fa8', 'volume_name': 'volume-26094cb4-a4fa-43a4-86c4-5a3342be6fa8', 'volume_size': 1}' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 20:52:14.889682 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-bf049b0e-1b2b-42be-9103-48f044736eeb tempest-TaggedBootDevicesTest-22902861 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6846158d-b08f-40fa-bcb7-5e4aaedca163) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 20:52:14.894675 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-bf049b0e-1b2b-42be-9103-48f044736eeb tempest-TaggedBootDevicesTest-22902861 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6846158d-b08f-40fa-bcb7-5e4aaedca163) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 20:52:14.897853 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-bf049b0e-1b2b-42be-9103-48f044736eeb tempest-TaggedBootDevicesTest-22902861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7da7f836-dbad-4980-900b-14d408db7b93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 20:52:14.898979 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.flows.manager.create_volume [None req-bf049b0e-1b2b-42be-9103-48f044736eeb tempest-TaggedBootDevicesTest-22902861 None] Volume 26094cb4-a4fa-43a4-86c4-5a3342be6fa8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-26094cb4-a4fa-43a4-86c4-5a3342be6fa8', 'volume_size': 1} Dec 18 20:52:14.899978 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-bf049b0e-1b2b-42be-9103-48f044736eeb tempest-TaggedBootDevicesTest-22902861 None] creating volume 'volume-26094cb4-a4fa-43a4-86c4-5a3342be6fa8' {{(pid=134148) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Dec 18 20:52:14.902638 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-bf049b0e-1b2b-42be-9103-48f044736eeb tempest-TaggedBootDevicesTest-22902861 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 20:52:15.062970 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-bf049b0e-1b2b-42be-9103-48f044736eeb tempest-TaggedBootDevicesTest-22902861 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134148) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 18 20:52:15.063353 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-bf049b0e-1b2b-42be-9103-48f044736eeb tempest-TaggedBootDevicesTest-22902861 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134148) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 18 20:52:15.065365 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-bf049b0e-1b2b-42be-9103-48f044736eeb tempest-TaggedBootDevicesTest-22902861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7da7f836-dbad-4980-900b-14d408db7b93) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-26094cb4-a4fa-43a4-86c4-5a3342be6fa8', 'volume_size': 1}' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 20:52:15.067749 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-bf049b0e-1b2b-42be-9103-48f044736eeb tempest-TaggedBootDevicesTest-22902861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92dbc51c-d36e-4bb7-b7a7-6ddc999bf70c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 20:52:15.086517 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.flows.manager.create_volume [None req-bf049b0e-1b2b-42be-9103-48f044736eeb tempest-TaggedBootDevicesTest-22902861 None] Volume volume-26094cb4-a4fa-43a4-86c4-5a3342be6fa8 (26094cb4-a4fa-43a4-86c4-5a3342be6fa8): created successfully Dec 18 20:52:15.099463 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-bf049b0e-1b2b-42be-9103-48f044736eeb tempest-TaggedBootDevicesTest-22902861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92dbc51c-d36e-4bb7-b7a7-6ddc999bf70c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 20:52:15.102477 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-bf049b0e-1b2b-42be-9103-48f044736eeb tempest-TaggedBootDevicesTest-22902861 None] Flow 'volume_create_manager' (3ef0f6b4-6860-43c5-aa46-45f98b5213e1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134148) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 18 20:52:15.124972 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-bf049b0e-1b2b-42be-9103-48f044736eeb tempest-TaggedBootDevicesTest-22902861 None] Created volume successfully. Dec 18 20:52:16.325871 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.flows.manager.create_volume [None req-491fe430-7483-4c3e-9a3f-da66c9a77989 tempest-TaggedBootDevicesTest-22902861 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134148) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Dec 18 20:52:16.330841 ncdv-master-1 cinder-volume[134148]: WARNING stevedore.named [None req-491fe430-7483-4c3e-9a3f-da66c9a77989 tempest-TaggedBootDevicesTest-22902861 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Dec 18 20:52:16.331575 ncdv-master-1 cinder-volume[134148]: WARNING castellan.key_manager [None req-491fe430-7483-4c3e-9a3f-da66c9a77989 tempest-TaggedBootDevicesTest-22902861 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Dec 18 20:52:16.355081 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-491fe430-7483-4c3e-9a3f-da66c9a77989 tempest-TaggedBootDevicesTest-22902861 None] Flow 'volume_create_manager' (f3c5d099-b353-41b5-bd66-ceb57cebda7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 18 20:52:16.362135 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-491fe430-7483-4c3e-9a3f-da66c9a77989 tempest-TaggedBootDevicesTest-22902861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2b54c07-0a3a-41c1-914d-f9bac7c0e14e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 20:52:16.372336 ncdv-master-1 cinder-volume[134148]: DEBUG oslo_db.sqlalchemy.engines [None req-491fe430-7483-4c3e-9a3f-da66c9a77989 tempest-TaggedBootDevicesTest-22902861 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134148) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 18 20:52:16.402643 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-491fe430-7483-4c3e-9a3f-da66c9a77989 tempest-TaggedBootDevicesTest-22902861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2b54c07-0a3a-41c1-914d-f9bac7c0e14e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-12-18T20:52:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-262158975',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=61701d83-e055-4683-9550-0ed663125a4c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='405bfbeb7b7d47c48b706aa32c6702bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-12-18T20:52:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-12-18T20:52:16Z,use_quota=True,user_id='9073865992504246b9d1699da089c86f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f2e1fe1-9fd6-411e-9ed9-368f463ccb6f),volume_type_id=1f2e1fe1-9fd6-411e-9ed9-368f463ccb6f)' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 20:52:16.405728 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-491fe430-7483-4c3e-9a3f-da66c9a77989 tempest-TaggedBootDevicesTest-22902861 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f1f1ca3-30cb-4d01-b19a-0ec7b56e6e55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 20:52:16.408225 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-491fe430-7483-4c3e-9a3f-da66c9a77989 tempest-TaggedBootDevicesTest-22902861 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f1f1ca3-30cb-4d01-b19a-0ec7b56e6e55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 20:52:16.411507 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-491fe430-7483-4c3e-9a3f-da66c9a77989 tempest-TaggedBootDevicesTest-22902861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aed4c618-b167-43ee-af0a-c8da8ba811a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 20:52:16.414523 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-491fe430-7483-4c3e-9a3f-da66c9a77989 tempest-TaggedBootDevicesTest-22902861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aed4c618-b167-43ee-af0a-c8da8ba811a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '61701d83-e055-4683-9550-0ed663125a4c', 'volume_name': 'volume-61701d83-e055-4683-9550-0ed663125a4c', 'volume_size': 1}' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 20:52:16.418503 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-491fe430-7483-4c3e-9a3f-da66c9a77989 tempest-TaggedBootDevicesTest-22902861 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d67dbba1-7a3e-4b88-903d-e6676dea423a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 20:52:16.421867 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-491fe430-7483-4c3e-9a3f-da66c9a77989 tempest-TaggedBootDevicesTest-22902861 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d67dbba1-7a3e-4b88-903d-e6676dea423a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 20:52:16.424956 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-491fe430-7483-4c3e-9a3f-da66c9a77989 tempest-TaggedBootDevicesTest-22902861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97613daf-82ba-4912-9efb-c46c87090c81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 20:52:16.427884 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.flows.manager.create_volume [None req-491fe430-7483-4c3e-9a3f-da66c9a77989 tempest-TaggedBootDevicesTest-22902861 None] Volume 61701d83-e055-4683-9550-0ed663125a4c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-61701d83-e055-4683-9550-0ed663125a4c', 'volume_size': 1} Dec 18 20:52:16.428487 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-491fe430-7483-4c3e-9a3f-da66c9a77989 tempest-TaggedBootDevicesTest-22902861 None] creating volume 'volume-61701d83-e055-4683-9550-0ed663125a4c' {{(pid=134148) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Dec 18 20:52:16.432834 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-491fe430-7483-4c3e-9a3f-da66c9a77989 tempest-TaggedBootDevicesTest-22902861 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 20:52:16.570455 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-491fe430-7483-4c3e-9a3f-da66c9a77989 tempest-TaggedBootDevicesTest-22902861 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134148) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 18 20:52:16.571087 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-491fe430-7483-4c3e-9a3f-da66c9a77989 tempest-TaggedBootDevicesTest-22902861 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134148) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 18 20:52:16.574204 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-491fe430-7483-4c3e-9a3f-da66c9a77989 tempest-TaggedBootDevicesTest-22902861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97613daf-82ba-4912-9efb-c46c87090c81) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-61701d83-e055-4683-9550-0ed663125a4c', 'volume_size': 1}' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 20:52:16.577581 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-491fe430-7483-4c3e-9a3f-da66c9a77989 tempest-TaggedBootDevicesTest-22902861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (105fa49c-f530-4571-bd37-25251d6d7652) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 20:52:16.594500 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.flows.manager.create_volume [None req-491fe430-7483-4c3e-9a3f-da66c9a77989 tempest-TaggedBootDevicesTest-22902861 None] Volume volume-61701d83-e055-4683-9550-0ed663125a4c (61701d83-e055-4683-9550-0ed663125a4c): created successfully Dec 18 20:52:16.599439 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-491fe430-7483-4c3e-9a3f-da66c9a77989 tempest-TaggedBootDevicesTest-22902861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (105fa49c-f530-4571-bd37-25251d6d7652) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 20:52:16.604164 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-491fe430-7483-4c3e-9a3f-da66c9a77989 tempest-TaggedBootDevicesTest-22902861 None] Flow 'volume_create_manager' (f3c5d099-b353-41b5-bd66-ceb57cebda7f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134148) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 18 20:52:16.618673 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-491fe430-7483-4c3e-9a3f-da66c9a77989 tempest-TaggedBootDevicesTest-22902861 None] Created volume successfully. Dec 18 20:52:34.333807 ncdv-master-1 cinder-volume[134148]: DEBUG oslo_service.periodic_task [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134148) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Dec 18 20:52:34.334719 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 20:52:34.370959 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 20:52:34.414357 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.manager [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] Notifying Schedulers of capabilities ... {{(pid=134148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 18 20:52:38.597761 ncdv-master-1 cinder-volume[134148]: DEBUG oslo_concurrency.processutils [req-954b2cf4-298a-4200-93a4-5d89bdbfd151 req-f7eb2b5b-f37d-48d5-8cbd-82778af0740d tempest-TaggedBootDevicesTest-22902861 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=134148) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Dec 18 20:52:39.410084 ncdv-master-1 cinder-volume[134148]: DEBUG oslo_concurrency.processutils [req-954b2cf4-298a-4200-93a4-5d89bdbfd151 req-f7eb2b5b-f37d-48d5-8cbd-82778af0740d tempest-TaggedBootDevicesTest-22902861 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.812s {{(pid=134148) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Dec 18 20:52:39.410984 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [req-954b2cf4-298a-4200-93a4-5d89bdbfd151 req-f7eb2b5b-f37d-48d5-8cbd-82778af0740d tempest-TaggedBootDevicesTest-22902861 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-ac480cea-f87c-451e-96df-24febe018123', 'hosts': ['10.222.0.13'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '946d1715-d12c-4dbf-8a79-181222df6e2e', 'volume_id': 'ac480cea-f87c-451e-96df-24febe018123', 'discard': True}} {{(pid=134148) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Dec 18 20:52:39.459151 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [req-954b2cf4-298a-4200-93a4-5d89bdbfd151 req-f7eb2b5b-f37d-48d5-8cbd-82778af0740d tempest-TaggedBootDevicesTest-22902861 None] Connection info returned from driver {'name': 'volumes/volume-ac480cea-f87c-451e-96df-24febe018123', 'hosts': ['10.222.0.13'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'ac480cea-f87c-451e-96df-24febe018123', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'dc1dc9b6-e8be-4c00-b152-3c4ed3ed1aab'} {{(pid=134148) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4812}} Dec 18 20:52:39.541311 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [req-954b2cf4-298a-4200-93a4-5d89bdbfd151 req-f7eb2b5b-f37d-48d5-8cbd-82778af0740d tempest-TaggedBootDevicesTest-22902861 None] attachment_update completed successfully. Dec 18 20:52:39.933572 ncdv-master-1 cinder-volume[134148]: DEBUG oslo_concurrency.processutils [req-954b2cf4-298a-4200-93a4-5d89bdbfd151 req-c721efe4-2a01-41cb-9c2b-818802a19b5c tempest-TaggedBootDevicesTest-22902861 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=134148) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Dec 18 20:52:40.798034 ncdv-master-1 cinder-volume[134148]: DEBUG oslo_concurrency.processutils [req-954b2cf4-298a-4200-93a4-5d89bdbfd151 req-c721efe4-2a01-41cb-9c2b-818802a19b5c tempest-TaggedBootDevicesTest-22902861 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.864s {{(pid=134148) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Dec 18 20:52:40.799214 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [req-954b2cf4-298a-4200-93a4-5d89bdbfd151 req-c721efe4-2a01-41cb-9c2b-818802a19b5c tempest-TaggedBootDevicesTest-22902861 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-26094cb4-a4fa-43a4-86c4-5a3342be6fa8', 'hosts': ['10.222.0.13'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '946d1715-d12c-4dbf-8a79-181222df6e2e', 'volume_id': '26094cb4-a4fa-43a4-86c4-5a3342be6fa8', 'discard': True}} {{(pid=134148) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Dec 18 20:52:40.825988 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [req-954b2cf4-298a-4200-93a4-5d89bdbfd151 req-c721efe4-2a01-41cb-9c2b-818802a19b5c tempest-TaggedBootDevicesTest-22902861 None] Connection info returned from driver {'name': 'volumes/volume-26094cb4-a4fa-43a4-86c4-5a3342be6fa8', 'hosts': ['10.222.0.13'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '26094cb4-a4fa-43a4-86c4-5a3342be6fa8', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'b5dfcf49-a94f-4c76-b515-98ddcb0485ee'} {{(pid=134148) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4812}} Dec 18 20:52:40.919186 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [req-954b2cf4-298a-4200-93a4-5d89bdbfd151 req-c721efe4-2a01-41cb-9c2b-818802a19b5c tempest-TaggedBootDevicesTest-22902861 None] attachment_update completed successfully. Dec 18 20:52:41.407957 ncdv-master-1 cinder-volume[134148]: DEBUG oslo_concurrency.processutils [req-954b2cf4-298a-4200-93a4-5d89bdbfd151 req-3684f107-8957-43c2-a9bf-e872899cfff7 tempest-TaggedBootDevicesTest-22902861 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=134148) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Dec 18 20:52:42.381769 ncdv-master-1 cinder-volume[134148]: DEBUG oslo_concurrency.processutils [req-954b2cf4-298a-4200-93a4-5d89bdbfd151 req-3684f107-8957-43c2-a9bf-e872899cfff7 tempest-TaggedBootDevicesTest-22902861 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.974s {{(pid=134148) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Dec 18 20:52:42.382912 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [req-954b2cf4-298a-4200-93a4-5d89bdbfd151 req-3684f107-8957-43c2-a9bf-e872899cfff7 tempest-TaggedBootDevicesTest-22902861 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-61701d83-e055-4683-9550-0ed663125a4c', 'hosts': ['10.222.0.13'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '946d1715-d12c-4dbf-8a79-181222df6e2e', 'volume_id': '61701d83-e055-4683-9550-0ed663125a4c', 'discard': True}} {{(pid=134148) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Dec 18 20:52:42.414131 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [req-954b2cf4-298a-4200-93a4-5d89bdbfd151 req-3684f107-8957-43c2-a9bf-e872899cfff7 tempest-TaggedBootDevicesTest-22902861 None] Connection info returned from driver {'name': 'volumes/volume-61701d83-e055-4683-9550-0ed663125a4c', 'hosts': ['10.222.0.13'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '61701d83-e055-4683-9550-0ed663125a4c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '29a175fa-de90-4109-9025-801dcacf9e1f'} {{(pid=134148) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4812}} Dec 18 20:52:42.493820 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [req-954b2cf4-298a-4200-93a4-5d89bdbfd151 req-3684f107-8957-43c2-a9bf-e872899cfff7 tempest-TaggedBootDevicesTest-22902861 None] attachment_update completed successfully. Dec 18 20:53:34.333595 ncdv-master-1 cinder-volume[134148]: DEBUG oslo_service.periodic_task [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134148) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Dec 18 20:53:34.335309 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 20:53:34.434991 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 20:53:34.563314 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.manager [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] Notifying Schedulers of capabilities ... {{(pid=134148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 18 20:54:17.487983 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.flows.manager.create_volume [None req-92a7fa34-807d-465b-b3ac-17603e808156 tempest-ServersTestBootFromVolume-1992682790 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134148) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Dec 18 20:54:17.493201 ncdv-master-1 cinder-volume[134148]: WARNING stevedore.named [None req-92a7fa34-807d-465b-b3ac-17603e808156 tempest-ServersTestBootFromVolume-1992682790 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Dec 18 20:54:17.493699 ncdv-master-1 cinder-volume[134148]: WARNING castellan.key_manager [None req-92a7fa34-807d-465b-b3ac-17603e808156 tempest-ServersTestBootFromVolume-1992682790 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Dec 18 20:54:17.508942 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-92a7fa34-807d-465b-b3ac-17603e808156 tempest-ServersTestBootFromVolume-1992682790 None] Flow 'volume_create_manager' (80a39392-3142-4d75-947c-d70c80ce7cc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 18 20:54:17.512906 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-92a7fa34-807d-465b-b3ac-17603e808156 tempest-ServersTestBootFromVolume-1992682790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (adcf67ed-924a-415f-9ba3-e3e92ac8202e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 20:54:17.520212 ncdv-master-1 cinder-volume[134148]: DEBUG oslo_db.sqlalchemy.engines [None req-92a7fa34-807d-465b-b3ac-17603e808156 tempest-ServersTestBootFromVolume-1992682790 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134148) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 18 20:54:17.543107 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-92a7fa34-807d-465b-b3ac-17603e808156 tempest-ServersTestBootFromVolume-1992682790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (adcf67ed-924a-415f-9ba3-e3e92ac8202e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-12-18T20:54:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1437257739',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=4bdb5baa-b93d-4799-a653-1de77543ed53,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8efd6d0e0ed74857b4b6265fdacc68cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-12-18T20:54:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-12-18T20:54:17Z,use_quota=True,user_id='0ee5b92caab2431f97702541033df654',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f2e1fe1-9fd6-411e-9ed9-368f463ccb6f),volume_type_id=1f2e1fe1-9fd6-411e-9ed9-368f463ccb6f)' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 20:54:17.545866 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-92a7fa34-807d-465b-b3ac-17603e808156 tempest-ServersTestBootFromVolume-1992682790 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1c0f430-de06-4c39-a2c8-6e518b1889b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 20:54:17.548454 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-92a7fa34-807d-465b-b3ac-17603e808156 tempest-ServersTestBootFromVolume-1992682790 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1c0f430-de06-4c39-a2c8-6e518b1889b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 20:54:17.551197 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-92a7fa34-807d-465b-b3ac-17603e808156 tempest-ServersTestBootFromVolume-1992682790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b2649a3-75a2-4a99-bbc0-9b68df29f043) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 20:54:17.675092 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-92a7fa34-807d-465b-b3ac-17603e808156 tempest-ServersTestBootFromVolume-1992682790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b2649a3-75a2-4a99-bbc0-9b68df29f043) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '4bdb5baa-b93d-4799-a653-1de77543ed53', 'volume_name': 'volume-4bdb5baa-b93d-4799-a653-1de77543ed53', 'volume_size': 1, 'image_id': '394b3891-80f2-44c9-a9aa-56fe23a5acb3', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b04c3d19c79d4c208395e97f9d293618', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '394b3891-80f2-44c9-a9aa-56fe23a5acb3', 'created_at': datetime.datetime(2021, 12, 18, 20, 38, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 12, 18, 20, 38, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/394b3891-80f2-44c9-a9aa-56fe23a5acb3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 20:54:17.678347 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-92a7fa34-807d-465b-b3ac-17603e808156 tempest-ServersTestBootFromVolume-1992682790 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (434a0279-8383-44f2-b872-a68663be0735) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 20:54:17.681477 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-92a7fa34-807d-465b-b3ac-17603e808156 tempest-ServersTestBootFromVolume-1992682790 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (434a0279-8383-44f2-b872-a68663be0735) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 20:54:17.684156 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-92a7fa34-807d-465b-b3ac-17603e808156 tempest-ServersTestBootFromVolume-1992682790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2caf56f2-40bc-49b3-bd37-9c206a821bef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 20:54:17.685337 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.flows.manager.create_volume [None req-92a7fa34-807d-465b-b3ac-17603e808156 tempest-ServersTestBootFromVolume-1992682790 None] Volume 4bdb5baa-b93d-4799-a653-1de77543ed53: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-4bdb5baa-b93d-4799-a653-1de77543ed53', 'volume_size': 1, 'image_id': '394b3891-80f2-44c9-a9aa-56fe23a5acb3', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b04c3d19c79d4c208395e97f9d293618', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '394b3891-80f2-44c9-a9aa-56fe23a5acb3', 'created_at': datetime.datetime(2021, 12, 18, 20, 38, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 12, 18, 20, 38, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/394b3891-80f2-44c9-a9aa-56fe23a5acb3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Dec 18 20:54:17.686044 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.flows.manager.create_volume [None req-92a7fa34-807d-465b-b3ac-17603e808156 tempest-ServersTestBootFromVolume-1992682790 None] Cloning 4bdb5baa-b93d-4799-a653-1de77543ed53 from image 394b3891-80f2-44c9-a9aa-56fe23a5acb3 at location (None, None). {{(pid=134148) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1047}} Dec 18 20:54:17.711047 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.coordination [None req-92a7fa34-807d-465b-b3ac-17603e808156 tempest-ServersTestBootFromVolume-1992682790 None] Lock "b'cinder-394b3891-80f2-44c9-a9aa-56fe23a5acb3'" acquired by "_prepare_image_cache_entry" :: waited 0.024s {{(pid=134148) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 18 20:54:17.729859 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.image.cache [None req-92a7fa34-807d-465b-b3ac-17603e808156 tempest-ServersTestBootFromVolume-1992682790 None] Found image-volume cache entry: {'id': 1, 'image_id': '394b3891-80f2-44c9-a9aa-56fe23a5acb3', 'volume_id': 'e6411a45-48fa-4beb-a5a0-eb6a6ca3f525', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2021, 12, 18, 20, 38, 21), 'last_used': datetime.datetime(2021, 12, 18, 20, 54, 17, 719733)}. {{(pid=134148) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Dec 18 20:54:17.739819 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.image.cache [None req-92a7fa34-807d-465b-b3ac-17603e808156 tempest-ServersTestBootFromVolume-1992682790 None] Image-volume cache entry image_update_at = 2021-12-18 20:38:21+00:00, requested image updated_at = 2021-12-18 20:38:21+00:00. {{(pid=134148) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Dec 18 20:54:17.741069 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.flows.manager.create_volume [None req-92a7fa34-807d-465b-b3ac-17603e808156 tempest-ServersTestBootFromVolume-1992682790 None] Found cache entry for image = 394b3891-80f2-44c9-a9aa-56fe23a5acb3 on host ncdv-master-1@ceph#ceph. {{(pid=134148) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:870}} Dec 18 20:54:17.747693 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.coordination [None req-92a7fa34-807d-465b-b3ac-17603e808156 tempest-ServersTestBootFromVolume-1992682790 None] Lock "b'cinder-394b3891-80f2-44c9-a9aa-56fe23a5acb3'" released by "_prepare_image_cache_entry" :: held 0.037s {{(pid=134148) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 18 20:54:17.758811 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.flows.manager.create_volume [None req-92a7fa34-807d-465b-b3ac-17603e808156 tempest-ServersTestBootFromVolume-1992682790 None] Attempting to retrieve cache entry for image = 394b3891-80f2-44c9-a9aa-56fe23a5acb3 on host ncdv-master-1@ceph#ceph. {{(pid=134148) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:811}} Dec 18 20:54:17.770202 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.image.cache [None req-92a7fa34-807d-465b-b3ac-17603e808156 tempest-ServersTestBootFromVolume-1992682790 None] Found image-volume cache entry: {'id': 1, 'image_id': '394b3891-80f2-44c9-a9aa-56fe23a5acb3', 'volume_id': 'e6411a45-48fa-4beb-a5a0-eb6a6ca3f525', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2021, 12, 18, 20, 38, 21), 'last_used': datetime.datetime(2021, 12, 18, 20, 54, 17, 767659)}. {{(pid=134148) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Dec 18 20:54:17.772098 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.image.cache [None req-92a7fa34-807d-465b-b3ac-17603e808156 tempest-ServersTestBootFromVolume-1992682790 None] Image-volume cache entry image_update_at = 2021-12-18 20:38:21+00:00, requested image updated_at = 2021-12-18 20:38:21+00:00. {{(pid=134148) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Dec 18 20:54:17.772835 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.flows.manager.create_volume [None req-92a7fa34-807d-465b-b3ac-17603e808156 tempest-ServersTestBootFromVolume-1992682790 None] Creating from source image-volume e6411a45-48fa-4beb-a5a0-eb6a6ca3f525 {{(pid=134148) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:825}} Dec 18 20:54:17.791644 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-92a7fa34-807d-465b-b3ac-17603e808156 tempest-ServersTestBootFromVolume-1992682790 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 20:54:17.883602 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-92a7fa34-807d-465b-b3ac-17603e808156 tempest-ServersTestBootFromVolume-1992682790 None] creating snapshot='volume-4bdb5baa-b93d-4799-a653-1de77543ed53.clone_snap' {{(pid=134148) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:725}} Dec 18 20:54:18.007275 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-92a7fa34-807d-465b-b3ac-17603e808156 tempest-ServersTestBootFromVolume-1992682790 None] cloning 'volume-e6411a45-48fa-4beb-a5a0-eb6a6ca3f525@volume-4bdb5baa-b93d-4799-a653-1de77543ed53.clone_snap' to 'volume-4bdb5baa-b93d-4799-a653-1de77543ed53' {{(pid=134148) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:731}} Dec 18 20:54:18.219544 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-92a7fa34-807d-465b-b3ac-17603e808156 tempest-ServersTestBootFromVolume-1992682790 None] Volume volume-9f5f7417-3abc-4462-988f-ef519750d753.deleted is not a clone. {{(pid=134148) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Dec 18 20:54:18.221973 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-92a7fa34-807d-465b-b3ac-17603e808156 tempest-ServersTestBootFromVolume-1992682790 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134148) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 18 20:54:18.222555 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-92a7fa34-807d-465b-b3ac-17603e808156 tempest-ServersTestBootFromVolume-1992682790 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134148) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 18 20:54:18.268134 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-92a7fa34-807d-465b-b3ac-17603e808156 tempest-ServersTestBootFromVolume-1992682790 None] clone created successfully {{(pid=134148) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:803}} Dec 18 20:54:18.268134 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.volume_utils [None req-92a7fa34-807d-465b-b3ac-17603e808156 tempest-ServersTestBootFromVolume-1992682790 None] Marking volume 4bdb5baa-b93d-4799-a653-1de77543ed53 as bootable. {{(pid=134148) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1178}} Dec 18 20:54:18.278437 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.flows.manager.create_volume [None req-92a7fa34-807d-465b-b3ac-17603e808156 tempest-ServersTestBootFromVolume-1992682790 None] Copying metadata from image 394b3891-80f2-44c9-a9aa-56fe23a5acb3 to 4bdb5baa-b93d-4799-a653-1de77543ed53. {{(pid=134148) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:444}} Dec 18 20:54:18.279081 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.flows.manager.create_volume [None req-92a7fa34-807d-465b-b3ac-17603e808156 tempest-ServersTestBootFromVolume-1992682790 None] Creating volume glance metadata for volume 4bdb5baa-b93d-4799-a653-1de77543ed53 backed by image 394b3891-80f2-44c9-a9aa-56fe23a5acb3 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '394b3891-80f2-44c9-a9aa-56fe23a5acb3', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=134148) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:667}} Dec 18 20:54:18.371704 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-92a7fa34-807d-465b-b3ac-17603e808156 tempest-ServersTestBootFromVolume-1992682790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2caf56f2-40bc-49b3-bd37-9c206a821bef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4bdb5baa-b93d-4799-a653-1de77543ed53', 'volume_size': 1, 'image_id': '394b3891-80f2-44c9-a9aa-56fe23a5acb3', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b04c3d19c79d4c208395e97f9d293618', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '394b3891-80f2-44c9-a9aa-56fe23a5acb3', 'created_at': datetime.datetime(2021, 12, 18, 20, 38, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 12, 18, 20, 38, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/394b3891-80f2-44c9-a9aa-56fe23a5acb3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 20:54:18.374287 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-92a7fa34-807d-465b-b3ac-17603e808156 tempest-ServersTestBootFromVolume-1992682790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (beb9d21b-b0d5-43b2-8583-59efa2860d8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 20:54:18.387579 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.flows.manager.create_volume [None req-92a7fa34-807d-465b-b3ac-17603e808156 tempest-ServersTestBootFromVolume-1992682790 None] Volume volume-4bdb5baa-b93d-4799-a653-1de77543ed53 (4bdb5baa-b93d-4799-a653-1de77543ed53): created successfully Dec 18 20:54:18.392465 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-92a7fa34-807d-465b-b3ac-17603e808156 tempest-ServersTestBootFromVolume-1992682790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (beb9d21b-b0d5-43b2-8583-59efa2860d8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 20:54:18.396306 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-92a7fa34-807d-465b-b3ac-17603e808156 tempest-ServersTestBootFromVolume-1992682790 None] Flow 'volume_create_manager' (80a39392-3142-4d75-947c-d70c80ce7cc8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134148) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 18 20:54:18.410764 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-92a7fa34-807d-465b-b3ac-17603e808156 tempest-ServersTestBootFromVolume-1992682790 None] Created volume successfully. Dec 18 20:54:22.081036 ncdv-master-1 cinder-volume[134148]: DEBUG oslo_concurrency.processutils [req-74bd90db-0d17-495e-ada9-1e86dbe7c76e req-277c8629-bbb2-495f-b12a-cdeb7b9ad57c tempest-ServersTestBootFromVolume-1992682790 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=134148) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Dec 18 20:54:23.154284 ncdv-master-1 cinder-volume[134148]: DEBUG oslo_concurrency.processutils [req-74bd90db-0d17-495e-ada9-1e86dbe7c76e req-277c8629-bbb2-495f-b12a-cdeb7b9ad57c tempest-ServersTestBootFromVolume-1992682790 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.073s {{(pid=134148) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Dec 18 20:54:23.155350 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [req-74bd90db-0d17-495e-ada9-1e86dbe7c76e req-277c8629-bbb2-495f-b12a-cdeb7b9ad57c tempest-ServersTestBootFromVolume-1992682790 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-4bdb5baa-b93d-4799-a653-1de77543ed53', 'hosts': ['10.222.0.13'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '946d1715-d12c-4dbf-8a79-181222df6e2e', 'volume_id': '4bdb5baa-b93d-4799-a653-1de77543ed53', 'discard': True}} {{(pid=134148) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Dec 18 20:54:23.183767 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [req-74bd90db-0d17-495e-ada9-1e86dbe7c76e req-277c8629-bbb2-495f-b12a-cdeb7b9ad57c tempest-ServersTestBootFromVolume-1992682790 None] Connection info returned from driver {'name': 'volumes/volume-4bdb5baa-b93d-4799-a653-1de77543ed53', 'hosts': ['10.222.0.13'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '4bdb5baa-b93d-4799-a653-1de77543ed53', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '638a1534-17bb-4186-ba5d-04df0ce86729'} {{(pid=134148) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4812}} Dec 18 20:54:23.247631 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [req-74bd90db-0d17-495e-ada9-1e86dbe7c76e req-277c8629-bbb2-495f-b12a-cdeb7b9ad57c tempest-ServersTestBootFromVolume-1992682790 None] attachment_update completed successfully. Dec 18 20:54:34.332427 ncdv-master-1 cinder-volume[134148]: DEBUG oslo_service.periodic_task [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134148) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Dec 18 20:54:34.334755 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 20:54:34.438784 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 20:54:34.510220 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.manager [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] Notifying Schedulers of capabilities ... {{(pid=134148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 18 20:55:34.328730 ncdv-master-1 cinder-volume[134148]: DEBUG oslo_service.periodic_task [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134148) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Dec 18 20:55:34.329495 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 20:55:34.431722 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 20:55:34.501872 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.manager [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] Notifying Schedulers of capabilities ... {{(pid=134148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 18 20:56:32.627991 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-ea605fe1-69ae-447b-9e8f-465b1e7138cb tempest-GroupSnapshotsTest-1763797211 None] Group tempest-GroupSnapshotsTest-Group-1485626263: creating Dec 18 20:56:32.726084 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-ea605fe1-69ae-447b-9e8f-465b1e7138cb tempest-GroupSnapshotsTest-1763797211 None] Group tempest-GroupSnapshotsTest-Group-1485626263: created successfully Dec 18 20:56:32.765039 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-ea605fe1-69ae-447b-9e8f-465b1e7138cb tempest-GroupSnapshotsTest-1763797211 None] Create group completed successfully. Dec 18 20:56:34.331223 ncdv-master-1 cinder-volume[134148]: DEBUG oslo_service.periodic_task [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134148) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Dec 18 20:56:34.333782 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 20:56:34.420404 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 20:56:34.498639 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.manager [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] Notifying Schedulers of capabilities ... {{(pid=134148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 18 20:56:34.545920 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.flows.manager.create_volume [None req-d8e1ea21-492d-45d9-83b3-eab14cce6711 tempest-GroupSnapshotsTest-1763797211 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134148) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Dec 18 20:56:34.550060 ncdv-master-1 cinder-volume[134148]: WARNING stevedore.named [None req-d8e1ea21-492d-45d9-83b3-eab14cce6711 tempest-GroupSnapshotsTest-1763797211 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Dec 18 20:56:34.550315 ncdv-master-1 cinder-volume[134148]: WARNING castellan.key_manager [None req-d8e1ea21-492d-45d9-83b3-eab14cce6711 tempest-GroupSnapshotsTest-1763797211 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Dec 18 20:56:34.573790 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-d8e1ea21-492d-45d9-83b3-eab14cce6711 tempest-GroupSnapshotsTest-1763797211 None] Flow 'volume_create_manager' (6d38bf4f-fed4-4aa2-944a-9e91cd7ffffd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 18 20:56:34.579934 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-d8e1ea21-492d-45d9-83b3-eab14cce6711 tempest-GroupSnapshotsTest-1763797211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (290f0c4a-2cae-47f4-b84f-316319734b29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 20:56:34.594092 ncdv-master-1 cinder-volume[134148]: DEBUG oslo_db.sqlalchemy.engines [None req-d8e1ea21-492d-45d9-83b3-eab14cce6711 tempest-GroupSnapshotsTest-1763797211 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134148) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 18 20:56:34.622976 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-d8e1ea21-492d-45d9-83b3-eab14cce6711 tempest-GroupSnapshotsTest-1763797211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (290f0c4a-2cae-47f4-b84f-316319734b29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-12-18T20:56:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-GroupSnapshotsTest-Volume-112035255',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f701a7e6-9fc8-471b-941c-934fc8395a31,host='ncdv-master-1@ceph#ceph',id=b7888f07-22f6-4687-b74c-96114d5702d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1acacc43a32d4cb8ae226b53cd78f92e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-12-18T20:56:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-12-18T20:56:34Z,use_quota=True,user_id='9b325974d7ea4b42bf73616257c08903',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a64d754a-1bce-4eba-9704-4d2bf2181d77),volume_type_id=a64d754a-1bce-4eba-9704-4d2bf2181d77)' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 20:56:34.625727 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-d8e1ea21-492d-45d9-83b3-eab14cce6711 tempest-GroupSnapshotsTest-1763797211 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ddfccd6c-9902-44af-ac62-814e064f12a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 20:56:34.628054 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-d8e1ea21-492d-45d9-83b3-eab14cce6711 tempest-GroupSnapshotsTest-1763797211 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ddfccd6c-9902-44af-ac62-814e064f12a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 20:56:34.637328 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-d8e1ea21-492d-45d9-83b3-eab14cce6711 tempest-GroupSnapshotsTest-1763797211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b87adfa1-9bc0-49ec-89ca-d220e3563787) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 20:56:34.643062 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-d8e1ea21-492d-45d9-83b3-eab14cce6711 tempest-GroupSnapshotsTest-1763797211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b87adfa1-9bc0-49ec-89ca-d220e3563787) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b7888f07-22f6-4687-b74c-96114d5702d8', 'volume_name': 'volume-b7888f07-22f6-4687-b74c-96114d5702d8', 'volume_size': 1}' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 20:56:34.646692 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-d8e1ea21-492d-45d9-83b3-eab14cce6711 tempest-GroupSnapshotsTest-1763797211 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c63b46fc-d3e9-4543-ac4b-d5ac4b3e870c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 20:56:34.650950 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-d8e1ea21-492d-45d9-83b3-eab14cce6711 tempest-GroupSnapshotsTest-1763797211 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c63b46fc-d3e9-4543-ac4b-d5ac4b3e870c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 20:56:34.666749 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-d8e1ea21-492d-45d9-83b3-eab14cce6711 tempest-GroupSnapshotsTest-1763797211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1235cde1-e0e2-4176-98a1-130848c59bb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 20:56:34.726134 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.flows.manager.create_volume [None req-d8e1ea21-492d-45d9-83b3-eab14cce6711 tempest-GroupSnapshotsTest-1763797211 None] Volume b7888f07-22f6-4687-b74c-96114d5702d8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b7888f07-22f6-4687-b74c-96114d5702d8', 'volume_size': 1} Dec 18 20:56:34.726691 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-d8e1ea21-492d-45d9-83b3-eab14cce6711 tempest-GroupSnapshotsTest-1763797211 None] creating volume 'volume-b7888f07-22f6-4687-b74c-96114d5702d8' {{(pid=134148) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Dec 18 20:56:34.728579 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-d8e1ea21-492d-45d9-83b3-eab14cce6711 tempest-GroupSnapshotsTest-1763797211 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 20:56:34.894238 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-d8e1ea21-492d-45d9-83b3-eab14cce6711 tempest-GroupSnapshotsTest-1763797211 None] extra_specs: {} {{(pid=134148) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 18 20:56:34.895188 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-d8e1ea21-492d-45d9-83b3-eab14cce6711 tempest-GroupSnapshotsTest-1763797211 None] extra_specs: {} {{(pid=134148) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 18 20:56:34.897018 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-d8e1ea21-492d-45d9-83b3-eab14cce6711 tempest-GroupSnapshotsTest-1763797211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1235cde1-e0e2-4176-98a1-130848c59bb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b7888f07-22f6-4687-b74c-96114d5702d8', 'volume_size': 1}' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 20:56:34.899122 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-d8e1ea21-492d-45d9-83b3-eab14cce6711 tempest-GroupSnapshotsTest-1763797211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09fee8eb-c300-439e-82d8-e782f6f72c5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 20:56:34.917022 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.flows.manager.create_volume [None req-d8e1ea21-492d-45d9-83b3-eab14cce6711 tempest-GroupSnapshotsTest-1763797211 None] Volume volume-b7888f07-22f6-4687-b74c-96114d5702d8 (b7888f07-22f6-4687-b74c-96114d5702d8): created successfully Dec 18 20:56:34.919685 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-d8e1ea21-492d-45d9-83b3-eab14cce6711 tempest-GroupSnapshotsTest-1763797211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09fee8eb-c300-439e-82d8-e782f6f72c5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 20:56:34.922216 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-d8e1ea21-492d-45d9-83b3-eab14cce6711 tempest-GroupSnapshotsTest-1763797211 None] Flow 'volume_create_manager' (6d38bf4f-fed4-4aa2-944a-9e91cd7ffffd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134148) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 18 20:56:34.946817 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-d8e1ea21-492d-45d9-83b3-eab14cce6711 tempest-GroupSnapshotsTest-1763797211 None] Created volume successfully. Dec 18 20:56:36.297912 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-b5907bbd-7232-4076-9e5d-e8f7e740141c tempest-GroupSnapshotsTest-1763797211 None] GroupSnapshot 4995fea5-855c-4bef-a874-82ff9e72fecd: creating. Dec 18 20:56:36.338477 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-b5907bbd-7232-4076-9e5d-e8f7e740141c tempest-GroupSnapshotsTest-1763797211 None] Group snapshot 4995fea5-855c-4bef-a874-82ff9e72fecd: creating. {{(pid=134148) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4078}} Dec 18 20:56:36.356367 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-b5907bbd-7232-4076-9e5d-e8f7e740141c tempest-GroupSnapshotsTest-1763797211 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 20:56:37.610531 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-b5907bbd-7232-4076-9e5d-e8f7e740141c tempest-GroupSnapshotsTest-1763797211 None] group_snapshot 4995fea5-855c-4bef-a874-82ff9e72fecd: created successfully Dec 18 20:56:39.452416 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-36adfcc5-3630-412c-9d54-56856b0912a2 tempest-GroupSnapshotsTest-1763797211 None] cloning volumes/volume-b7888f07-22f6-4687-b74c-96114d5702d8@snapshot-ba3c070a-fae3-4c47-9154-566531e6ba2c to volume-dd54ed9a-4d50-4d34-ba7b-cccf5450d197 {{(pid=134148) _clone /opt/stack/cinder/cinder/volume/drivers/rbd.py:1028}} Dec 18 20:56:39.453088 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-36adfcc5-3630-412c-9d54-56856b0912a2 tempest-GroupSnapshotsTest-1763797211 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 20:56:39.553098 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-36adfcc5-3630-412c-9d54-56856b0912a2 tempest-GroupSnapshotsTest-1763797211 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 20:56:39.777510 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-36adfcc5-3630-412c-9d54-56856b0912a2 tempest-GroupSnapshotsTest-1763797211 None] extra_specs: {} {{(pid=134148) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 18 20:56:39.778082 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-36adfcc5-3630-412c-9d54-56856b0912a2 tempest-GroupSnapshotsTest-1763797211 None] extra_specs: {} {{(pid=134148) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 18 20:56:39.784850 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-36adfcc5-3630-412c-9d54-56856b0912a2 tempest-GroupSnapshotsTest-1763797211 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 20:56:39.871912 ncdv-master-1 cinder-volume[134148]: WARNING cinder.volume.drivers.rbd [None req-36adfcc5-3630-412c-9d54-56856b0912a2 tempest-GroupSnapshotsTest-1763797211 None] Not using v2 clone API, please upgrade to mimic+ and set the OSD minimum client compat version to mimic for better performance, fewer deletion issues: NotImplementedError Dec 18 20:56:40.082055 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-36adfcc5-3630-412c-9d54-56856b0912a2 tempest-GroupSnapshotsTest-1763797211 None] Create group from source-snapshot-4995fea5-855c-4bef-a874-82ff9e72fecd completed successfully. Dec 18 20:56:41.239771 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-04faf0d6-7435-45c6-a4c6-6304e39e5010 tempest-GroupSnapshotsTest-1763797211 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 20:56:41.340081 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-04faf0d6-7435-45c6-a4c6-6304e39e5010 tempest-GroupSnapshotsTest-1763797211 None] volume has no backup snaps {{(pid=134148) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Dec 18 20:56:41.359203 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-04faf0d6-7435-45c6-a4c6-6304e39e5010 tempest-GroupSnapshotsTest-1763797211 None] deleting rbd volume volume-dd54ed9a-4d50-4d34-ba7b-cccf5450d197 {{(pid=134148) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Dec 18 20:56:41.855248 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.quota [None req-04faf0d6-7435-45c6-a4c6-6304e39e5010 tempest-GroupSnapshotsTest-1763797211 None] Created reservations ['5cbf7c73-eb63-4ea5-85e4-75c9bf1765cf'] {{(pid=134148) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 18 20:56:41.881695 ncdv-master-1 cinder-volume[134148]: WARNING cinder.quota [None req-04faf0d6-7435-45c6-a4c6-6304e39e5010 tempest-GroupSnapshotsTest-1763797211 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1825055471 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1825055471, it is now deprecated. Please use the default quota class for default quota. Dec 18 20:56:41.883509 ncdv-master-1 cinder-volume[134148]: WARNING cinder.quota [None req-04faf0d6-7435-45c6-a4c6-6304e39e5010 tempest-GroupSnapshotsTest-1763797211 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1825055471 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1825055471, it is now deprecated. Please use the default quota class for default quota. Dec 18 20:56:41.906479 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.quota [None req-04faf0d6-7435-45c6-a4c6-6304e39e5010 tempest-GroupSnapshotsTest-1763797211 None] Created reservations ['ae659353-65c8-438f-a002-36e3295edfed', '0d14f4e6-3eec-4af4-a288-a2d26fe8bb6f', '10927990-30c5-44a7-a802-0f2db4ce300a', 'd8598f42-9b77-451d-9dd0-6da1eae23a88'] {{(pid=134148) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 18 20:56:42.030804 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-04faf0d6-7435-45c6-a4c6-6304e39e5010 tempest-GroupSnapshotsTest-1763797211 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 20:56:42.113289 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-04faf0d6-7435-45c6-a4c6-6304e39e5010 tempest-GroupSnapshotsTest-1763797211 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 20:56:42.230693 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.manager [None req-04faf0d6-7435-45c6-a4c6-6304e39e5010 tempest-GroupSnapshotsTest-1763797211 None] Notifying Schedulers of capabilities ... {{(pid=134148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 18 20:56:42.237203 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-04faf0d6-7435-45c6-a4c6-6304e39e5010 tempest-GroupSnapshotsTest-1763797211 None] Delete group completed successfully. Dec 18 20:56:42.610209 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-d2c323e8-0f0d-46ba-8ae2-b7a2eb4027f8 tempest-GroupSnapshotsTest-1763797211 None] group_snapshot 4995fea5-855c-4bef-a874-82ff9e72fecd: deleting Dec 18 20:56:42.653276 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-d2c323e8-0f0d-46ba-8ae2-b7a2eb4027f8 tempest-GroupSnapshotsTest-1763797211 None] group_snapshot 4995fea5-855c-4bef-a874-82ff9e72fecd: deleting {{(pid=134148) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4253}} Dec 18 20:56:42.693287 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-d2c323e8-0f0d-46ba-8ae2-b7a2eb4027f8 tempest-GroupSnapshotsTest-1763797211 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 20:56:43.623713 ncdv-master-1 cinder-volume[134148]: WARNING cinder.quota [None req-d2c323e8-0f0d-46ba-8ae2-b7a2eb4027f8 tempest-GroupSnapshotsTest-1763797211 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1825055471 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1825055471, it is now deprecated. Please use the default quota class for default quota. Dec 18 20:56:43.657054 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.quota [None req-d2c323e8-0f0d-46ba-8ae2-b7a2eb4027f8 tempest-GroupSnapshotsTest-1763797211 None] Created reservations ['74468637-bc51-4192-b235-8552f42828f6', '159b322e-d3d4-4a36-ae72-c496ff05e787', '05c89f53-3263-41d9-af20-ea00819d3dae', 'b1dac4b6-b9ff-4ce1-8733-7caa246d64e2'] {{(pid=134148) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 18 20:56:43.759800 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-d2c323e8-0f0d-46ba-8ae2-b7a2eb4027f8 tempest-GroupSnapshotsTest-1763797211 None] group_snapshot 4995fea5-855c-4bef-a874-82ff9e72fecd: deleted successfully Dec 18 20:56:44.395344 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-7eb37491-8a87-404a-9a57-0878080d589f tempest-GroupSnapshotsTest-1763797211 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 20:56:44.510211 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-7eb37491-8a87-404a-9a57-0878080d589f tempest-GroupSnapshotsTest-1763797211 None] volume has no backup snaps {{(pid=134148) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Dec 18 20:56:44.510717 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-7eb37491-8a87-404a-9a57-0878080d589f tempest-GroupSnapshotsTest-1763797211 None] Volume volume-b7888f07-22f6-4687-b74c-96114d5702d8 is not a clone. {{(pid=134148) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Dec 18 20:56:44.520146 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-7eb37491-8a87-404a-9a57-0878080d589f tempest-GroupSnapshotsTest-1763797211 None] deleting rbd volume volume-b7888f07-22f6-4687-b74c-96114d5702d8 {{(pid=134148) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Dec 18 20:56:45.023287 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.quota [None req-7eb37491-8a87-404a-9a57-0878080d589f tempest-GroupSnapshotsTest-1763797211 None] Created reservations ['368add3d-51a0-4b75-ba75-1078fbf204f1'] {{(pid=134148) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 18 20:56:45.107672 ncdv-master-1 cinder-volume[134148]: WARNING cinder.db.sqlalchemy.api [None req-7eb37491-8a87-404a-9a57-0878080d589f tempest-GroupSnapshotsTest-1763797211 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-1825055471'] Dec 18 20:56:45.116134 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.quota [None req-7eb37491-8a87-404a-9a57-0878080d589f tempest-GroupSnapshotsTest-1763797211 None] Created reservations ['3c845fea-66f0-4974-b77a-fa603c52b74f', '2c4ab1c7-193c-4767-b81f-3c05d203b72c', 'e5a98451-cff7-4630-8d72-a4624de9fd70', '62de0403-9d5c-423e-9a38-9f298e8a08ce'] {{(pid=134148) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 18 20:56:45.235380 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-7eb37491-8a87-404a-9a57-0878080d589f tempest-GroupSnapshotsTest-1763797211 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 20:56:45.293039 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-7eb37491-8a87-404a-9a57-0878080d589f tempest-GroupSnapshotsTest-1763797211 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 20:56:45.365324 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.manager [None req-7eb37491-8a87-404a-9a57-0878080d589f tempest-GroupSnapshotsTest-1763797211 None] Notifying Schedulers of capabilities ... {{(pid=134148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 18 20:56:45.373297 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-7eb37491-8a87-404a-9a57-0878080d589f tempest-GroupSnapshotsTest-1763797211 None] Delete group completed successfully. Dec 18 20:56:45.889887 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-e927007f-589a-487d-aec9-5809abe314f1 tempest-GroupSnapshotsTest-1763797211 None] Group tempest-GroupSnapshotsTest-Group-563591465: creating Dec 18 20:56:45.914033 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-e927007f-589a-487d-aec9-5809abe314f1 tempest-GroupSnapshotsTest-1763797211 None] Group tempest-GroupSnapshotsTest-Group-563591465: created successfully Dec 18 20:56:45.926065 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-e927007f-589a-487d-aec9-5809abe314f1 tempest-GroupSnapshotsTest-1763797211 None] Create group completed successfully. Dec 18 20:56:47.295961 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.flows.manager.create_volume [None req-f98d5276-c5b4-4968-8b0e-7731939156cd tempest-GroupSnapshotsTest-1763797211 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134148) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Dec 18 20:56:47.299242 ncdv-master-1 cinder-volume[134148]: WARNING stevedore.named [None req-f98d5276-c5b4-4968-8b0e-7731939156cd tempest-GroupSnapshotsTest-1763797211 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Dec 18 20:56:47.299693 ncdv-master-1 cinder-volume[134148]: WARNING castellan.key_manager [None req-f98d5276-c5b4-4968-8b0e-7731939156cd tempest-GroupSnapshotsTest-1763797211 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Dec 18 20:56:47.312036 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-f98d5276-c5b4-4968-8b0e-7731939156cd tempest-GroupSnapshotsTest-1763797211 None] Flow 'volume_create_manager' (7a26eafe-a749-44be-aab2-b6489590de16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 18 20:56:47.315609 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-f98d5276-c5b4-4968-8b0e-7731939156cd tempest-GroupSnapshotsTest-1763797211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (526a94bf-746b-4ae4-b1fe-93235da4d584) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 20:56:47.322217 ncdv-master-1 cinder-volume[134148]: DEBUG oslo_db.sqlalchemy.engines [None req-f98d5276-c5b4-4968-8b0e-7731939156cd tempest-GroupSnapshotsTest-1763797211 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134148) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 18 20:56:47.336602 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-f98d5276-c5b4-4968-8b0e-7731939156cd tempest-GroupSnapshotsTest-1763797211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (526a94bf-746b-4ae4-b1fe-93235da4d584) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-12-18T20:56:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-GroupSnapshotsTest-Volume-460983818',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=5bfdffaa-d090-498e-a609-e5a639d512ba,host='ncdv-master-1@ceph#ceph',id=bcea29bb-02f9-44ae-9863-e7bb64c9007d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1acacc43a32d4cb8ae226b53cd78f92e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-12-18T20:56:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-12-18T20:56:47Z,use_quota=True,user_id='9b325974d7ea4b42bf73616257c08903',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(43e83226-0168-493d-b22c-41cfad8cfba9),volume_type_id=43e83226-0168-493d-b22c-41cfad8cfba9)' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 20:56:47.339324 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-f98d5276-c5b4-4968-8b0e-7731939156cd tempest-GroupSnapshotsTest-1763797211 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc950b08-d63c-4a15-ba6b-c981bcb88696) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 20:56:47.341605 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-f98d5276-c5b4-4968-8b0e-7731939156cd tempest-GroupSnapshotsTest-1763797211 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc950b08-d63c-4a15-ba6b-c981bcb88696) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 20:56:47.343972 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-f98d5276-c5b4-4968-8b0e-7731939156cd tempest-GroupSnapshotsTest-1763797211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05e6adec-757d-49f6-a947-b69230053edd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 20:56:47.346233 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-f98d5276-c5b4-4968-8b0e-7731939156cd tempest-GroupSnapshotsTest-1763797211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05e6adec-757d-49f6-a947-b69230053edd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bcea29bb-02f9-44ae-9863-e7bb64c9007d', 'volume_name': 'volume-bcea29bb-02f9-44ae-9863-e7bb64c9007d', 'volume_size': 1}' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 20:56:47.349153 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-f98d5276-c5b4-4968-8b0e-7731939156cd tempest-GroupSnapshotsTest-1763797211 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ac453c9-14e1-4a7c-bc6f-2e25a7353a55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 20:56:47.351322 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-f98d5276-c5b4-4968-8b0e-7731939156cd tempest-GroupSnapshotsTest-1763797211 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ac453c9-14e1-4a7c-bc6f-2e25a7353a55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 20:56:47.353554 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-f98d5276-c5b4-4968-8b0e-7731939156cd tempest-GroupSnapshotsTest-1763797211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f7128cf-d3fc-4ca0-a836-044ec919b97c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 20:56:47.367077 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.flows.manager.create_volume [None req-f98d5276-c5b4-4968-8b0e-7731939156cd tempest-GroupSnapshotsTest-1763797211 None] Volume bcea29bb-02f9-44ae-9863-e7bb64c9007d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bcea29bb-02f9-44ae-9863-e7bb64c9007d', 'volume_size': 1} Dec 18 20:56:47.367951 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-f98d5276-c5b4-4968-8b0e-7731939156cd tempest-GroupSnapshotsTest-1763797211 None] creating volume 'volume-bcea29bb-02f9-44ae-9863-e7bb64c9007d' {{(pid=134148) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Dec 18 20:56:47.368494 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-f98d5276-c5b4-4968-8b0e-7731939156cd tempest-GroupSnapshotsTest-1763797211 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 20:56:47.472315 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-f98d5276-c5b4-4968-8b0e-7731939156cd tempest-GroupSnapshotsTest-1763797211 None] extra_specs: {} {{(pid=134148) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 18 20:56:47.473584 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-f98d5276-c5b4-4968-8b0e-7731939156cd tempest-GroupSnapshotsTest-1763797211 None] extra_specs: {} {{(pid=134148) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 18 20:56:47.476582 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-f98d5276-c5b4-4968-8b0e-7731939156cd tempest-GroupSnapshotsTest-1763797211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f7128cf-d3fc-4ca0-a836-044ec919b97c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bcea29bb-02f9-44ae-9863-e7bb64c9007d', 'volume_size': 1}' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 20:56:47.479152 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-f98d5276-c5b4-4968-8b0e-7731939156cd tempest-GroupSnapshotsTest-1763797211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11202f1c-1482-41e9-89bd-440c4ac946ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 20:56:47.490884 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.flows.manager.create_volume [None req-f98d5276-c5b4-4968-8b0e-7731939156cd tempest-GroupSnapshotsTest-1763797211 None] Volume volume-bcea29bb-02f9-44ae-9863-e7bb64c9007d (bcea29bb-02f9-44ae-9863-e7bb64c9007d): created successfully Dec 18 20:56:47.495129 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-f98d5276-c5b4-4968-8b0e-7731939156cd tempest-GroupSnapshotsTest-1763797211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11202f1c-1482-41e9-89bd-440c4ac946ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 20:56:47.512961 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-f98d5276-c5b4-4968-8b0e-7731939156cd tempest-GroupSnapshotsTest-1763797211 None] Flow 'volume_create_manager' (7a26eafe-a749-44be-aab2-b6489590de16) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134148) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 18 20:56:47.529010 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-f98d5276-c5b4-4968-8b0e-7731939156cd tempest-GroupSnapshotsTest-1763797211 None] Created volume successfully. Dec 18 20:56:48.820964 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.flows.manager.create_volume [None req-72d7a7a4-9beb-4b8c-9403-7208618756b3 tempest-GroupSnapshotsTest-1763797211 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134148) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Dec 18 20:56:48.825694 ncdv-master-1 cinder-volume[134148]: WARNING stevedore.named [None req-72d7a7a4-9beb-4b8c-9403-7208618756b3 tempest-GroupSnapshotsTest-1763797211 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Dec 18 20:56:48.826526 ncdv-master-1 cinder-volume[134148]: WARNING castellan.key_manager [None req-72d7a7a4-9beb-4b8c-9403-7208618756b3 tempest-GroupSnapshotsTest-1763797211 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Dec 18 20:56:48.844098 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-72d7a7a4-9beb-4b8c-9403-7208618756b3 tempest-GroupSnapshotsTest-1763797211 None] Flow 'volume_create_manager' (c7017350-e65c-4492-b5b7-9ed8d9db9fc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 18 20:56:48.847140 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-72d7a7a4-9beb-4b8c-9403-7208618756b3 tempest-GroupSnapshotsTest-1763797211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83ee7e08-18b4-4c03-88e5-ee56895c7595) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 20:56:48.854506 ncdv-master-1 cinder-volume[134148]: DEBUG oslo_db.sqlalchemy.engines [None req-72d7a7a4-9beb-4b8c-9403-7208618756b3 tempest-GroupSnapshotsTest-1763797211 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134148) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 18 20:56:48.871582 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-72d7a7a4-9beb-4b8c-9403-7208618756b3 tempest-GroupSnapshotsTest-1763797211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83ee7e08-18b4-4c03-88e5-ee56895c7595) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-12-18T20:56:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-GroupSnapshotsTest-Volume-139221471',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=5bfdffaa-d090-498e-a609-e5a639d512ba,host='ncdv-master-1@ceph#ceph',id=d065c8f3-938c-4628-933d-0473823c6051,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1acacc43a32d4cb8ae226b53cd78f92e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-12-18T20:56:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-12-18T20:56:49Z,use_quota=True,user_id='9b325974d7ea4b42bf73616257c08903',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(43e83226-0168-493d-b22c-41cfad8cfba9),volume_type_id=43e83226-0168-493d-b22c-41cfad8cfba9)' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 20:56:48.874651 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-72d7a7a4-9beb-4b8c-9403-7208618756b3 tempest-GroupSnapshotsTest-1763797211 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8cfa5fc1-b8b9-4a73-8086-1e7ef162c954) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 20:56:48.877394 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-72d7a7a4-9beb-4b8c-9403-7208618756b3 tempest-GroupSnapshotsTest-1763797211 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8cfa5fc1-b8b9-4a73-8086-1e7ef162c954) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 20:56:48.881060 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-72d7a7a4-9beb-4b8c-9403-7208618756b3 tempest-GroupSnapshotsTest-1763797211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (487dcd92-eacb-469d-9ebc-ed231c20cac2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 20:56:48.884014 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-72d7a7a4-9beb-4b8c-9403-7208618756b3 tempest-GroupSnapshotsTest-1763797211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (487dcd92-eacb-469d-9ebc-ed231c20cac2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd065c8f3-938c-4628-933d-0473823c6051', 'volume_name': 'volume-d065c8f3-938c-4628-933d-0473823c6051', 'volume_size': 1}' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 20:56:48.886804 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-72d7a7a4-9beb-4b8c-9403-7208618756b3 tempest-GroupSnapshotsTest-1763797211 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6f3cd86-60b4-4ccf-8060-beee2d243a21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 20:56:48.890749 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-72d7a7a4-9beb-4b8c-9403-7208618756b3 tempest-GroupSnapshotsTest-1763797211 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6f3cd86-60b4-4ccf-8060-beee2d243a21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 20:56:48.893884 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-72d7a7a4-9beb-4b8c-9403-7208618756b3 tempest-GroupSnapshotsTest-1763797211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5b7a8a5-b71f-4a36-9f9d-2acd847a610f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 20:56:48.908864 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.flows.manager.create_volume [None req-72d7a7a4-9beb-4b8c-9403-7208618756b3 tempest-GroupSnapshotsTest-1763797211 None] Volume d065c8f3-938c-4628-933d-0473823c6051: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d065c8f3-938c-4628-933d-0473823c6051', 'volume_size': 1} Dec 18 20:56:48.909502 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-72d7a7a4-9beb-4b8c-9403-7208618756b3 tempest-GroupSnapshotsTest-1763797211 None] creating volume 'volume-d065c8f3-938c-4628-933d-0473823c6051' {{(pid=134148) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Dec 18 20:56:48.910949 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-72d7a7a4-9beb-4b8c-9403-7208618756b3 tempest-GroupSnapshotsTest-1763797211 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 20:56:48.980933 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-72d7a7a4-9beb-4b8c-9403-7208618756b3 tempest-GroupSnapshotsTest-1763797211 None] extra_specs: {} {{(pid=134148) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 18 20:56:48.981668 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-72d7a7a4-9beb-4b8c-9403-7208618756b3 tempest-GroupSnapshotsTest-1763797211 None] extra_specs: {} {{(pid=134148) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 18 20:56:48.983994 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-72d7a7a4-9beb-4b8c-9403-7208618756b3 tempest-GroupSnapshotsTest-1763797211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5b7a8a5-b71f-4a36-9f9d-2acd847a610f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d065c8f3-938c-4628-933d-0473823c6051', 'volume_size': 1}' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 20:56:48.986279 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-72d7a7a4-9beb-4b8c-9403-7208618756b3 tempest-GroupSnapshotsTest-1763797211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a04d25c-0990-4470-8d38-51eb7beb287a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 20:56:48.998499 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.flows.manager.create_volume [None req-72d7a7a4-9beb-4b8c-9403-7208618756b3 tempest-GroupSnapshotsTest-1763797211 None] Volume volume-d065c8f3-938c-4628-933d-0473823c6051 (d065c8f3-938c-4628-933d-0473823c6051): created successfully Dec 18 20:56:49.000981 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-72d7a7a4-9beb-4b8c-9403-7208618756b3 tempest-GroupSnapshotsTest-1763797211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a04d25c-0990-4470-8d38-51eb7beb287a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 20:56:49.004995 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-72d7a7a4-9beb-4b8c-9403-7208618756b3 tempest-GroupSnapshotsTest-1763797211 None] Flow 'volume_create_manager' (c7017350-e65c-4492-b5b7-9ed8d9db9fc2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134148) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 18 20:56:49.017493 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-72d7a7a4-9beb-4b8c-9403-7208618756b3 tempest-GroupSnapshotsTest-1763797211 None] Created volume successfully. Dec 18 20:56:50.051321 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-e4966762-03b6-4962-80f5-c71d2bcd1ff3 tempest-GroupSnapshotsTest-1763797211 None] Update group completed successfully. Dec 18 20:56:51.277216 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-d744c201-7adf-4525-b2f9-ce12ccd15d85 tempest-GroupSnapshotsTest-1763797211 None] Update group completed successfully. Dec 18 20:56:52.553147 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-dc1532ea-f4d2-423f-bc79-9a98a1f80bf9 tempest-GroupSnapshotsTest-1763797211 None] Update group completed successfully. Dec 18 20:56:53.764814 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-062c3e0e-5139-45e7-9b99-48432c157b38 tempest-GroupSnapshotsTest-1763797211 None] Update group completed successfully. Dec 18 20:56:55.532131 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-51755eed-0cba-4df5-b4b3-6902a6c79214 tempest-GroupSnapshotsTest-1763797211 None] GroupSnapshot 8a7522db-7185-4a42-84c5-d506123e6eca: creating. Dec 18 20:56:55.571203 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-51755eed-0cba-4df5-b4b3-6902a6c79214 tempest-GroupSnapshotsTest-1763797211 None] Group snapshot 8a7522db-7185-4a42-84c5-d506123e6eca: creating. {{(pid=134148) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4078}} Dec 18 20:56:55.619513 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-51755eed-0cba-4df5-b4b3-6902a6c79214 tempest-GroupSnapshotsTest-1763797211 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 20:56:56.060483 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-51755eed-0cba-4df5-b4b3-6902a6c79214 tempest-GroupSnapshotsTest-1763797211 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 20:56:57.255454 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-51755eed-0cba-4df5-b4b3-6902a6c79214 tempest-GroupSnapshotsTest-1763797211 None] group_snapshot 8a7522db-7185-4a42-84c5-d506123e6eca: created successfully Dec 18 20:56:58.007207 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-4324bb23-c7fe-4039-b1bc-3d3c1b3bd600 tempest-GroupSnapshotsTest-1763797211 None] group_snapshot 8a7522db-7185-4a42-84c5-d506123e6eca: deleting Dec 18 20:56:58.044897 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-4324bb23-c7fe-4039-b1bc-3d3c1b3bd600 tempest-GroupSnapshotsTest-1763797211 None] group_snapshot 8a7522db-7185-4a42-84c5-d506123e6eca: deleting {{(pid=134148) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4253}} Dec 18 20:56:58.083396 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-4324bb23-c7fe-4039-b1bc-3d3c1b3bd600 tempest-GroupSnapshotsTest-1763797211 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 20:56:59.200090 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-4324bb23-c7fe-4039-b1bc-3d3c1b3bd600 tempest-GroupSnapshotsTest-1763797211 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 20:57:00.325114 ncdv-master-1 cinder-volume[134148]: WARNING cinder.quota [None req-4324bb23-c7fe-4039-b1bc-3d3c1b3bd600 tempest-GroupSnapshotsTest-1763797211 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-747197944 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-747197944, it is now deprecated. Please use the default quota class for default quota. Dec 18 20:57:00.325931 ncdv-master-1 cinder-volume[134148]: WARNING cinder.quota [None req-4324bb23-c7fe-4039-b1bc-3d3c1b3bd600 tempest-GroupSnapshotsTest-1763797211 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-747197944 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-747197944, it is now deprecated. Please use the default quota class for default quota. Dec 18 20:57:00.366138 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.quota [None req-4324bb23-c7fe-4039-b1bc-3d3c1b3bd600 tempest-GroupSnapshotsTest-1763797211 None] Created reservations ['7e0418ea-cce3-4ee4-8d73-7f73e8c84c52', '50171fae-9482-4748-af75-25bd2d23b7c1', 'ed6ad38c-a62e-46a4-b24b-a409eace1ca4', 'd0ed93dd-0846-4f3d-8454-9ea24f1e0b89'] {{(pid=134148) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 18 20:57:00.528348 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.quota [None req-4324bb23-c7fe-4039-b1bc-3d3c1b3bd600 tempest-GroupSnapshotsTest-1763797211 None] Created reservations ['cdc3b3fd-59ae-485b-af35-247f47a36303', '4f13b164-0619-4c36-a55e-f7e86d8f0142', 'f387db09-63a2-49f6-af9b-367fb7a3176c', '7d88fb4b-2433-4f2c-b03a-effdc9c7bd75'] {{(pid=134148) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 18 20:57:00.618197 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-4324bb23-c7fe-4039-b1bc-3d3c1b3bd600 tempest-GroupSnapshotsTest-1763797211 None] group_snapshot 8a7522db-7185-4a42-84c5-d506123e6eca: deleted successfully Dec 18 20:57:01.957440 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-fe474e9b-54db-4a34-8807-e6aef85324f9 tempest-GroupSnapshotsTest-1763797211 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 20:57:02.094005 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-fe474e9b-54db-4a34-8807-e6aef85324f9 tempest-GroupSnapshotsTest-1763797211 None] volume has no backup snaps {{(pid=134148) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Dec 18 20:57:02.094452 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-fe474e9b-54db-4a34-8807-e6aef85324f9 tempest-GroupSnapshotsTest-1763797211 None] Volume volume-bcea29bb-02f9-44ae-9863-e7bb64c9007d is not a clone. {{(pid=134148) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Dec 18 20:57:02.109502 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-fe474e9b-54db-4a34-8807-e6aef85324f9 tempest-GroupSnapshotsTest-1763797211 None] deleting rbd volume volume-bcea29bb-02f9-44ae-9863-e7bb64c9007d {{(pid=134148) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Dec 18 20:57:02.696126 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-fe474e9b-54db-4a34-8807-e6aef85324f9 tempest-GroupSnapshotsTest-1763797211 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 20:57:02.779940 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-fe474e9b-54db-4a34-8807-e6aef85324f9 tempest-GroupSnapshotsTest-1763797211 None] volume has no backup snaps {{(pid=134148) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Dec 18 20:57:02.780585 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-fe474e9b-54db-4a34-8807-e6aef85324f9 tempest-GroupSnapshotsTest-1763797211 None] Volume volume-d065c8f3-938c-4628-933d-0473823c6051 is not a clone. {{(pid=134148) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Dec 18 20:57:02.809673 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-fe474e9b-54db-4a34-8807-e6aef85324f9 tempest-GroupSnapshotsTest-1763797211 None] deleting rbd volume volume-d065c8f3-938c-4628-933d-0473823c6051 {{(pid=134148) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Dec 18 20:57:03.614485 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.quota [None req-fe474e9b-54db-4a34-8807-e6aef85324f9 tempest-GroupSnapshotsTest-1763797211 None] Created reservations ['2a3a814d-e5b1-4493-b748-c2486f8c506d'] {{(pid=134148) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 18 20:57:03.668732 ncdv-master-1 cinder-volume[134148]: WARNING cinder.quota [None req-fe474e9b-54db-4a34-8807-e6aef85324f9 tempest-GroupSnapshotsTest-1763797211 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-747197944 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-747197944, it is now deprecated. Please use the default quota class for default quota. Dec 18 20:57:03.722327 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.quota [None req-fe474e9b-54db-4a34-8807-e6aef85324f9 tempest-GroupSnapshotsTest-1763797211 None] Created reservations ['c6cacd4d-f24e-4444-b2d0-d364d5cf5839', 'ba267427-3814-4491-a078-64004e811c82', '803bb556-8059-4c93-a268-15b645e324a3', '873973d3-7e2f-4c4b-8a3f-1ae58de48510'] {{(pid=134148) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 18 20:57:03.976387 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.quota [None req-fe474e9b-54db-4a34-8807-e6aef85324f9 tempest-GroupSnapshotsTest-1763797211 None] Created reservations ['70734aae-b7cc-4cf2-8f8f-81c925693635', 'b827e5e5-9865-4220-a2c2-7deebed79ba6', '1fff1a50-dd3d-40e0-93a9-c76a09145f6b', '3676937b-1245-4970-88f4-62ef66f03841'] {{(pid=134148) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 18 20:57:04.140127 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-fe474e9b-54db-4a34-8807-e6aef85324f9 tempest-GroupSnapshotsTest-1763797211 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 20:57:04.240398 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-fe474e9b-54db-4a34-8807-e6aef85324f9 tempest-GroupSnapshotsTest-1763797211 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 20:57:04.377054 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.manager [None req-fe474e9b-54db-4a34-8807-e6aef85324f9 tempest-GroupSnapshotsTest-1763797211 None] Notifying Schedulers of capabilities ... {{(pid=134148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 18 20:57:04.382997 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-fe474e9b-54db-4a34-8807-e6aef85324f9 tempest-GroupSnapshotsTest-1763797211 None] Delete group completed successfully. Dec 18 20:57:04.857152 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-44342298-7ce6-4375-9d7c-53b22bf1285e tempest-GroupSnapshotsTest-1763797211 None] Group tempest-GroupSnapshotsTest-Group-1338740709: creating Dec 18 20:57:04.955931 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-44342298-7ce6-4375-9d7c-53b22bf1285e tempest-GroupSnapshotsTest-1763797211 None] Group tempest-GroupSnapshotsTest-Group-1338740709: created successfully Dec 18 20:57:04.990971 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-44342298-7ce6-4375-9d7c-53b22bf1285e tempest-GroupSnapshotsTest-1763797211 None] Create group completed successfully. Dec 18 20:57:07.057876 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.flows.manager.create_volume [None req-2265497c-74a8-48b3-8d9f-51604e4a0911 tempest-GroupSnapshotsTest-1763797211 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134148) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Dec 18 20:57:07.062092 ncdv-master-1 cinder-volume[134148]: WARNING stevedore.named [None req-2265497c-74a8-48b3-8d9f-51604e4a0911 tempest-GroupSnapshotsTest-1763797211 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Dec 18 20:57:07.063060 ncdv-master-1 cinder-volume[134148]: WARNING castellan.key_manager [None req-2265497c-74a8-48b3-8d9f-51604e4a0911 tempest-GroupSnapshotsTest-1763797211 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Dec 18 20:57:07.082718 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-2265497c-74a8-48b3-8d9f-51604e4a0911 tempest-GroupSnapshotsTest-1763797211 None] Flow 'volume_create_manager' (8cc2236e-7524-4128-a20e-da3431105836) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 18 20:57:07.087040 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-2265497c-74a8-48b3-8d9f-51604e4a0911 tempest-GroupSnapshotsTest-1763797211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0986f07-d95c-4353-95f4-517b14ad285e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 20:57:07.095268 ncdv-master-1 cinder-volume[134148]: DEBUG oslo_db.sqlalchemy.engines [None req-2265497c-74a8-48b3-8d9f-51604e4a0911 tempest-GroupSnapshotsTest-1763797211 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134148) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 18 20:57:07.121842 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-2265497c-74a8-48b3-8d9f-51604e4a0911 tempest-GroupSnapshotsTest-1763797211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0986f07-d95c-4353-95f4-517b14ad285e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-12-18T20:57:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-GroupSnapshotsTest-Volume-2123985657',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f76046e5-138a-4899-ac31-9592ec0e448f,host='ncdv-master-1@ceph#ceph',id=bd31f689-d0ef-4511-93a7-ab76b907111c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1acacc43a32d4cb8ae226b53cd78f92e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-12-18T20:57:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-12-18T20:57:07Z,use_quota=True,user_id='9b325974d7ea4b42bf73616257c08903',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(82cd8933-770d-44d2-8cde-2ebb78b56af1),volume_type_id=82cd8933-770d-44d2-8cde-2ebb78b56af1)' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 20:57:07.128607 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-2265497c-74a8-48b3-8d9f-51604e4a0911 tempest-GroupSnapshotsTest-1763797211 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c398d76f-2c20-4be6-86fc-ad19490be96c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 20:57:07.133002 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-2265497c-74a8-48b3-8d9f-51604e4a0911 tempest-GroupSnapshotsTest-1763797211 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c398d76f-2c20-4be6-86fc-ad19490be96c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 20:57:07.136237 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-2265497c-74a8-48b3-8d9f-51604e4a0911 tempest-GroupSnapshotsTest-1763797211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9373249-a9a9-4e54-a8c7-46a38763dd70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 20:57:07.140448 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-2265497c-74a8-48b3-8d9f-51604e4a0911 tempest-GroupSnapshotsTest-1763797211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9373249-a9a9-4e54-a8c7-46a38763dd70) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bd31f689-d0ef-4511-93a7-ab76b907111c', 'volume_name': 'volume-bd31f689-d0ef-4511-93a7-ab76b907111c', 'volume_size': 1}' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 20:57:07.144034 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-2265497c-74a8-48b3-8d9f-51604e4a0911 tempest-GroupSnapshotsTest-1763797211 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (332550e6-289f-4bd3-aab1-8ff2b8f1e4ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 20:57:07.147063 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-2265497c-74a8-48b3-8d9f-51604e4a0911 tempest-GroupSnapshotsTest-1763797211 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (332550e6-289f-4bd3-aab1-8ff2b8f1e4ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 20:57:07.154820 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-2265497c-74a8-48b3-8d9f-51604e4a0911 tempest-GroupSnapshotsTest-1763797211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef64f7d6-6f87-4b6f-92d8-6ff30532f06b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 20:57:07.175632 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.flows.manager.create_volume [None req-2265497c-74a8-48b3-8d9f-51604e4a0911 tempest-GroupSnapshotsTest-1763797211 None] Volume bd31f689-d0ef-4511-93a7-ab76b907111c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bd31f689-d0ef-4511-93a7-ab76b907111c', 'volume_size': 1} Dec 18 20:57:07.176307 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-2265497c-74a8-48b3-8d9f-51604e4a0911 tempest-GroupSnapshotsTest-1763797211 None] creating volume 'volume-bd31f689-d0ef-4511-93a7-ab76b907111c' {{(pid=134148) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Dec 18 20:57:07.177519 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-2265497c-74a8-48b3-8d9f-51604e4a0911 tempest-GroupSnapshotsTest-1763797211 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 20:57:07.333998 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-2265497c-74a8-48b3-8d9f-51604e4a0911 tempest-GroupSnapshotsTest-1763797211 None] extra_specs: {} {{(pid=134148) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 18 20:57:07.334674 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-2265497c-74a8-48b3-8d9f-51604e4a0911 tempest-GroupSnapshotsTest-1763797211 None] extra_specs: {} {{(pid=134148) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 18 20:57:07.336987 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-2265497c-74a8-48b3-8d9f-51604e4a0911 tempest-GroupSnapshotsTest-1763797211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef64f7d6-6f87-4b6f-92d8-6ff30532f06b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bd31f689-d0ef-4511-93a7-ab76b907111c', 'volume_size': 1}' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 20:57:07.339609 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-2265497c-74a8-48b3-8d9f-51604e4a0911 tempest-GroupSnapshotsTest-1763797211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf360520-4601-461e-bcee-f8e006b0e5e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 20:57:07.368235 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.flows.manager.create_volume [None req-2265497c-74a8-48b3-8d9f-51604e4a0911 tempest-GroupSnapshotsTest-1763797211 None] Volume volume-bd31f689-d0ef-4511-93a7-ab76b907111c (bd31f689-d0ef-4511-93a7-ab76b907111c): created successfully Dec 18 20:57:07.376310 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-2265497c-74a8-48b3-8d9f-51604e4a0911 tempest-GroupSnapshotsTest-1763797211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf360520-4601-461e-bcee-f8e006b0e5e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 20:57:07.388349 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-2265497c-74a8-48b3-8d9f-51604e4a0911 tempest-GroupSnapshotsTest-1763797211 None] Flow 'volume_create_manager' (8cc2236e-7524-4128-a20e-da3431105836) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134148) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 18 20:57:07.416810 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-2265497c-74a8-48b3-8d9f-51604e4a0911 tempest-GroupSnapshotsTest-1763797211 None] Created volume successfully. Dec 18 20:57:08.487045 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-2a47752d-6605-42b0-ab8e-82dfcf754b80 tempest-GroupSnapshotsTest-1763797211 None] GroupSnapshot 15ec412c-b5fb-44b7-b561-301ecc7dff88: creating. Dec 18 20:57:08.547552 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-2a47752d-6605-42b0-ab8e-82dfcf754b80 tempest-GroupSnapshotsTest-1763797211 None] Group snapshot 15ec412c-b5fb-44b7-b561-301ecc7dff88: creating. {{(pid=134148) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4078}} Dec 18 20:57:08.623665 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-2a47752d-6605-42b0-ab8e-82dfcf754b80 tempest-GroupSnapshotsTest-1763797211 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 20:57:09.230512 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-2a47752d-6605-42b0-ab8e-82dfcf754b80 tempest-GroupSnapshotsTest-1763797211 None] group_snapshot 15ec412c-b5fb-44b7-b561-301ecc7dff88: created successfully Dec 18 20:57:09.970067 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-524c50dd-0c0b-499d-8fd5-bba9997b89b4 tempest-GroupSnapshotsTest-1763797211 None] group_snapshot 15ec412c-b5fb-44b7-b561-301ecc7dff88: deleting Dec 18 20:57:10.005929 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-524c50dd-0c0b-499d-8fd5-bba9997b89b4 tempest-GroupSnapshotsTest-1763797211 None] group_snapshot 15ec412c-b5fb-44b7-b561-301ecc7dff88: deleting {{(pid=134148) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4253}} Dec 18 20:57:10.078239 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-524c50dd-0c0b-499d-8fd5-bba9997b89b4 tempest-GroupSnapshotsTest-1763797211 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 20:57:10.608736 ncdv-master-1 cinder-volume[134148]: WARNING cinder.quota [None req-524c50dd-0c0b-499d-8fd5-bba9997b89b4 tempest-GroupSnapshotsTest-1763797211 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1141401178 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1141401178, it is now deprecated. Please use the default quota class for default quota. Dec 18 20:57:10.609570 ncdv-master-1 cinder-volume[134148]: WARNING cinder.quota [None req-524c50dd-0c0b-499d-8fd5-bba9997b89b4 tempest-GroupSnapshotsTest-1763797211 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1141401178 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1141401178, it is now deprecated. Please use the default quota class for default quota. Dec 18 20:57:10.671859 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.quota [None req-524c50dd-0c0b-499d-8fd5-bba9997b89b4 tempest-GroupSnapshotsTest-1763797211 None] Created reservations ['0cdf3390-c1b8-44c2-a99f-0e0e6f79bbe9', '618e2590-5ea7-46b5-b4d6-5875e0f8b9da', 'b0f18c9a-ea0c-4284-a399-beca7c315beb', 'ff57ab76-ee8c-4581-9131-2601d9bb47e3'] {{(pid=134148) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 18 20:57:10.850001 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-524c50dd-0c0b-499d-8fd5-bba9997b89b4 tempest-GroupSnapshotsTest-1763797211 None] group_snapshot 15ec412c-b5fb-44b7-b561-301ecc7dff88: deleted successfully Dec 18 20:57:12.044526 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-8204fafd-2302-4bc4-a112-3cf7ab14cc9d tempest-GroupSnapshotsTest-1763797211 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 20:57:12.162802 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-8204fafd-2302-4bc4-a112-3cf7ab14cc9d tempest-GroupSnapshotsTest-1763797211 None] volume has no backup snaps {{(pid=134148) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Dec 18 20:57:12.163146 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-8204fafd-2302-4bc4-a112-3cf7ab14cc9d tempest-GroupSnapshotsTest-1763797211 None] Volume volume-bd31f689-d0ef-4511-93a7-ab76b907111c is not a clone. {{(pid=134148) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Dec 18 20:57:12.181504 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-8204fafd-2302-4bc4-a112-3cf7ab14cc9d tempest-GroupSnapshotsTest-1763797211 None] deleting rbd volume volume-bd31f689-d0ef-4511-93a7-ab76b907111c {{(pid=134148) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Dec 18 20:57:12.905877 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.quota [None req-8204fafd-2302-4bc4-a112-3cf7ab14cc9d tempest-GroupSnapshotsTest-1763797211 None] Created reservations ['7455d2cd-d571-43cf-a97d-f6aa2d26ff91'] {{(pid=134148) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 18 20:57:12.938300 ncdv-master-1 cinder-volume[134148]: WARNING cinder.quota [None req-8204fafd-2302-4bc4-a112-3cf7ab14cc9d tempest-GroupSnapshotsTest-1763797211 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1141401178 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1141401178, it is now deprecated. Please use the default quota class for default quota. Dec 18 20:57:12.968044 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.quota [None req-8204fafd-2302-4bc4-a112-3cf7ab14cc9d tempest-GroupSnapshotsTest-1763797211 None] Created reservations ['f27e4213-2cbb-4f2f-bb89-94525c090de3', '702f3870-5089-4cfe-8229-601d1951ee23', '1e9c5103-b9b2-4c18-8d88-57082ee20572', 'e044a368-7d7a-49c6-8938-6b116a993548'] {{(pid=134148) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 18 20:57:13.138493 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-8204fafd-2302-4bc4-a112-3cf7ab14cc9d tempest-GroupSnapshotsTest-1763797211 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 20:57:13.229113 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-8204fafd-2302-4bc4-a112-3cf7ab14cc9d tempest-GroupSnapshotsTest-1763797211 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 20:57:13.352451 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.manager [None req-8204fafd-2302-4bc4-a112-3cf7ab14cc9d tempest-GroupSnapshotsTest-1763797211 None] Notifying Schedulers of capabilities ... {{(pid=134148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 18 20:57:13.359394 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-8204fafd-2302-4bc4-a112-3cf7ab14cc9d tempest-GroupSnapshotsTest-1763797211 None] Delete group completed successfully. Dec 18 20:57:16.505443 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [req-2a6dd975-80e3-410e-9042-cfee015c2511 req-78db2599-6ef7-4b20-b93a-6732d417cc5c tempest-ServersTestBootFromVolume-1992682790 None] Terminate volume connection completed successfully. Dec 18 20:57:16.508152 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [req-2a6dd975-80e3-410e-9042-cfee015c2511 req-78db2599-6ef7-4b20-b93a-6732d417cc5c tempest-ServersTestBootFromVolume-1992682790 None] Deleting attachment 638a1534-17bb-4186-ba5d-04df0ce86729. {{(pid=134148) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4948}} Dec 18 20:57:16.895254 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.coordination [req-2a6dd975-80e3-410e-9042-cfee015c2511 req-7f1a2a52-bafe-47f1-8694-c7e9085ed27d tempest-ServersTestBootFromVolume-1992682790 None] Lock "b'cinder-4bdb5baa-b93d-4799-a653-1de77543ed53-delete_volume'" acquired by "delete_volume" :: waited 0.041s {{(pid=134148) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 18 20:57:17.004274 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [req-2a6dd975-80e3-410e-9042-cfee015c2511 req-7f1a2a52-bafe-47f1-8694-c7e9085ed27d tempest-ServersTestBootFromVolume-1992682790 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 20:57:17.180253 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [req-2a6dd975-80e3-410e-9042-cfee015c2511 req-7f1a2a52-bafe-47f1-8694-c7e9085ed27d tempest-ServersTestBootFromVolume-1992682790 None] volume has no backup snaps {{(pid=134148) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Dec 18 20:57:17.210107 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [req-2a6dd975-80e3-410e-9042-cfee015c2511 req-7f1a2a52-bafe-47f1-8694-c7e9085ed27d tempest-ServersTestBootFromVolume-1992682790 None] deleting rbd volume volume-4bdb5baa-b93d-4799-a653-1de77543ed53 {{(pid=134148) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Dec 18 20:57:17.998024 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [req-2a6dd975-80e3-410e-9042-cfee015c2511 req-7f1a2a52-bafe-47f1-8694-c7e9085ed27d tempest-ServersTestBootFromVolume-1992682790 None] volume is a clone so cleaning references {{(pid=134148) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1266}} Dec 18 20:57:18.069261 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [req-2a6dd975-80e3-410e-9042-cfee015c2511 req-7f1a2a52-bafe-47f1-8694-c7e9085ed27d tempest-ServersTestBootFromVolume-1992682790 None] deleting parent snapshot volume-4bdb5baa-b93d-4799-a653-1de77543ed53.clone_snap {{(pid=134148) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1158}} Dec 18 20:57:18.785933 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.quota [req-2a6dd975-80e3-410e-9042-cfee015c2511 req-7f1a2a52-bafe-47f1-8694-c7e9085ed27d tempest-ServersTestBootFromVolume-1992682790 None] Created reservations ['fd48bee1-9d8e-4a1e-8d8f-e7ddbd0f84a5', '2623ef25-373b-4459-a72c-34e33059e7d3', '67cba60a-d922-47e1-b952-653e6dfd494d', 'fea1148e-b891-4ed5-92fd-a761c5174ce5'] {{(pid=134148) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 18 20:57:18.992676 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [req-2a6dd975-80e3-410e-9042-cfee015c2511 req-7f1a2a52-bafe-47f1-8694-c7e9085ed27d tempest-ServersTestBootFromVolume-1992682790 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 20:57:19.124906 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [req-2a6dd975-80e3-410e-9042-cfee015c2511 req-7f1a2a52-bafe-47f1-8694-c7e9085ed27d tempest-ServersTestBootFromVolume-1992682790 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 20:57:19.239208 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.manager [req-2a6dd975-80e3-410e-9042-cfee015c2511 req-7f1a2a52-bafe-47f1-8694-c7e9085ed27d tempest-ServersTestBootFromVolume-1992682790 None] Notifying Schedulers of capabilities ... {{(pid=134148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 18 20:57:19.249690 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [req-2a6dd975-80e3-410e-9042-cfee015c2511 req-7f1a2a52-bafe-47f1-8694-c7e9085ed27d tempest-ServersTestBootFromVolume-1992682790 None] Deleted volume successfully. Dec 18 20:57:19.285651 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.coordination [req-2a6dd975-80e3-410e-9042-cfee015c2511 req-7f1a2a52-bafe-47f1-8694-c7e9085ed27d tempest-ServersTestBootFromVolume-1992682790 None] Lock "b'cinder-4bdb5baa-b93d-4799-a653-1de77543ed53-delete_volume'" released by "delete_volume" :: held 2.385s {{(pid=134148) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 18 20:57:22.941952 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.flows.manager.create_volume [None req-050817ec-8a01-4b46-87b7-7d9528a18816 tempest-VolumeQuotasNegativeTestJSON-2079655484 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134148) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Dec 18 20:57:22.958163 ncdv-master-1 cinder-volume[134148]: WARNING stevedore.named [None req-050817ec-8a01-4b46-87b7-7d9528a18816 tempest-VolumeQuotasNegativeTestJSON-2079655484 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Dec 18 20:57:22.958426 ncdv-master-1 cinder-volume[134148]: WARNING castellan.key_manager [None req-050817ec-8a01-4b46-87b7-7d9528a18816 tempest-VolumeQuotasNegativeTestJSON-2079655484 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Dec 18 20:57:23.042023 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-050817ec-8a01-4b46-87b7-7d9528a18816 tempest-VolumeQuotasNegativeTestJSON-2079655484 None] Flow 'volume_create_manager' (5d94aafc-2294-43fe-a0e6-9dbca00e3779) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 18 20:57:23.061129 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-050817ec-8a01-4b46-87b7-7d9528a18816 tempest-VolumeQuotasNegativeTestJSON-2079655484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bee0c01b-67a4-4260-8000-b47178464105) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 20:57:23.081964 ncdv-master-1 cinder-volume[134148]: DEBUG oslo_db.sqlalchemy.engines [None req-050817ec-8a01-4b46-87b7-7d9528a18816 tempest-VolumeQuotasNegativeTestJSON-2079655484 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134148) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 18 20:57:23.114501 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-050817ec-8a01-4b46-87b7-7d9528a18816 tempest-VolumeQuotasNegativeTestJSON-2079655484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bee0c01b-67a4-4260-8000-b47178464105) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-12-18T20:57:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-214814077',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=18b6490e-5950-4fbe-8798-4c0bcc39016d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='98128a4aa0b74995a96111645c40342e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-12-18T20:57:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-12-18T20:57:23Z,use_quota=True,user_id='357489c5c060461090a47c9f08de5037',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f2e1fe1-9fd6-411e-9ed9-368f463ccb6f),volume_type_id=1f2e1fe1-9fd6-411e-9ed9-368f463ccb6f)' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 20:57:23.121187 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-050817ec-8a01-4b46-87b7-7d9528a18816 tempest-VolumeQuotasNegativeTestJSON-2079655484 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e954918-16cc-43f1-8a30-94aeac93c230) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 20:57:23.126747 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-050817ec-8a01-4b46-87b7-7d9528a18816 tempest-VolumeQuotasNegativeTestJSON-2079655484 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e954918-16cc-43f1-8a30-94aeac93c230) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 20:57:23.132407 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-050817ec-8a01-4b46-87b7-7d9528a18816 tempest-VolumeQuotasNegativeTestJSON-2079655484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01cfed13-7523-484a-8fed-298e89e5b937) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 20:57:23.138898 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-050817ec-8a01-4b46-87b7-7d9528a18816 tempest-VolumeQuotasNegativeTestJSON-2079655484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01cfed13-7523-484a-8fed-298e89e5b937) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '18b6490e-5950-4fbe-8798-4c0bcc39016d', 'volume_name': 'volume-18b6490e-5950-4fbe-8798-4c0bcc39016d', 'volume_size': 1}' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 20:57:23.145041 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-050817ec-8a01-4b46-87b7-7d9528a18816 tempest-VolumeQuotasNegativeTestJSON-2079655484 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8849b72d-aaff-47ab-b4e8-b52b7850c694) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 20:57:23.154373 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-050817ec-8a01-4b46-87b7-7d9528a18816 tempest-VolumeQuotasNegativeTestJSON-2079655484 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8849b72d-aaff-47ab-b4e8-b52b7850c694) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 20:57:23.159024 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-050817ec-8a01-4b46-87b7-7d9528a18816 tempest-VolumeQuotasNegativeTestJSON-2079655484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (035dec3a-5ab7-4e9e-9b3b-7d2ba7f3a0dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 20:57:23.162350 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.flows.manager.create_volume [None req-050817ec-8a01-4b46-87b7-7d9528a18816 tempest-VolumeQuotasNegativeTestJSON-2079655484 None] Volume 18b6490e-5950-4fbe-8798-4c0bcc39016d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-18b6490e-5950-4fbe-8798-4c0bcc39016d', 'volume_size': 1} Dec 18 20:57:23.169643 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-050817ec-8a01-4b46-87b7-7d9528a18816 tempest-VolumeQuotasNegativeTestJSON-2079655484 None] creating volume 'volume-18b6490e-5950-4fbe-8798-4c0bcc39016d' {{(pid=134148) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Dec 18 20:57:23.173814 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-050817ec-8a01-4b46-87b7-7d9528a18816 tempest-VolumeQuotasNegativeTestJSON-2079655484 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 20:57:23.331122 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-050817ec-8a01-4b46-87b7-7d9528a18816 tempest-VolumeQuotasNegativeTestJSON-2079655484 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134148) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 18 20:57:23.331538 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-050817ec-8a01-4b46-87b7-7d9528a18816 tempest-VolumeQuotasNegativeTestJSON-2079655484 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134148) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 18 20:57:23.333569 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-050817ec-8a01-4b46-87b7-7d9528a18816 tempest-VolumeQuotasNegativeTestJSON-2079655484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (035dec3a-5ab7-4e9e-9b3b-7d2ba7f3a0dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-18b6490e-5950-4fbe-8798-4c0bcc39016d', 'volume_size': 1}' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 20:57:23.337371 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-050817ec-8a01-4b46-87b7-7d9528a18816 tempest-VolumeQuotasNegativeTestJSON-2079655484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7e73f48-51c9-4db2-af78-bb8816e9efcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 20:57:23.352853 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.flows.manager.create_volume [None req-050817ec-8a01-4b46-87b7-7d9528a18816 tempest-VolumeQuotasNegativeTestJSON-2079655484 None] Volume volume-18b6490e-5950-4fbe-8798-4c0bcc39016d (18b6490e-5950-4fbe-8798-4c0bcc39016d): created successfully Dec 18 20:57:23.356259 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-050817ec-8a01-4b46-87b7-7d9528a18816 tempest-VolumeQuotasNegativeTestJSON-2079655484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7e73f48-51c9-4db2-af78-bb8816e9efcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 20:57:23.364090 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-050817ec-8a01-4b46-87b7-7d9528a18816 tempest-VolumeQuotasNegativeTestJSON-2079655484 None] Flow 'volume_create_manager' (5d94aafc-2294-43fe-a0e6-9dbca00e3779) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134148) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 18 20:57:23.383024 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-050817ec-8a01-4b46-87b7-7d9528a18816 tempest-VolumeQuotasNegativeTestJSON-2079655484 None] Created volume successfully. Dec 18 20:57:25.505172 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.coordination [None req-c5deee69-6858-4eb8-b366-debb8ee27aeb tempest-VolumeQuotasNegativeTestJSON-2079655484 None] Lock "b'cinder-18b6490e-5950-4fbe-8798-4c0bcc39016d-delete_volume'" acquired by "delete_volume" :: waited 0.020s {{(pid=134148) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 18 20:57:25.596000 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-c5deee69-6858-4eb8-b366-debb8ee27aeb tempest-VolumeQuotasNegativeTestJSON-2079655484 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 20:57:25.717293 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-c5deee69-6858-4eb8-b366-debb8ee27aeb tempest-VolumeQuotasNegativeTestJSON-2079655484 None] volume has no backup snaps {{(pid=134148) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Dec 18 20:57:25.717817 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-c5deee69-6858-4eb8-b366-debb8ee27aeb tempest-VolumeQuotasNegativeTestJSON-2079655484 None] Volume volume-18b6490e-5950-4fbe-8798-4c0bcc39016d is not a clone. {{(pid=134148) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Dec 18 20:57:25.741775 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-c5deee69-6858-4eb8-b366-debb8ee27aeb tempest-VolumeQuotasNegativeTestJSON-2079655484 None] deleting rbd volume volume-18b6490e-5950-4fbe-8798-4c0bcc39016d {{(pid=134148) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Dec 18 20:57:26.421170 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.quota [None req-c5deee69-6858-4eb8-b366-debb8ee27aeb tempest-VolumeQuotasNegativeTestJSON-2079655484 None] Created reservations ['00220ce7-03ed-4483-8ead-8a48dd0432f0', '56c646fe-f1b6-41e9-b304-5192de131897', '02791344-0a42-4dac-8463-b12f4927c372', '7f310ec2-eb7c-4725-a1b4-eac82e15a3ce'] {{(pid=134148) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 18 20:57:26.587475 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-c5deee69-6858-4eb8-b366-debb8ee27aeb tempest-VolumeQuotasNegativeTestJSON-2079655484 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 20:57:26.691186 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-c5deee69-6858-4eb8-b366-debb8ee27aeb tempest-VolumeQuotasNegativeTestJSON-2079655484 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 20:57:26.748422 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.manager [None req-c5deee69-6858-4eb8-b366-debb8ee27aeb tempest-VolumeQuotasNegativeTestJSON-2079655484 None] Notifying Schedulers of capabilities ... {{(pid=134148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 18 20:57:26.754836 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-c5deee69-6858-4eb8-b366-debb8ee27aeb tempest-VolumeQuotasNegativeTestJSON-2079655484 None] Deleted volume successfully. Dec 18 20:57:26.779043 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.coordination [None req-c5deee69-6858-4eb8-b366-debb8ee27aeb tempest-VolumeQuotasNegativeTestJSON-2079655484 None] Lock "b'cinder-18b6490e-5950-4fbe-8798-4c0bcc39016d-delete_volume'" released by "delete_volume" :: held 1.274s {{(pid=134148) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 18 20:57:34.336227 ncdv-master-1 cinder-volume[134148]: DEBUG oslo_service.periodic_task [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134148) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Dec 18 20:57:34.337770 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 20:57:34.457420 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 20:57:34.627733 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.manager [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] Notifying Schedulers of capabilities ... {{(pid=134148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 18 20:57:36.850394 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.flows.manager.create_volume [None req-fd094533-1aad-4714-b46c-8a4b5671957f tempest-VolumesServicesTestJSON-972042575 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134148) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Dec 18 20:57:36.872905 ncdv-master-1 cinder-volume[134148]: WARNING stevedore.named [None req-fd094533-1aad-4714-b46c-8a4b5671957f tempest-VolumesServicesTestJSON-972042575 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Dec 18 20:57:36.873479 ncdv-master-1 cinder-volume[134148]: WARNING castellan.key_manager [None req-fd094533-1aad-4714-b46c-8a4b5671957f tempest-VolumesServicesTestJSON-972042575 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Dec 18 20:57:36.910210 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-fd094533-1aad-4714-b46c-8a4b5671957f tempest-VolumesServicesTestJSON-972042575 None] Flow 'volume_create_manager' (0b56f5b0-a97e-44c5-a005-2d4df60be3ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 18 20:57:36.914001 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-fd094533-1aad-4714-b46c-8a4b5671957f tempest-VolumesServicesTestJSON-972042575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29485f80-1f5e-4ce6-97a9-02fc9916e8c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 20:57:36.963483 ncdv-master-1 cinder-volume[134148]: DEBUG oslo_db.sqlalchemy.engines [None req-fd094533-1aad-4714-b46c-8a4b5671957f tempest-VolumesServicesTestJSON-972042575 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134148) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 18 20:57:37.021200 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-fd094533-1aad-4714-b46c-8a4b5671957f tempest-VolumesServicesTestJSON-972042575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29485f80-1f5e-4ce6-97a9-02fc9916e8c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-12-18T20:57:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1241457749',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=86e16f33-cef4-4d00-9bd9-fb34a627bd07,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fef903d47c94905adbf98ad8a717ce9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-12-18T20:57:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-12-18T20:57:37Z,use_quota=True,user_id='b69b84227a10456b88c5fd874ae44814',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f2e1fe1-9fd6-411e-9ed9-368f463ccb6f),volume_type_id=1f2e1fe1-9fd6-411e-9ed9-368f463ccb6f)' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 20:57:37.038500 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-fd094533-1aad-4714-b46c-8a4b5671957f tempest-VolumesServicesTestJSON-972042575 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c1d93fe-9c6e-4661-8fdf-f937c5c3664e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 20:57:37.050544 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-fd094533-1aad-4714-b46c-8a4b5671957f tempest-VolumesServicesTestJSON-972042575 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c1d93fe-9c6e-4661-8fdf-f937c5c3664e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 20:57:37.069466 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-fd094533-1aad-4714-b46c-8a4b5671957f tempest-VolumesServicesTestJSON-972042575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ac12ad0-5819-4250-84c3-6996fec36510) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 20:57:37.090580 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-fd094533-1aad-4714-b46c-8a4b5671957f tempest-VolumesServicesTestJSON-972042575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ac12ad0-5819-4250-84c3-6996fec36510) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '86e16f33-cef4-4d00-9bd9-fb34a627bd07', 'volume_name': 'volume-86e16f33-cef4-4d00-9bd9-fb34a627bd07', 'volume_size': 1}' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 20:57:37.097785 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-fd094533-1aad-4714-b46c-8a4b5671957f tempest-VolumesServicesTestJSON-972042575 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17367fb8-1b0e-4578-8027-b933f6deb8b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 20:57:37.107171 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-fd094533-1aad-4714-b46c-8a4b5671957f tempest-VolumesServicesTestJSON-972042575 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17367fb8-1b0e-4578-8027-b933f6deb8b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 20:57:37.119175 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-fd094533-1aad-4714-b46c-8a4b5671957f tempest-VolumesServicesTestJSON-972042575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98047c69-adab-4b95-9e8f-4558c8e6d76b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 20:57:37.121297 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.flows.manager.create_volume [None req-fd094533-1aad-4714-b46c-8a4b5671957f tempest-VolumesServicesTestJSON-972042575 None] Volume 86e16f33-cef4-4d00-9bd9-fb34a627bd07: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-86e16f33-cef4-4d00-9bd9-fb34a627bd07', 'volume_size': 1} Dec 18 20:57:37.126436 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-fd094533-1aad-4714-b46c-8a4b5671957f tempest-VolumesServicesTestJSON-972042575 None] creating volume 'volume-86e16f33-cef4-4d00-9bd9-fb34a627bd07' {{(pid=134148) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Dec 18 20:57:37.127802 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-fd094533-1aad-4714-b46c-8a4b5671957f tempest-VolumesServicesTestJSON-972042575 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 20:57:37.318087 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-fd094533-1aad-4714-b46c-8a4b5671957f tempest-VolumesServicesTestJSON-972042575 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134148) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 18 20:57:37.318760 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-fd094533-1aad-4714-b46c-8a4b5671957f tempest-VolumesServicesTestJSON-972042575 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134148) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 18 20:57:37.321018 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-fd094533-1aad-4714-b46c-8a4b5671957f tempest-VolumesServicesTestJSON-972042575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98047c69-adab-4b95-9e8f-4558c8e6d76b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-86e16f33-cef4-4d00-9bd9-fb34a627bd07', 'volume_size': 1}' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 20:57:37.323531 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-fd094533-1aad-4714-b46c-8a4b5671957f tempest-VolumesServicesTestJSON-972042575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6239a554-d1ba-46bf-86ad-2b962632e049) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 20:57:37.344913 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.flows.manager.create_volume [None req-fd094533-1aad-4714-b46c-8a4b5671957f tempest-VolumesServicesTestJSON-972042575 None] Volume volume-86e16f33-cef4-4d00-9bd9-fb34a627bd07 (86e16f33-cef4-4d00-9bd9-fb34a627bd07): created successfully Dec 18 20:57:37.348370 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-fd094533-1aad-4714-b46c-8a4b5671957f tempest-VolumesServicesTestJSON-972042575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6239a554-d1ba-46bf-86ad-2b962632e049) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 20:57:37.351550 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-fd094533-1aad-4714-b46c-8a4b5671957f tempest-VolumesServicesTestJSON-972042575 None] Flow 'volume_create_manager' (0b56f5b0-a97e-44c5-a005-2d4df60be3ca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134148) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 18 20:57:37.380841 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-fd094533-1aad-4714-b46c-8a4b5671957f tempest-VolumesServicesTestJSON-972042575 None] Created volume successfully. Dec 18 20:57:38.017206 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.coordination [None req-62cf9da2-021e-414d-84c1-cf7059206553 tempest-VolumesServicesTestJSON-972042575 None] Lock "b'cinder-86e16f33-cef4-4d00-9bd9-fb34a627bd07-delete_volume'" acquired by "delete_volume" :: waited 0.021s {{(pid=134148) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 18 20:57:38.118162 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-62cf9da2-021e-414d-84c1-cf7059206553 tempest-VolumesServicesTestJSON-972042575 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 20:57:38.195642 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-62cf9da2-021e-414d-84c1-cf7059206553 tempest-VolumesServicesTestJSON-972042575 None] volume has no backup snaps {{(pid=134148) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Dec 18 20:57:38.196368 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-62cf9da2-021e-414d-84c1-cf7059206553 tempest-VolumesServicesTestJSON-972042575 None] Volume volume-86e16f33-cef4-4d00-9bd9-fb34a627bd07 is not a clone. {{(pid=134148) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Dec 18 20:57:38.209383 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-62cf9da2-021e-414d-84c1-cf7059206553 tempest-VolumesServicesTestJSON-972042575 None] deleting rbd volume volume-86e16f33-cef4-4d00-9bd9-fb34a627bd07 {{(pid=134148) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Dec 18 20:57:38.793014 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.quota [None req-62cf9da2-021e-414d-84c1-cf7059206553 tempest-VolumesServicesTestJSON-972042575 None] Created reservations ['5d47fd47-6f0f-4b21-a44a-a1f06819118b', '2d776899-93f3-4020-859b-0635dc53ae9b', '0d54d806-1947-4b27-b21c-a1d8fd725e18', '90fd3377-e845-431e-9037-2ed3a359a038'] {{(pid=134148) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 18 20:57:38.876717 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-62cf9da2-021e-414d-84c1-cf7059206553 tempest-VolumesServicesTestJSON-972042575 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 20:57:38.957825 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-62cf9da2-021e-414d-84c1-cf7059206553 tempest-VolumesServicesTestJSON-972042575 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 20:57:39.049119 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.manager [None req-62cf9da2-021e-414d-84c1-cf7059206553 tempest-VolumesServicesTestJSON-972042575 None] Notifying Schedulers of capabilities ... {{(pid=134148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 18 20:57:39.054764 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-62cf9da2-021e-414d-84c1-cf7059206553 tempest-VolumesServicesTestJSON-972042575 None] Deleted volume successfully. Dec 18 20:57:39.075142 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.coordination [None req-62cf9da2-021e-414d-84c1-cf7059206553 tempest-VolumesServicesTestJSON-972042575 None] Lock "b'cinder-86e16f33-cef4-4d00-9bd9-fb34a627bd07-delete_volume'" released by "delete_volume" :: held 1.058s {{(pid=134148) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 18 20:57:42.736949 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.flows.manager.create_volume [None req-231325ea-af64-4549-b6d2-b0a0cbb1d0ad tempest-ServerRescueNegativeTestJSON-2089751494 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134148) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Dec 18 20:57:42.746007 ncdv-master-1 cinder-volume[134148]: WARNING stevedore.named [None req-231325ea-af64-4549-b6d2-b0a0cbb1d0ad tempest-ServerRescueNegativeTestJSON-2089751494 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Dec 18 20:57:42.746842 ncdv-master-1 cinder-volume[134148]: WARNING castellan.key_manager [None req-231325ea-af64-4549-b6d2-b0a0cbb1d0ad tempest-ServerRescueNegativeTestJSON-2089751494 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Dec 18 20:57:42.763502 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-231325ea-af64-4549-b6d2-b0a0cbb1d0ad tempest-ServerRescueNegativeTestJSON-2089751494 None] Flow 'volume_create_manager' (c510de08-a6ef-4fcb-90c7-3b041468fd60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 18 20:57:42.768015 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-231325ea-af64-4549-b6d2-b0a0cbb1d0ad tempest-ServerRescueNegativeTestJSON-2089751494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80011e89-b6f6-4f86-a58c-2673bf6a701c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 20:57:42.779006 ncdv-master-1 cinder-volume[134148]: DEBUG oslo_db.sqlalchemy.engines [None req-231325ea-af64-4549-b6d2-b0a0cbb1d0ad tempest-ServerRescueNegativeTestJSON-2089751494 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134148) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 18 20:57:42.800564 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-231325ea-af64-4549-b6d2-b0a0cbb1d0ad tempest-ServerRescueNegativeTestJSON-2089751494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80011e89-b6f6-4f86-a58c-2673bf6a701c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-12-18T20:57:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1569232674',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=40750169-3a96-4904-a7e2-ed473ccd50cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2aba7bee78744949dc3323cb4c7df55',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-12-18T20:57:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-12-18T20:57:43Z,use_quota=True,user_id='4ceb4b626d5f479b9e28dd26702d9d1e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f2e1fe1-9fd6-411e-9ed9-368f463ccb6f),volume_type_id=1f2e1fe1-9fd6-411e-9ed9-368f463ccb6f)' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 20:57:42.803958 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-231325ea-af64-4549-b6d2-b0a0cbb1d0ad tempest-ServerRescueNegativeTestJSON-2089751494 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e39d7d2c-452c-4004-bcfe-50dcc82aec0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 20:57:42.806946 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-231325ea-af64-4549-b6d2-b0a0cbb1d0ad tempest-ServerRescueNegativeTestJSON-2089751494 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e39d7d2c-452c-4004-bcfe-50dcc82aec0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 20:57:42.812236 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-231325ea-af64-4549-b6d2-b0a0cbb1d0ad tempest-ServerRescueNegativeTestJSON-2089751494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c81a730e-f0b6-4150-bde1-9fee8a0d8cc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 20:57:42.815427 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-231325ea-af64-4549-b6d2-b0a0cbb1d0ad tempest-ServerRescueNegativeTestJSON-2089751494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c81a730e-f0b6-4150-bde1-9fee8a0d8cc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '40750169-3a96-4904-a7e2-ed473ccd50cd', 'volume_name': 'volume-40750169-3a96-4904-a7e2-ed473ccd50cd', 'volume_size': 1}' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 20:57:42.818852 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-231325ea-af64-4549-b6d2-b0a0cbb1d0ad tempest-ServerRescueNegativeTestJSON-2089751494 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60adde54-b80e-4813-94e4-2b206f3e6bc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 20:57:42.821793 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-231325ea-af64-4549-b6d2-b0a0cbb1d0ad tempest-ServerRescueNegativeTestJSON-2089751494 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60adde54-b80e-4813-94e4-2b206f3e6bc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 20:57:42.830768 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-231325ea-af64-4549-b6d2-b0a0cbb1d0ad tempest-ServerRescueNegativeTestJSON-2089751494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7897f535-1320-41e3-8eaa-ba7884a50738) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 20:57:42.834121 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.flows.manager.create_volume [None req-231325ea-af64-4549-b6d2-b0a0cbb1d0ad tempest-ServerRescueNegativeTestJSON-2089751494 None] Volume 40750169-3a96-4904-a7e2-ed473ccd50cd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-40750169-3a96-4904-a7e2-ed473ccd50cd', 'volume_size': 1} Dec 18 20:57:42.835773 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-231325ea-af64-4549-b6d2-b0a0cbb1d0ad tempest-ServerRescueNegativeTestJSON-2089751494 None] creating volume 'volume-40750169-3a96-4904-a7e2-ed473ccd50cd' {{(pid=134148) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Dec 18 20:57:42.838039 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-231325ea-af64-4549-b6d2-b0a0cbb1d0ad tempest-ServerRescueNegativeTestJSON-2089751494 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 20:57:43.014850 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-231325ea-af64-4549-b6d2-b0a0cbb1d0ad tempest-ServerRescueNegativeTestJSON-2089751494 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134148) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 18 20:57:43.015484 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-231325ea-af64-4549-b6d2-b0a0cbb1d0ad tempest-ServerRescueNegativeTestJSON-2089751494 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134148) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 18 20:57:43.017692 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-231325ea-af64-4549-b6d2-b0a0cbb1d0ad tempest-ServerRescueNegativeTestJSON-2089751494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7897f535-1320-41e3-8eaa-ba7884a50738) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-40750169-3a96-4904-a7e2-ed473ccd50cd', 'volume_size': 1}' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 20:57:43.021517 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-231325ea-af64-4549-b6d2-b0a0cbb1d0ad tempest-ServerRescueNegativeTestJSON-2089751494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d3b1aa6-40ba-48aa-a115-edb0aae7d438) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 20:57:43.067607 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.flows.manager.create_volume [None req-231325ea-af64-4549-b6d2-b0a0cbb1d0ad tempest-ServerRescueNegativeTestJSON-2089751494 None] Volume volume-40750169-3a96-4904-a7e2-ed473ccd50cd (40750169-3a96-4904-a7e2-ed473ccd50cd): created successfully Dec 18 20:57:43.069921 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-231325ea-af64-4549-b6d2-b0a0cbb1d0ad tempest-ServerRescueNegativeTestJSON-2089751494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d3b1aa6-40ba-48aa-a115-edb0aae7d438) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 20:57:43.073334 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-231325ea-af64-4549-b6d2-b0a0cbb1d0ad tempest-ServerRescueNegativeTestJSON-2089751494 None] Flow 'volume_create_manager' (c510de08-a6ef-4fcb-90c7-3b041468fd60) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134148) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 18 20:57:43.093595 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-231325ea-af64-4549-b6d2-b0a0cbb1d0ad tempest-ServerRescueNegativeTestJSON-2089751494 None] Created volume successfully. Dec 18 20:57:47.307775 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.flows.manager.create_volume [None req-776dbc84-0a13-44b8-9d1c-f773b6011ea7 tempest-VolumesBackupsAdminTest-1670197762 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134148) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Dec 18 20:57:47.317280 ncdv-master-1 cinder-volume[134148]: WARNING stevedore.named [None req-776dbc84-0a13-44b8-9d1c-f773b6011ea7 tempest-VolumesBackupsAdminTest-1670197762 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Dec 18 20:57:47.320114 ncdv-master-1 cinder-volume[134148]: WARNING castellan.key_manager [None req-776dbc84-0a13-44b8-9d1c-f773b6011ea7 tempest-VolumesBackupsAdminTest-1670197762 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Dec 18 20:57:47.348994 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-776dbc84-0a13-44b8-9d1c-f773b6011ea7 tempest-VolumesBackupsAdminTest-1670197762 None] Flow 'volume_create_manager' (fb344a26-a63c-44f4-b43b-7c53f8f84db0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 18 20:57:47.362210 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-776dbc84-0a13-44b8-9d1c-f773b6011ea7 tempest-VolumesBackupsAdminTest-1670197762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (430ba0d0-635e-4534-88ae-0376a8171156) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 20:57:47.378942 ncdv-master-1 cinder-volume[134148]: DEBUG oslo_db.sqlalchemy.engines [None req-776dbc84-0a13-44b8-9d1c-f773b6011ea7 tempest-VolumesBackupsAdminTest-1670197762 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134148) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 18 20:57:47.403578 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-776dbc84-0a13-44b8-9d1c-f773b6011ea7 tempest-VolumesBackupsAdminTest-1670197762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (430ba0d0-635e-4534-88ae-0376a8171156) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-12-18T20:57:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsAdminTest-Volume-1294055217',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=8222c671-bce9-4818-87da-9a29a84c1f34,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='80a85b7775474a3ea11c992e707ac5cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-12-18T20:57:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-12-18T20:57:47Z,use_quota=True,user_id='56e6eb2cd17747939217b9a03e1ca1b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f2e1fe1-9fd6-411e-9ed9-368f463ccb6f),volume_type_id=1f2e1fe1-9fd6-411e-9ed9-368f463ccb6f)' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 20:57:47.414994 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-776dbc84-0a13-44b8-9d1c-f773b6011ea7 tempest-VolumesBackupsAdminTest-1670197762 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (997d291c-1253-4032-be2d-cdc228a9d2a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 20:57:47.417224 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-776dbc84-0a13-44b8-9d1c-f773b6011ea7 tempest-VolumesBackupsAdminTest-1670197762 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (997d291c-1253-4032-be2d-cdc228a9d2a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 20:57:47.419688 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-776dbc84-0a13-44b8-9d1c-f773b6011ea7 tempest-VolumesBackupsAdminTest-1670197762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (458cea80-1119-40b1-8678-6ef5e0e415c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 20:57:47.422622 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-776dbc84-0a13-44b8-9d1c-f773b6011ea7 tempest-VolumesBackupsAdminTest-1670197762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (458cea80-1119-40b1-8678-6ef5e0e415c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8222c671-bce9-4818-87da-9a29a84c1f34', 'volume_name': 'volume-8222c671-bce9-4818-87da-9a29a84c1f34', 'volume_size': 1}' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 20:57:47.426543 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-776dbc84-0a13-44b8-9d1c-f773b6011ea7 tempest-VolumesBackupsAdminTest-1670197762 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e3f3009-90eb-49e1-9fe2-4da2d8784d51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 20:57:47.428748 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-776dbc84-0a13-44b8-9d1c-f773b6011ea7 tempest-VolumesBackupsAdminTest-1670197762 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e3f3009-90eb-49e1-9fe2-4da2d8784d51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 20:57:47.431543 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-776dbc84-0a13-44b8-9d1c-f773b6011ea7 tempest-VolumesBackupsAdminTest-1670197762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (221a7d01-9018-4afe-83ac-f9e3af25fb3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 20:57:47.432838 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.flows.manager.create_volume [None req-776dbc84-0a13-44b8-9d1c-f773b6011ea7 tempest-VolumesBackupsAdminTest-1670197762 None] Volume 8222c671-bce9-4818-87da-9a29a84c1f34: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8222c671-bce9-4818-87da-9a29a84c1f34', 'volume_size': 1} Dec 18 20:57:47.433235 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-776dbc84-0a13-44b8-9d1c-f773b6011ea7 tempest-VolumesBackupsAdminTest-1670197762 None] creating volume 'volume-8222c671-bce9-4818-87da-9a29a84c1f34' {{(pid=134148) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Dec 18 20:57:47.434621 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-776dbc84-0a13-44b8-9d1c-f773b6011ea7 tempest-VolumesBackupsAdminTest-1670197762 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 20:57:47.595604 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-776dbc84-0a13-44b8-9d1c-f773b6011ea7 tempest-VolumesBackupsAdminTest-1670197762 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134148) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 18 20:57:47.595979 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-776dbc84-0a13-44b8-9d1c-f773b6011ea7 tempest-VolumesBackupsAdminTest-1670197762 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134148) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 18 20:57:47.598040 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-776dbc84-0a13-44b8-9d1c-f773b6011ea7 tempest-VolumesBackupsAdminTest-1670197762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (221a7d01-9018-4afe-83ac-f9e3af25fb3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8222c671-bce9-4818-87da-9a29a84c1f34', 'volume_size': 1}' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 20:57:47.601292 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-776dbc84-0a13-44b8-9d1c-f773b6011ea7 tempest-VolumesBackupsAdminTest-1670197762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8af8b69f-49c0-4e46-bd2d-caa4a30fba19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 20:57:47.614532 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.flows.manager.create_volume [None req-776dbc84-0a13-44b8-9d1c-f773b6011ea7 tempest-VolumesBackupsAdminTest-1670197762 None] Volume volume-8222c671-bce9-4818-87da-9a29a84c1f34 (8222c671-bce9-4818-87da-9a29a84c1f34): created successfully Dec 18 20:57:47.619588 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-776dbc84-0a13-44b8-9d1c-f773b6011ea7 tempest-VolumesBackupsAdminTest-1670197762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8af8b69f-49c0-4e46-bd2d-caa4a30fba19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 20:57:47.628453 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-776dbc84-0a13-44b8-9d1c-f773b6011ea7 tempest-VolumesBackupsAdminTest-1670197762 None] Flow 'volume_create_manager' (fb344a26-a63c-44f4-b43b-7c53f8f84db0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134148) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 18 20:57:47.667977 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-776dbc84-0a13-44b8-9d1c-f773b6011ea7 tempest-VolumesBackupsAdminTest-1670197762 None] Created volume successfully. Dec 18 20:57:55.548195 ncdv-master-1 cinder-volume[134148]: DEBUG oslo_concurrency.processutils [None req-f7b0af25-d11b-4c55-ae1b-961f0c385dec tempest-VolumesBackupsAdminTest-1670197762 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=134148) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Dec 18 20:57:57.303418 ncdv-master-1 cinder-volume[134148]: DEBUG oslo_concurrency.processutils [None req-f7b0af25-d11b-4c55-ae1b-961f0c385dec tempest-VolumesBackupsAdminTest-1670197762 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.755s {{(pid=134148) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Dec 18 20:57:57.305065 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-f7b0af25-d11b-4c55-ae1b-961f0c385dec tempest-VolumesBackupsAdminTest-1670197762 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-8222c671-bce9-4818-87da-9a29a84c1f34', 'hosts': ['10.222.0.13'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '946d1715-d12c-4dbf-8a79-181222df6e2e', 'volume_id': '8222c671-bce9-4818-87da-9a29a84c1f34', 'discard': True}} {{(pid=134148) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Dec 18 20:57:57.344007 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-f7b0af25-d11b-4c55-ae1b-961f0c385dec tempest-VolumesBackupsAdminTest-1670197762 None] Initialize volume connection completed successfully. Dec 18 20:58:01.827329 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-f7b0af25-d11b-4c55-ae1b-961f0c385dec tempest-VolumesBackupsAdminTest-1670197762 None] Terminate volume connection completed successfully. Dec 18 20:58:01.865442 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-f7b0af25-d11b-4c55-ae1b-961f0c385dec tempest-VolumesBackupsAdminTest-1670197762 None] Remove volume export completed successfully. Dec 18 20:58:04.156205 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.flows.manager.create_volume [None req-12b4e21b-2aa3-4d14-b8c3-79cf2e61205d tempest-VolumesBackupsAdminTest-1670197762 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134148) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Dec 18 20:58:04.162103 ncdv-master-1 cinder-volume[134148]: WARNING stevedore.named [None req-12b4e21b-2aa3-4d14-b8c3-79cf2e61205d tempest-VolumesBackupsAdminTest-1670197762 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Dec 18 20:58:04.162829 ncdv-master-1 cinder-volume[134148]: WARNING castellan.key_manager [None req-12b4e21b-2aa3-4d14-b8c3-79cf2e61205d tempest-VolumesBackupsAdminTest-1670197762 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Dec 18 20:58:04.182611 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-12b4e21b-2aa3-4d14-b8c3-79cf2e61205d tempest-VolumesBackupsAdminTest-1670197762 None] Flow 'volume_create_manager' (1757f0f8-4fb7-43ca-951d-13418c832a4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 18 20:58:04.187437 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-12b4e21b-2aa3-4d14-b8c3-79cf2e61205d tempest-VolumesBackupsAdminTest-1670197762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e2239e2-e13e-4dc3-9618-c6386d1bfed3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 20:58:04.195068 ncdv-master-1 cinder-volume[134148]: DEBUG oslo_db.sqlalchemy.engines [None req-12b4e21b-2aa3-4d14-b8c3-79cf2e61205d tempest-VolumesBackupsAdminTest-1670197762 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134148) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 18 20:58:04.217551 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-12b4e21b-2aa3-4d14-b8c3-79cf2e61205d tempest-VolumesBackupsAdminTest-1670197762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e2239e2-e13e-4dc3-9618-c6386d1bfed3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-12-18T20:58:04Z,deleted=False,deleted_at=None,display_description='auto-created_from_restore_from_backup',display_name='restore_backup_d157fedf-164b-4cfc-b135-2c6328dcac6d',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=95b27fc5-0e0a-4cee-b4ba-1e9a17fa53ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='80a85b7775474a3ea11c992e707ac5cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-12-18T20:58:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-12-18T20:58:04Z,use_quota=True,user_id='56e6eb2cd17747939217b9a03e1ca1b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f2e1fe1-9fd6-411e-9ed9-368f463ccb6f),volume_type_id=1f2e1fe1-9fd6-411e-9ed9-368f463ccb6f)' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 20:58:04.223234 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-12b4e21b-2aa3-4d14-b8c3-79cf2e61205d tempest-VolumesBackupsAdminTest-1670197762 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e3cfc61-3a7c-4cad-9a20-d101f37f58ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 20:58:04.225689 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-12b4e21b-2aa3-4d14-b8c3-79cf2e61205d tempest-VolumesBackupsAdminTest-1670197762 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e3cfc61-3a7c-4cad-9a20-d101f37f58ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 20:58:04.229311 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-12b4e21b-2aa3-4d14-b8c3-79cf2e61205d tempest-VolumesBackupsAdminTest-1670197762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc69e740-e261-4dd3-9abe-cb46d20c100a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 20:58:04.232583 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-12b4e21b-2aa3-4d14-b8c3-79cf2e61205d tempest-VolumesBackupsAdminTest-1670197762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc69e740-e261-4dd3-9abe-cb46d20c100a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '95b27fc5-0e0a-4cee-b4ba-1e9a17fa53ba', 'volume_name': 'volume-95b27fc5-0e0a-4cee-b4ba-1e9a17fa53ba', 'volume_size': 1}' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 20:58:04.236774 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-12b4e21b-2aa3-4d14-b8c3-79cf2e61205d tempest-VolumesBackupsAdminTest-1670197762 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07817732-8e69-4216-b83c-4a3e27d45c77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 20:58:04.241788 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-12b4e21b-2aa3-4d14-b8c3-79cf2e61205d tempest-VolumesBackupsAdminTest-1670197762 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07817732-8e69-4216-b83c-4a3e27d45c77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 20:58:04.246043 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-12b4e21b-2aa3-4d14-b8c3-79cf2e61205d tempest-VolumesBackupsAdminTest-1670197762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38cd7def-47cb-4220-8d75-a289dcda9dfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 20:58:04.247242 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.flows.manager.create_volume [None req-12b4e21b-2aa3-4d14-b8c3-79cf2e61205d tempest-VolumesBackupsAdminTest-1670197762 None] Volume 95b27fc5-0e0a-4cee-b4ba-1e9a17fa53ba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-95b27fc5-0e0a-4cee-b4ba-1e9a17fa53ba', 'volume_size': 1} Dec 18 20:58:04.247676 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-12b4e21b-2aa3-4d14-b8c3-79cf2e61205d tempest-VolumesBackupsAdminTest-1670197762 None] creating volume 'volume-95b27fc5-0e0a-4cee-b4ba-1e9a17fa53ba' {{(pid=134148) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Dec 18 20:58:04.249042 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-12b4e21b-2aa3-4d14-b8c3-79cf2e61205d tempest-VolumesBackupsAdminTest-1670197762 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 20:58:04.359749 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-12b4e21b-2aa3-4d14-b8c3-79cf2e61205d tempest-VolumesBackupsAdminTest-1670197762 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134148) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 18 20:58:04.360145 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-12b4e21b-2aa3-4d14-b8c3-79cf2e61205d tempest-VolumesBackupsAdminTest-1670197762 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134148) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 18 20:58:04.363871 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-12b4e21b-2aa3-4d14-b8c3-79cf2e61205d tempest-VolumesBackupsAdminTest-1670197762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38cd7def-47cb-4220-8d75-a289dcda9dfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-95b27fc5-0e0a-4cee-b4ba-1e9a17fa53ba', 'volume_size': 1}' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 20:58:04.367554 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-12b4e21b-2aa3-4d14-b8c3-79cf2e61205d tempest-VolumesBackupsAdminTest-1670197762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85e98a0c-5650-4c24-8603-509bc6908318) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 20:58:04.378666 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.flows.manager.create_volume [None req-12b4e21b-2aa3-4d14-b8c3-79cf2e61205d tempest-VolumesBackupsAdminTest-1670197762 None] Volume volume-95b27fc5-0e0a-4cee-b4ba-1e9a17fa53ba (95b27fc5-0e0a-4cee-b4ba-1e9a17fa53ba): created successfully Dec 18 20:58:04.381961 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-12b4e21b-2aa3-4d14-b8c3-79cf2e61205d tempest-VolumesBackupsAdminTest-1670197762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85e98a0c-5650-4c24-8603-509bc6908318) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 20:58:04.386794 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-12b4e21b-2aa3-4d14-b8c3-79cf2e61205d tempest-VolumesBackupsAdminTest-1670197762 None] Flow 'volume_create_manager' (1757f0f8-4fb7-43ca-951d-13418c832a4f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134148) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 18 20:58:04.398348 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-12b4e21b-2aa3-4d14-b8c3-79cf2e61205d tempest-VolumesBackupsAdminTest-1670197762 None] Created volume successfully. Dec 18 20:58:05.470614 ncdv-master-1 cinder-volume[134148]: DEBUG oslo_concurrency.processutils [None req-12b4e21b-2aa3-4d14-b8c3-79cf2e61205d tempest-VolumesBackupsAdminTest-1670197762 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=134148) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Dec 18 20:58:06.446378 ncdv-master-1 cinder-volume[134148]: DEBUG oslo_concurrency.processutils [None req-12b4e21b-2aa3-4d14-b8c3-79cf2e61205d tempest-VolumesBackupsAdminTest-1670197762 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.976s {{(pid=134148) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Dec 18 20:58:06.451032 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-12b4e21b-2aa3-4d14-b8c3-79cf2e61205d tempest-VolumesBackupsAdminTest-1670197762 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-95b27fc5-0e0a-4cee-b4ba-1e9a17fa53ba', 'hosts': ['10.222.0.13'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '946d1715-d12c-4dbf-8a79-181222df6e2e', 'volume_id': '95b27fc5-0e0a-4cee-b4ba-1e9a17fa53ba', 'discard': True}} {{(pid=134148) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Dec 18 20:58:06.471518 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-12b4e21b-2aa3-4d14-b8c3-79cf2e61205d tempest-VolumesBackupsAdminTest-1670197762 None] Initialize volume connection completed successfully. Dec 18 20:58:08.383935 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-12b4e21b-2aa3-4d14-b8c3-79cf2e61205d tempest-VolumesBackupsAdminTest-1670197762 None] Terminate volume connection completed successfully. Dec 18 20:58:08.403970 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-12b4e21b-2aa3-4d14-b8c3-79cf2e61205d tempest-VolumesBackupsAdminTest-1670197762 None] Remove volume export completed successfully. Dec 18 20:58:09.641301 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.coordination [None req-6c20dffd-d775-49c1-8505-5c3885b32ce5 tempest-VolumesBackupsAdminTest-1670197762 None] Lock "b'cinder-95b27fc5-0e0a-4cee-b4ba-1e9a17fa53ba-delete_volume'" acquired by "delete_volume" :: waited 0.017s {{(pid=134148) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 18 20:58:09.697206 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-6c20dffd-d775-49c1-8505-5c3885b32ce5 tempest-VolumesBackupsAdminTest-1670197762 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 20:58:10.125628 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-6c20dffd-d775-49c1-8505-5c3885b32ce5 tempest-VolumesBackupsAdminTest-1670197762 None] Volume volume-95b27fc5-0e0a-4cee-b4ba-1e9a17fa53ba is not a clone. {{(pid=134148) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Dec 18 20:58:10.145085 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-6c20dffd-d775-49c1-8505-5c3885b32ce5 tempest-VolumesBackupsAdminTest-1670197762 None] deleting rbd volume volume-95b27fc5-0e0a-4cee-b4ba-1e9a17fa53ba {{(pid=134148) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Dec 18 20:58:10.528810 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.quota [None req-6c20dffd-d775-49c1-8505-5c3885b32ce5 tempest-VolumesBackupsAdminTest-1670197762 None] Created reservations ['d589fd87-f893-4d52-9eaf-12839ea45cb4', '3781cc67-aa55-4adf-ac78-333f579b2904', '8db4daed-9445-4d66-ba20-2ff9e742ae3d', 'f379bb1f-df79-4de2-b500-18eafe7d7b88'] {{(pid=134148) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 18 20:58:10.619878 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-6c20dffd-d775-49c1-8505-5c3885b32ce5 tempest-VolumesBackupsAdminTest-1670197762 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 20:58:10.688529 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-6c20dffd-d775-49c1-8505-5c3885b32ce5 tempest-VolumesBackupsAdminTest-1670197762 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 20:58:10.788587 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.manager [None req-6c20dffd-d775-49c1-8505-5c3885b32ce5 tempest-VolumesBackupsAdminTest-1670197762 None] Notifying Schedulers of capabilities ... {{(pid=134148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 18 20:58:10.793022 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-6c20dffd-d775-49c1-8505-5c3885b32ce5 tempest-VolumesBackupsAdminTest-1670197762 None] Deleted volume successfully. Dec 18 20:58:10.815442 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.coordination [None req-6c20dffd-d775-49c1-8505-5c3885b32ce5 tempest-VolumesBackupsAdminTest-1670197762 None] Lock "b'cinder-95b27fc5-0e0a-4cee-b4ba-1e9a17fa53ba-delete_volume'" released by "delete_volume" :: held 1.173s {{(pid=134148) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 18 20:58:10.885050 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.flows.manager.create_volume [None req-059422e3-126d-43fe-b1e1-d0b6977111ae tempest-ServerRescueNegativeTestJSON-2089751494 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134148) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Dec 18 20:58:10.892400 ncdv-master-1 cinder-volume[134148]: WARNING stevedore.named [None req-059422e3-126d-43fe-b1e1-d0b6977111ae tempest-ServerRescueNegativeTestJSON-2089751494 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Dec 18 20:58:10.892400 ncdv-master-1 cinder-volume[134148]: WARNING castellan.key_manager [None req-059422e3-126d-43fe-b1e1-d0b6977111ae tempest-ServerRescueNegativeTestJSON-2089751494 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Dec 18 20:58:10.906963 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-059422e3-126d-43fe-b1e1-d0b6977111ae tempest-ServerRescueNegativeTestJSON-2089751494 None] Flow 'volume_create_manager' (508095fa-5531-4022-bd35-b31a137a197a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 18 20:58:10.908732 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-059422e3-126d-43fe-b1e1-d0b6977111ae tempest-ServerRescueNegativeTestJSON-2089751494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db9335db-bbf1-4de3-b188-8d16d0a9666d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 20:58:10.919986 ncdv-master-1 cinder-volume[134148]: DEBUG oslo_db.sqlalchemy.engines [None req-059422e3-126d-43fe-b1e1-d0b6977111ae tempest-ServerRescueNegativeTestJSON-2089751494 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134148) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 18 20:58:10.938941 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-059422e3-126d-43fe-b1e1-d0b6977111ae tempest-ServerRescueNegativeTestJSON-2089751494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db9335db-bbf1-4de3-b188-8d16d0a9666d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-12-18T20:58:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1310109827',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=78a2ade0-d35d-4737-a6ce-c8fb33ea5e2e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2aba7bee78744949dc3323cb4c7df55',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-12-18T20:58:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-12-18T20:58:11Z,use_quota=True,user_id='4ceb4b626d5f479b9e28dd26702d9d1e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f2e1fe1-9fd6-411e-9ed9-368f463ccb6f),volume_type_id=1f2e1fe1-9fd6-411e-9ed9-368f463ccb6f)' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 20:58:10.942867 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-059422e3-126d-43fe-b1e1-d0b6977111ae tempest-ServerRescueNegativeTestJSON-2089751494 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1a0ce37-edeb-4182-bc80-8f82f238734f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 20:58:10.949978 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-059422e3-126d-43fe-b1e1-d0b6977111ae tempest-ServerRescueNegativeTestJSON-2089751494 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1a0ce37-edeb-4182-bc80-8f82f238734f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 20:58:10.952532 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-059422e3-126d-43fe-b1e1-d0b6977111ae tempest-ServerRescueNegativeTestJSON-2089751494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7d8359f-2093-4aa6-b48c-cf3fe73128ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 20:58:10.954941 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-059422e3-126d-43fe-b1e1-d0b6977111ae tempest-ServerRescueNegativeTestJSON-2089751494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7d8359f-2093-4aa6-b48c-cf3fe73128ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '78a2ade0-d35d-4737-a6ce-c8fb33ea5e2e', 'volume_name': 'volume-78a2ade0-d35d-4737-a6ce-c8fb33ea5e2e', 'volume_size': 1}' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 20:58:10.957737 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-059422e3-126d-43fe-b1e1-d0b6977111ae tempest-ServerRescueNegativeTestJSON-2089751494 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69a53399-be66-4736-9b63-79283339fe6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 20:58:10.961345 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-059422e3-126d-43fe-b1e1-d0b6977111ae tempest-ServerRescueNegativeTestJSON-2089751494 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69a53399-be66-4736-9b63-79283339fe6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 20:58:10.963736 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-059422e3-126d-43fe-b1e1-d0b6977111ae tempest-ServerRescueNegativeTestJSON-2089751494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05e983c3-f1ab-41b8-97c4-bac731ad1a94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 20:58:10.964445 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.flows.manager.create_volume [None req-059422e3-126d-43fe-b1e1-d0b6977111ae tempest-ServerRescueNegativeTestJSON-2089751494 None] Volume 78a2ade0-d35d-4737-a6ce-c8fb33ea5e2e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-78a2ade0-d35d-4737-a6ce-c8fb33ea5e2e', 'volume_size': 1} Dec 18 20:58:10.964841 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-059422e3-126d-43fe-b1e1-d0b6977111ae tempest-ServerRescueNegativeTestJSON-2089751494 None] creating volume 'volume-78a2ade0-d35d-4737-a6ce-c8fb33ea5e2e' {{(pid=134148) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Dec 18 20:58:10.965865 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-059422e3-126d-43fe-b1e1-d0b6977111ae tempest-ServerRescueNegativeTestJSON-2089751494 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 20:58:11.078954 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-059422e3-126d-43fe-b1e1-d0b6977111ae tempest-ServerRescueNegativeTestJSON-2089751494 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134148) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 18 20:58:11.079340 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-059422e3-126d-43fe-b1e1-d0b6977111ae tempest-ServerRescueNegativeTestJSON-2089751494 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134148) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 18 20:58:11.081903 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-059422e3-126d-43fe-b1e1-d0b6977111ae tempest-ServerRescueNegativeTestJSON-2089751494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05e983c3-f1ab-41b8-97c4-bac731ad1a94) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-78a2ade0-d35d-4737-a6ce-c8fb33ea5e2e', 'volume_size': 1}' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 20:58:11.084775 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-059422e3-126d-43fe-b1e1-d0b6977111ae tempest-ServerRescueNegativeTestJSON-2089751494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c017fd52-d02c-410a-89f1-34eb1967442b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 20:58:11.096399 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.flows.manager.create_volume [None req-059422e3-126d-43fe-b1e1-d0b6977111ae tempest-ServerRescueNegativeTestJSON-2089751494 None] Volume volume-78a2ade0-d35d-4737-a6ce-c8fb33ea5e2e (78a2ade0-d35d-4737-a6ce-c8fb33ea5e2e): created successfully Dec 18 20:58:11.099832 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-059422e3-126d-43fe-b1e1-d0b6977111ae tempest-ServerRescueNegativeTestJSON-2089751494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c017fd52-d02c-410a-89f1-34eb1967442b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 20:58:11.105415 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-059422e3-126d-43fe-b1e1-d0b6977111ae tempest-ServerRescueNegativeTestJSON-2089751494 None] Flow 'volume_create_manager' (508095fa-5531-4022-bd35-b31a137a197a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134148) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 18 20:58:11.120929 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-059422e3-126d-43fe-b1e1-d0b6977111ae tempest-ServerRescueNegativeTestJSON-2089751494 None] Created volume successfully. Dec 18 20:58:12.319728 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.flows.manager.create_volume [None req-7bfbd1c1-b644-471c-afa5-9b3bb7321778 tempest-VolumesBackupsAdminTest-1670197762 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134148) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Dec 18 20:58:12.323904 ncdv-master-1 cinder-volume[134148]: WARNING stevedore.named [None req-7bfbd1c1-b644-471c-afa5-9b3bb7321778 tempest-VolumesBackupsAdminTest-1670197762 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Dec 18 20:58:12.324348 ncdv-master-1 cinder-volume[134148]: WARNING castellan.key_manager [None req-7bfbd1c1-b644-471c-afa5-9b3bb7321778 tempest-VolumesBackupsAdminTest-1670197762 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Dec 18 20:58:12.348579 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-7bfbd1c1-b644-471c-afa5-9b3bb7321778 tempest-VolumesBackupsAdminTest-1670197762 None] Flow 'volume_create_manager' (92d8e01b-87aa-4bb0-99e4-fa4b241bd770) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 18 20:58:12.352442 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-7bfbd1c1-b644-471c-afa5-9b3bb7321778 tempest-VolumesBackupsAdminTest-1670197762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb9224e2-836e-417d-94e1-163691c0daf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 20:58:12.359524 ncdv-master-1 cinder-volume[134148]: DEBUG oslo_db.sqlalchemy.engines [None req-7bfbd1c1-b644-471c-afa5-9b3bb7321778 tempest-VolumesBackupsAdminTest-1670197762 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134148) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 18 20:58:12.374326 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-7bfbd1c1-b644-471c-afa5-9b3bb7321778 tempest-VolumesBackupsAdminTest-1670197762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb9224e2-836e-417d-94e1-163691c0daf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-12-18T20:58:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsAdminTest-Volume-717380757',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=569eafdb-d840-4136-8d56-ebbc5607b8ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='80a85b7775474a3ea11c992e707ac5cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-12-18T20:58:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-12-18T20:58:12Z,use_quota=True,user_id='56e6eb2cd17747939217b9a03e1ca1b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f2e1fe1-9fd6-411e-9ed9-368f463ccb6f),volume_type_id=1f2e1fe1-9fd6-411e-9ed9-368f463ccb6f)' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 20:58:12.377920 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-7bfbd1c1-b644-471c-afa5-9b3bb7321778 tempest-VolumesBackupsAdminTest-1670197762 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60726fbb-d53e-45d7-980b-14e76f59198d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 20:58:12.380310 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-7bfbd1c1-b644-471c-afa5-9b3bb7321778 tempest-VolumesBackupsAdminTest-1670197762 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60726fbb-d53e-45d7-980b-14e76f59198d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 20:58:12.382916 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-7bfbd1c1-b644-471c-afa5-9b3bb7321778 tempest-VolumesBackupsAdminTest-1670197762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8228a837-16b2-4092-8d6a-ac13abdc428e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 20:58:12.385428 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-7bfbd1c1-b644-471c-afa5-9b3bb7321778 tempest-VolumesBackupsAdminTest-1670197762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8228a837-16b2-4092-8d6a-ac13abdc428e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '569eafdb-d840-4136-8d56-ebbc5607b8ab', 'volume_name': 'volume-569eafdb-d840-4136-8d56-ebbc5607b8ab', 'volume_size': 1}' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 20:58:12.387980 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-7bfbd1c1-b644-471c-afa5-9b3bb7321778 tempest-VolumesBackupsAdminTest-1670197762 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b78f2e4a-e1c1-4d5b-bfc3-4d098606070c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 20:58:12.390524 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-7bfbd1c1-b644-471c-afa5-9b3bb7321778 tempest-VolumesBackupsAdminTest-1670197762 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b78f2e4a-e1c1-4d5b-bfc3-4d098606070c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 20:58:12.392851 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-7bfbd1c1-b644-471c-afa5-9b3bb7321778 tempest-VolumesBackupsAdminTest-1670197762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6748b55-2eee-4395-bbb7-6fa67161bd45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 20:58:12.393648 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.flows.manager.create_volume [None req-7bfbd1c1-b644-471c-afa5-9b3bb7321778 tempest-VolumesBackupsAdminTest-1670197762 None] Volume 569eafdb-d840-4136-8d56-ebbc5607b8ab: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-569eafdb-d840-4136-8d56-ebbc5607b8ab', 'volume_size': 1} Dec 18 20:58:12.394038 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-7bfbd1c1-b644-471c-afa5-9b3bb7321778 tempest-VolumesBackupsAdminTest-1670197762 None] creating volume 'volume-569eafdb-d840-4136-8d56-ebbc5607b8ab' {{(pid=134148) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Dec 18 20:58:12.395055 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-7bfbd1c1-b644-471c-afa5-9b3bb7321778 tempest-VolumesBackupsAdminTest-1670197762 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 20:58:12.484246 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-7bfbd1c1-b644-471c-afa5-9b3bb7321778 tempest-VolumesBackupsAdminTest-1670197762 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134148) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 18 20:58:12.484899 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-7bfbd1c1-b644-471c-afa5-9b3bb7321778 tempest-VolumesBackupsAdminTest-1670197762 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134148) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 18 20:58:12.488363 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-7bfbd1c1-b644-471c-afa5-9b3bb7321778 tempest-VolumesBackupsAdminTest-1670197762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6748b55-2eee-4395-bbb7-6fa67161bd45) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-569eafdb-d840-4136-8d56-ebbc5607b8ab', 'volume_size': 1}' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 20:58:12.491495 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-7bfbd1c1-b644-471c-afa5-9b3bb7321778 tempest-VolumesBackupsAdminTest-1670197762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5dc4bae2-d2be-4e81-b975-577168175de9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 20:58:12.504238 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.flows.manager.create_volume [None req-7bfbd1c1-b644-471c-afa5-9b3bb7321778 tempest-VolumesBackupsAdminTest-1670197762 None] Volume volume-569eafdb-d840-4136-8d56-ebbc5607b8ab (569eafdb-d840-4136-8d56-ebbc5607b8ab): created successfully Dec 18 20:58:12.507238 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-7bfbd1c1-b644-471c-afa5-9b3bb7321778 tempest-VolumesBackupsAdminTest-1670197762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5dc4bae2-d2be-4e81-b975-577168175de9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 20:58:12.512991 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-7bfbd1c1-b644-471c-afa5-9b3bb7321778 tempest-VolumesBackupsAdminTest-1670197762 None] Flow 'volume_create_manager' (92d8e01b-87aa-4bb0-99e4-fa4b241bd770) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134148) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 18 20:58:12.526501 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-7bfbd1c1-b644-471c-afa5-9b3bb7321778 tempest-VolumesBackupsAdminTest-1670197762 None] Created volume successfully. Dec 18 20:58:12.806349 ncdv-master-1 cinder-volume[134148]: DEBUG oslo_concurrency.processutils [req-1ea8d6c6-1878-4c62-bdf3-bead62cf7521 req-ac1c1db8-de54-44b1-a93a-29467641e48f tempest-ServerRescueNegativeTestJSON-2089751494 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=134148) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Dec 18 20:58:13.577537 ncdv-master-1 cinder-volume[134148]: DEBUG oslo_concurrency.processutils [req-1ea8d6c6-1878-4c62-bdf3-bead62cf7521 req-ac1c1db8-de54-44b1-a93a-29467641e48f tempest-ServerRescueNegativeTestJSON-2089751494 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.771s {{(pid=134148) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Dec 18 20:58:13.578309 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [req-1ea8d6c6-1878-4c62-bdf3-bead62cf7521 req-ac1c1db8-de54-44b1-a93a-29467641e48f tempest-ServerRescueNegativeTestJSON-2089751494 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-78a2ade0-d35d-4737-a6ce-c8fb33ea5e2e', 'hosts': ['10.222.0.13'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '946d1715-d12c-4dbf-8a79-181222df6e2e', 'volume_id': '78a2ade0-d35d-4737-a6ce-c8fb33ea5e2e', 'discard': True}} {{(pid=134148) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Dec 18 20:58:13.605212 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [req-1ea8d6c6-1878-4c62-bdf3-bead62cf7521 req-ac1c1db8-de54-44b1-a93a-29467641e48f tempest-ServerRescueNegativeTestJSON-2089751494 None] Connection info returned from driver {'name': 'volumes/volume-78a2ade0-d35d-4737-a6ce-c8fb33ea5e2e', 'hosts': ['10.222.0.13'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '78a2ade0-d35d-4737-a6ce-c8fb33ea5e2e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '063832f3-b832-4506-970b-53016cccca32'} {{(pid=134148) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4812}} Dec 18 20:58:13.670058 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [req-1ea8d6c6-1878-4c62-bdf3-bead62cf7521 req-ac1c1db8-de54-44b1-a93a-29467641e48f tempest-ServerRescueNegativeTestJSON-2089751494 None] attachment_update completed successfully. Dec 18 20:58:13.733654 ncdv-master-1 cinder-volume[134148]: DEBUG oslo_concurrency.processutils [None req-0ce735fa-7119-497f-916a-8407bfc2b31f tempest-VolumesBackupsAdminTest-1670197762 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=134148) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Dec 18 20:58:14.433117 ncdv-master-1 cinder-volume[134148]: DEBUG oslo_concurrency.processutils [None req-0ce735fa-7119-497f-916a-8407bfc2b31f tempest-VolumesBackupsAdminTest-1670197762 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.699s {{(pid=134148) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Dec 18 20:58:14.433922 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-0ce735fa-7119-497f-916a-8407bfc2b31f tempest-VolumesBackupsAdminTest-1670197762 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-569eafdb-d840-4136-8d56-ebbc5607b8ab', 'hosts': ['10.222.0.13'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '946d1715-d12c-4dbf-8a79-181222df6e2e', 'volume_id': '569eafdb-d840-4136-8d56-ebbc5607b8ab', 'discard': True}} {{(pid=134148) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Dec 18 20:58:14.453097 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-0ce735fa-7119-497f-916a-8407bfc2b31f tempest-VolumesBackupsAdminTest-1670197762 None] Initialize volume connection completed successfully. Dec 18 20:58:14.887664 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.flows.manager.create_volume [None req-3c1b2c5a-93fc-4da6-a673-92b22a21b813 tempest-AttachSCSIVolumeTestJSON-250543757 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134148) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Dec 18 20:58:14.898508 ncdv-master-1 cinder-volume[134148]: WARNING stevedore.named [None req-3c1b2c5a-93fc-4da6-a673-92b22a21b813 tempest-AttachSCSIVolumeTestJSON-250543757 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Dec 18 20:58:14.899583 ncdv-master-1 cinder-volume[134148]: WARNING castellan.key_manager [None req-3c1b2c5a-93fc-4da6-a673-92b22a21b813 tempest-AttachSCSIVolumeTestJSON-250543757 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Dec 18 20:58:14.924891 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-3c1b2c5a-93fc-4da6-a673-92b22a21b813 tempest-AttachSCSIVolumeTestJSON-250543757 None] Flow 'volume_create_manager' (e32a6c07-248f-46b0-8f99-77193a265f19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 18 20:58:14.930124 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-3c1b2c5a-93fc-4da6-a673-92b22a21b813 tempest-AttachSCSIVolumeTestJSON-250543757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf32d414-5b68-4fd2-a975-eb790fa5ea38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 20:58:14.938720 ncdv-master-1 cinder-volume[134148]: DEBUG oslo_db.sqlalchemy.engines [None req-3c1b2c5a-93fc-4da6-a673-92b22a21b813 tempest-AttachSCSIVolumeTestJSON-250543757 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134148) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 18 20:58:14.973020 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-3c1b2c5a-93fc-4da6-a673-92b22a21b813 tempest-AttachSCSIVolumeTestJSON-250543757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf32d414-5b68-4fd2-a975-eb790fa5ea38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-12-18T20:58:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachSCSIVolumeTestJSON-volume-515060635',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=88cfbe27-4f06-4df2-b679-ca48269e92dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f69c5059282455ca98cc9bff0fe1c94',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-12-18T20:58:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-12-18T20:58:15Z,use_quota=True,user_id='baaead8443a7492db118aa577386a88b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f2e1fe1-9fd6-411e-9ed9-368f463ccb6f),volume_type_id=1f2e1fe1-9fd6-411e-9ed9-368f463ccb6f)' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 20:58:14.979743 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-3c1b2c5a-93fc-4da6-a673-92b22a21b813 tempest-AttachSCSIVolumeTestJSON-250543757 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6258234-a574-406c-ae0a-375de4ee0c34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 20:58:14.983922 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-3c1b2c5a-93fc-4da6-a673-92b22a21b813 tempest-AttachSCSIVolumeTestJSON-250543757 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6258234-a574-406c-ae0a-375de4ee0c34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 20:58:14.993827 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-3c1b2c5a-93fc-4da6-a673-92b22a21b813 tempest-AttachSCSIVolumeTestJSON-250543757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a88f32b-3c02-44f1-a7e9-1bc961f448c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 20:58:14.997162 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-3c1b2c5a-93fc-4da6-a673-92b22a21b813 tempest-AttachSCSIVolumeTestJSON-250543757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a88f32b-3c02-44f1-a7e9-1bc961f448c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '88cfbe27-4f06-4df2-b679-ca48269e92dd', 'volume_name': 'volume-88cfbe27-4f06-4df2-b679-ca48269e92dd', 'volume_size': 1}' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 20:58:15.000177 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-3c1b2c5a-93fc-4da6-a673-92b22a21b813 tempest-AttachSCSIVolumeTestJSON-250543757 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (006e8375-9614-402d-a67e-84e4186a42d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 20:58:15.008058 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-3c1b2c5a-93fc-4da6-a673-92b22a21b813 tempest-AttachSCSIVolumeTestJSON-250543757 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (006e8375-9614-402d-a67e-84e4186a42d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 20:58:15.011278 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-3c1b2c5a-93fc-4da6-a673-92b22a21b813 tempest-AttachSCSIVolumeTestJSON-250543757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21c866e6-de94-4b15-9b73-77121c89716c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 20:58:15.012430 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.flows.manager.create_volume [None req-3c1b2c5a-93fc-4da6-a673-92b22a21b813 tempest-AttachSCSIVolumeTestJSON-250543757 None] Volume 88cfbe27-4f06-4df2-b679-ca48269e92dd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-88cfbe27-4f06-4df2-b679-ca48269e92dd', 'volume_size': 1} Dec 18 20:58:15.013041 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-3c1b2c5a-93fc-4da6-a673-92b22a21b813 tempest-AttachSCSIVolumeTestJSON-250543757 None] creating volume 'volume-88cfbe27-4f06-4df2-b679-ca48269e92dd' {{(pid=134148) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Dec 18 20:58:15.014391 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-3c1b2c5a-93fc-4da6-a673-92b22a21b813 tempest-AttachSCSIVolumeTestJSON-250543757 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 20:58:15.167127 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-3c1b2c5a-93fc-4da6-a673-92b22a21b813 tempest-AttachSCSIVolumeTestJSON-250543757 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134148) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 18 20:58:15.167772 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-3c1b2c5a-93fc-4da6-a673-92b22a21b813 tempest-AttachSCSIVolumeTestJSON-250543757 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134148) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 18 20:58:15.170115 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-3c1b2c5a-93fc-4da6-a673-92b22a21b813 tempest-AttachSCSIVolumeTestJSON-250543757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21c866e6-de94-4b15-9b73-77121c89716c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-88cfbe27-4f06-4df2-b679-ca48269e92dd', 'volume_size': 1}' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 20:58:15.195526 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-3c1b2c5a-93fc-4da6-a673-92b22a21b813 tempest-AttachSCSIVolumeTestJSON-250543757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2239a5ec-f85e-4076-8277-576a12ed04fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 20:58:15.212174 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.flows.manager.create_volume [None req-3c1b2c5a-93fc-4da6-a673-92b22a21b813 tempest-AttachSCSIVolumeTestJSON-250543757 None] Volume volume-88cfbe27-4f06-4df2-b679-ca48269e92dd (88cfbe27-4f06-4df2-b679-ca48269e92dd): created successfully Dec 18 20:58:15.216117 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-3c1b2c5a-93fc-4da6-a673-92b22a21b813 tempest-AttachSCSIVolumeTestJSON-250543757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2239a5ec-f85e-4076-8277-576a12ed04fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 20:58:15.220245 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-3c1b2c5a-93fc-4da6-a673-92b22a21b813 tempest-AttachSCSIVolumeTestJSON-250543757 None] Flow 'volume_create_manager' (e32a6c07-248f-46b0-8f99-77193a265f19) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134148) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 18 20:58:15.236090 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-3c1b2c5a-93fc-4da6-a673-92b22a21b813 tempest-AttachSCSIVolumeTestJSON-250543757 None] Created volume successfully. Dec 18 20:58:16.455046 ncdv-master-1 cinder-volume[134148]: DEBUG oslo_concurrency.processutils [req-bf1d4940-f9d1-4269-9074-fc6e57149201 req-7fb5d7d8-0807-4c96-8fce-fe80d209d03f tempest-AttachSCSIVolumeTestJSON-250543757 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=134148) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Dec 18 20:58:16.608424 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-0ce735fa-7119-497f-916a-8407bfc2b31f tempest-VolumesBackupsAdminTest-1670197762 None] Terminate volume connection completed successfully. Dec 18 20:58:16.643369 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-0ce735fa-7119-497f-916a-8407bfc2b31f tempest-VolumesBackupsAdminTest-1670197762 None] Remove volume export completed successfully. Dec 18 20:58:17.524339 ncdv-master-1 cinder-volume[134148]: DEBUG oslo_concurrency.processutils [req-bf1d4940-f9d1-4269-9074-fc6e57149201 req-7fb5d7d8-0807-4c96-8fce-fe80d209d03f tempest-AttachSCSIVolumeTestJSON-250543757 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.069s {{(pid=134148) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Dec 18 20:58:17.526858 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [req-bf1d4940-f9d1-4269-9074-fc6e57149201 req-7fb5d7d8-0807-4c96-8fce-fe80d209d03f tempest-AttachSCSIVolumeTestJSON-250543757 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-88cfbe27-4f06-4df2-b679-ca48269e92dd', 'hosts': ['10.222.0.13'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '946d1715-d12c-4dbf-8a79-181222df6e2e', 'volume_id': '88cfbe27-4f06-4df2-b679-ca48269e92dd', 'discard': True}} {{(pid=134148) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Dec 18 20:58:17.557541 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [req-bf1d4940-f9d1-4269-9074-fc6e57149201 req-7fb5d7d8-0807-4c96-8fce-fe80d209d03f tempest-AttachSCSIVolumeTestJSON-250543757 None] Connection info returned from driver {'name': 'volumes/volume-88cfbe27-4f06-4df2-b679-ca48269e92dd', 'hosts': ['10.222.0.13'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '88cfbe27-4f06-4df2-b679-ca48269e92dd', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '1968a854-930c-4158-83f7-e2f66671db49'} {{(pid=134148) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4812}} Dec 18 20:58:17.678449 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [req-bf1d4940-f9d1-4269-9074-fc6e57149201 req-7fb5d7d8-0807-4c96-8fce-fe80d209d03f tempest-AttachSCSIVolumeTestJSON-250543757 None] attachment_update completed successfully. Dec 18 20:58:19.044734 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.coordination [None req-33de1124-80d9-4957-9a2c-ec882dfdaa34 tempest-VolumesBackupsAdminTest-1670197762 None] Lock "b'cinder-569eafdb-d840-4136-8d56-ebbc5607b8ab-delete_volume'" acquired by "delete_volume" :: waited 0.014s {{(pid=134148) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 18 20:58:19.085816 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-33de1124-80d9-4957-9a2c-ec882dfdaa34 tempest-VolumesBackupsAdminTest-1670197762 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 20:58:20.067466 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-33de1124-80d9-4957-9a2c-ec882dfdaa34 tempest-VolumesBackupsAdminTest-1670197762 None] Volume volume-569eafdb-d840-4136-8d56-ebbc5607b8ab is not a clone. {{(pid=134148) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Dec 18 20:58:20.097142 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-33de1124-80d9-4957-9a2c-ec882dfdaa34 tempest-VolumesBackupsAdminTest-1670197762 None] deleting rbd volume volume-569eafdb-d840-4136-8d56-ebbc5607b8ab {{(pid=134148) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Dec 18 20:58:20.563940 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.quota [None req-33de1124-80d9-4957-9a2c-ec882dfdaa34 tempest-VolumesBackupsAdminTest-1670197762 None] Created reservations ['9d7f70a1-fb5d-4ef8-9ff0-d37284aea9e7', '401706f2-c84d-4e39-a3fa-874e77252d46', '931dcf45-f33e-445b-b499-8cc3cf1c38b7', 'ac2de682-ea5a-40d7-ba05-a0c7d3dfb35c'] {{(pid=134148) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 18 20:58:20.684791 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-33de1124-80d9-4957-9a2c-ec882dfdaa34 tempest-VolumesBackupsAdminTest-1670197762 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 20:58:20.748222 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-33de1124-80d9-4957-9a2c-ec882dfdaa34 tempest-VolumesBackupsAdminTest-1670197762 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 20:58:20.789778 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.manager [None req-33de1124-80d9-4957-9a2c-ec882dfdaa34 tempest-VolumesBackupsAdminTest-1670197762 None] Notifying Schedulers of capabilities ... {{(pid=134148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 18 20:58:20.795277 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-33de1124-80d9-4957-9a2c-ec882dfdaa34 tempest-VolumesBackupsAdminTest-1670197762 None] Deleted volume successfully. Dec 18 20:58:20.819452 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [req-ef57559e-20b2-4098-970f-37ee046938aa req-f1a525f0-c888-4e6f-82f4-96876302eed7 tempest-AttachSCSIVolumeTestJSON-250543757 None] Terminate volume connection completed successfully. Dec 18 20:58:20.819884 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [req-ef57559e-20b2-4098-970f-37ee046938aa req-f1a525f0-c888-4e6f-82f4-96876302eed7 tempest-AttachSCSIVolumeTestJSON-250543757 None] Deleting attachment 1968a854-930c-4158-83f7-e2f66671db49. {{(pid=134148) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4948}} Dec 18 20:58:20.833750 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.coordination [None req-33de1124-80d9-4957-9a2c-ec882dfdaa34 tempest-VolumesBackupsAdminTest-1670197762 None] Lock "b'cinder-569eafdb-d840-4136-8d56-ebbc5607b8ab-delete_volume'" released by "delete_volume" :: held 1.789s {{(pid=134148) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 18 20:58:21.280537 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.coordination [None req-fb1d6ff6-2e68-453e-bee5-ffde5b02434c tempest-VolumesBackupsAdminTest-1670197762 None] Lock "b'cinder-8222c671-bce9-4818-87da-9a29a84c1f34-delete_volume'" acquired by "delete_volume" :: waited 0.022s {{(pid=134148) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 18 20:58:21.324147 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-fb1d6ff6-2e68-453e-bee5-ffde5b02434c tempest-VolumesBackupsAdminTest-1670197762 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 20:58:22.084500 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-fb1d6ff6-2e68-453e-bee5-ffde5b02434c tempest-VolumesBackupsAdminTest-1670197762 None] Volume volume-8222c671-bce9-4818-87da-9a29a84c1f34 is not a clone. {{(pid=134148) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Dec 18 20:58:22.115732 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-fb1d6ff6-2e68-453e-bee5-ffde5b02434c tempest-VolumesBackupsAdminTest-1670197762 None] deleting rbd volume volume-8222c671-bce9-4818-87da-9a29a84c1f34 {{(pid=134148) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Dec 18 20:58:22.363510 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.quota [None req-fb1d6ff6-2e68-453e-bee5-ffde5b02434c tempest-VolumesBackupsAdminTest-1670197762 None] Created reservations ['699b395c-58cf-4105-bfc3-14dd3e67a401', 'cf6c67cf-5cae-433c-a4d4-224ae89da655', 'e32b0952-2b9d-4a35-bc33-3e95bacf15a7', 'b858302b-7733-4234-ba43-be8f598ff4be'] {{(pid=134148) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 18 20:58:22.408599 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-fb1d6ff6-2e68-453e-bee5-ffde5b02434c tempest-VolumesBackupsAdminTest-1670197762 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 20:58:22.434682 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-fb1d6ff6-2e68-453e-bee5-ffde5b02434c tempest-VolumesBackupsAdminTest-1670197762 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 20:58:22.466683 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.manager [None req-fb1d6ff6-2e68-453e-bee5-ffde5b02434c tempest-VolumesBackupsAdminTest-1670197762 None] Notifying Schedulers of capabilities ... {{(pid=134148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 18 20:58:22.471139 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-fb1d6ff6-2e68-453e-bee5-ffde5b02434c tempest-VolumesBackupsAdminTest-1670197762 None] Deleted volume successfully. Dec 18 20:58:22.482963 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.coordination [None req-fb1d6ff6-2e68-453e-bee5-ffde5b02434c tempest-VolumesBackupsAdminTest-1670197762 None] Lock "b'cinder-8222c671-bce9-4818-87da-9a29a84c1f34-delete_volume'" released by "delete_volume" :: held 1.204s {{(pid=134148) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 18 20:58:26.889867 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.coordination [None req-3cfbdfa8-77a6-49c3-a242-807348de874d tempest-AttachSCSIVolumeTestJSON-250543757 None] Lock "b'cinder-88cfbe27-4f06-4df2-b679-ca48269e92dd-delete_volume'" acquired by "delete_volume" :: waited 0.033s {{(pid=134148) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 18 20:58:26.925861 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.flows.manager.create_volume [None req-7db955e8-9186-4347-8316-9db3bfa3c528 tempest-VolumesCloneNegativeTest-232287532 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134148) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Dec 18 20:58:26.929526 ncdv-master-1 cinder-volume[134148]: WARNING stevedore.named [None req-7db955e8-9186-4347-8316-9db3bfa3c528 tempest-VolumesCloneNegativeTest-232287532 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Dec 18 20:58:26.930375 ncdv-master-1 cinder-volume[134148]: WARNING castellan.key_manager [None req-7db955e8-9186-4347-8316-9db3bfa3c528 tempest-VolumesCloneNegativeTest-232287532 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Dec 18 20:58:26.946913 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-7db955e8-9186-4347-8316-9db3bfa3c528 tempest-VolumesCloneNegativeTest-232287532 None] Flow 'volume_create_manager' (68613304-a3c4-4887-aa63-e219bca0636b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 18 20:58:26.951973 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-7db955e8-9186-4347-8316-9db3bfa3c528 tempest-VolumesCloneNegativeTest-232287532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69e6c42d-c54b-42e6-b155-61675b0faeb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 20:58:26.965836 ncdv-master-1 cinder-volume[134148]: DEBUG oslo_db.sqlalchemy.engines [None req-3cfbdfa8-77a6-49c3-a242-807348de874d tempest-AttachSCSIVolumeTestJSON-250543757 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134148) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 18 20:58:26.989036 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-7db955e8-9186-4347-8316-9db3bfa3c528 tempest-VolumesCloneNegativeTest-232287532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69e6c42d-c54b-42e6-b155-61675b0faeb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-12-18T20:58:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1001976280',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=41c44d41-8ecd-490d-83bf-6640d6239466,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='64fbffc17fb94d73bd9ad8ad325fb2ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-12-18T20:58:27Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-12-18T20:58:27Z,use_quota=True,user_id='c5e4871963ee496b852a0962fcd00f28',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f2e1fe1-9fd6-411e-9ed9-368f463ccb6f),volume_type_id=1f2e1fe1-9fd6-411e-9ed9-368f463ccb6f)' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 20:58:26.991733 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-7db955e8-9186-4347-8316-9db3bfa3c528 tempest-VolumesCloneNegativeTest-232287532 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (669ff48c-8365-4850-ae7c-714dbcdff3b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 20:58:26.995406 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-7db955e8-9186-4347-8316-9db3bfa3c528 tempest-VolumesCloneNegativeTest-232287532 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (669ff48c-8365-4850-ae7c-714dbcdff3b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 20:58:26.998363 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-7db955e8-9186-4347-8316-9db3bfa3c528 tempest-VolumesCloneNegativeTest-232287532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c49916f2-9390-45ad-9a20-65064de74394) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 20:58:27.001017 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-7db955e8-9186-4347-8316-9db3bfa3c528 tempest-VolumesCloneNegativeTest-232287532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c49916f2-9390-45ad-9a20-65064de74394) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '41c44d41-8ecd-490d-83bf-6640d6239466', 'volume_name': 'volume-41c44d41-8ecd-490d-83bf-6640d6239466', 'volume_size': 2}' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 20:58:27.004017 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-7db955e8-9186-4347-8316-9db3bfa3c528 tempest-VolumesCloneNegativeTest-232287532 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7b1d72a-eaa5-4a26-98c1-3fa7de69c352) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 20:58:27.006900 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-7db955e8-9186-4347-8316-9db3bfa3c528 tempest-VolumesCloneNegativeTest-232287532 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7b1d72a-eaa5-4a26-98c1-3fa7de69c352) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 20:58:27.011825 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-7db955e8-9186-4347-8316-9db3bfa3c528 tempest-VolumesCloneNegativeTest-232287532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9e3d0c3-6356-4ac6-8026-8a058ec3bab8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 20:58:27.012830 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.flows.manager.create_volume [None req-7db955e8-9186-4347-8316-9db3bfa3c528 tempest-VolumesCloneNegativeTest-232287532 None] Volume 41c44d41-8ecd-490d-83bf-6640d6239466: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-41c44d41-8ecd-490d-83bf-6640d6239466', 'volume_size': 2} Dec 18 20:58:27.013409 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-7db955e8-9186-4347-8316-9db3bfa3c528 tempest-VolumesCloneNegativeTest-232287532 None] creating volume 'volume-41c44d41-8ecd-490d-83bf-6640d6239466' {{(pid=134148) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Dec 18 20:58:27.014437 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-7db955e8-9186-4347-8316-9db3bfa3c528 tempest-VolumesCloneNegativeTest-232287532 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 20:58:27.058909 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-3cfbdfa8-77a6-49c3-a242-807348de874d tempest-AttachSCSIVolumeTestJSON-250543757 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 20:58:27.141481 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-3cfbdfa8-77a6-49c3-a242-807348de874d tempest-AttachSCSIVolumeTestJSON-250543757 None] volume has no backup snaps {{(pid=134148) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Dec 18 20:58:27.142304 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-3cfbdfa8-77a6-49c3-a242-807348de874d tempest-AttachSCSIVolumeTestJSON-250543757 None] Volume volume-88cfbe27-4f06-4df2-b679-ca48269e92dd is not a clone. {{(pid=134148) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Dec 18 20:58:27.151132 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-3cfbdfa8-77a6-49c3-a242-807348de874d tempest-AttachSCSIVolumeTestJSON-250543757 None] deleting rbd volume volume-88cfbe27-4f06-4df2-b679-ca48269e92dd {{(pid=134148) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Dec 18 20:58:27.161731 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-7db955e8-9186-4347-8316-9db3bfa3c528 tempest-VolumesCloneNegativeTest-232287532 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134148) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 18 20:58:27.162232 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-7db955e8-9186-4347-8316-9db3bfa3c528 tempest-VolumesCloneNegativeTest-232287532 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134148) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 18 20:58:27.164300 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-7db955e8-9186-4347-8316-9db3bfa3c528 tempest-VolumesCloneNegativeTest-232287532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9e3d0c3-6356-4ac6-8026-8a058ec3bab8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-41c44d41-8ecd-490d-83bf-6640d6239466', 'volume_size': 2}' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 20:58:27.166500 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-7db955e8-9186-4347-8316-9db3bfa3c528 tempest-VolumesCloneNegativeTest-232287532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad5d859d-7c0a-438e-affd-c9b6e111e9bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 20:58:27.191233 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.flows.manager.create_volume [None req-7db955e8-9186-4347-8316-9db3bfa3c528 tempest-VolumesCloneNegativeTest-232287532 None] Volume volume-41c44d41-8ecd-490d-83bf-6640d6239466 (41c44d41-8ecd-490d-83bf-6640d6239466): created successfully Dec 18 20:58:27.192733 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-7db955e8-9186-4347-8316-9db3bfa3c528 tempest-VolumesCloneNegativeTest-232287532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad5d859d-7c0a-438e-affd-c9b6e111e9bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 20:58:27.203772 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-7db955e8-9186-4347-8316-9db3bfa3c528 tempest-VolumesCloneNegativeTest-232287532 None] Flow 'volume_create_manager' (68613304-a3c4-4887-aa63-e219bca0636b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134148) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 18 20:58:27.221661 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-7db955e8-9186-4347-8316-9db3bfa3c528 tempest-VolumesCloneNegativeTest-232287532 None] Created volume successfully. Dec 18 20:58:27.471288 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.quota [None req-3cfbdfa8-77a6-49c3-a242-807348de874d tempest-AttachSCSIVolumeTestJSON-250543757 None] Created reservations ['99078947-dc80-4fc0-92bf-0bfd70327417', '22705aa4-3ce6-4013-9f73-8960a6813e0b', 'cfebc2e6-b4b6-41c1-9490-5bc826e86c14', 'fd0abc4b-dc9e-4357-bd85-e960a1db2121'] {{(pid=134148) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 18 20:58:27.520397 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-3cfbdfa8-77a6-49c3-a242-807348de874d tempest-AttachSCSIVolumeTestJSON-250543757 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 20:58:27.553713 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-3cfbdfa8-77a6-49c3-a242-807348de874d tempest-AttachSCSIVolumeTestJSON-250543757 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 20:58:27.585436 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.manager [None req-3cfbdfa8-77a6-49c3-a242-807348de874d tempest-AttachSCSIVolumeTestJSON-250543757 None] Notifying Schedulers of capabilities ... {{(pid=134148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 18 20:58:27.589597 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-3cfbdfa8-77a6-49c3-a242-807348de874d tempest-AttachSCSIVolumeTestJSON-250543757 None] Deleted volume successfully. Dec 18 20:58:27.611623 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.coordination [None req-3cfbdfa8-77a6-49c3-a242-807348de874d tempest-AttachSCSIVolumeTestJSON-250543757 None] Lock "b'cinder-88cfbe27-4f06-4df2-b679-ca48269e92dd-delete_volume'" released by "delete_volume" :: held 0.723s {{(pid=134148) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 18 20:58:28.036763 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.coordination [None req-68ce328a-6894-4d50-846f-3529b415183f tempest-VolumesCloneNegativeTest-232287532 None] Lock "b'cinder-41c44d41-8ecd-490d-83bf-6640d6239466-delete_volume'" acquired by "delete_volume" :: waited 0.010s {{(pid=134148) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 18 20:58:28.107522 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-68ce328a-6894-4d50-846f-3529b415183f tempest-VolumesCloneNegativeTest-232287532 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 20:58:28.171793 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-68ce328a-6894-4d50-846f-3529b415183f tempest-VolumesCloneNegativeTest-232287532 None] volume has no backup snaps {{(pid=134148) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Dec 18 20:58:28.172374 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-68ce328a-6894-4d50-846f-3529b415183f tempest-VolumesCloneNegativeTest-232287532 None] Volume volume-41c44d41-8ecd-490d-83bf-6640d6239466 is not a clone. {{(pid=134148) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Dec 18 20:58:28.191171 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-68ce328a-6894-4d50-846f-3529b415183f tempest-VolumesCloneNegativeTest-232287532 None] deleting rbd volume volume-41c44d41-8ecd-490d-83bf-6640d6239466 {{(pid=134148) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Dec 18 20:58:28.588515 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.quota [None req-68ce328a-6894-4d50-846f-3529b415183f tempest-VolumesCloneNegativeTest-232287532 None] Created reservations ['579f35ec-42fa-416f-b6e7-648c05e27676', '0e863a47-04ab-4191-a47c-9c4d1c83b6d9', '5d1505ae-1555-4891-a7af-599147089452', '673acc4f-041c-47b6-b2d3-2beacc479190'] {{(pid=134148) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 18 20:58:28.666878 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-68ce328a-6894-4d50-846f-3529b415183f tempest-VolumesCloneNegativeTest-232287532 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 20:58:28.725438 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-68ce328a-6894-4d50-846f-3529b415183f tempest-VolumesCloneNegativeTest-232287532 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 20:58:28.807977 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.manager [None req-68ce328a-6894-4d50-846f-3529b415183f tempest-VolumesCloneNegativeTest-232287532 None] Notifying Schedulers of capabilities ... {{(pid=134148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 18 20:58:28.813755 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-68ce328a-6894-4d50-846f-3529b415183f tempest-VolumesCloneNegativeTest-232287532 None] Deleted volume successfully. Dec 18 20:58:28.832570 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.coordination [None req-68ce328a-6894-4d50-846f-3529b415183f tempest-VolumesCloneNegativeTest-232287532 None] Lock "b'cinder-41c44d41-8ecd-490d-83bf-6640d6239466-delete_volume'" released by "delete_volume" :: held 0.806s {{(pid=134148) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 18 20:58:34.336984 ncdv-master-1 cinder-volume[134148]: DEBUG oslo_service.periodic_task [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134148) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Dec 18 20:58:34.337699 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 20:58:34.413380 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 20:58:34.467857 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.manager [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] Notifying Schedulers of capabilities ... {{(pid=134148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 18 20:58:48.916369 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [req-48952a6c-212a-4733-ab59-41190f5705ac req-b3f31721-2ed0-409a-83d0-c172ba0e11ba tempest-ServerRescueNegativeTestJSON-2089751494 None] Terminate volume connection completed successfully. Dec 18 20:58:48.917716 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [req-48952a6c-212a-4733-ab59-41190f5705ac req-b3f31721-2ed0-409a-83d0-c172ba0e11ba tempest-ServerRescueNegativeTestJSON-2089751494 None] Deleting attachment 063832f3-b832-4506-970b-53016cccca32. {{(pid=134148) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4948}} Dec 18 20:58:50.772958 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.coordination [None req-9b0647b8-5456-4da7-bd9f-9ecc743a7a37 tempest-ServerRescueNegativeTestJSON-2089751494 None] Lock "b'cinder-78a2ade0-d35d-4737-a6ce-c8fb33ea5e2e-delete_volume'" acquired by "delete_volume" :: waited 0.071s {{(pid=134148) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 18 20:58:50.822525 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-9b0647b8-5456-4da7-bd9f-9ecc743a7a37 tempest-ServerRescueNegativeTestJSON-2089751494 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 20:58:50.907380 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-9b0647b8-5456-4da7-bd9f-9ecc743a7a37 tempest-ServerRescueNegativeTestJSON-2089751494 None] volume has no backup snaps {{(pid=134148) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Dec 18 20:58:50.907783 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-9b0647b8-5456-4da7-bd9f-9ecc743a7a37 tempest-ServerRescueNegativeTestJSON-2089751494 None] Volume volume-78a2ade0-d35d-4737-a6ce-c8fb33ea5e2e is not a clone. {{(pid=134148) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Dec 18 20:58:50.925915 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-9b0647b8-5456-4da7-bd9f-9ecc743a7a37 tempest-ServerRescueNegativeTestJSON-2089751494 None] deleting rbd volume volume-78a2ade0-d35d-4737-a6ce-c8fb33ea5e2e {{(pid=134148) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Dec 18 20:58:51.394153 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.quota [None req-9b0647b8-5456-4da7-bd9f-9ecc743a7a37 tempest-ServerRescueNegativeTestJSON-2089751494 None] Created reservations ['0cc55596-55eb-42de-b863-02aa3b36efe3', '2061be2f-bafb-4447-b9bc-30b20deb9e28', '0ca959cc-eeed-475c-b83f-e71f92499269', '395a1645-8ebf-41e4-8f84-cde64692d13d'] {{(pid=134148) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 18 20:58:51.525033 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-9b0647b8-5456-4da7-bd9f-9ecc743a7a37 tempest-ServerRescueNegativeTestJSON-2089751494 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 20:58:51.614996 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-9b0647b8-5456-4da7-bd9f-9ecc743a7a37 tempest-ServerRescueNegativeTestJSON-2089751494 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 20:58:51.665176 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.manager [None req-9b0647b8-5456-4da7-bd9f-9ecc743a7a37 tempest-ServerRescueNegativeTestJSON-2089751494 None] Notifying Schedulers of capabilities ... {{(pid=134148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 18 20:58:51.671322 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-9b0647b8-5456-4da7-bd9f-9ecc743a7a37 tempest-ServerRescueNegativeTestJSON-2089751494 None] Deleted volume successfully. Dec 18 20:58:51.694207 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.coordination [None req-9b0647b8-5456-4da7-bd9f-9ecc743a7a37 tempest-ServerRescueNegativeTestJSON-2089751494 None] Lock "b'cinder-78a2ade0-d35d-4737-a6ce-c8fb33ea5e2e-delete_volume'" released by "delete_volume" :: held 0.926s {{(pid=134148) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 18 20:58:51.975240 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.coordination [None req-9242a13a-0fb5-47b4-93b1-e4f168ef6a1c tempest-ServerRescueNegativeTestJSON-2089751494 None] Lock "b'cinder-40750169-3a96-4904-a7e2-ed473ccd50cd-delete_volume'" acquired by "delete_volume" :: waited 0.010s {{(pid=134148) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 18 20:58:52.042870 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-9242a13a-0fb5-47b4-93b1-e4f168ef6a1c tempest-ServerRescueNegativeTestJSON-2089751494 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 20:58:52.139850 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-9242a13a-0fb5-47b4-93b1-e4f168ef6a1c tempest-ServerRescueNegativeTestJSON-2089751494 None] volume has no backup snaps {{(pid=134148) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Dec 18 20:58:52.140452 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-9242a13a-0fb5-47b4-93b1-e4f168ef6a1c tempest-ServerRescueNegativeTestJSON-2089751494 None] Volume volume-40750169-3a96-4904-a7e2-ed473ccd50cd is not a clone. {{(pid=134148) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Dec 18 20:58:52.146933 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-9242a13a-0fb5-47b4-93b1-e4f168ef6a1c tempest-ServerRescueNegativeTestJSON-2089751494 None] deleting rbd volume volume-40750169-3a96-4904-a7e2-ed473ccd50cd {{(pid=134148) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Dec 18 20:58:52.561471 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.quota [None req-9242a13a-0fb5-47b4-93b1-e4f168ef6a1c tempest-ServerRescueNegativeTestJSON-2089751494 None] Created reservations ['14aa3fcf-39b4-4c41-ac9e-3939fe15952f', '2b7b09d4-9566-4160-a101-e0033740f6f0', 'cbfed24d-3874-49e9-99d2-2d11a4fb9f19', '5bced3ba-57ca-4856-b1c0-4f72a9358305'] {{(pid=134148) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 18 20:58:52.642126 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-9242a13a-0fb5-47b4-93b1-e4f168ef6a1c tempest-ServerRescueNegativeTestJSON-2089751494 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 20:58:52.692418 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-9242a13a-0fb5-47b4-93b1-e4f168ef6a1c tempest-ServerRescueNegativeTestJSON-2089751494 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 20:58:52.759339 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.manager [None req-9242a13a-0fb5-47b4-93b1-e4f168ef6a1c tempest-ServerRescueNegativeTestJSON-2089751494 None] Notifying Schedulers of capabilities ... {{(pid=134148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 18 20:58:52.764511 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-9242a13a-0fb5-47b4-93b1-e4f168ef6a1c tempest-ServerRescueNegativeTestJSON-2089751494 None] Deleted volume successfully. Dec 18 20:58:52.789739 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.coordination [None req-9242a13a-0fb5-47b4-93b1-e4f168ef6a1c tempest-ServerRescueNegativeTestJSON-2089751494 None] Lock "b'cinder-40750169-3a96-4904-a7e2-ed473ccd50cd-delete_volume'" released by "delete_volume" :: held 0.815s {{(pid=134148) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 18 20:59:34.334221 ncdv-master-1 cinder-volume[134148]: DEBUG oslo_service.periodic_task [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134148) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Dec 18 20:59:34.334977 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 20:59:34.387784 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 20:59:34.447528 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.manager [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] Notifying Schedulers of capabilities ... {{(pid=134148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 18 20:59:41.909052 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.flows.manager.create_volume [None req-40673f44-135a-48d9-8c96-2ead03df2509 tempest-AttachVolumeNegativeTest-997340476 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134148) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Dec 18 20:59:41.917492 ncdv-master-1 cinder-volume[134148]: WARNING stevedore.named [None req-40673f44-135a-48d9-8c96-2ead03df2509 tempest-AttachVolumeNegativeTest-997340476 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Dec 18 20:59:41.917948 ncdv-master-1 cinder-volume[134148]: WARNING castellan.key_manager [None req-40673f44-135a-48d9-8c96-2ead03df2509 tempest-AttachVolumeNegativeTest-997340476 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Dec 18 20:59:41.954739 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-40673f44-135a-48d9-8c96-2ead03df2509 tempest-AttachVolumeNegativeTest-997340476 None] Flow 'volume_create_manager' (82409513-d24a-441e-98ed-8b533ccb6506) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 18 20:59:41.958191 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-40673f44-135a-48d9-8c96-2ead03df2509 tempest-AttachVolumeNegativeTest-997340476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c23597ef-bd9e-4e0a-bb09-19a6ab267300) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 20:59:41.970811 ncdv-master-1 cinder-volume[134148]: DEBUG oslo_db.sqlalchemy.engines [None req-40673f44-135a-48d9-8c96-2ead03df2509 tempest-AttachVolumeNegativeTest-997340476 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134148) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 18 20:59:41.986152 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-40673f44-135a-48d9-8c96-2ead03df2509 tempest-AttachVolumeNegativeTest-997340476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c23597ef-bd9e-4e0a-bb09-19a6ab267300) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-12-18T20:59:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1637911288',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=17286a65-2bb6-4891-8fc9-210c222fe2a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d1b96ca6ed964b6a9db0ed2249251328',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-12-18T20:59:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-12-18T20:59:42Z,use_quota=True,user_id='4196dd207ce543d3bdd5f48ae57e156a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f2e1fe1-9fd6-411e-9ed9-368f463ccb6f),volume_type_id=1f2e1fe1-9fd6-411e-9ed9-368f463ccb6f)' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 20:59:41.990034 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-40673f44-135a-48d9-8c96-2ead03df2509 tempest-AttachVolumeNegativeTest-997340476 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f5b4006-319e-417d-8870-9c6317510c08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 20:59:41.990883 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-40673f44-135a-48d9-8c96-2ead03df2509 tempest-AttachVolumeNegativeTest-997340476 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f5b4006-319e-417d-8870-9c6317510c08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 20:59:41.993507 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-40673f44-135a-48d9-8c96-2ead03df2509 tempest-AttachVolumeNegativeTest-997340476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85a93861-f102-457d-9a06-87fc87b358fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 20:59:41.996065 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-40673f44-135a-48d9-8c96-2ead03df2509 tempest-AttachVolumeNegativeTest-997340476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85a93861-f102-457d-9a06-87fc87b358fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '17286a65-2bb6-4891-8fc9-210c222fe2a9', 'volume_name': 'volume-17286a65-2bb6-4891-8fc9-210c222fe2a9', 'volume_size': 1}' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 20:59:41.998428 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-40673f44-135a-48d9-8c96-2ead03df2509 tempest-AttachVolumeNegativeTest-997340476 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab672c0b-ec5e-4541-b8e6-2812e5992401) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 20:59:42.000859 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-40673f44-135a-48d9-8c96-2ead03df2509 tempest-AttachVolumeNegativeTest-997340476 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab672c0b-ec5e-4541-b8e6-2812e5992401) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 20:59:42.003115 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-40673f44-135a-48d9-8c96-2ead03df2509 tempest-AttachVolumeNegativeTest-997340476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a397d76f-885b-4e3b-b12b-a524e86ef5a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 20:59:42.003894 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.flows.manager.create_volume [None req-40673f44-135a-48d9-8c96-2ead03df2509 tempest-AttachVolumeNegativeTest-997340476 None] Volume 17286a65-2bb6-4891-8fc9-210c222fe2a9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-17286a65-2bb6-4891-8fc9-210c222fe2a9', 'volume_size': 1} Dec 18 20:59:42.004287 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-40673f44-135a-48d9-8c96-2ead03df2509 tempest-AttachVolumeNegativeTest-997340476 None] creating volume 'volume-17286a65-2bb6-4891-8fc9-210c222fe2a9' {{(pid=134148) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Dec 18 20:59:42.005247 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-40673f44-135a-48d9-8c96-2ead03df2509 tempest-AttachVolumeNegativeTest-997340476 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 20:59:42.136608 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-40673f44-135a-48d9-8c96-2ead03df2509 tempest-AttachVolumeNegativeTest-997340476 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134148) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 18 20:59:42.137233 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-40673f44-135a-48d9-8c96-2ead03df2509 tempest-AttachVolumeNegativeTest-997340476 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134148) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 18 20:59:42.140531 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-40673f44-135a-48d9-8c96-2ead03df2509 tempest-AttachVolumeNegativeTest-997340476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a397d76f-885b-4e3b-b12b-a524e86ef5a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-17286a65-2bb6-4891-8fc9-210c222fe2a9', 'volume_size': 1}' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 20:59:42.143480 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-40673f44-135a-48d9-8c96-2ead03df2509 tempest-AttachVolumeNegativeTest-997340476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (109d3655-40a1-48c2-97c9-da1161245538) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 20:59:42.172944 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.flows.manager.create_volume [None req-40673f44-135a-48d9-8c96-2ead03df2509 tempest-AttachVolumeNegativeTest-997340476 None] Volume volume-17286a65-2bb6-4891-8fc9-210c222fe2a9 (17286a65-2bb6-4891-8fc9-210c222fe2a9): created successfully Dec 18 20:59:42.176563 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-40673f44-135a-48d9-8c96-2ead03df2509 tempest-AttachVolumeNegativeTest-997340476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (109d3655-40a1-48c2-97c9-da1161245538) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 20:59:42.182922 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-40673f44-135a-48d9-8c96-2ead03df2509 tempest-AttachVolumeNegativeTest-997340476 None] Flow 'volume_create_manager' (82409513-d24a-441e-98ed-8b533ccb6506) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134148) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 18 20:59:42.207601 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-40673f44-135a-48d9-8c96-2ead03df2509 tempest-AttachVolumeNegativeTest-997340476 None] Created volume successfully. Dec 18 20:59:43.788571 ncdv-master-1 cinder-volume[134148]: DEBUG oslo_concurrency.processutils [req-b346c98b-a78a-457d-8d83-24d76cff8afe req-244c8d9d-15f4-451e-bb82-49a1230e0ef1 tempest-AttachVolumeNegativeTest-997340476 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=134148) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Dec 18 20:59:45.221200 ncdv-master-1 cinder-volume[134148]: DEBUG oslo_concurrency.processutils [req-b346c98b-a78a-457d-8d83-24d76cff8afe req-244c8d9d-15f4-451e-bb82-49a1230e0ef1 tempest-AttachVolumeNegativeTest-997340476 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.433s {{(pid=134148) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Dec 18 20:59:45.222178 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [req-b346c98b-a78a-457d-8d83-24d76cff8afe req-244c8d9d-15f4-451e-bb82-49a1230e0ef1 tempest-AttachVolumeNegativeTest-997340476 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-17286a65-2bb6-4891-8fc9-210c222fe2a9', 'hosts': ['10.222.0.13'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '946d1715-d12c-4dbf-8a79-181222df6e2e', 'volume_id': '17286a65-2bb6-4891-8fc9-210c222fe2a9', 'discard': True}} {{(pid=134148) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Dec 18 20:59:45.260628 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [req-b346c98b-a78a-457d-8d83-24d76cff8afe req-244c8d9d-15f4-451e-bb82-49a1230e0ef1 tempest-AttachVolumeNegativeTest-997340476 None] Connection info returned from driver {'name': 'volumes/volume-17286a65-2bb6-4891-8fc9-210c222fe2a9', 'hosts': ['10.222.0.13'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '17286a65-2bb6-4891-8fc9-210c222fe2a9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '5310dfa2-9299-4768-9a1c-b8898c760208'} {{(pid=134148) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4812}} Dec 18 20:59:45.365005 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [req-b346c98b-a78a-457d-8d83-24d76cff8afe req-244c8d9d-15f4-451e-bb82-49a1230e0ef1 tempest-AttachVolumeNegativeTest-997340476 None] attachment_update completed successfully. Dec 18 21:00:05.664483 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [req-5a00e3ae-5fd1-4a6d-a137-0dc4a5f8580b req-85876899-86ac-4d93-8702-1fddfc2943dc tempest-AttachVolumeNegativeTest-997340476 None] Terminate volume connection completed successfully. Dec 18 21:00:05.664483 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [req-5a00e3ae-5fd1-4a6d-a137-0dc4a5f8580b req-85876899-86ac-4d93-8702-1fddfc2943dc tempest-AttachVolumeNegativeTest-997340476 None] Deleting attachment 5310dfa2-9299-4768-9a1c-b8898c760208. {{(pid=134148) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4948}} Dec 18 21:00:21.009344 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.flows.manager.create_volume [None req-3753b04e-8705-4b4d-a634-ddfa659db05f tempest-AttachVolumeNegativeTest-997340476 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134148) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Dec 18 21:00:21.017664 ncdv-master-1 cinder-volume[134148]: WARNING stevedore.named [None req-3753b04e-8705-4b4d-a634-ddfa659db05f tempest-AttachVolumeNegativeTest-997340476 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Dec 18 21:00:21.018184 ncdv-master-1 cinder-volume[134148]: WARNING castellan.key_manager [None req-3753b04e-8705-4b4d-a634-ddfa659db05f tempest-AttachVolumeNegativeTest-997340476 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Dec 18 21:00:21.033630 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-3753b04e-8705-4b4d-a634-ddfa659db05f tempest-AttachVolumeNegativeTest-997340476 None] Flow 'volume_create_manager' (8d4ae7ce-a60a-40c5-937e-416384e8990f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 18 21:00:21.037367 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-3753b04e-8705-4b4d-a634-ddfa659db05f tempest-AttachVolumeNegativeTest-997340476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca9b5d36-0482-47a0-95d5-413711e2fc63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:00:21.044447 ncdv-master-1 cinder-volume[134148]: DEBUG oslo_db.sqlalchemy.engines [None req-3753b04e-8705-4b4d-a634-ddfa659db05f tempest-AttachVolumeNegativeTest-997340476 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134148) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 18 21:00:21.059254 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-3753b04e-8705-4b4d-a634-ddfa659db05f tempest-AttachVolumeNegativeTest-997340476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca9b5d36-0482-47a0-95d5-413711e2fc63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-12-18T21:00:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-253201351',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=4d0bb476-e8f3-480c-9032-e87a7899ee26,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d1b96ca6ed964b6a9db0ed2249251328',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-12-18T21:00:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-12-18T21:00:21Z,use_quota=True,user_id='4196dd207ce543d3bdd5f48ae57e156a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f2e1fe1-9fd6-411e-9ed9-368f463ccb6f),volume_type_id=1f2e1fe1-9fd6-411e-9ed9-368f463ccb6f)' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:00:21.062424 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-3753b04e-8705-4b4d-a634-ddfa659db05f tempest-AttachVolumeNegativeTest-997340476 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71196866-149b-4747-944f-42059d044559) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:00:21.065431 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-3753b04e-8705-4b4d-a634-ddfa659db05f tempest-AttachVolumeNegativeTest-997340476 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71196866-149b-4747-944f-42059d044559) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:00:21.068424 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-3753b04e-8705-4b4d-a634-ddfa659db05f tempest-AttachVolumeNegativeTest-997340476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63d6d448-5ed0-441f-aa72-2949b75e85bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:00:21.071441 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-3753b04e-8705-4b4d-a634-ddfa659db05f tempest-AttachVolumeNegativeTest-997340476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63d6d448-5ed0-441f-aa72-2949b75e85bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4d0bb476-e8f3-480c-9032-e87a7899ee26', 'volume_name': 'volume-4d0bb476-e8f3-480c-9032-e87a7899ee26', 'volume_size': 1}' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:00:21.076453 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-3753b04e-8705-4b4d-a634-ddfa659db05f tempest-AttachVolumeNegativeTest-997340476 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e495448-ac9c-496d-9e26-083b1e9b5fbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:00:21.079636 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-3753b04e-8705-4b4d-a634-ddfa659db05f tempest-AttachVolumeNegativeTest-997340476 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e495448-ac9c-496d-9e26-083b1e9b5fbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:00:21.082204 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-3753b04e-8705-4b4d-a634-ddfa659db05f tempest-AttachVolumeNegativeTest-997340476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e8019ce-962c-4725-bbeb-b0def104e93a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:00:21.083194 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.flows.manager.create_volume [None req-3753b04e-8705-4b4d-a634-ddfa659db05f tempest-AttachVolumeNegativeTest-997340476 None] Volume 4d0bb476-e8f3-480c-9032-e87a7899ee26: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4d0bb476-e8f3-480c-9032-e87a7899ee26', 'volume_size': 1} Dec 18 21:00:21.083763 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-3753b04e-8705-4b4d-a634-ddfa659db05f tempest-AttachVolumeNegativeTest-997340476 None] creating volume 'volume-4d0bb476-e8f3-480c-9032-e87a7899ee26' {{(pid=134148) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Dec 18 21:00:21.085024 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-3753b04e-8705-4b4d-a634-ddfa659db05f tempest-AttachVolumeNegativeTest-997340476 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:00:21.179337 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-3753b04e-8705-4b4d-a634-ddfa659db05f tempest-AttachVolumeNegativeTest-997340476 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134148) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 18 21:00:21.180069 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-3753b04e-8705-4b4d-a634-ddfa659db05f tempest-AttachVolumeNegativeTest-997340476 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134148) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 18 21:00:21.182630 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-3753b04e-8705-4b4d-a634-ddfa659db05f tempest-AttachVolumeNegativeTest-997340476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e8019ce-962c-4725-bbeb-b0def104e93a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4d0bb476-e8f3-480c-9032-e87a7899ee26', 'volume_size': 1}' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:00:21.185623 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-3753b04e-8705-4b4d-a634-ddfa659db05f tempest-AttachVolumeNegativeTest-997340476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d894c6cb-b3e6-4b1b-a2aa-fb8df0e3c368) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:00:21.225152 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.flows.manager.create_volume [None req-3753b04e-8705-4b4d-a634-ddfa659db05f tempest-AttachVolumeNegativeTest-997340476 None] Volume volume-4d0bb476-e8f3-480c-9032-e87a7899ee26 (4d0bb476-e8f3-480c-9032-e87a7899ee26): created successfully Dec 18 21:00:21.228956 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-3753b04e-8705-4b4d-a634-ddfa659db05f tempest-AttachVolumeNegativeTest-997340476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d894c6cb-b3e6-4b1b-a2aa-fb8df0e3c368) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:00:21.236584 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-3753b04e-8705-4b4d-a634-ddfa659db05f tempest-AttachVolumeNegativeTest-997340476 None] Flow 'volume_create_manager' (8d4ae7ce-a60a-40c5-937e-416384e8990f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134148) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 18 21:00:21.248098 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-3753b04e-8705-4b4d-a634-ddfa659db05f tempest-AttachVolumeNegativeTest-997340476 None] Created volume successfully. Dec 18 21:00:23.032177 ncdv-master-1 cinder-volume[134148]: DEBUG oslo_concurrency.processutils [req-e5362099-5818-4466-96e6-e971b5f74c19 req-541c199f-4d1c-44d2-9d94-377ad7552c63 tempest-AttachVolumeNegativeTest-997340476 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=134148) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Dec 18 21:00:23.922513 ncdv-master-1 cinder-volume[134148]: DEBUG oslo_concurrency.processutils [req-e5362099-5818-4466-96e6-e971b5f74c19 req-541c199f-4d1c-44d2-9d94-377ad7552c63 tempest-AttachVolumeNegativeTest-997340476 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.889s {{(pid=134148) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Dec 18 21:00:23.923705 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [req-e5362099-5818-4466-96e6-e971b5f74c19 req-541c199f-4d1c-44d2-9d94-377ad7552c63 tempest-AttachVolumeNegativeTest-997340476 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-4d0bb476-e8f3-480c-9032-e87a7899ee26', 'hosts': ['10.222.0.13'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '946d1715-d12c-4dbf-8a79-181222df6e2e', 'volume_id': '4d0bb476-e8f3-480c-9032-e87a7899ee26', 'discard': True}} {{(pid=134148) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Dec 18 21:00:23.974561 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [req-e5362099-5818-4466-96e6-e971b5f74c19 req-541c199f-4d1c-44d2-9d94-377ad7552c63 tempest-AttachVolumeNegativeTest-997340476 None] Connection info returned from driver {'name': 'volumes/volume-4d0bb476-e8f3-480c-9032-e87a7899ee26', 'hosts': ['10.222.0.13'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '4d0bb476-e8f3-480c-9032-e87a7899ee26', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'e0cb9561-3b25-4c56-9c31-aec57890d3d4'} {{(pid=134148) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4812}} Dec 18 21:00:24.052531 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [req-e5362099-5818-4466-96e6-e971b5f74c19 req-541c199f-4d1c-44d2-9d94-377ad7552c63 tempest-AttachVolumeNegativeTest-997340476 None] attachment_update completed successfully. Dec 18 21:00:27.562536 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [req-a0e95819-5dd2-4ff3-9c48-662e879b72aa req-e588bd82-6827-4992-a387-cd763cbf53fa tempest-AttachVolumeNegativeTest-997340476 None] Terminate volume connection completed successfully. Dec 18 21:00:27.563166 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [req-a0e95819-5dd2-4ff3-9c48-662e879b72aa req-e588bd82-6827-4992-a387-cd763cbf53fa tempest-AttachVolumeNegativeTest-997340476 None] Deleting attachment e0cb9561-3b25-4c56-9c31-aec57890d3d4. {{(pid=134148) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4948}} Dec 18 21:00:34.334231 ncdv-master-1 cinder-volume[134148]: DEBUG oslo_service.periodic_task [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134148) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Dec 18 21:00:34.340614 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:00:34.424342 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:00:34.491528 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.manager [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] Notifying Schedulers of capabilities ... {{(pid=134148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 18 21:00:41.171518 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.flows.manager.create_volume [None req-5ddb4dd7-5ca0-4042-aa42-d0b9214a212e tempest-TaggedBootDevicesTest_v242-1367484865 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134148) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Dec 18 21:00:41.179263 ncdv-master-1 cinder-volume[134148]: WARNING stevedore.named [None req-5ddb4dd7-5ca0-4042-aa42-d0b9214a212e tempest-TaggedBootDevicesTest_v242-1367484865 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Dec 18 21:00:41.180126 ncdv-master-1 cinder-volume[134148]: WARNING castellan.key_manager [None req-5ddb4dd7-5ca0-4042-aa42-d0b9214a212e tempest-TaggedBootDevicesTest_v242-1367484865 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Dec 18 21:00:41.204989 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-5ddb4dd7-5ca0-4042-aa42-d0b9214a212e tempest-TaggedBootDevicesTest_v242-1367484865 None] Flow 'volume_create_manager' (15969175-648b-44a9-ac65-c981bbcb3ac2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 18 21:00:41.208363 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-5ddb4dd7-5ca0-4042-aa42-d0b9214a212e tempest-TaggedBootDevicesTest_v242-1367484865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (efbe165b-11b2-45f1-8aa4-9d6ea8f7301e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:00:41.215837 ncdv-master-1 cinder-volume[134148]: DEBUG oslo_db.sqlalchemy.engines [None req-5ddb4dd7-5ca0-4042-aa42-d0b9214a212e tempest-TaggedBootDevicesTest_v242-1367484865 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134148) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 18 21:00:41.229839 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-5ddb4dd7-5ca0-4042-aa42-d0b9214a212e tempest-TaggedBootDevicesTest_v242-1367484865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (efbe165b-11b2-45f1-8aa4-9d6ea8f7301e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-12-18T21:00:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest_v242-volume-920609422',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=8f6e05d6-463a-4bb2-82e3-f0b21a816f31,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='08fc19b054a54a08aec65b0870725eb8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-12-18T21:00:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-12-18T21:00:41Z,use_quota=True,user_id='e80a2e31964348e7b4abd7c321e713b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f2e1fe1-9fd6-411e-9ed9-368f463ccb6f),volume_type_id=1f2e1fe1-9fd6-411e-9ed9-368f463ccb6f)' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:00:41.233802 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-5ddb4dd7-5ca0-4042-aa42-d0b9214a212e tempest-TaggedBootDevicesTest_v242-1367484865 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1998dc6-70ad-49df-82d7-0232dcb57584) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:00:41.236436 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-5ddb4dd7-5ca0-4042-aa42-d0b9214a212e tempest-TaggedBootDevicesTest_v242-1367484865 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1998dc6-70ad-49df-82d7-0232dcb57584) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:00:41.241400 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-5ddb4dd7-5ca0-4042-aa42-d0b9214a212e tempest-TaggedBootDevicesTest_v242-1367484865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e74cee42-5011-478a-b923-e54e3b8680eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:00:41.352840 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-5ddb4dd7-5ca0-4042-aa42-d0b9214a212e tempest-TaggedBootDevicesTest_v242-1367484865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e74cee42-5011-478a-b923-e54e3b8680eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '8f6e05d6-463a-4bb2-82e3-f0b21a816f31', 'volume_name': 'volume-8f6e05d6-463a-4bb2-82e3-f0b21a816f31', 'volume_size': 1, 'image_id': '394b3891-80f2-44c9-a9aa-56fe23a5acb3', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b04c3d19c79d4c208395e97f9d293618', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '394b3891-80f2-44c9-a9aa-56fe23a5acb3', 'created_at': datetime.datetime(2021, 12, 18, 20, 38, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 12, 18, 20, 38, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/394b3891-80f2-44c9-a9aa-56fe23a5acb3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:00:41.355479 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-5ddb4dd7-5ca0-4042-aa42-d0b9214a212e tempest-TaggedBootDevicesTest_v242-1367484865 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ced594e-3895-4f64-b80b-814f62db66bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:00:41.357780 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-5ddb4dd7-5ca0-4042-aa42-d0b9214a212e tempest-TaggedBootDevicesTest_v242-1367484865 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ced594e-3895-4f64-b80b-814f62db66bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:00:41.360066 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-5ddb4dd7-5ca0-4042-aa42-d0b9214a212e tempest-TaggedBootDevicesTest_v242-1367484865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d43d2cb-c814-4e77-961a-6d8de1173617) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:00:41.360878 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.flows.manager.create_volume [None req-5ddb4dd7-5ca0-4042-aa42-d0b9214a212e tempest-TaggedBootDevicesTest_v242-1367484865 None] Volume 8f6e05d6-463a-4bb2-82e3-f0b21a816f31: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-8f6e05d6-463a-4bb2-82e3-f0b21a816f31', 'volume_size': 1, 'image_id': '394b3891-80f2-44c9-a9aa-56fe23a5acb3', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b04c3d19c79d4c208395e97f9d293618', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '394b3891-80f2-44c9-a9aa-56fe23a5acb3', 'created_at': datetime.datetime(2021, 12, 18, 20, 38, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 12, 18, 20, 38, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/394b3891-80f2-44c9-a9aa-56fe23a5acb3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Dec 18 21:00:41.361619 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.flows.manager.create_volume [None req-5ddb4dd7-5ca0-4042-aa42-d0b9214a212e tempest-TaggedBootDevicesTest_v242-1367484865 None] Cloning 8f6e05d6-463a-4bb2-82e3-f0b21a816f31 from image 394b3891-80f2-44c9-a9aa-56fe23a5acb3 at location (None, None). {{(pid=134148) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1047}} Dec 18 21:00:41.371248 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.coordination [None req-5ddb4dd7-5ca0-4042-aa42-d0b9214a212e tempest-TaggedBootDevicesTest_v242-1367484865 None] Lock "b'cinder-394b3891-80f2-44c9-a9aa-56fe23a5acb3'" acquired by "_prepare_image_cache_entry" :: waited 0.009s {{(pid=134148) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 18 21:00:41.381793 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.image.cache [None req-5ddb4dd7-5ca0-4042-aa42-d0b9214a212e tempest-TaggedBootDevicesTest_v242-1367484865 None] Found image-volume cache entry: {'id': 1, 'image_id': '394b3891-80f2-44c9-a9aa-56fe23a5acb3', 'volume_id': 'e6411a45-48fa-4beb-a5a0-eb6a6ca3f525', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2021, 12, 18, 20, 38, 21), 'last_used': datetime.datetime(2021, 12, 18, 21, 0, 41, 375702)}. {{(pid=134148) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Dec 18 21:00:41.382234 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.image.cache [None req-5ddb4dd7-5ca0-4042-aa42-d0b9214a212e tempest-TaggedBootDevicesTest_v242-1367484865 None] Image-volume cache entry image_update_at = 2021-12-18 20:38:21+00:00, requested image updated_at = 2021-12-18 20:38:21+00:00. {{(pid=134148) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Dec 18 21:00:41.382698 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.flows.manager.create_volume [None req-5ddb4dd7-5ca0-4042-aa42-d0b9214a212e tempest-TaggedBootDevicesTest_v242-1367484865 None] Found cache entry for image = 394b3891-80f2-44c9-a9aa-56fe23a5acb3 on host ncdv-master-1@ceph#ceph. {{(pid=134148) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:870}} Dec 18 21:00:41.416760 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.coordination [None req-5ddb4dd7-5ca0-4042-aa42-d0b9214a212e tempest-TaggedBootDevicesTest_v242-1367484865 None] Lock "b'cinder-394b3891-80f2-44c9-a9aa-56fe23a5acb3'" released by "_prepare_image_cache_entry" :: held 0.045s {{(pid=134148) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 18 21:00:41.418386 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.flows.manager.create_volume [None req-5ddb4dd7-5ca0-4042-aa42-d0b9214a212e tempest-TaggedBootDevicesTest_v242-1367484865 None] Attempting to retrieve cache entry for image = 394b3891-80f2-44c9-a9aa-56fe23a5acb3 on host ncdv-master-1@ceph#ceph. {{(pid=134148) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:811}} Dec 18 21:00:41.438584 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.image.cache [None req-5ddb4dd7-5ca0-4042-aa42-d0b9214a212e tempest-TaggedBootDevicesTest_v242-1367484865 None] Found image-volume cache entry: {'id': 1, 'image_id': '394b3891-80f2-44c9-a9aa-56fe23a5acb3', 'volume_id': 'e6411a45-48fa-4beb-a5a0-eb6a6ca3f525', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2021, 12, 18, 20, 38, 21), 'last_used': datetime.datetime(2021, 12, 18, 21, 0, 41, 435890)}. {{(pid=134148) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Dec 18 21:00:41.439604 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.image.cache [None req-5ddb4dd7-5ca0-4042-aa42-d0b9214a212e tempest-TaggedBootDevicesTest_v242-1367484865 None] Image-volume cache entry image_update_at = 2021-12-18 20:38:21+00:00, requested image updated_at = 2021-12-18 20:38:21+00:00. {{(pid=134148) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Dec 18 21:00:41.443802 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.flows.manager.create_volume [None req-5ddb4dd7-5ca0-4042-aa42-d0b9214a212e tempest-TaggedBootDevicesTest_v242-1367484865 None] Creating from source image-volume e6411a45-48fa-4beb-a5a0-eb6a6ca3f525 {{(pid=134148) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:825}} Dec 18 21:00:41.463670 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-5ddb4dd7-5ca0-4042-aa42-d0b9214a212e tempest-TaggedBootDevicesTest_v242-1367484865 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:00:41.563714 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-5ddb4dd7-5ca0-4042-aa42-d0b9214a212e tempest-TaggedBootDevicesTest_v242-1367484865 None] creating snapshot='volume-8f6e05d6-463a-4bb2-82e3-f0b21a816f31.clone_snap' {{(pid=134148) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:725}} Dec 18 21:00:42.612440 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-5ddb4dd7-5ca0-4042-aa42-d0b9214a212e tempest-TaggedBootDevicesTest_v242-1367484865 None] cloning 'volume-e6411a45-48fa-4beb-a5a0-eb6a6ca3f525@volume-8f6e05d6-463a-4bb2-82e3-f0b21a816f31.clone_snap' to 'volume-8f6e05d6-463a-4bb2-82e3-f0b21a816f31' {{(pid=134148) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:731}} Dec 18 21:00:42.938270 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-5ddb4dd7-5ca0-4042-aa42-d0b9214a212e tempest-TaggedBootDevicesTest_v242-1367484865 None] Volume volume-9f5f7417-3abc-4462-988f-ef519750d753.deleted is not a clone. {{(pid=134148) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Dec 18 21:00:42.939543 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-5ddb4dd7-5ca0-4042-aa42-d0b9214a212e tempest-TaggedBootDevicesTest_v242-1367484865 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134148) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 18 21:00:42.940640 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-5ddb4dd7-5ca0-4042-aa42-d0b9214a212e tempest-TaggedBootDevicesTest_v242-1367484865 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134148) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 18 21:00:42.980722 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-5ddb4dd7-5ca0-4042-aa42-d0b9214a212e tempest-TaggedBootDevicesTest_v242-1367484865 None] clone created successfully {{(pid=134148) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:803}} Dec 18 21:00:42.984560 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.volume_utils [None req-5ddb4dd7-5ca0-4042-aa42-d0b9214a212e tempest-TaggedBootDevicesTest_v242-1367484865 None] Marking volume 8f6e05d6-463a-4bb2-82e3-f0b21a816f31 as bootable. {{(pid=134148) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1178}} Dec 18 21:00:42.996837 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.flows.manager.create_volume [None req-5ddb4dd7-5ca0-4042-aa42-d0b9214a212e tempest-TaggedBootDevicesTest_v242-1367484865 None] Copying metadata from image 394b3891-80f2-44c9-a9aa-56fe23a5acb3 to 8f6e05d6-463a-4bb2-82e3-f0b21a816f31. {{(pid=134148) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:444}} Dec 18 21:00:42.998340 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.flows.manager.create_volume [None req-5ddb4dd7-5ca0-4042-aa42-d0b9214a212e tempest-TaggedBootDevicesTest_v242-1367484865 None] Creating volume glance metadata for volume 8f6e05d6-463a-4bb2-82e3-f0b21a816f31 backed by image 394b3891-80f2-44c9-a9aa-56fe23a5acb3 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '394b3891-80f2-44c9-a9aa-56fe23a5acb3', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=134148) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:667}} Dec 18 21:00:43.082746 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-5ddb4dd7-5ca0-4042-aa42-d0b9214a212e tempest-TaggedBootDevicesTest_v242-1367484865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d43d2cb-c814-4e77-961a-6d8de1173617) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8f6e05d6-463a-4bb2-82e3-f0b21a816f31', 'volume_size': 1, 'image_id': '394b3891-80f2-44c9-a9aa-56fe23a5acb3', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b04c3d19c79d4c208395e97f9d293618', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '394b3891-80f2-44c9-a9aa-56fe23a5acb3', 'created_at': datetime.datetime(2021, 12, 18, 20, 38, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 12, 18, 20, 38, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/394b3891-80f2-44c9-a9aa-56fe23a5acb3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:00:43.085119 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-5ddb4dd7-5ca0-4042-aa42-d0b9214a212e tempest-TaggedBootDevicesTest_v242-1367484865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ecd6a9b-1a83-40f2-b0f0-aa1fcebafb93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:00:43.097859 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.flows.manager.create_volume [None req-5ddb4dd7-5ca0-4042-aa42-d0b9214a212e tempest-TaggedBootDevicesTest_v242-1367484865 None] Volume volume-8f6e05d6-463a-4bb2-82e3-f0b21a816f31 (8f6e05d6-463a-4bb2-82e3-f0b21a816f31): created successfully Dec 18 21:00:43.100445 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-5ddb4dd7-5ca0-4042-aa42-d0b9214a212e tempest-TaggedBootDevicesTest_v242-1367484865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ecd6a9b-1a83-40f2-b0f0-aa1fcebafb93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:00:43.106073 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-5ddb4dd7-5ca0-4042-aa42-d0b9214a212e tempest-TaggedBootDevicesTest_v242-1367484865 None] Flow 'volume_create_manager' (15969175-648b-44a9-ac65-c981bbcb3ac2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134148) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 18 21:00:43.146669 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-5ddb4dd7-5ca0-4042-aa42-d0b9214a212e tempest-TaggedBootDevicesTest_v242-1367484865 None] Created volume successfully. Dec 18 21:00:43.827144 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.flows.manager.create_volume [None req-af6b6790-37d5-4140-b4a8-b20f1d61f258 tempest-TaggedBootDevicesTest_v242-1367484865 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134148) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Dec 18 21:00:43.830543 ncdv-master-1 cinder-volume[134148]: WARNING stevedore.named [None req-af6b6790-37d5-4140-b4a8-b20f1d61f258 tempest-TaggedBootDevicesTest_v242-1367484865 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Dec 18 21:00:43.830993 ncdv-master-1 cinder-volume[134148]: WARNING castellan.key_manager [None req-af6b6790-37d5-4140-b4a8-b20f1d61f258 tempest-TaggedBootDevicesTest_v242-1367484865 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Dec 18 21:00:43.846238 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-af6b6790-37d5-4140-b4a8-b20f1d61f258 tempest-TaggedBootDevicesTest_v242-1367484865 None] Flow 'volume_create_manager' (191dc974-905b-4fa3-80f1-bf2996bc4ba0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 18 21:00:43.849851 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-af6b6790-37d5-4140-b4a8-b20f1d61f258 tempest-TaggedBootDevicesTest_v242-1367484865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ff56159-0c8b-43bf-a108-47abfb9ae3c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:00:43.857023 ncdv-master-1 cinder-volume[134148]: DEBUG oslo_db.sqlalchemy.engines [None req-af6b6790-37d5-4140-b4a8-b20f1d61f258 tempest-TaggedBootDevicesTest_v242-1367484865 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134148) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 18 21:00:43.881544 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-af6b6790-37d5-4140-b4a8-b20f1d61f258 tempest-TaggedBootDevicesTest_v242-1367484865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ff56159-0c8b-43bf-a108-47abfb9ae3c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-12-18T21:00:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest_v242-volume-1146276174',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=1ea7630c-e820-4aaa-bc7b-d24a0a7e0bab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='08fc19b054a54a08aec65b0870725eb8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-12-18T21:00:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-12-18T21:00:44Z,use_quota=True,user_id='e80a2e31964348e7b4abd7c321e713b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f2e1fe1-9fd6-411e-9ed9-368f463ccb6f),volume_type_id=1f2e1fe1-9fd6-411e-9ed9-368f463ccb6f)' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:00:43.885313 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-af6b6790-37d5-4140-b4a8-b20f1d61f258 tempest-TaggedBootDevicesTest_v242-1367484865 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9af74afe-626c-4e6f-aef5-c6073c75892a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:00:43.887571 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-af6b6790-37d5-4140-b4a8-b20f1d61f258 tempest-TaggedBootDevicesTest_v242-1367484865 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9af74afe-626c-4e6f-aef5-c6073c75892a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:00:43.890776 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-af6b6790-37d5-4140-b4a8-b20f1d61f258 tempest-TaggedBootDevicesTest_v242-1367484865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2def7874-f160-441c-a3c1-d68ae0395644) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:00:43.893253 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-af6b6790-37d5-4140-b4a8-b20f1d61f258 tempest-TaggedBootDevicesTest_v242-1367484865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2def7874-f160-441c-a3c1-d68ae0395644) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1ea7630c-e820-4aaa-bc7b-d24a0a7e0bab', 'volume_name': 'volume-1ea7630c-e820-4aaa-bc7b-d24a0a7e0bab', 'volume_size': 1}' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:00:43.896298 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-af6b6790-37d5-4140-b4a8-b20f1d61f258 tempest-TaggedBootDevicesTest_v242-1367484865 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8d810a6-921c-4970-afa0-8c8ff48d3c66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:00:43.898665 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-af6b6790-37d5-4140-b4a8-b20f1d61f258 tempest-TaggedBootDevicesTest_v242-1367484865 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8d810a6-921c-4970-afa0-8c8ff48d3c66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:00:43.902077 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-af6b6790-37d5-4140-b4a8-b20f1d61f258 tempest-TaggedBootDevicesTest_v242-1367484865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f10a2abc-d211-4fba-83fe-7411f7122fc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:00:43.903113 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.flows.manager.create_volume [None req-af6b6790-37d5-4140-b4a8-b20f1d61f258 tempest-TaggedBootDevicesTest_v242-1367484865 None] Volume 1ea7630c-e820-4aaa-bc7b-d24a0a7e0bab: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1ea7630c-e820-4aaa-bc7b-d24a0a7e0bab', 'volume_size': 1} Dec 18 21:00:43.903508 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-af6b6790-37d5-4140-b4a8-b20f1d61f258 tempest-TaggedBootDevicesTest_v242-1367484865 None] creating volume 'volume-1ea7630c-e820-4aaa-bc7b-d24a0a7e0bab' {{(pid=134148) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Dec 18 21:00:43.905109 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-af6b6790-37d5-4140-b4a8-b20f1d61f258 tempest-TaggedBootDevicesTest_v242-1367484865 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:00:44.010049 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-af6b6790-37d5-4140-b4a8-b20f1d61f258 tempest-TaggedBootDevicesTest_v242-1367484865 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134148) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 18 21:00:44.010714 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-af6b6790-37d5-4140-b4a8-b20f1d61f258 tempest-TaggedBootDevicesTest_v242-1367484865 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134148) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 18 21:00:44.012919 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-af6b6790-37d5-4140-b4a8-b20f1d61f258 tempest-TaggedBootDevicesTest_v242-1367484865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f10a2abc-d211-4fba-83fe-7411f7122fc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1ea7630c-e820-4aaa-bc7b-d24a0a7e0bab', 'volume_size': 1}' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:00:44.016215 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-af6b6790-37d5-4140-b4a8-b20f1d61f258 tempest-TaggedBootDevicesTest_v242-1367484865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90046b2c-74ea-4751-84b6-b2adf0ed2b9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:00:44.027475 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.flows.manager.create_volume [None req-af6b6790-37d5-4140-b4a8-b20f1d61f258 tempest-TaggedBootDevicesTest_v242-1367484865 None] Volume volume-1ea7630c-e820-4aaa-bc7b-d24a0a7e0bab (1ea7630c-e820-4aaa-bc7b-d24a0a7e0bab): created successfully Dec 18 21:00:44.031018 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-af6b6790-37d5-4140-b4a8-b20f1d61f258 tempest-TaggedBootDevicesTest_v242-1367484865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90046b2c-74ea-4751-84b6-b2adf0ed2b9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:00:44.035209 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-af6b6790-37d5-4140-b4a8-b20f1d61f258 tempest-TaggedBootDevicesTest_v242-1367484865 None] Flow 'volume_create_manager' (191dc974-905b-4fa3-80f1-bf2996bc4ba0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134148) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 18 21:00:44.045844 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-af6b6790-37d5-4140-b4a8-b20f1d61f258 tempest-TaggedBootDevicesTest_v242-1367484865 None] Created volume successfully. Dec 18 21:00:45.323748 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.flows.manager.create_volume [None req-ff4b3889-9c64-4f61-89a5-190eb5c7ff4f tempest-TaggedBootDevicesTest_v242-1367484865 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134148) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Dec 18 21:00:45.327660 ncdv-master-1 cinder-volume[134148]: WARNING stevedore.named [None req-ff4b3889-9c64-4f61-89a5-190eb5c7ff4f tempest-TaggedBootDevicesTest_v242-1367484865 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Dec 18 21:00:45.328315 ncdv-master-1 cinder-volume[134148]: WARNING castellan.key_manager [None req-ff4b3889-9c64-4f61-89a5-190eb5c7ff4f tempest-TaggedBootDevicesTest_v242-1367484865 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Dec 18 21:00:45.370602 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-ff4b3889-9c64-4f61-89a5-190eb5c7ff4f tempest-TaggedBootDevicesTest_v242-1367484865 None] Flow 'volume_create_manager' (d75b01cb-81dc-4e7b-9451-ee4ec3016f91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 18 21:00:45.375848 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-ff4b3889-9c64-4f61-89a5-190eb5c7ff4f tempest-TaggedBootDevicesTest_v242-1367484865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d80be4ff-842b-4d80-a272-8c24cd6046ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:00:45.385449 ncdv-master-1 cinder-volume[134148]: DEBUG oslo_db.sqlalchemy.engines [None req-ff4b3889-9c64-4f61-89a5-190eb5c7ff4f tempest-TaggedBootDevicesTest_v242-1367484865 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134148) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 18 21:00:45.407458 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-ff4b3889-9c64-4f61-89a5-190eb5c7ff4f tempest-TaggedBootDevicesTest_v242-1367484865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d80be4ff-842b-4d80-a272-8c24cd6046ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-12-18T21:00:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest_v242-volume-56734237',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=ef3e7ab0-e225-41eb-80c8-31e494531508,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='08fc19b054a54a08aec65b0870725eb8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-12-18T21:00:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-12-18T21:00:45Z,use_quota=True,user_id='e80a2e31964348e7b4abd7c321e713b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f2e1fe1-9fd6-411e-9ed9-368f463ccb6f),volume_type_id=1f2e1fe1-9fd6-411e-9ed9-368f463ccb6f)' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:00:45.411354 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-ff4b3889-9c64-4f61-89a5-190eb5c7ff4f tempest-TaggedBootDevicesTest_v242-1367484865 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5fb71da-b5f3-465d-ae48-d433d16b8a63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:00:45.416516 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-ff4b3889-9c64-4f61-89a5-190eb5c7ff4f tempest-TaggedBootDevicesTest_v242-1367484865 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5fb71da-b5f3-465d-ae48-d433d16b8a63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:00:45.425243 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-ff4b3889-9c64-4f61-89a5-190eb5c7ff4f tempest-TaggedBootDevicesTest_v242-1367484865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4fd7a099-79dc-4e05-923b-40fc37b9ce45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:00:45.427686 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-ff4b3889-9c64-4f61-89a5-190eb5c7ff4f tempest-TaggedBootDevicesTest_v242-1367484865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4fd7a099-79dc-4e05-923b-40fc37b9ce45) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ef3e7ab0-e225-41eb-80c8-31e494531508', 'volume_name': 'volume-ef3e7ab0-e225-41eb-80c8-31e494531508', 'volume_size': 1}' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:00:45.437707 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-ff4b3889-9c64-4f61-89a5-190eb5c7ff4f tempest-TaggedBootDevicesTest_v242-1367484865 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f804a51-9e82-4a79-9f79-7b9bdafabc46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:00:45.440571 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-ff4b3889-9c64-4f61-89a5-190eb5c7ff4f tempest-TaggedBootDevicesTest_v242-1367484865 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f804a51-9e82-4a79-9f79-7b9bdafabc46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:00:45.442548 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-ff4b3889-9c64-4f61-89a5-190eb5c7ff4f tempest-TaggedBootDevicesTest_v242-1367484865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28e72187-0544-4d34-8193-e774b0876bb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:00:45.458932 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.flows.manager.create_volume [None req-ff4b3889-9c64-4f61-89a5-190eb5c7ff4f tempest-TaggedBootDevicesTest_v242-1367484865 None] Volume ef3e7ab0-e225-41eb-80c8-31e494531508: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ef3e7ab0-e225-41eb-80c8-31e494531508', 'volume_size': 1} Dec 18 21:00:45.460510 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-ff4b3889-9c64-4f61-89a5-190eb5c7ff4f tempest-TaggedBootDevicesTest_v242-1367484865 None] creating volume 'volume-ef3e7ab0-e225-41eb-80c8-31e494531508' {{(pid=134148) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Dec 18 21:00:45.461765 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-ff4b3889-9c64-4f61-89a5-190eb5c7ff4f tempest-TaggedBootDevicesTest_v242-1367484865 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:00:45.618630 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-ff4b3889-9c64-4f61-89a5-190eb5c7ff4f tempest-TaggedBootDevicesTest_v242-1367484865 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134148) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 18 21:00:45.619200 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-ff4b3889-9c64-4f61-89a5-190eb5c7ff4f tempest-TaggedBootDevicesTest_v242-1367484865 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134148) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 18 21:00:45.622159 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-ff4b3889-9c64-4f61-89a5-190eb5c7ff4f tempest-TaggedBootDevicesTest_v242-1367484865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28e72187-0544-4d34-8193-e774b0876bb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ef3e7ab0-e225-41eb-80c8-31e494531508', 'volume_size': 1}' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:00:45.624811 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-ff4b3889-9c64-4f61-89a5-190eb5c7ff4f tempest-TaggedBootDevicesTest_v242-1367484865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86fcb4b8-458a-4c2f-84ea-7bbb72001664) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:00:45.645186 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.flows.manager.create_volume [None req-ff4b3889-9c64-4f61-89a5-190eb5c7ff4f tempest-TaggedBootDevicesTest_v242-1367484865 None] Volume volume-ef3e7ab0-e225-41eb-80c8-31e494531508 (ef3e7ab0-e225-41eb-80c8-31e494531508): created successfully Dec 18 21:00:45.647705 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-ff4b3889-9c64-4f61-89a5-190eb5c7ff4f tempest-TaggedBootDevicesTest_v242-1367484865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86fcb4b8-458a-4c2f-84ea-7bbb72001664) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:00:45.652486 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-ff4b3889-9c64-4f61-89a5-190eb5c7ff4f tempest-TaggedBootDevicesTest_v242-1367484865 None] Flow 'volume_create_manager' (d75b01cb-81dc-4e7b-9451-ee4ec3016f91) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134148) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 18 21:00:45.682058 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-ff4b3889-9c64-4f61-89a5-190eb5c7ff4f tempest-TaggedBootDevicesTest_v242-1367484865 None] Created volume successfully. Dec 18 21:00:50.242376 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.flows.manager.create_volume [None req-b74d0075-9820-4690-80d2-0b6fe38df49a tempest-AttachVolumeNegativeTest-997340476 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134148) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Dec 18 21:00:50.246486 ncdv-master-1 cinder-volume[134148]: WARNING stevedore.named [None req-b74d0075-9820-4690-80d2-0b6fe38df49a tempest-AttachVolumeNegativeTest-997340476 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Dec 18 21:00:50.247028 ncdv-master-1 cinder-volume[134148]: WARNING castellan.key_manager [None req-b74d0075-9820-4690-80d2-0b6fe38df49a tempest-AttachVolumeNegativeTest-997340476 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Dec 18 21:00:50.273139 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-b74d0075-9820-4690-80d2-0b6fe38df49a tempest-AttachVolumeNegativeTest-997340476 None] Flow 'volume_create_manager' (5dc5ae53-2662-4185-b235-2ff8f22d404d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 18 21:00:50.277946 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-b74d0075-9820-4690-80d2-0b6fe38df49a tempest-AttachVolumeNegativeTest-997340476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21576440-e2f9-40db-81ff-3463305d975b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:00:50.296746 ncdv-master-1 cinder-volume[134148]: DEBUG oslo_db.sqlalchemy.engines [None req-b74d0075-9820-4690-80d2-0b6fe38df49a tempest-AttachVolumeNegativeTest-997340476 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134148) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 18 21:00:50.339850 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-b74d0075-9820-4690-80d2-0b6fe38df49a tempest-AttachVolumeNegativeTest-997340476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21576440-e2f9-40db-81ff-3463305d975b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-12-18T21:00:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1765039081',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=f6f5fd62-4a46-4649-8474-05602a3eed93,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d1b96ca6ed964b6a9db0ed2249251328',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-12-18T21:00:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-12-18T21:00:50Z,use_quota=True,user_id='4196dd207ce543d3bdd5f48ae57e156a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f2e1fe1-9fd6-411e-9ed9-368f463ccb6f),volume_type_id=1f2e1fe1-9fd6-411e-9ed9-368f463ccb6f)' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:00:50.366520 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-b74d0075-9820-4690-80d2-0b6fe38df49a tempest-AttachVolumeNegativeTest-997340476 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c35d0214-5d6f-4315-8bb6-55191d59a1d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:00:50.369195 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-b74d0075-9820-4690-80d2-0b6fe38df49a tempest-AttachVolumeNegativeTest-997340476 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c35d0214-5d6f-4315-8bb6-55191d59a1d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:00:50.371901 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-b74d0075-9820-4690-80d2-0b6fe38df49a tempest-AttachVolumeNegativeTest-997340476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d8de9ce-e0b0-42bf-ae5e-6fe2e9ef342b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:00:50.382494 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-b74d0075-9820-4690-80d2-0b6fe38df49a tempest-AttachVolumeNegativeTest-997340476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d8de9ce-e0b0-42bf-ae5e-6fe2e9ef342b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f6f5fd62-4a46-4649-8474-05602a3eed93', 'volume_name': 'volume-f6f5fd62-4a46-4649-8474-05602a3eed93', 'volume_size': 1}' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:00:50.392212 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-b74d0075-9820-4690-80d2-0b6fe38df49a tempest-AttachVolumeNegativeTest-997340476 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ecd14175-9f07-4604-b8b7-c6d2781127b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:00:50.397744 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-b74d0075-9820-4690-80d2-0b6fe38df49a tempest-AttachVolumeNegativeTest-997340476 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ecd14175-9f07-4604-b8b7-c6d2781127b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:00:50.400643 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-b74d0075-9820-4690-80d2-0b6fe38df49a tempest-AttachVolumeNegativeTest-997340476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6539237c-1bc5-4500-93d2-a2dc5cbb4826) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:00:50.401726 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.flows.manager.create_volume [None req-b74d0075-9820-4690-80d2-0b6fe38df49a tempest-AttachVolumeNegativeTest-997340476 None] Volume f6f5fd62-4a46-4649-8474-05602a3eed93: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f6f5fd62-4a46-4649-8474-05602a3eed93', 'volume_size': 1} Dec 18 21:00:50.402419 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-b74d0075-9820-4690-80d2-0b6fe38df49a tempest-AttachVolumeNegativeTest-997340476 None] creating volume 'volume-f6f5fd62-4a46-4649-8474-05602a3eed93' {{(pid=134148) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Dec 18 21:00:50.404164 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-b74d0075-9820-4690-80d2-0b6fe38df49a tempest-AttachVolumeNegativeTest-997340476 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:00:50.539900 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-b74d0075-9820-4690-80d2-0b6fe38df49a tempest-AttachVolumeNegativeTest-997340476 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134148) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 18 21:00:50.541648 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-b74d0075-9820-4690-80d2-0b6fe38df49a tempest-AttachVolumeNegativeTest-997340476 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134148) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 18 21:00:50.546199 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-b74d0075-9820-4690-80d2-0b6fe38df49a tempest-AttachVolumeNegativeTest-997340476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6539237c-1bc5-4500-93d2-a2dc5cbb4826) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f6f5fd62-4a46-4649-8474-05602a3eed93', 'volume_size': 1}' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:00:50.549046 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-b74d0075-9820-4690-80d2-0b6fe38df49a tempest-AttachVolumeNegativeTest-997340476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5b15636-ff86-4699-a34b-809b260e723f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:00:50.563846 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.flows.manager.create_volume [None req-b74d0075-9820-4690-80d2-0b6fe38df49a tempest-AttachVolumeNegativeTest-997340476 None] Volume volume-f6f5fd62-4a46-4649-8474-05602a3eed93 (f6f5fd62-4a46-4649-8474-05602a3eed93): created successfully Dec 18 21:00:50.570708 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-b74d0075-9820-4690-80d2-0b6fe38df49a tempest-AttachVolumeNegativeTest-997340476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5b15636-ff86-4699-a34b-809b260e723f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:00:50.577368 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-b74d0075-9820-4690-80d2-0b6fe38df49a tempest-AttachVolumeNegativeTest-997340476 None] Flow 'volume_create_manager' (5dc5ae53-2662-4185-b235-2ff8f22d404d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134148) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 18 21:00:50.590673 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-b74d0075-9820-4690-80d2-0b6fe38df49a tempest-AttachVolumeNegativeTest-997340476 None] Created volume successfully. Dec 18 21:00:52.084228 ncdv-master-1 cinder-volume[134148]: DEBUG oslo_concurrency.processutils [req-771b4088-ab64-4d8f-ad2d-c4b596d49ade req-b0e405fa-fc38-4e49-958f-e02bd125759a tempest-AttachVolumeNegativeTest-997340476 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=134148) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Dec 18 21:00:53.315059 ncdv-master-1 cinder-volume[134148]: DEBUG oslo_concurrency.processutils [req-771b4088-ab64-4d8f-ad2d-c4b596d49ade req-b0e405fa-fc38-4e49-958f-e02bd125759a tempest-AttachVolumeNegativeTest-997340476 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.233s {{(pid=134148) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Dec 18 21:00:53.316850 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [req-771b4088-ab64-4d8f-ad2d-c4b596d49ade req-b0e405fa-fc38-4e49-958f-e02bd125759a tempest-AttachVolumeNegativeTest-997340476 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-f6f5fd62-4a46-4649-8474-05602a3eed93', 'hosts': ['10.222.0.13'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '946d1715-d12c-4dbf-8a79-181222df6e2e', 'volume_id': 'f6f5fd62-4a46-4649-8474-05602a3eed93', 'discard': True}} {{(pid=134148) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Dec 18 21:00:53.352638 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [req-771b4088-ab64-4d8f-ad2d-c4b596d49ade req-b0e405fa-fc38-4e49-958f-e02bd125759a tempest-AttachVolumeNegativeTest-997340476 None] Connection info returned from driver {'name': 'volumes/volume-f6f5fd62-4a46-4649-8474-05602a3eed93', 'hosts': ['10.222.0.13'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'f6f5fd62-4a46-4649-8474-05602a3eed93', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '1ad58b3f-ef7b-4b2f-b604-8352fe0d23c7'} {{(pid=134148) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4812}} Dec 18 21:00:53.426960 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [req-771b4088-ab64-4d8f-ad2d-c4b596d49ade req-b0e405fa-fc38-4e49-958f-e02bd125759a tempest-AttachVolumeNegativeTest-997340476 None] attachment_update completed successfully. Dec 18 21:00:56.585712 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [req-8b3c24f8-156d-4844-ac3d-7459b9c102f0 req-d05cd34e-1dc3-433f-be5d-314f1000feb9 tempest-AttachVolumeNegativeTest-997340476 None] Terminate volume connection completed successfully. Dec 18 21:00:56.586338 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [req-8b3c24f8-156d-4844-ac3d-7459b9c102f0 req-d05cd34e-1dc3-433f-be5d-314f1000feb9 tempest-AttachVolumeNegativeTest-997340476 None] Deleting attachment 1ad58b3f-ef7b-4b2f-b604-8352fe0d23c7. {{(pid=134148) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4948}} Dec 18 21:00:58.324629 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.coordination [None req-30747903-605d-4dad-9a93-76d5be6a2310 tempest-AttachVolumeNegativeTest-997340476 None] Lock "b'cinder-f6f5fd62-4a46-4649-8474-05602a3eed93-delete_volume'" acquired by "delete_volume" :: waited 0.017s {{(pid=134148) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 18 21:00:58.394213 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-30747903-605d-4dad-9a93-76d5be6a2310 tempest-AttachVolumeNegativeTest-997340476 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:00:58.491722 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-30747903-605d-4dad-9a93-76d5be6a2310 tempest-AttachVolumeNegativeTest-997340476 None] volume has no backup snaps {{(pid=134148) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Dec 18 21:00:58.492220 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-30747903-605d-4dad-9a93-76d5be6a2310 tempest-AttachVolumeNegativeTest-997340476 None] Volume volume-f6f5fd62-4a46-4649-8474-05602a3eed93 is not a clone. {{(pid=134148) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Dec 18 21:00:58.511610 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-30747903-605d-4dad-9a93-76d5be6a2310 tempest-AttachVolumeNegativeTest-997340476 None] deleting rbd volume volume-f6f5fd62-4a46-4649-8474-05602a3eed93 {{(pid=134148) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Dec 18 21:00:58.832783 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.quota [None req-30747903-605d-4dad-9a93-76d5be6a2310 tempest-AttachVolumeNegativeTest-997340476 None] Created reservations ['5bbe884a-d14b-4b3d-908a-c927644af546', '412a600d-2f15-424e-ab92-6539e3e43627', 'cb1db604-3c48-4fbc-8785-b12f99c55548', 'c62f3020-143b-4cf5-8ba6-c146c8317aac'] {{(pid=134148) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 18 21:00:58.900364 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-30747903-605d-4dad-9a93-76d5be6a2310 tempest-AttachVolumeNegativeTest-997340476 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:00:58.976593 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-30747903-605d-4dad-9a93-76d5be6a2310 tempest-AttachVolumeNegativeTest-997340476 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:00:59.048977 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.manager [None req-30747903-605d-4dad-9a93-76d5be6a2310 tempest-AttachVolumeNegativeTest-997340476 None] Notifying Schedulers of capabilities ... {{(pid=134148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 18 21:00:59.055199 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-30747903-605d-4dad-9a93-76d5be6a2310 tempest-AttachVolumeNegativeTest-997340476 None] Deleted volume successfully. Dec 18 21:00:59.074302 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.coordination [None req-30747903-605d-4dad-9a93-76d5be6a2310 tempest-AttachVolumeNegativeTest-997340476 None] Lock "b'cinder-f6f5fd62-4a46-4649-8474-05602a3eed93-delete_volume'" released by "delete_volume" :: held 0.750s {{(pid=134148) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 18 21:01:00.699891 ncdv-master-1 cinder-volume[134148]: DEBUG oslo_concurrency.processutils [req-99d3c0ff-0722-4931-8bfe-b2b1e0516107 req-a506f586-2949-4031-aa74-40c8957580f1 tempest-TaggedBootDevicesTest_v242-1367484865 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=134148) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Dec 18 21:01:01.679689 ncdv-master-1 cinder-volume[134148]: DEBUG oslo_concurrency.processutils [req-99d3c0ff-0722-4931-8bfe-b2b1e0516107 req-a506f586-2949-4031-aa74-40c8957580f1 tempest-TaggedBootDevicesTest_v242-1367484865 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.979s {{(pid=134148) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Dec 18 21:01:01.680474 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [req-99d3c0ff-0722-4931-8bfe-b2b1e0516107 req-a506f586-2949-4031-aa74-40c8957580f1 tempest-TaggedBootDevicesTest_v242-1367484865 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-8f6e05d6-463a-4bb2-82e3-f0b21a816f31', 'hosts': ['10.222.0.13'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '946d1715-d12c-4dbf-8a79-181222df6e2e', 'volume_id': '8f6e05d6-463a-4bb2-82e3-f0b21a816f31', 'discard': True}} {{(pid=134148) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Dec 18 21:01:01.729557 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [req-99d3c0ff-0722-4931-8bfe-b2b1e0516107 req-a506f586-2949-4031-aa74-40c8957580f1 tempest-TaggedBootDevicesTest_v242-1367484865 None] Connection info returned from driver {'name': 'volumes/volume-8f6e05d6-463a-4bb2-82e3-f0b21a816f31', 'hosts': ['10.222.0.13'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '8f6e05d6-463a-4bb2-82e3-f0b21a816f31', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'c3e22986-07b0-4fe3-a93d-560839571b22'} {{(pid=134148) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4812}} Dec 18 21:01:01.806585 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [req-99d3c0ff-0722-4931-8bfe-b2b1e0516107 req-a506f586-2949-4031-aa74-40c8957580f1 tempest-TaggedBootDevicesTest_v242-1367484865 None] attachment_update completed successfully. Dec 18 21:01:02.162405 ncdv-master-1 cinder-volume[134148]: DEBUG oslo_concurrency.processutils [req-99d3c0ff-0722-4931-8bfe-b2b1e0516107 req-881d560b-6081-4c84-8edb-04742c624579 tempest-TaggedBootDevicesTest_v242-1367484865 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=134148) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Dec 18 21:01:03.233170 ncdv-master-1 cinder-volume[134148]: DEBUG oslo_concurrency.processutils [req-99d3c0ff-0722-4931-8bfe-b2b1e0516107 req-881d560b-6081-4c84-8edb-04742c624579 tempest-TaggedBootDevicesTest_v242-1367484865 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.070s {{(pid=134148) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Dec 18 21:01:03.236677 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [req-99d3c0ff-0722-4931-8bfe-b2b1e0516107 req-881d560b-6081-4c84-8edb-04742c624579 tempest-TaggedBootDevicesTest_v242-1367484865 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-1ea7630c-e820-4aaa-bc7b-d24a0a7e0bab', 'hosts': ['10.222.0.13'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '946d1715-d12c-4dbf-8a79-181222df6e2e', 'volume_id': '1ea7630c-e820-4aaa-bc7b-d24a0a7e0bab', 'discard': True}} {{(pid=134148) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Dec 18 21:01:03.276021 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [req-99d3c0ff-0722-4931-8bfe-b2b1e0516107 req-881d560b-6081-4c84-8edb-04742c624579 tempest-TaggedBootDevicesTest_v242-1367484865 None] Connection info returned from driver {'name': 'volumes/volume-1ea7630c-e820-4aaa-bc7b-d24a0a7e0bab', 'hosts': ['10.222.0.13'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '1ea7630c-e820-4aaa-bc7b-d24a0a7e0bab', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '3cc31b6d-15fd-4d7c-a391-8c601e56e4a8'} {{(pid=134148) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4812}} Dec 18 21:01:03.348398 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [req-99d3c0ff-0722-4931-8bfe-b2b1e0516107 req-881d560b-6081-4c84-8edb-04742c624579 tempest-TaggedBootDevicesTest_v242-1367484865 None] attachment_update completed successfully. Dec 18 21:01:03.917442 ncdv-master-1 cinder-volume[134148]: DEBUG oslo_concurrency.processutils [req-99d3c0ff-0722-4931-8bfe-b2b1e0516107 req-dc6e2e1b-2e59-4a36-9910-d12d1705eb1e tempest-TaggedBootDevicesTest_v242-1367484865 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=134148) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Dec 18 21:01:05.190318 ncdv-master-1 cinder-volume[134148]: DEBUG oslo_concurrency.processutils [req-99d3c0ff-0722-4931-8bfe-b2b1e0516107 req-dc6e2e1b-2e59-4a36-9910-d12d1705eb1e tempest-TaggedBootDevicesTest_v242-1367484865 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.272s {{(pid=134148) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Dec 18 21:01:05.191879 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [req-99d3c0ff-0722-4931-8bfe-b2b1e0516107 req-dc6e2e1b-2e59-4a36-9910-d12d1705eb1e tempest-TaggedBootDevicesTest_v242-1367484865 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-ef3e7ab0-e225-41eb-80c8-31e494531508', 'hosts': ['10.222.0.13'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '946d1715-d12c-4dbf-8a79-181222df6e2e', 'volume_id': 'ef3e7ab0-e225-41eb-80c8-31e494531508', 'discard': True}} {{(pid=134148) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Dec 18 21:01:05.246420 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [req-99d3c0ff-0722-4931-8bfe-b2b1e0516107 req-dc6e2e1b-2e59-4a36-9910-d12d1705eb1e tempest-TaggedBootDevicesTest_v242-1367484865 None] Connection info returned from driver {'name': 'volumes/volume-ef3e7ab0-e225-41eb-80c8-31e494531508', 'hosts': ['10.222.0.13'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'ef3e7ab0-e225-41eb-80c8-31e494531508', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '8a141446-e1a8-4dc4-b8b5-26bfcd8eb51a'} {{(pid=134148) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4812}} Dec 18 21:01:05.401572 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [req-99d3c0ff-0722-4931-8bfe-b2b1e0516107 req-dc6e2e1b-2e59-4a36-9910-d12d1705eb1e tempest-TaggedBootDevicesTest_v242-1367484865 None] attachment_update completed successfully. Dec 18 21:01:05.980356 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.coordination [None req-bbc7875b-404c-4fcc-96fc-41c0808fabe3 tempest-AttachVolumeNegativeTest-997340476 None] Lock "b'cinder-4d0bb476-e8f3-480c-9032-e87a7899ee26-delete_volume'" acquired by "delete_volume" :: waited 0.036s {{(pid=134148) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 18 21:01:06.050484 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-bbc7875b-404c-4fcc-96fc-41c0808fabe3 tempest-AttachVolumeNegativeTest-997340476 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:01:06.155303 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-bbc7875b-404c-4fcc-96fc-41c0808fabe3 tempest-AttachVolumeNegativeTest-997340476 None] volume has no backup snaps {{(pid=134148) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Dec 18 21:01:06.155756 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-bbc7875b-404c-4fcc-96fc-41c0808fabe3 tempest-AttachVolumeNegativeTest-997340476 None] Volume volume-4d0bb476-e8f3-480c-9032-e87a7899ee26 is not a clone. {{(pid=134148) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Dec 18 21:01:06.162980 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-bbc7875b-404c-4fcc-96fc-41c0808fabe3 tempest-AttachVolumeNegativeTest-997340476 None] deleting rbd volume volume-4d0bb476-e8f3-480c-9032-e87a7899ee26 {{(pid=134148) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Dec 18 21:01:06.601703 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.quota [None req-bbc7875b-404c-4fcc-96fc-41c0808fabe3 tempest-AttachVolumeNegativeTest-997340476 None] Created reservations ['b9a1aee8-42cb-493d-93e4-b9f2c49631d5', '33f85f87-0c87-4e68-a203-a543dcbcddf9', 'c2b8afb9-a6df-45ca-9478-d98b27c23b1c', 'aad218ee-bd30-4398-ac66-0a0050658a4e'] {{(pid=134148) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 18 21:01:06.710039 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-bbc7875b-404c-4fcc-96fc-41c0808fabe3 tempest-AttachVolumeNegativeTest-997340476 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:01:06.854470 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-bbc7875b-404c-4fcc-96fc-41c0808fabe3 tempest-AttachVolumeNegativeTest-997340476 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:01:06.993928 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.manager [None req-bbc7875b-404c-4fcc-96fc-41c0808fabe3 tempest-AttachVolumeNegativeTest-997340476 None] Notifying Schedulers of capabilities ... {{(pid=134148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 18 21:01:07.007469 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-bbc7875b-404c-4fcc-96fc-41c0808fabe3 tempest-AttachVolumeNegativeTest-997340476 None] Deleted volume successfully. Dec 18 21:01:07.037362 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.coordination [None req-bbc7875b-404c-4fcc-96fc-41c0808fabe3 tempest-AttachVolumeNegativeTest-997340476 None] Lock "b'cinder-4d0bb476-e8f3-480c-9032-e87a7899ee26-delete_volume'" released by "delete_volume" :: held 1.057s {{(pid=134148) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 18 21:01:17.795052 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.coordination [None req-e6e20d11-5b5a-4b3b-83f7-5f6d5d205e63 tempest-AttachVolumeNegativeTest-997340476 None] Lock "b'cinder-17286a65-2bb6-4891-8fc9-210c222fe2a9-delete_volume'" acquired by "delete_volume" :: waited 0.049s {{(pid=134148) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 18 21:01:17.937513 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-e6e20d11-5b5a-4b3b-83f7-5f6d5d205e63 tempest-AttachVolumeNegativeTest-997340476 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:01:18.100079 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-e6e20d11-5b5a-4b3b-83f7-5f6d5d205e63 tempest-AttachVolumeNegativeTest-997340476 None] volume has no backup snaps {{(pid=134148) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Dec 18 21:01:18.100497 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-e6e20d11-5b5a-4b3b-83f7-5f6d5d205e63 tempest-AttachVolumeNegativeTest-997340476 None] Volume volume-17286a65-2bb6-4891-8fc9-210c222fe2a9 is not a clone. {{(pid=134148) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Dec 18 21:01:18.117467 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-e6e20d11-5b5a-4b3b-83f7-5f6d5d205e63 tempest-AttachVolumeNegativeTest-997340476 None] deleting rbd volume volume-17286a65-2bb6-4891-8fc9-210c222fe2a9 {{(pid=134148) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Dec 18 21:01:18.470914 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.quota [None req-e6e20d11-5b5a-4b3b-83f7-5f6d5d205e63 tempest-AttachVolumeNegativeTest-997340476 None] Created reservations ['40803bb3-4cdd-43fb-8e53-52343d05be91', 'c97a4273-cbdd-4fd1-b10c-7b1b3bf429ce', '7ca56705-85f6-41ca-9bfc-2cb356d00c40', 'ded25dfd-8a79-4301-8735-059e6714d632'] {{(pid=134148) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 18 21:01:18.518573 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-e6e20d11-5b5a-4b3b-83f7-5f6d5d205e63 tempest-AttachVolumeNegativeTest-997340476 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:01:18.560635 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-e6e20d11-5b5a-4b3b-83f7-5f6d5d205e63 tempest-AttachVolumeNegativeTest-997340476 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:01:18.594484 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.manager [None req-e6e20d11-5b5a-4b3b-83f7-5f6d5d205e63 tempest-AttachVolumeNegativeTest-997340476 None] Notifying Schedulers of capabilities ... {{(pid=134148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 18 21:01:18.599617 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-e6e20d11-5b5a-4b3b-83f7-5f6d5d205e63 tempest-AttachVolumeNegativeTest-997340476 None] Deleted volume successfully. Dec 18 21:01:18.612668 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.coordination [None req-e6e20d11-5b5a-4b3b-83f7-5f6d5d205e63 tempest-AttachVolumeNegativeTest-997340476 None] Lock "b'cinder-17286a65-2bb6-4891-8fc9-210c222fe2a9-delete_volume'" released by "delete_volume" :: held 0.818s {{(pid=134148) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 18 21:01:34.345524 ncdv-master-1 cinder-volume[134148]: DEBUG oslo_service.periodic_task [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134148) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Dec 18 21:01:34.345524 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:01:34.412156 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:01:34.461093 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.manager [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] Notifying Schedulers of capabilities ... {{(pid=134148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 18 21:01:50.802515 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [req-b33bafaf-4926-4c4a-b7f4-b522c90c0498 req-ff2686e5-cffd-4b71-bbda-8862a2812f4d tempest-TaggedBootDevicesTest-22902861 None] Terminate volume connection completed successfully. Dec 18 21:01:50.804046 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [req-b33bafaf-4926-4c4a-b7f4-b522c90c0498 req-ff2686e5-cffd-4b71-bbda-8862a2812f4d tempest-TaggedBootDevicesTest-22902861 None] Deleting attachment dc1dc9b6-e8be-4c00-b152-3c4ed3ed1aab. {{(pid=134148) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4948}} Dec 18 21:01:50.972578 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [req-b33bafaf-4926-4c4a-b7f4-b522c90c0498 req-5da2653a-2d8d-45bf-b8fd-b5d5b3a6389d tempest-TaggedBootDevicesTest-22902861 None] Terminate volume connection completed successfully. Dec 18 21:01:50.973300 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [req-b33bafaf-4926-4c4a-b7f4-b522c90c0498 req-5da2653a-2d8d-45bf-b8fd-b5d5b3a6389d tempest-TaggedBootDevicesTest-22902861 None] Deleting attachment b5dfcf49-a94f-4c76-b515-98ddcb0485ee. {{(pid=134148) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4948}} Dec 18 21:01:51.228974 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [req-b33bafaf-4926-4c4a-b7f4-b522c90c0498 req-560f0e41-ec9e-46a8-aaca-c7e7d676a535 tempest-TaggedBootDevicesTest-22902861 None] Terminate volume connection completed successfully. Dec 18 21:01:51.233676 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [req-b33bafaf-4926-4c4a-b7f4-b522c90c0498 req-560f0e41-ec9e-46a8-aaca-c7e7d676a535 tempest-TaggedBootDevicesTest-22902861 None] Deleting attachment 29a175fa-de90-4109-9025-801dcacf9e1f. {{(pid=134148) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4948}} Dec 18 21:01:57.937073 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.coordination [None req-40184e7b-5c48-4f88-bc57-694410ce1dab tempest-TaggedBootDevicesTest-22902861 None] Lock "b'cinder-61701d83-e055-4683-9550-0ed663125a4c-delete_volume'" acquired by "delete_volume" :: waited 0.013s {{(pid=134148) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 18 21:01:57.975014 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-40184e7b-5c48-4f88-bc57-694410ce1dab tempest-TaggedBootDevicesTest-22902861 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:01:58.018928 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-40184e7b-5c48-4f88-bc57-694410ce1dab tempest-TaggedBootDevicesTest-22902861 None] volume has no backup snaps {{(pid=134148) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Dec 18 21:01:58.019622 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-40184e7b-5c48-4f88-bc57-694410ce1dab tempest-TaggedBootDevicesTest-22902861 None] Volume volume-61701d83-e055-4683-9550-0ed663125a4c is not a clone. {{(pid=134148) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Dec 18 21:01:58.025898 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-40184e7b-5c48-4f88-bc57-694410ce1dab tempest-TaggedBootDevicesTest-22902861 None] deleting rbd volume volume-61701d83-e055-4683-9550-0ed663125a4c {{(pid=134148) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Dec 18 21:01:58.367802 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.quota [None req-40184e7b-5c48-4f88-bc57-694410ce1dab tempest-TaggedBootDevicesTest-22902861 None] Created reservations ['dfaef99f-554d-4bed-b76b-90afe33898fb', '63dc2384-d6d3-48f3-9f79-67807eaea5d0', 'cbe9d1b0-eca3-4f96-9762-7d9b0d2de4a8', '844f28fe-29f2-4aa9-ab5c-ea04aaad5279'] {{(pid=134148) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 18 21:01:58.450916 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-40184e7b-5c48-4f88-bc57-694410ce1dab tempest-TaggedBootDevicesTest-22902861 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:01:58.498190 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-40184e7b-5c48-4f88-bc57-694410ce1dab tempest-TaggedBootDevicesTest-22902861 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:01:58.527558 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.manager [None req-40184e7b-5c48-4f88-bc57-694410ce1dab tempest-TaggedBootDevicesTest-22902861 None] Notifying Schedulers of capabilities ... {{(pid=134148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 18 21:01:58.532036 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-40184e7b-5c48-4f88-bc57-694410ce1dab tempest-TaggedBootDevicesTest-22902861 None] Deleted volume successfully. Dec 18 21:01:58.548121 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.coordination [None req-40184e7b-5c48-4f88-bc57-694410ce1dab tempest-TaggedBootDevicesTest-22902861 None] Lock "b'cinder-61701d83-e055-4683-9550-0ed663125a4c-delete_volume'" released by "delete_volume" :: held 0.611s {{(pid=134148) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 18 21:01:59.079747 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.coordination [None req-d7b9877b-882d-429d-bcc5-3c2531eafbd6 tempest-TaggedBootDevicesTest-22902861 None] Lock "b'cinder-26094cb4-a4fa-43a4-86c4-5a3342be6fa8-delete_volume'" acquired by "delete_volume" :: waited 0.020s {{(pid=134148) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 18 21:01:59.117535 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-d7b9877b-882d-429d-bcc5-3c2531eafbd6 tempest-TaggedBootDevicesTest-22902861 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:01:59.187160 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-d7b9877b-882d-429d-bcc5-3c2531eafbd6 tempest-TaggedBootDevicesTest-22902861 None] volume has no backup snaps {{(pid=134148) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Dec 18 21:01:59.187854 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-d7b9877b-882d-429d-bcc5-3c2531eafbd6 tempest-TaggedBootDevicesTest-22902861 None] Volume volume-26094cb4-a4fa-43a4-86c4-5a3342be6fa8 is not a clone. {{(pid=134148) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Dec 18 21:01:59.200103 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-d7b9877b-882d-429d-bcc5-3c2531eafbd6 tempest-TaggedBootDevicesTest-22902861 None] deleting rbd volume volume-26094cb4-a4fa-43a4-86c4-5a3342be6fa8 {{(pid=134148) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Dec 18 21:01:59.544567 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.quota [None req-d7b9877b-882d-429d-bcc5-3c2531eafbd6 tempest-TaggedBootDevicesTest-22902861 None] Created reservations ['1cccf4c2-380e-4684-b705-2de4a299f2b8', '7722d381-a3c4-49c4-b72f-50cd2c9cbbe5', '43efab3d-ac30-4118-8bcb-fadc176b5aed', 'd931390e-4092-492f-81e0-6af2f2cbc164'] {{(pid=134148) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 18 21:01:59.600482 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-d7b9877b-882d-429d-bcc5-3c2531eafbd6 tempest-TaggedBootDevicesTest-22902861 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:01:59.653058 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-d7b9877b-882d-429d-bcc5-3c2531eafbd6 tempest-TaggedBootDevicesTest-22902861 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:01:59.726903 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.manager [None req-d7b9877b-882d-429d-bcc5-3c2531eafbd6 tempest-TaggedBootDevicesTest-22902861 None] Notifying Schedulers of capabilities ... {{(pid=134148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 18 21:01:59.738458 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-d7b9877b-882d-429d-bcc5-3c2531eafbd6 tempest-TaggedBootDevicesTest-22902861 None] Deleted volume successfully. Dec 18 21:01:59.755463 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.coordination [None req-d7b9877b-882d-429d-bcc5-3c2531eafbd6 tempest-TaggedBootDevicesTest-22902861 None] Lock "b'cinder-26094cb4-a4fa-43a4-86c4-5a3342be6fa8-delete_volume'" released by "delete_volume" :: held 0.676s {{(pid=134148) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 18 21:02:00.217870 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.coordination [None req-59b3b0e0-521a-4a12-8e60-f0d82fef1ee5 tempest-TaggedBootDevicesTest-22902861 None] Lock "b'cinder-ac480cea-f87c-451e-96df-24febe018123-delete_volume'" acquired by "delete_volume" :: waited 0.010s {{(pid=134148) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 18 21:02:00.262095 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-59b3b0e0-521a-4a12-8e60-f0d82fef1ee5 tempest-TaggedBootDevicesTest-22902861 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:02:00.374821 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-59b3b0e0-521a-4a12-8e60-f0d82fef1ee5 tempest-TaggedBootDevicesTest-22902861 None] volume has no backup snaps {{(pid=134148) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Dec 18 21:02:00.387458 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-59b3b0e0-521a-4a12-8e60-f0d82fef1ee5 tempest-TaggedBootDevicesTest-22902861 None] deleting rbd volume volume-ac480cea-f87c-451e-96df-24febe018123 {{(pid=134148) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Dec 18 21:02:00.700914 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-59b3b0e0-521a-4a12-8e60-f0d82fef1ee5 tempest-TaggedBootDevicesTest-22902861 None] volume is a clone so cleaning references {{(pid=134148) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1266}} Dec 18 21:02:00.745260 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-59b3b0e0-521a-4a12-8e60-f0d82fef1ee5 tempest-TaggedBootDevicesTest-22902861 None] deleting parent snapshot volume-ac480cea-f87c-451e-96df-24febe018123.clone_snap {{(pid=134148) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1158}} Dec 18 21:02:01.602123 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.quota [None req-59b3b0e0-521a-4a12-8e60-f0d82fef1ee5 tempest-TaggedBootDevicesTest-22902861 None] Created reservations ['628d68f5-4ccd-4075-9c8b-26fa3b5c640b', 'ad049438-ce98-4ccc-a8ab-90b67eeda3d4', '097f0c5c-07b6-4dbb-82e3-fae7ca06a189', '42145fae-08cc-425a-ac63-570e5cdb11c2'] {{(pid=134148) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 18 21:02:01.656439 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-59b3b0e0-521a-4a12-8e60-f0d82fef1ee5 tempest-TaggedBootDevicesTest-22902861 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:02:01.710511 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-59b3b0e0-521a-4a12-8e60-f0d82fef1ee5 tempest-TaggedBootDevicesTest-22902861 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:02:01.768956 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.manager [None req-59b3b0e0-521a-4a12-8e60-f0d82fef1ee5 tempest-TaggedBootDevicesTest-22902861 None] Notifying Schedulers of capabilities ... {{(pid=134148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 18 21:02:01.773093 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-59b3b0e0-521a-4a12-8e60-f0d82fef1ee5 tempest-TaggedBootDevicesTest-22902861 None] Deleted volume successfully. Dec 18 21:02:01.789543 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.coordination [None req-59b3b0e0-521a-4a12-8e60-f0d82fef1ee5 tempest-TaggedBootDevicesTest-22902861 None] Lock "b'cinder-ac480cea-f87c-451e-96df-24febe018123-delete_volume'" released by "delete_volume" :: held 1.572s {{(pid=134148) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 18 21:02:34.337385 ncdv-master-1 cinder-volume[134148]: DEBUG oslo_service.periodic_task [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134148) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Dec 18 21:02:34.339719 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:02:34.408708 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:02:34.477755 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.manager [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] Notifying Schedulers of capabilities ... {{(pid=134148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 18 21:03:08.510479 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.flows.manager.create_volume [None req-ddefa511-2586-4280-b914-7bc19acf2981 tempest-VolumesTestJSON-1445677590 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134148) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Dec 18 21:03:08.516594 ncdv-master-1 cinder-volume[134148]: WARNING stevedore.named [None req-ddefa511-2586-4280-b914-7bc19acf2981 tempest-VolumesTestJSON-1445677590 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Dec 18 21:03:08.520432 ncdv-master-1 cinder-volume[134148]: WARNING castellan.key_manager [None req-ddefa511-2586-4280-b914-7bc19acf2981 tempest-VolumesTestJSON-1445677590 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Dec 18 21:03:08.553068 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-ddefa511-2586-4280-b914-7bc19acf2981 tempest-VolumesTestJSON-1445677590 None] Flow 'volume_create_manager' (fa43db6a-9c85-476b-9231-f72e25f53323) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 18 21:03:08.562776 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-ddefa511-2586-4280-b914-7bc19acf2981 tempest-VolumesTestJSON-1445677590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19a8fd62-5115-4e15-b2b7-b622c4405a0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:03:08.574704 ncdv-master-1 cinder-volume[134148]: DEBUG oslo_db.sqlalchemy.engines [None req-ddefa511-2586-4280-b914-7bc19acf2981 tempest-VolumesTestJSON-1445677590 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134148) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 18 21:03:08.603193 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-ddefa511-2586-4280-b914-7bc19acf2981 tempest-VolumesTestJSON-1445677590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19a8fd62-5115-4e15-b2b7-b622c4405a0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-12-18T21:03:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-697020704',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=c2059a83-33dc-4ab3-90a2-459bbc5a74e3,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='37f8d3a76a7b40ccbd92ec26deed6ab5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-12-18T21:03:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-12-18T21:03:08Z,use_quota=True,user_id='4e51d207098e4793a27ce37c1d7a0d70',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f2e1fe1-9fd6-411e-9ed9-368f463ccb6f),volume_type_id=1f2e1fe1-9fd6-411e-9ed9-368f463ccb6f)' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:03:08.607500 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-ddefa511-2586-4280-b914-7bc19acf2981 tempest-VolumesTestJSON-1445677590 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3aa8750-9499-46e1-9d0f-242c6d5a4cdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:03:08.612011 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-ddefa511-2586-4280-b914-7bc19acf2981 tempest-VolumesTestJSON-1445677590 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3aa8750-9499-46e1-9d0f-242c6d5a4cdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:03:08.624814 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-ddefa511-2586-4280-b914-7bc19acf2981 tempest-VolumesTestJSON-1445677590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (205d57c3-6aec-4504-b354-cb8da0fe4844) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:03:08.627436 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-ddefa511-2586-4280-b914-7bc19acf2981 tempest-VolumesTestJSON-1445677590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (205d57c3-6aec-4504-b354-cb8da0fe4844) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c2059a83-33dc-4ab3-90a2-459bbc5a74e3', 'volume_name': 'volume-c2059a83-33dc-4ab3-90a2-459bbc5a74e3', 'volume_size': 1}' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:03:08.630598 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-ddefa511-2586-4280-b914-7bc19acf2981 tempest-VolumesTestJSON-1445677590 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c225c1c-98d2-4e23-9d8e-f28275f6dceb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:03:08.637202 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-ddefa511-2586-4280-b914-7bc19acf2981 tempest-VolumesTestJSON-1445677590 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c225c1c-98d2-4e23-9d8e-f28275f6dceb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:03:08.639924 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-ddefa511-2586-4280-b914-7bc19acf2981 tempest-VolumesTestJSON-1445677590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd927ecb-3991-48b0-9563-306b179a9305) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:03:08.644173 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.flows.manager.create_volume [None req-ddefa511-2586-4280-b914-7bc19acf2981 tempest-VolumesTestJSON-1445677590 None] Volume c2059a83-33dc-4ab3-90a2-459bbc5a74e3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c2059a83-33dc-4ab3-90a2-459bbc5a74e3', 'volume_size': 1} Dec 18 21:03:08.644619 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-ddefa511-2586-4280-b914-7bc19acf2981 tempest-VolumesTestJSON-1445677590 None] creating volume 'volume-c2059a83-33dc-4ab3-90a2-459bbc5a74e3' {{(pid=134148) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Dec 18 21:03:08.645647 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-ddefa511-2586-4280-b914-7bc19acf2981 tempest-VolumesTestJSON-1445677590 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:03:08.821635 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-ddefa511-2586-4280-b914-7bc19acf2981 tempest-VolumesTestJSON-1445677590 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134148) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 18 21:03:08.823303 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-ddefa511-2586-4280-b914-7bc19acf2981 tempest-VolumesTestJSON-1445677590 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134148) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 18 21:03:08.826878 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-ddefa511-2586-4280-b914-7bc19acf2981 tempest-VolumesTestJSON-1445677590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd927ecb-3991-48b0-9563-306b179a9305) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c2059a83-33dc-4ab3-90a2-459bbc5a74e3', 'volume_size': 1}' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:03:08.830012 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-ddefa511-2586-4280-b914-7bc19acf2981 tempest-VolumesTestJSON-1445677590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef024500-9707-48c4-bff0-439b606093ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:03:08.850864 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.flows.manager.create_volume [None req-ddefa511-2586-4280-b914-7bc19acf2981 tempest-VolumesTestJSON-1445677590 None] Volume volume-c2059a83-33dc-4ab3-90a2-459bbc5a74e3 (c2059a83-33dc-4ab3-90a2-459bbc5a74e3): created successfully Dec 18 21:03:08.853744 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-ddefa511-2586-4280-b914-7bc19acf2981 tempest-VolumesTestJSON-1445677590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef024500-9707-48c4-bff0-439b606093ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:03:08.860691 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-ddefa511-2586-4280-b914-7bc19acf2981 tempest-VolumesTestJSON-1445677590 None] Flow 'volume_create_manager' (fa43db6a-9c85-476b-9231-f72e25f53323) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134148) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 18 21:03:08.876474 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-ddefa511-2586-4280-b914-7bc19acf2981 tempest-VolumesTestJSON-1445677590 None] Created volume successfully. Dec 18 21:03:10.342052 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.flows.manager.create_volume [None req-a80e4921-39df-4319-8840-877633f12c17 tempest-VolumesTestJSON-1445677590 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134148) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Dec 18 21:03:10.364364 ncdv-master-1 cinder-volume[134148]: WARNING stevedore.named [None req-a80e4921-39df-4319-8840-877633f12c17 tempest-VolumesTestJSON-1445677590 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Dec 18 21:03:10.364983 ncdv-master-1 cinder-volume[134148]: WARNING castellan.key_manager [None req-a80e4921-39df-4319-8840-877633f12c17 tempest-VolumesTestJSON-1445677590 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Dec 18 21:03:10.401415 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-a80e4921-39df-4319-8840-877633f12c17 tempest-VolumesTestJSON-1445677590 None] Flow 'volume_create_manager' (1c6a897d-c130-4d0a-93c9-84847bb46dff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 18 21:03:10.411196 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-a80e4921-39df-4319-8840-877633f12c17 tempest-VolumesTestJSON-1445677590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2101407-482b-451e-871e-bc0c245fbde8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:03:10.431606 ncdv-master-1 cinder-volume[134148]: DEBUG oslo_db.sqlalchemy.engines [None req-a80e4921-39df-4319-8840-877633f12c17 tempest-VolumesTestJSON-1445677590 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134148) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 18 21:03:10.460565 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-a80e4921-39df-4319-8840-877633f12c17 tempest-VolumesTestJSON-1445677590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2101407-482b-451e-871e-bc0c245fbde8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-12-18T21:03:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-866460541',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=69926e98-bbee-4546-8e54-ad520f803bb7,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='37f8d3a76a7b40ccbd92ec26deed6ab5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-12-18T21:03:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-12-18T21:03:10Z,use_quota=True,user_id='4e51d207098e4793a27ce37c1d7a0d70',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f2e1fe1-9fd6-411e-9ed9-368f463ccb6f),volume_type_id=1f2e1fe1-9fd6-411e-9ed9-368f463ccb6f)' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:03:10.475325 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-a80e4921-39df-4319-8840-877633f12c17 tempest-VolumesTestJSON-1445677590 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb358d45-94a6-4e72-bab5-0ae8239a9718) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:03:10.482059 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-a80e4921-39df-4319-8840-877633f12c17 tempest-VolumesTestJSON-1445677590 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb358d45-94a6-4e72-bab5-0ae8239a9718) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:03:10.485783 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-a80e4921-39df-4319-8840-877633f12c17 tempest-VolumesTestJSON-1445677590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (121d72b9-0676-4caf-9443-e333bce8ffd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:03:10.488544 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-a80e4921-39df-4319-8840-877633f12c17 tempest-VolumesTestJSON-1445677590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (121d72b9-0676-4caf-9443-e333bce8ffd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '69926e98-bbee-4546-8e54-ad520f803bb7', 'volume_name': 'volume-69926e98-bbee-4546-8e54-ad520f803bb7', 'volume_size': 1}' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:03:10.493125 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-a80e4921-39df-4319-8840-877633f12c17 tempest-VolumesTestJSON-1445677590 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3377f55-6a71-4c99-88f5-c59bb9f77746) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:03:10.507271 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-a80e4921-39df-4319-8840-877633f12c17 tempest-VolumesTestJSON-1445677590 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3377f55-6a71-4c99-88f5-c59bb9f77746) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:03:10.511843 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-a80e4921-39df-4319-8840-877633f12c17 tempest-VolumesTestJSON-1445677590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7774b3a-0a8c-48a2-b2aa-d67b488cf258) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:03:10.513520 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.flows.manager.create_volume [None req-a80e4921-39df-4319-8840-877633f12c17 tempest-VolumesTestJSON-1445677590 None] Volume 69926e98-bbee-4546-8e54-ad520f803bb7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-69926e98-bbee-4546-8e54-ad520f803bb7', 'volume_size': 1} Dec 18 21:03:10.514195 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-a80e4921-39df-4319-8840-877633f12c17 tempest-VolumesTestJSON-1445677590 None] creating volume 'volume-69926e98-bbee-4546-8e54-ad520f803bb7' {{(pid=134148) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Dec 18 21:03:10.516757 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-a80e4921-39df-4319-8840-877633f12c17 tempest-VolumesTestJSON-1445677590 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:03:10.673327 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-a80e4921-39df-4319-8840-877633f12c17 tempest-VolumesTestJSON-1445677590 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134148) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 18 21:03:10.673707 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-a80e4921-39df-4319-8840-877633f12c17 tempest-VolumesTestJSON-1445677590 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134148) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 18 21:03:10.676929 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-a80e4921-39df-4319-8840-877633f12c17 tempest-VolumesTestJSON-1445677590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7774b3a-0a8c-48a2-b2aa-d67b488cf258) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-69926e98-bbee-4546-8e54-ad520f803bb7', 'volume_size': 1}' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:03:10.680040 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-a80e4921-39df-4319-8840-877633f12c17 tempest-VolumesTestJSON-1445677590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18ae988d-63b7-4be7-a1cb-4400cc16d43a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:03:10.701415 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.flows.manager.create_volume [None req-a80e4921-39df-4319-8840-877633f12c17 tempest-VolumesTestJSON-1445677590 None] Volume volume-69926e98-bbee-4546-8e54-ad520f803bb7 (69926e98-bbee-4546-8e54-ad520f803bb7): created successfully Dec 18 21:03:10.703801 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-a80e4921-39df-4319-8840-877633f12c17 tempest-VolumesTestJSON-1445677590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18ae988d-63b7-4be7-a1cb-4400cc16d43a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:03:10.707154 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-a80e4921-39df-4319-8840-877633f12c17 tempest-VolumesTestJSON-1445677590 None] Flow 'volume_create_manager' (1c6a897d-c130-4d0a-93c9-84847bb46dff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134148) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 18 21:03:10.728264 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-a80e4921-39df-4319-8840-877633f12c17 tempest-VolumesTestJSON-1445677590 None] Created volume successfully. Dec 18 21:03:12.365129 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.flows.manager.create_volume [None req-43bdcf4b-8fee-430f-a1be-d98d1ff8671e tempest-VolumesTestJSON-1445677590 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134148) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Dec 18 21:03:12.368679 ncdv-master-1 cinder-volume[134148]: WARNING stevedore.named [None req-43bdcf4b-8fee-430f-a1be-d98d1ff8671e tempest-VolumesTestJSON-1445677590 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Dec 18 21:03:12.369128 ncdv-master-1 cinder-volume[134148]: WARNING castellan.key_manager [None req-43bdcf4b-8fee-430f-a1be-d98d1ff8671e tempest-VolumesTestJSON-1445677590 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Dec 18 21:03:12.396472 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-43bdcf4b-8fee-430f-a1be-d98d1ff8671e tempest-VolumesTestJSON-1445677590 None] Flow 'volume_create_manager' (0217031d-53d1-4dbe-858e-d7f3d18703e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 18 21:03:12.400993 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-43bdcf4b-8fee-430f-a1be-d98d1ff8671e tempest-VolumesTestJSON-1445677590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7e4b948-2899-4b05-8b33-3c6a0ed81016) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:03:12.422092 ncdv-master-1 cinder-volume[134148]: DEBUG oslo_db.sqlalchemy.engines [None req-43bdcf4b-8fee-430f-a1be-d98d1ff8671e tempest-VolumesTestJSON-1445677590 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134148) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 18 21:03:12.445142 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-43bdcf4b-8fee-430f-a1be-d98d1ff8671e tempest-VolumesTestJSON-1445677590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7e4b948-2899-4b05-8b33-3c6a0ed81016) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-12-18T21:03:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-57690748',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=8c64b82f-6510-48f7-af58-62a58468754b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='37f8d3a76a7b40ccbd92ec26deed6ab5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-12-18T21:03:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-12-18T21:03:12Z,use_quota=True,user_id='4e51d207098e4793a27ce37c1d7a0d70',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f2e1fe1-9fd6-411e-9ed9-368f463ccb6f),volume_type_id=1f2e1fe1-9fd6-411e-9ed9-368f463ccb6f)' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:03:12.454355 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-43bdcf4b-8fee-430f-a1be-d98d1ff8671e tempest-VolumesTestJSON-1445677590 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51eeeb43-52ca-4eff-8d34-30eb3b4819c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:03:12.460038 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-43bdcf4b-8fee-430f-a1be-d98d1ff8671e tempest-VolumesTestJSON-1445677590 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51eeeb43-52ca-4eff-8d34-30eb3b4819c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:03:12.469495 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-43bdcf4b-8fee-430f-a1be-d98d1ff8671e tempest-VolumesTestJSON-1445677590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d4853a6-98ae-4b29-a614-c37e5cf025ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:03:12.475814 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-43bdcf4b-8fee-430f-a1be-d98d1ff8671e tempest-VolumesTestJSON-1445677590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d4853a6-98ae-4b29-a614-c37e5cf025ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8c64b82f-6510-48f7-af58-62a58468754b', 'volume_name': 'volume-8c64b82f-6510-48f7-af58-62a58468754b', 'volume_size': 1}' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:03:12.484438 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-43bdcf4b-8fee-430f-a1be-d98d1ff8671e tempest-VolumesTestJSON-1445677590 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61c3204c-cf01-47f6-a09e-721931d193ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:03:12.488740 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-43bdcf4b-8fee-430f-a1be-d98d1ff8671e tempest-VolumesTestJSON-1445677590 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61c3204c-cf01-47f6-a09e-721931d193ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:03:12.495565 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-43bdcf4b-8fee-430f-a1be-d98d1ff8671e tempest-VolumesTestJSON-1445677590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6bfffc68-0ed3-4390-9117-7994b19ffc83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:03:12.496809 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.flows.manager.create_volume [None req-43bdcf4b-8fee-430f-a1be-d98d1ff8671e tempest-VolumesTestJSON-1445677590 None] Volume 8c64b82f-6510-48f7-af58-62a58468754b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8c64b82f-6510-48f7-af58-62a58468754b', 'volume_size': 1} Dec 18 21:03:12.497365 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-43bdcf4b-8fee-430f-a1be-d98d1ff8671e tempest-VolumesTestJSON-1445677590 None] creating volume 'volume-8c64b82f-6510-48f7-af58-62a58468754b' {{(pid=134148) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Dec 18 21:03:12.498714 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-43bdcf4b-8fee-430f-a1be-d98d1ff8671e tempest-VolumesTestJSON-1445677590 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:03:12.601649 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-43bdcf4b-8fee-430f-a1be-d98d1ff8671e tempest-VolumesTestJSON-1445677590 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134148) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 18 21:03:12.602482 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-43bdcf4b-8fee-430f-a1be-d98d1ff8671e tempest-VolumesTestJSON-1445677590 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134148) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 18 21:03:12.604970 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-43bdcf4b-8fee-430f-a1be-d98d1ff8671e tempest-VolumesTestJSON-1445677590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6bfffc68-0ed3-4390-9117-7994b19ffc83) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8c64b82f-6510-48f7-af58-62a58468754b', 'volume_size': 1}' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:03:12.608580 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-43bdcf4b-8fee-430f-a1be-d98d1ff8671e tempest-VolumesTestJSON-1445677590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (030eea35-da7f-43ae-b4b9-9c5d93841efb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:03:12.641063 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.flows.manager.create_volume [None req-43bdcf4b-8fee-430f-a1be-d98d1ff8671e tempest-VolumesTestJSON-1445677590 None] Volume volume-8c64b82f-6510-48f7-af58-62a58468754b (8c64b82f-6510-48f7-af58-62a58468754b): created successfully Dec 18 21:03:12.645314 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-43bdcf4b-8fee-430f-a1be-d98d1ff8671e tempest-VolumesTestJSON-1445677590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (030eea35-da7f-43ae-b4b9-9c5d93841efb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:03:12.653073 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-43bdcf4b-8fee-430f-a1be-d98d1ff8671e tempest-VolumesTestJSON-1445677590 None] Flow 'volume_create_manager' (0217031d-53d1-4dbe-858e-d7f3d18703e3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134148) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 18 21:03:12.667447 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-43bdcf4b-8fee-430f-a1be-d98d1ff8671e tempest-VolumesTestJSON-1445677590 None] Created volume successfully. Dec 18 21:03:14.838129 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.coordination [None req-11c533c9-e58f-4a27-9be0-1983e6d96b58 tempest-VolumesTestJSON-1445677590 None] Lock "b'cinder-8c64b82f-6510-48f7-af58-62a58468754b-delete_volume'" acquired by "delete_volume" :: waited 0.016s {{(pid=134148) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 18 21:03:14.913762 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-11c533c9-e58f-4a27-9be0-1983e6d96b58 tempest-VolumesTestJSON-1445677590 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:03:15.014043 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-11c533c9-e58f-4a27-9be0-1983e6d96b58 tempest-VolumesTestJSON-1445677590 None] volume has no backup snaps {{(pid=134148) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Dec 18 21:03:15.015918 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-11c533c9-e58f-4a27-9be0-1983e6d96b58 tempest-VolumesTestJSON-1445677590 None] Volume volume-8c64b82f-6510-48f7-af58-62a58468754b is not a clone. {{(pid=134148) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Dec 18 21:03:15.026062 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-11c533c9-e58f-4a27-9be0-1983e6d96b58 tempest-VolumesTestJSON-1445677590 None] deleting rbd volume volume-8c64b82f-6510-48f7-af58-62a58468754b {{(pid=134148) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Dec 18 21:03:15.503781 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.quota [None req-11c533c9-e58f-4a27-9be0-1983e6d96b58 tempest-VolumesTestJSON-1445677590 None] Created reservations ['953ab7aa-a075-4580-99b2-2a0daa943157', '490fc7e3-92e6-4f24-bbd1-cd18df97d4ac', 'f36f6010-95e7-45a1-ac42-9038ae466b66', '2508e8cd-840d-43f2-9ef6-f35955af0177'] {{(pid=134148) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 18 21:03:15.636305 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-11c533c9-e58f-4a27-9be0-1983e6d96b58 tempest-VolumesTestJSON-1445677590 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:03:15.721882 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-11c533c9-e58f-4a27-9be0-1983e6d96b58 tempest-VolumesTestJSON-1445677590 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:03:15.763393 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.manager [None req-11c533c9-e58f-4a27-9be0-1983e6d96b58 tempest-VolumesTestJSON-1445677590 None] Notifying Schedulers of capabilities ... {{(pid=134148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 18 21:03:15.768558 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-11c533c9-e58f-4a27-9be0-1983e6d96b58 tempest-VolumesTestJSON-1445677590 None] Deleted volume successfully. Dec 18 21:03:15.795860 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.coordination [None req-11c533c9-e58f-4a27-9be0-1983e6d96b58 tempest-VolumesTestJSON-1445677590 None] Lock "b'cinder-8c64b82f-6510-48f7-af58-62a58468754b-delete_volume'" released by "delete_volume" :: held 0.960s {{(pid=134148) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 18 21:03:16.093118 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.coordination [None req-6be5996e-098c-4bdd-b0b4-ab136b1c8bf3 tempest-VolumesTestJSON-1445677590 None] Lock "b'cinder-69926e98-bbee-4546-8e54-ad520f803bb7-delete_volume'" acquired by "delete_volume" :: waited 0.030s {{(pid=134148) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 18 21:03:16.178314 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-6be5996e-098c-4bdd-b0b4-ab136b1c8bf3 tempest-VolumesTestJSON-1445677590 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:03:16.264195 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-6be5996e-098c-4bdd-b0b4-ab136b1c8bf3 tempest-VolumesTestJSON-1445677590 None] volume has no backup snaps {{(pid=134148) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Dec 18 21:03:16.264865 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-6be5996e-098c-4bdd-b0b4-ab136b1c8bf3 tempest-VolumesTestJSON-1445677590 None] Volume volume-69926e98-bbee-4546-8e54-ad520f803bb7 is not a clone. {{(pid=134148) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Dec 18 21:03:16.276591 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-6be5996e-098c-4bdd-b0b4-ab136b1c8bf3 tempest-VolumesTestJSON-1445677590 None] deleting rbd volume volume-69926e98-bbee-4546-8e54-ad520f803bb7 {{(pid=134148) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Dec 18 21:03:16.755008 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.quota [None req-6be5996e-098c-4bdd-b0b4-ab136b1c8bf3 tempest-VolumesTestJSON-1445677590 None] Created reservations ['6745d008-f633-4a61-ac38-09801fae2364', '4314ac40-bb69-4071-ac69-f5c9676fc41a', 'ac3ab3b5-7df2-4615-a24c-f66969f7393c', '18d36d3f-8a5a-44f8-a0dd-72e7af6f1d0e'] {{(pid=134148) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 18 21:03:16.885080 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-6be5996e-098c-4bdd-b0b4-ab136b1c8bf3 tempest-VolumesTestJSON-1445677590 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:03:16.997721 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-6be5996e-098c-4bdd-b0b4-ab136b1c8bf3 tempest-VolumesTestJSON-1445677590 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:03:17.095905 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.manager [None req-6be5996e-098c-4bdd-b0b4-ab136b1c8bf3 tempest-VolumesTestJSON-1445677590 None] Notifying Schedulers of capabilities ... {{(pid=134148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 18 21:03:17.103431 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-6be5996e-098c-4bdd-b0b4-ab136b1c8bf3 tempest-VolumesTestJSON-1445677590 None] Deleted volume successfully. Dec 18 21:03:17.155101 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.coordination [None req-6be5996e-098c-4bdd-b0b4-ab136b1c8bf3 tempest-VolumesTestJSON-1445677590 None] Lock "b'cinder-69926e98-bbee-4546-8e54-ad520f803bb7-delete_volume'" released by "delete_volume" :: held 1.062s {{(pid=134148) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 18 21:03:17.309317 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.coordination [None req-76bd5922-a704-476b-992c-fcd97f00ada5 tempest-VolumesTestJSON-1445677590 None] Lock "b'cinder-c2059a83-33dc-4ab3-90a2-459bbc5a74e3-delete_volume'" acquired by "delete_volume" :: waited 0.011s {{(pid=134148) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 18 21:03:17.429114 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-76bd5922-a704-476b-992c-fcd97f00ada5 tempest-VolumesTestJSON-1445677590 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:03:17.519602 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-76bd5922-a704-476b-992c-fcd97f00ada5 tempest-VolumesTestJSON-1445677590 None] volume has no backup snaps {{(pid=134148) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Dec 18 21:03:17.520073 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-76bd5922-a704-476b-992c-fcd97f00ada5 tempest-VolumesTestJSON-1445677590 None] Volume volume-c2059a83-33dc-4ab3-90a2-459bbc5a74e3 is not a clone. {{(pid=134148) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Dec 18 21:03:17.531454 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-76bd5922-a704-476b-992c-fcd97f00ada5 tempest-VolumesTestJSON-1445677590 None] deleting rbd volume volume-c2059a83-33dc-4ab3-90a2-459bbc5a74e3 {{(pid=134148) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Dec 18 21:03:17.950914 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.quota [None req-76bd5922-a704-476b-992c-fcd97f00ada5 tempest-VolumesTestJSON-1445677590 None] Created reservations ['3924d5f2-804c-442d-be07-18d0589979b0', 'd48d4c4c-6b69-48ca-918a-4b9c8b8acc6c', 'f5e04f91-ebb5-4469-9554-eed7f9a46783', '7ba36faa-c3fd-48a3-a900-ea8288e51c40'] {{(pid=134148) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 18 21:03:18.042001 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-76bd5922-a704-476b-992c-fcd97f00ada5 tempest-VolumesTestJSON-1445677590 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:03:18.108148 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-76bd5922-a704-476b-992c-fcd97f00ada5 tempest-VolumesTestJSON-1445677590 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:03:18.156587 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.manager [None req-76bd5922-a704-476b-992c-fcd97f00ada5 tempest-VolumesTestJSON-1445677590 None] Notifying Schedulers of capabilities ... {{(pid=134148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 18 21:03:18.162909 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-76bd5922-a704-476b-992c-fcd97f00ada5 tempest-VolumesTestJSON-1445677590 None] Deleted volume successfully. Dec 18 21:03:18.179273 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.coordination [None req-76bd5922-a704-476b-992c-fcd97f00ada5 tempest-VolumesTestJSON-1445677590 None] Lock "b'cinder-c2059a83-33dc-4ab3-90a2-459bbc5a74e3-delete_volume'" released by "delete_volume" :: held 0.870s {{(pid=134148) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 18 21:03:34.336789 ncdv-master-1 cinder-volume[134148]: DEBUG oslo_service.periodic_task [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134148) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Dec 18 21:03:34.337508 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:03:34.404439 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:03:34.453827 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.manager [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] Notifying Schedulers of capabilities ... {{(pid=134148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 18 21:04:20.666486 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.flows.manager.create_volume [None req-122dbc9d-30da-4583-833b-c37c75a03ba7 tempest-DeleteServersTestJSON-508589951 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134148) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Dec 18 21:04:20.676237 ncdv-master-1 cinder-volume[134148]: WARNING stevedore.named [None req-122dbc9d-30da-4583-833b-c37c75a03ba7 tempest-DeleteServersTestJSON-508589951 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Dec 18 21:04:20.676740 ncdv-master-1 cinder-volume[134148]: WARNING castellan.key_manager [None req-122dbc9d-30da-4583-833b-c37c75a03ba7 tempest-DeleteServersTestJSON-508589951 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Dec 18 21:04:20.700488 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-122dbc9d-30da-4583-833b-c37c75a03ba7 tempest-DeleteServersTestJSON-508589951 None] Flow 'volume_create_manager' (9efdeb1f-d338-48ff-927a-1d674734eab3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 18 21:04:20.705414 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-122dbc9d-30da-4583-833b-c37c75a03ba7 tempest-DeleteServersTestJSON-508589951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73202567-03c3-48e7-9117-275e1ef2cfba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:04:20.722987 ncdv-master-1 cinder-volume[134148]: DEBUG oslo_db.sqlalchemy.engines [None req-122dbc9d-30da-4583-833b-c37c75a03ba7 tempest-DeleteServersTestJSON-508589951 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134148) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 18 21:04:20.762682 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-122dbc9d-30da-4583-833b-c37c75a03ba7 tempest-DeleteServersTestJSON-508589951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73202567-03c3-48e7-9117-275e1ef2cfba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-12-18T21:04:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-783751239',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=fbf7eaf2-c408-4d24-9a0e-9cee7a2427a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58d1ab8b81784fb2ad1b6c9a7d9efc37',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-12-18T21:04:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-12-18T21:04:21Z,use_quota=True,user_id='0a98795bdb7447c5b2a4930173b3c56d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f2e1fe1-9fd6-411e-9ed9-368f463ccb6f),volume_type_id=1f2e1fe1-9fd6-411e-9ed9-368f463ccb6f)' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:04:20.768507 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-122dbc9d-30da-4583-833b-c37c75a03ba7 tempest-DeleteServersTestJSON-508589951 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (405d5f05-e3f3-4fee-9fe8-30f85e1dc77d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:04:20.777699 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-122dbc9d-30da-4583-833b-c37c75a03ba7 tempest-DeleteServersTestJSON-508589951 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (405d5f05-e3f3-4fee-9fe8-30f85e1dc77d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:04:20.786612 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-122dbc9d-30da-4583-833b-c37c75a03ba7 tempest-DeleteServersTestJSON-508589951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ff8c639-e8a0-428d-8b65-07f5facd8992) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:04:20.794394 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-122dbc9d-30da-4583-833b-c37c75a03ba7 tempest-DeleteServersTestJSON-508589951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ff8c639-e8a0-428d-8b65-07f5facd8992) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fbf7eaf2-c408-4d24-9a0e-9cee7a2427a8', 'volume_name': 'volume-fbf7eaf2-c408-4d24-9a0e-9cee7a2427a8', 'volume_size': 1}' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:04:20.802135 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-122dbc9d-30da-4583-833b-c37c75a03ba7 tempest-DeleteServersTestJSON-508589951 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc68602d-b17d-4538-8b54-6524a7841407) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:04:20.810623 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-122dbc9d-30da-4583-833b-c37c75a03ba7 tempest-DeleteServersTestJSON-508589951 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc68602d-b17d-4538-8b54-6524a7841407) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:04:20.815119 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-122dbc9d-30da-4583-833b-c37c75a03ba7 tempest-DeleteServersTestJSON-508589951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (500ba344-b2a5-44a8-9430-abbe796cd57d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:04:20.818069 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.flows.manager.create_volume [None req-122dbc9d-30da-4583-833b-c37c75a03ba7 tempest-DeleteServersTestJSON-508589951 None] Volume fbf7eaf2-c408-4d24-9a0e-9cee7a2427a8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fbf7eaf2-c408-4d24-9a0e-9cee7a2427a8', 'volume_size': 1} Dec 18 21:04:20.818808 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-122dbc9d-30da-4583-833b-c37c75a03ba7 tempest-DeleteServersTestJSON-508589951 None] creating volume 'volume-fbf7eaf2-c408-4d24-9a0e-9cee7a2427a8' {{(pid=134148) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Dec 18 21:04:20.820846 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-122dbc9d-30da-4583-833b-c37c75a03ba7 tempest-DeleteServersTestJSON-508589951 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:04:21.001952 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-122dbc9d-30da-4583-833b-c37c75a03ba7 tempest-DeleteServersTestJSON-508589951 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134148) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 18 21:04:21.002903 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-122dbc9d-30da-4583-833b-c37c75a03ba7 tempest-DeleteServersTestJSON-508589951 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134148) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 18 21:04:21.005453 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-122dbc9d-30da-4583-833b-c37c75a03ba7 tempest-DeleteServersTestJSON-508589951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (500ba344-b2a5-44a8-9430-abbe796cd57d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fbf7eaf2-c408-4d24-9a0e-9cee7a2427a8', 'volume_size': 1}' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:04:21.009440 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-122dbc9d-30da-4583-833b-c37c75a03ba7 tempest-DeleteServersTestJSON-508589951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4079b2d1-71ef-4d5f-aa35-e3d144bd2cff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:04:21.023331 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.flows.manager.create_volume [None req-122dbc9d-30da-4583-833b-c37c75a03ba7 tempest-DeleteServersTestJSON-508589951 None] Volume volume-fbf7eaf2-c408-4d24-9a0e-9cee7a2427a8 (fbf7eaf2-c408-4d24-9a0e-9cee7a2427a8): created successfully Dec 18 21:04:21.026723 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-122dbc9d-30da-4583-833b-c37c75a03ba7 tempest-DeleteServersTestJSON-508589951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4079b2d1-71ef-4d5f-aa35-e3d144bd2cff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:04:21.031978 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-122dbc9d-30da-4583-833b-c37c75a03ba7 tempest-DeleteServersTestJSON-508589951 None] Flow 'volume_create_manager' (9efdeb1f-d338-48ff-927a-1d674734eab3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134148) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 18 21:04:21.045635 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-122dbc9d-30da-4583-833b-c37c75a03ba7 tempest-DeleteServersTestJSON-508589951 None] Created volume successfully. Dec 18 21:04:22.696627 ncdv-master-1 cinder-volume[134148]: DEBUG oslo_concurrency.processutils [req-8c6ddf35-c2aa-45b3-9948-6661c7720db4 req-29d22641-839b-4cfd-8ac2-3e5fff442fca tempest-DeleteServersTestJSON-508589951 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=134148) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Dec 18 21:04:23.839084 ncdv-master-1 cinder-volume[134148]: DEBUG oslo_concurrency.processutils [req-8c6ddf35-c2aa-45b3-9948-6661c7720db4 req-29d22641-839b-4cfd-8ac2-3e5fff442fca tempest-DeleteServersTestJSON-508589951 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.144s {{(pid=134148) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Dec 18 21:04:23.842216 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [req-8c6ddf35-c2aa-45b3-9948-6661c7720db4 req-29d22641-839b-4cfd-8ac2-3e5fff442fca tempest-DeleteServersTestJSON-508589951 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-fbf7eaf2-c408-4d24-9a0e-9cee7a2427a8', 'hosts': ['10.222.0.13'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '946d1715-d12c-4dbf-8a79-181222df6e2e', 'volume_id': 'fbf7eaf2-c408-4d24-9a0e-9cee7a2427a8', 'discard': True}} {{(pid=134148) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Dec 18 21:04:23.888169 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [req-8c6ddf35-c2aa-45b3-9948-6661c7720db4 req-29d22641-839b-4cfd-8ac2-3e5fff442fca tempest-DeleteServersTestJSON-508589951 None] Connection info returned from driver {'name': 'volumes/volume-fbf7eaf2-c408-4d24-9a0e-9cee7a2427a8', 'hosts': ['10.222.0.13'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'fbf7eaf2-c408-4d24-9a0e-9cee7a2427a8', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '1267ebd4-395c-455d-8c2c-dfe3bb27c464'} {{(pid=134148) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4812}} Dec 18 21:04:23.976035 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [req-8c6ddf35-c2aa-45b3-9948-6661c7720db4 req-29d22641-839b-4cfd-8ac2-3e5fff442fca tempest-DeleteServersTestJSON-508589951 None] attachment_update completed successfully. Dec 18 21:04:31.149249 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [req-91208390-48b0-4372-b481-52b69dc5a49f req-a6314121-f1c5-4248-a78e-d056a19636d2 tempest-DeleteServersTestJSON-508589951 None] Terminate volume connection completed successfully. Dec 18 21:04:31.149928 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [req-91208390-48b0-4372-b481-52b69dc5a49f req-a6314121-f1c5-4248-a78e-d056a19636d2 tempest-DeleteServersTestJSON-508589951 None] Deleting attachment 1267ebd4-395c-455d-8c2c-dfe3bb27c464. {{(pid=134148) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4948}} Dec 18 21:04:34.341292 ncdv-master-1 cinder-volume[134148]: DEBUG oslo_service.periodic_task [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134148) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Dec 18 21:04:34.343013 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:04:34.409795 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:04:34.522434 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.manager [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] Notifying Schedulers of capabilities ... {{(pid=134148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 18 21:05:34.343653 ncdv-master-1 cinder-volume[134148]: DEBUG oslo_service.periodic_task [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134148) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Dec 18 21:05:34.344308 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:05:34.426517 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:05:34.494366 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.manager [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] Notifying Schedulers of capabilities ... {{(pid=134148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 18 21:06:33.207384 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-b1cbaf48-33b1-4d9e-964a-e7cd482e6a69 tempest-GroupsV320Test-944292368 None] Group tempest-GroupsV320Test-Group-1758163920: creating Dec 18 21:06:33.297699 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-b1cbaf48-33b1-4d9e-964a-e7cd482e6a69 tempest-GroupsV320Test-944292368 None] Group tempest-GroupsV320Test-Group-1758163920: created successfully Dec 18 21:06:33.334457 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-b1cbaf48-33b1-4d9e-964a-e7cd482e6a69 tempest-GroupsV320Test-944292368 None] Create group completed successfully. Dec 18 21:06:34.340358 ncdv-master-1 cinder-volume[134148]: DEBUG oslo_service.periodic_task [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134148) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Dec 18 21:06:34.342734 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:06:34.425455 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:06:34.489410 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.manager [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] Notifying Schedulers of capabilities ... {{(pid=134148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 18 21:06:34.938131 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.quota [None req-61354de2-bc48-456f-b1ce-0fe677d01c91 tempest-GroupsV320Test-944292368 None] Created reservations ['c64f022a-f1f5-47bd-a015-7ee0adbdf145'] {{(pid=134148) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 18 21:06:35.015343 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-61354de2-bc48-456f-b1ce-0fe677d01c91 tempest-GroupsV320Test-944292368 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:06:35.084887 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-61354de2-bc48-456f-b1ce-0fe677d01c91 tempest-GroupsV320Test-944292368 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:06:35.164686 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.manager [None req-61354de2-bc48-456f-b1ce-0fe677d01c91 tempest-GroupsV320Test-944292368 None] Notifying Schedulers of capabilities ... {{(pid=134148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 18 21:06:35.168550 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-61354de2-bc48-456f-b1ce-0fe677d01c91 tempest-GroupsV320Test-944292368 None] Delete group completed successfully. Dec 18 21:06:43.285141 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.flows.manager.create_volume [None req-1e556a30-f12d-49b9-a50a-37aa5ebbfd0c tempest-SnapshotsActionsTest-1099231035 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134148) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Dec 18 21:06:43.296173 ncdv-master-1 cinder-volume[134148]: WARNING stevedore.named [None req-1e556a30-f12d-49b9-a50a-37aa5ebbfd0c tempest-SnapshotsActionsTest-1099231035 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Dec 18 21:06:43.296683 ncdv-master-1 cinder-volume[134148]: WARNING castellan.key_manager [None req-1e556a30-f12d-49b9-a50a-37aa5ebbfd0c tempest-SnapshotsActionsTest-1099231035 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Dec 18 21:06:43.330772 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-1e556a30-f12d-49b9-a50a-37aa5ebbfd0c tempest-SnapshotsActionsTest-1099231035 None] Flow 'volume_create_manager' (74f72f35-f57b-4848-98bb-4d6fc0acaf6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 18 21:06:43.351615 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-1e556a30-f12d-49b9-a50a-37aa5ebbfd0c tempest-SnapshotsActionsTest-1099231035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3a990b9-527b-45b1-953e-399bf40df384) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:06:43.362424 ncdv-master-1 cinder-volume[134148]: DEBUG oslo_db.sqlalchemy.engines [None req-1e556a30-f12d-49b9-a50a-37aa5ebbfd0c tempest-SnapshotsActionsTest-1099231035 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134148) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 18 21:06:43.409546 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-1e556a30-f12d-49b9-a50a-37aa5ebbfd0c tempest-SnapshotsActionsTest-1099231035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3a990b9-527b-45b1-953e-399bf40df384) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-12-18T21:06:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-387360079',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=54c0b51f-5477-42ea-b9b3-2e49f5ea9545,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c532cc90b02c49449cb03e27e1614862',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-12-18T21:06:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-12-18T21:06:43Z,use_quota=True,user_id='f027b547c51549b3809b6dcd53913294',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f2e1fe1-9fd6-411e-9ed9-368f463ccb6f),volume_type_id=1f2e1fe1-9fd6-411e-9ed9-368f463ccb6f)' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:06:43.413839 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-1e556a30-f12d-49b9-a50a-37aa5ebbfd0c tempest-SnapshotsActionsTest-1099231035 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a24b7c6-25a8-41a3-aab8-acfac1a62ce1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:06:43.416419 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-1e556a30-f12d-49b9-a50a-37aa5ebbfd0c tempest-SnapshotsActionsTest-1099231035 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a24b7c6-25a8-41a3-aab8-acfac1a62ce1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:06:43.419263 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-1e556a30-f12d-49b9-a50a-37aa5ebbfd0c tempest-SnapshotsActionsTest-1099231035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5721c59f-ded2-4c6f-992a-9d7e32688f13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:06:43.422098 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-1e556a30-f12d-49b9-a50a-37aa5ebbfd0c tempest-SnapshotsActionsTest-1099231035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5721c59f-ded2-4c6f-992a-9d7e32688f13) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '54c0b51f-5477-42ea-b9b3-2e49f5ea9545', 'volume_name': 'volume-54c0b51f-5477-42ea-b9b3-2e49f5ea9545', 'volume_size': 1}' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:06:43.436343 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-1e556a30-f12d-49b9-a50a-37aa5ebbfd0c tempest-SnapshotsActionsTest-1099231035 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0907a819-8699-474b-ba56-897e7f912941) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:06:43.439383 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-1e556a30-f12d-49b9-a50a-37aa5ebbfd0c tempest-SnapshotsActionsTest-1099231035 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0907a819-8699-474b-ba56-897e7f912941) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:06:43.445522 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-1e556a30-f12d-49b9-a50a-37aa5ebbfd0c tempest-SnapshotsActionsTest-1099231035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cdeb1b67-6b74-4b97-a775-130b300d7811) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:06:43.446637 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.flows.manager.create_volume [None req-1e556a30-f12d-49b9-a50a-37aa5ebbfd0c tempest-SnapshotsActionsTest-1099231035 None] Volume 54c0b51f-5477-42ea-b9b3-2e49f5ea9545: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-54c0b51f-5477-42ea-b9b3-2e49f5ea9545', 'volume_size': 1} Dec 18 21:06:43.447257 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-1e556a30-f12d-49b9-a50a-37aa5ebbfd0c tempest-SnapshotsActionsTest-1099231035 None] creating volume 'volume-54c0b51f-5477-42ea-b9b3-2e49f5ea9545' {{(pid=134148) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Dec 18 21:06:43.448490 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-1e556a30-f12d-49b9-a50a-37aa5ebbfd0c tempest-SnapshotsActionsTest-1099231035 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:06:43.560017 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-1e556a30-f12d-49b9-a50a-37aa5ebbfd0c tempest-SnapshotsActionsTest-1099231035 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134148) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 18 21:06:43.561197 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-1e556a30-f12d-49b9-a50a-37aa5ebbfd0c tempest-SnapshotsActionsTest-1099231035 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134148) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 18 21:06:43.564058 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-1e556a30-f12d-49b9-a50a-37aa5ebbfd0c tempest-SnapshotsActionsTest-1099231035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cdeb1b67-6b74-4b97-a775-130b300d7811) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-54c0b51f-5477-42ea-b9b3-2e49f5ea9545', 'volume_size': 1}' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:06:43.566441 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-1e556a30-f12d-49b9-a50a-37aa5ebbfd0c tempest-SnapshotsActionsTest-1099231035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d19e0955-bf85-48b9-8948-870db5e33b27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:06:43.583074 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.flows.manager.create_volume [None req-1e556a30-f12d-49b9-a50a-37aa5ebbfd0c tempest-SnapshotsActionsTest-1099231035 None] Volume volume-54c0b51f-5477-42ea-b9b3-2e49f5ea9545 (54c0b51f-5477-42ea-b9b3-2e49f5ea9545): created successfully Dec 18 21:06:43.588065 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-1e556a30-f12d-49b9-a50a-37aa5ebbfd0c tempest-SnapshotsActionsTest-1099231035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d19e0955-bf85-48b9-8948-870db5e33b27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:06:43.591799 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-1e556a30-f12d-49b9-a50a-37aa5ebbfd0c tempest-SnapshotsActionsTest-1099231035 None] Flow 'volume_create_manager' (74f72f35-f57b-4848-98bb-4d6fc0acaf6f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134148) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 18 21:06:43.601580 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-1e556a30-f12d-49b9-a50a-37aa5ebbfd0c tempest-SnapshotsActionsTest-1099231035 None] Created volume successfully. Dec 18 21:06:44.757617 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-2e44ec4c-4f7c-41ec-bc44-b7da3b68ea11 tempest-SnapshotsActionsTest-1099231035 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:06:46.013893 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.flows.manager.create_volume [None req-e46e5e84-c074-4184-a041-30c916458d1f tempest-ServersNegativeTestJSON-381782243 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134148) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Dec 18 21:06:46.019345 ncdv-master-1 cinder-volume[134148]: WARNING stevedore.named [None req-e46e5e84-c074-4184-a041-30c916458d1f tempest-ServersNegativeTestJSON-381782243 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Dec 18 21:06:46.020203 ncdv-master-1 cinder-volume[134148]: WARNING castellan.key_manager [None req-e46e5e84-c074-4184-a041-30c916458d1f tempest-ServersNegativeTestJSON-381782243 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Dec 18 21:06:46.036986 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-e46e5e84-c074-4184-a041-30c916458d1f tempest-ServersNegativeTestJSON-381782243 None] Flow 'volume_create_manager' (b9a6fccf-4fc6-4f2a-8c73-0b4210a6db91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 18 21:06:46.040919 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-e46e5e84-c074-4184-a041-30c916458d1f tempest-ServersNegativeTestJSON-381782243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79dcde6a-4951-4502-bb3a-36f3c204ebe0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:06:46.045819 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-2e44ec4c-4f7c-41ec-bc44-b7da3b68ea11 tempest-SnapshotsActionsTest-1099231035 None] Create snapshot completed successfully Dec 18 21:06:46.052273 ncdv-master-1 cinder-volume[134148]: DEBUG oslo_db.sqlalchemy.engines [None req-2e44ec4c-4f7c-41ec-bc44-b7da3b68ea11 tempest-SnapshotsActionsTest-1099231035 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134148) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 18 21:06:46.073949 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-e46e5e84-c074-4184-a041-30c916458d1f tempest-ServersNegativeTestJSON-381782243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79dcde6a-4951-4502-bb3a-36f3c204ebe0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-12-18T21:06:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1083094551',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=dd78e899-c855-4e65-bba8-34d29b113975,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea26536b064a4650b9c08f4b5ce6fadf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-12-18T21:06:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-12-18T21:06:46Z,use_quota=True,user_id='d6278aefb6d5497aad3d74b47b2e95d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f2e1fe1-9fd6-411e-9ed9-368f463ccb6f),volume_type_id=1f2e1fe1-9fd6-411e-9ed9-368f463ccb6f)' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:06:46.076696 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-e46e5e84-c074-4184-a041-30c916458d1f tempest-ServersNegativeTestJSON-381782243 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f36efb25-1776-461d-89ee-f72825d05dc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:06:46.079670 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-e46e5e84-c074-4184-a041-30c916458d1f tempest-ServersNegativeTestJSON-381782243 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f36efb25-1776-461d-89ee-f72825d05dc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:06:46.082073 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-e46e5e84-c074-4184-a041-30c916458d1f tempest-ServersNegativeTestJSON-381782243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4f56e3c-35a9-4594-98c1-579955c81637) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:06:46.084564 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-e46e5e84-c074-4184-a041-30c916458d1f tempest-ServersNegativeTestJSON-381782243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4f56e3c-35a9-4594-98c1-579955c81637) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dd78e899-c855-4e65-bba8-34d29b113975', 'volume_name': 'volume-dd78e899-c855-4e65-bba8-34d29b113975', 'volume_size': 1}' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:06:46.086893 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-e46e5e84-c074-4184-a041-30c916458d1f tempest-ServersNegativeTestJSON-381782243 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d56eff2-fd58-4cc1-82db-f3035cfc7d0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:06:46.089308 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-e46e5e84-c074-4184-a041-30c916458d1f tempest-ServersNegativeTestJSON-381782243 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d56eff2-fd58-4cc1-82db-f3035cfc7d0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:06:46.091555 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-e46e5e84-c074-4184-a041-30c916458d1f tempest-ServersNegativeTestJSON-381782243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bbaf024b-8039-48fb-8f47-cc19a350fd1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:06:46.092340 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.flows.manager.create_volume [None req-e46e5e84-c074-4184-a041-30c916458d1f tempest-ServersNegativeTestJSON-381782243 None] Volume dd78e899-c855-4e65-bba8-34d29b113975: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dd78e899-c855-4e65-bba8-34d29b113975', 'volume_size': 1} Dec 18 21:06:46.092839 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-e46e5e84-c074-4184-a041-30c916458d1f tempest-ServersNegativeTestJSON-381782243 None] creating volume 'volume-dd78e899-c855-4e65-bba8-34d29b113975' {{(pid=134148) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Dec 18 21:06:46.093819 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-e46e5e84-c074-4184-a041-30c916458d1f tempest-ServersNegativeTestJSON-381782243 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:06:46.176794 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-e46e5e84-c074-4184-a041-30c916458d1f tempest-ServersNegativeTestJSON-381782243 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134148) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 18 21:06:46.177378 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-e46e5e84-c074-4184-a041-30c916458d1f tempest-ServersNegativeTestJSON-381782243 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134148) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 18 21:06:46.180509 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-e46e5e84-c074-4184-a041-30c916458d1f tempest-ServersNegativeTestJSON-381782243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bbaf024b-8039-48fb-8f47-cc19a350fd1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dd78e899-c855-4e65-bba8-34d29b113975', 'volume_size': 1}' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:06:46.184826 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-e46e5e84-c074-4184-a041-30c916458d1f tempest-ServersNegativeTestJSON-381782243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09e236cf-4211-4941-a152-ed756e8d81e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:06:46.197250 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.flows.manager.create_volume [None req-e46e5e84-c074-4184-a041-30c916458d1f tempest-ServersNegativeTestJSON-381782243 None] Volume volume-dd78e899-c855-4e65-bba8-34d29b113975 (dd78e899-c855-4e65-bba8-34d29b113975): created successfully Dec 18 21:06:46.200310 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-e46e5e84-c074-4184-a041-30c916458d1f tempest-ServersNegativeTestJSON-381782243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09e236cf-4211-4941-a152-ed756e8d81e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:06:46.207028 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-e46e5e84-c074-4184-a041-30c916458d1f tempest-ServersNegativeTestJSON-381782243 None] Flow 'volume_create_manager' (b9a6fccf-4fc6-4f2a-8c73-0b4210a6db91) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134148) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 18 21:06:46.219331 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-e46e5e84-c074-4184-a041-30c916458d1f tempest-ServersNegativeTestJSON-381782243 None] Created volume successfully. Dec 18 21:06:47.772758 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-bb29a0d3-7249-4a93-b8e1-5615b43f8342 tempest-SnapshotsActionsTest-1099231035 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:06:49.107425 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-bb29a0d3-7249-4a93-b8e1-5615b43f8342 tempest-SnapshotsActionsTest-1099231035 None] Create snapshot completed successfully Dec 18 21:06:49.523550 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.flows.manager.create_volume [None req-43fb3289-2e93-42db-a0df-908388513fe9 tempest-ServersNegativeTestJSON-381782243 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134148) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Dec 18 21:06:49.526977 ncdv-master-1 cinder-volume[134148]: WARNING stevedore.named [None req-43fb3289-2e93-42db-a0df-908388513fe9 tempest-ServersNegativeTestJSON-381782243 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Dec 18 21:06:49.527601 ncdv-master-1 cinder-volume[134148]: WARNING castellan.key_manager [None req-43fb3289-2e93-42db-a0df-908388513fe9 tempest-ServersNegativeTestJSON-381782243 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Dec 18 21:06:49.558067 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-43fb3289-2e93-42db-a0df-908388513fe9 tempest-ServersNegativeTestJSON-381782243 None] Flow 'volume_create_manager' (1b36bfae-f802-4e88-9524-e3a469e2d461) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 18 21:06:49.561890 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-43fb3289-2e93-42db-a0df-908388513fe9 tempest-ServersNegativeTestJSON-381782243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fae52fe4-38fa-4f7b-89ad-c8dcc29f8a74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:06:49.582284 ncdv-master-1 cinder-volume[134148]: DEBUG oslo_db.sqlalchemy.engines [None req-43fb3289-2e93-42db-a0df-908388513fe9 tempest-ServersNegativeTestJSON-381782243 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134148) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 18 21:06:49.605971 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-43fb3289-2e93-42db-a0df-908388513fe9 tempest-ServersNegativeTestJSON-381782243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fae52fe4-38fa-4f7b-89ad-c8dcc29f8a74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-12-18T21:06:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-225567125',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=7cf9ffd2-1a5c-45ac-b99c-8aa62037cc81,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea26536b064a4650b9c08f4b5ce6fadf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-12-18T21:06:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-12-18T21:06:49Z,use_quota=True,user_id='d6278aefb6d5497aad3d74b47b2e95d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f2e1fe1-9fd6-411e-9ed9-368f463ccb6f),volume_type_id=1f2e1fe1-9fd6-411e-9ed9-368f463ccb6f)' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:06:49.606215 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-43fb3289-2e93-42db-a0df-908388513fe9 tempest-ServersNegativeTestJSON-381782243 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72360401-cd84-4261-9401-18ca4b144e23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:06:49.615627 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-43fb3289-2e93-42db-a0df-908388513fe9 tempest-ServersNegativeTestJSON-381782243 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72360401-cd84-4261-9401-18ca4b144e23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:06:49.618390 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-43fb3289-2e93-42db-a0df-908388513fe9 tempest-ServersNegativeTestJSON-381782243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35d93fb8-2968-44d2-bf23-80e323bb63c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:06:49.620769 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-43fb3289-2e93-42db-a0df-908388513fe9 tempest-ServersNegativeTestJSON-381782243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35d93fb8-2968-44d2-bf23-80e323bb63c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7cf9ffd2-1a5c-45ac-b99c-8aa62037cc81', 'volume_name': 'volume-7cf9ffd2-1a5c-45ac-b99c-8aa62037cc81', 'volume_size': 1}' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:06:49.623209 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-43fb3289-2e93-42db-a0df-908388513fe9 tempest-ServersNegativeTestJSON-381782243 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10a5b88b-052b-4023-844a-83837edfbc83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:06:49.625462 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-43fb3289-2e93-42db-a0df-908388513fe9 tempest-ServersNegativeTestJSON-381782243 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10a5b88b-052b-4023-844a-83837edfbc83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:06:49.645124 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-43fb3289-2e93-42db-a0df-908388513fe9 tempest-ServersNegativeTestJSON-381782243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b92b337-505f-4e01-9133-8cba1cd1c07a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:06:49.645993 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.flows.manager.create_volume [None req-43fb3289-2e93-42db-a0df-908388513fe9 tempest-ServersNegativeTestJSON-381782243 None] Volume 7cf9ffd2-1a5c-45ac-b99c-8aa62037cc81: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7cf9ffd2-1a5c-45ac-b99c-8aa62037cc81', 'volume_size': 1} Dec 18 21:06:49.646419 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-43fb3289-2e93-42db-a0df-908388513fe9 tempest-ServersNegativeTestJSON-381782243 None] creating volume 'volume-7cf9ffd2-1a5c-45ac-b99c-8aa62037cc81' {{(pid=134148) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Dec 18 21:06:49.647431 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-43fb3289-2e93-42db-a0df-908388513fe9 tempest-ServersNegativeTestJSON-381782243 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:06:49.775938 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-43fb3289-2e93-42db-a0df-908388513fe9 tempest-ServersNegativeTestJSON-381782243 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134148) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 18 21:06:49.776390 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-43fb3289-2e93-42db-a0df-908388513fe9 tempest-ServersNegativeTestJSON-381782243 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134148) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 18 21:06:49.778519 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-43fb3289-2e93-42db-a0df-908388513fe9 tempest-ServersNegativeTestJSON-381782243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b92b337-505f-4e01-9133-8cba1cd1c07a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7cf9ffd2-1a5c-45ac-b99c-8aa62037cc81', 'volume_size': 1}' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:06:49.781084 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-43fb3289-2e93-42db-a0df-908388513fe9 tempest-ServersNegativeTestJSON-381782243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ceddc534-74ed-47e9-917c-a996ee88c2b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:06:49.807381 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.flows.manager.create_volume [None req-43fb3289-2e93-42db-a0df-908388513fe9 tempest-ServersNegativeTestJSON-381782243 None] Volume volume-7cf9ffd2-1a5c-45ac-b99c-8aa62037cc81 (7cf9ffd2-1a5c-45ac-b99c-8aa62037cc81): created successfully Dec 18 21:06:49.809734 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-43fb3289-2e93-42db-a0df-908388513fe9 tempest-ServersNegativeTestJSON-381782243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ceddc534-74ed-47e9-917c-a996ee88c2b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:06:49.813745 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-43fb3289-2e93-42db-a0df-908388513fe9 tempest-ServersNegativeTestJSON-381782243 None] Flow 'volume_create_manager' (1b36bfae-f802-4e88-9524-e3a469e2d461) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134148) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 18 21:06:49.840702 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-43fb3289-2e93-42db-a0df-908388513fe9 tempest-ServersNegativeTestJSON-381782243 None] Created volume successfully. Dec 18 21:06:49.998990 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.coordination [None req-d44eb39c-4fc9-4bdd-9041-f65a5efff9bd tempest-SnapshotsActionsTest-67191287 None] Lock "b'cinder-af61ab1f-8c3d-4c01-91d8-934da2589836-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.012s {{(pid=134148) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 18 21:06:50.001045 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-d44eb39c-4fc9-4bdd-9041-f65a5efff9bd tempest-SnapshotsActionsTest-67191287 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:06:51.147255 ncdv-master-1 cinder-volume[134148]: WARNING cinder.quota [None req-d44eb39c-4fc9-4bdd-9041-f65a5efff9bd tempest-SnapshotsActionsTest-67191287 None] Deprecated: Default quota for resource: snapshots_ceph is set by the default quota flag: quota_snapshots_ceph, it is now deprecated. Please use the default quota class for default quota. Dec 18 21:06:51.183778 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.quota [None req-d44eb39c-4fc9-4bdd-9041-f65a5efff9bd tempest-SnapshotsActionsTest-67191287 None] Created reservations ['e95a8d0c-0b3a-4749-a97f-2864d5dd8dfe', 'a80f1082-c451-4f6d-ad30-d55a0bfa49c5', '52f688af-c8c2-46d4-94d0-c21dca2d8529', '47794fcb-ea23-43b6-819b-0e41c41128ba'] {{(pid=134148) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 18 21:06:51.299016 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-d44eb39c-4fc9-4bdd-9041-f65a5efff9bd tempest-SnapshotsActionsTest-67191287 None] Delete snapshot completed successfully. Dec 18 21:06:51.306161 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.coordination [None req-d44eb39c-4fc9-4bdd-9041-f65a5efff9bd tempest-SnapshotsActionsTest-67191287 None] Lock "b'cinder-af61ab1f-8c3d-4c01-91d8-934da2589836-delete_snapshot'" released by "delete_snapshot" :: held 1.308s {{(pid=134148) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 18 21:06:52.758682 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-d27a149f-180d-4d57-ba6b-377150e2e5a2 tempest-SnapshotsActionsTest-1099231035 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:06:53.755439 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-d27a149f-180d-4d57-ba6b-377150e2e5a2 tempest-SnapshotsActionsTest-1099231035 None] Create snapshot completed successfully Dec 18 21:06:55.000230 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.coordination [None req-45fd3a72-b414-42f7-8da2-52674be1a22a tempest-SnapshotsActionsTest-67191287 None] Lock "b'cinder-42f62ff9-8b7b-4c54-beed-ba3d2eb7c56a-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.022s {{(pid=134148) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 18 21:06:55.006899 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-45fd3a72-b414-42f7-8da2-52674be1a22a tempest-SnapshotsActionsTest-67191287 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:06:56.084484 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.quota [None req-45fd3a72-b414-42f7-8da2-52674be1a22a tempest-SnapshotsActionsTest-67191287 None] Created reservations ['e3785797-4ca0-4daf-8713-87a9b371d6c5', '35ba853c-e4e1-4efd-a99c-744c9c6cb583', 'e258d9f7-f490-4201-8f78-00f40f7da450', '8768a970-3592-448c-b374-e46829aab3f2'] {{(pid=134148) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 18 21:06:56.149900 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-45fd3a72-b414-42f7-8da2-52674be1a22a tempest-SnapshotsActionsTest-67191287 None] Delete snapshot completed successfully. Dec 18 21:06:56.155613 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.coordination [None req-45fd3a72-b414-42f7-8da2-52674be1a22a tempest-SnapshotsActionsTest-67191287 None] Lock "b'cinder-42f62ff9-8b7b-4c54-beed-ba3d2eb7c56a-delete_snapshot'" released by "delete_snapshot" :: held 1.156s {{(pid=134148) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 18 21:06:57.607233 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-27faa231-f2e1-46d9-b882-9b4cf1d1dd32 tempest-SnapshotsActionsTest-1099231035 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:06:58.085159 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-27faa231-f2e1-46d9-b882-9b4cf1d1dd32 tempest-SnapshotsActionsTest-1099231035 None] Create snapshot completed successfully Dec 18 21:06:58.873671 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.coordination [None req-3cc326a1-0374-4524-9eda-fd3487f5870d tempest-SnapshotsActionsTest-67191287 None] Lock "b'cinder-8cb8a075-5066-4aa2-b998-e6f022edff27-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.016s {{(pid=134148) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 18 21:06:58.873671 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-3cc326a1-0374-4524-9eda-fd3487f5870d tempest-SnapshotsActionsTest-67191287 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:07:00.032707 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.quota [None req-3cc326a1-0374-4524-9eda-fd3487f5870d tempest-SnapshotsActionsTest-67191287 None] Created reservations ['587984f2-2ee5-440d-bd26-c67d15562673', 'a7cdc7bd-6be7-4ea4-9da9-69ee38b27c29', '854e454a-52e0-41e1-adec-3817730b38da', 'cb74792e-f164-4110-8b8c-08509717429e'] {{(pid=134148) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 18 21:07:00.117190 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-3cc326a1-0374-4524-9eda-fd3487f5870d tempest-SnapshotsActionsTest-67191287 None] Delete snapshot completed successfully. Dec 18 21:07:00.125231 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.coordination [None req-3cc326a1-0374-4524-9eda-fd3487f5870d tempest-SnapshotsActionsTest-67191287 None] Lock "b'cinder-8cb8a075-5066-4aa2-b998-e6f022edff27-delete_snapshot'" released by "delete_snapshot" :: held 1.255s {{(pid=134148) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 18 21:07:01.401681 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-ef7a4177-32ce-487e-b7d0-e0eacd99f984 tempest-SnapshotsActionsTest-1099231035 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:07:02.095738 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-ef7a4177-32ce-487e-b7d0-e0eacd99f984 tempest-SnapshotsActionsTest-1099231035 None] Create snapshot completed successfully Dec 18 21:07:02.643526 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.coordination [None req-3eb52765-2d32-491d-bff6-23620f98a673 tempest-SnapshotsActionsTest-67191287 None] Lock "b'cinder-6b1be0d4-e24a-47c7-851f-ab14262f95fe-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.016s {{(pid=134148) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 18 21:07:02.647380 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-3eb52765-2d32-491d-bff6-23620f98a673 tempest-SnapshotsActionsTest-67191287 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:07:03.150450 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.quota [None req-3eb52765-2d32-491d-bff6-23620f98a673 tempest-SnapshotsActionsTest-67191287 None] Created reservations ['688ef947-bc65-4206-8816-516a4c13c2d3', '7919c6a6-fb02-476d-8f5c-92483b82c9bf', '204cd44b-9c6d-46a4-abd7-9832fd7a727a', 'f5511654-0c69-438c-8dbb-b61c812e862d'] {{(pid=134148) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 18 21:07:03.234058 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-3eb52765-2d32-491d-bff6-23620f98a673 tempest-SnapshotsActionsTest-67191287 None] Delete snapshot completed successfully. Dec 18 21:07:03.240315 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.coordination [None req-3eb52765-2d32-491d-bff6-23620f98a673 tempest-SnapshotsActionsTest-67191287 None] Lock "b'cinder-6b1be0d4-e24a-47c7-851f-ab14262f95fe-delete_snapshot'" released by "delete_snapshot" :: held 0.597s {{(pid=134148) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 18 21:07:04.236752 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.coordination [None req-c2d6e162-ff76-43d5-82f4-33fd104da4be tempest-SnapshotsActionsTest-1099231035 None] Lock "b'cinder-dc01ab4b-1b75-47f9-9479-4a519f2993af-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.012s {{(pid=134148) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 18 21:07:04.242693 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-c2d6e162-ff76-43d5-82f4-33fd104da4be tempest-SnapshotsActionsTest-1099231035 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:07:05.077067 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.quota [None req-c2d6e162-ff76-43d5-82f4-33fd104da4be tempest-SnapshotsActionsTest-1099231035 None] Created reservations ['5ec14260-a9dc-4281-a534-cc1eec4e55b4', 'beefd59f-b3d9-4a9d-add1-3940c7dc2fb2', '00390b02-65d5-4ddd-9c3c-badd7abcc706', 'febeb45c-3685-46de-8619-69835f8b17d1'] {{(pid=134148) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 18 21:07:05.185491 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-c2d6e162-ff76-43d5-82f4-33fd104da4be tempest-SnapshotsActionsTest-1099231035 None] Delete snapshot completed successfully. Dec 18 21:07:05.196721 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.coordination [None req-c2d6e162-ff76-43d5-82f4-33fd104da4be tempest-SnapshotsActionsTest-1099231035 None] Lock "b'cinder-dc01ab4b-1b75-47f9-9479-4a519f2993af-delete_snapshot'" released by "delete_snapshot" :: held 0.964s {{(pid=134148) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 18 21:07:05.398598 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.coordination [None req-b944344b-069c-442c-9d79-a30328639d11 tempest-SnapshotsActionsTest-1099231035 None] Lock "b'cinder-54c0b51f-5477-42ea-b9b3-2e49f5ea9545-delete_volume'" acquired by "delete_volume" :: waited 0.020s {{(pid=134148) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 18 21:07:05.514511 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-b944344b-069c-442c-9d79-a30328639d11 tempest-SnapshotsActionsTest-1099231035 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:07:05.632487 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-b944344b-069c-442c-9d79-a30328639d11 tempest-SnapshotsActionsTest-1099231035 None] volume has no backup snaps {{(pid=134148) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Dec 18 21:07:05.633379 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-b944344b-069c-442c-9d79-a30328639d11 tempest-SnapshotsActionsTest-1099231035 None] Volume volume-54c0b51f-5477-42ea-b9b3-2e49f5ea9545 is not a clone. {{(pid=134148) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Dec 18 21:07:05.643382 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-b944344b-069c-442c-9d79-a30328639d11 tempest-SnapshotsActionsTest-1099231035 None] deleting rbd volume volume-54c0b51f-5477-42ea-b9b3-2e49f5ea9545 {{(pid=134148) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Dec 18 21:07:05.992908 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.quota [None req-b944344b-069c-442c-9d79-a30328639d11 tempest-SnapshotsActionsTest-1099231035 None] Created reservations ['cc218f6e-705d-43a5-b2d0-a193a83cf854', 'f726bdca-50ed-4a25-808f-56535278a05d', '48f3c442-af76-4193-bfef-133d8038dc17', 'e209daa9-c753-4956-8b71-e2734be01cae'] {{(pid=134148) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 18 21:07:06.088440 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-b944344b-069c-442c-9d79-a30328639d11 tempest-SnapshotsActionsTest-1099231035 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:07:06.166041 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-b944344b-069c-442c-9d79-a30328639d11 tempest-SnapshotsActionsTest-1099231035 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:07:06.206837 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.manager [None req-b944344b-069c-442c-9d79-a30328639d11 tempest-SnapshotsActionsTest-1099231035 None] Notifying Schedulers of capabilities ... {{(pid=134148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 18 21:07:06.221266 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-b944344b-069c-442c-9d79-a30328639d11 tempest-SnapshotsActionsTest-1099231035 None] Deleted volume successfully. Dec 18 21:07:06.239370 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.coordination [None req-b944344b-069c-442c-9d79-a30328639d11 tempest-SnapshotsActionsTest-1099231035 None] Lock "b'cinder-54c0b51f-5477-42ea-b9b3-2e49f5ea9545-delete_volume'" released by "delete_volume" :: held 0.841s {{(pid=134148) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 18 21:07:23.737797 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.flows.manager.create_volume [None req-a21d01a5-0d78-458c-b466-f6c9822a4f50 tempest-VolumesListAdminTestJSON-426575821 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134148) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Dec 18 21:07:23.752844 ncdv-master-1 cinder-volume[134148]: WARNING stevedore.named [None req-a21d01a5-0d78-458c-b466-f6c9822a4f50 tempest-VolumesListAdminTestJSON-426575821 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Dec 18 21:07:23.758286 ncdv-master-1 cinder-volume[134148]: WARNING castellan.key_manager [None req-a21d01a5-0d78-458c-b466-f6c9822a4f50 tempest-VolumesListAdminTestJSON-426575821 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Dec 18 21:07:23.807181 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-a21d01a5-0d78-458c-b466-f6c9822a4f50 tempest-VolumesListAdminTestJSON-426575821 None] Flow 'volume_create_manager' (bf800a4d-a7ae-4dfb-8f06-e28700c201f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 18 21:07:23.816839 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-a21d01a5-0d78-458c-b466-f6c9822a4f50 tempest-VolumesListAdminTestJSON-426575821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d82aa851-2b43-42a1-92ad-bc97ad7fdbbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:07:23.827422 ncdv-master-1 cinder-volume[134148]: DEBUG oslo_db.sqlalchemy.engines [None req-a21d01a5-0d78-458c-b466-f6c9822a4f50 tempest-VolumesListAdminTestJSON-426575821 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134148) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 18 21:07:23.854047 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-a21d01a5-0d78-458c-b466-f6c9822a4f50 tempest-VolumesListAdminTestJSON-426575821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d82aa851-2b43-42a1-92ad-bc97ad7fdbbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-12-18T21:07:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-22736358',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=b628a8b0-f3cb-44e6-9705-2cf5180377aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e339ef82bc39461dabd675419b8e591c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-12-18T21:07:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-12-18T21:07:24Z,use_quota=True,user_id='a8e583ad9fc14e4d81ebbf714f89f56b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f2e1fe1-9fd6-411e-9ed9-368f463ccb6f),volume_type_id=1f2e1fe1-9fd6-411e-9ed9-368f463ccb6f)' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:07:23.856961 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-a21d01a5-0d78-458c-b466-f6c9822a4f50 tempest-VolumesListAdminTestJSON-426575821 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (daa6634c-c26c-4c04-a383-f0600fcd7804) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:07:23.871564 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-a21d01a5-0d78-458c-b466-f6c9822a4f50 tempest-VolumesListAdminTestJSON-426575821 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (daa6634c-c26c-4c04-a383-f0600fcd7804) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:07:23.874167 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-a21d01a5-0d78-458c-b466-f6c9822a4f50 tempest-VolumesListAdminTestJSON-426575821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84002cf3-7070-453c-92fd-1e8b25f48aec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:07:23.885304 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-a21d01a5-0d78-458c-b466-f6c9822a4f50 tempest-VolumesListAdminTestJSON-426575821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84002cf3-7070-453c-92fd-1e8b25f48aec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b628a8b0-f3cb-44e6-9705-2cf5180377aa', 'volume_name': 'volume-b628a8b0-f3cb-44e6-9705-2cf5180377aa', 'volume_size': 1}' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:07:23.887851 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-a21d01a5-0d78-458c-b466-f6c9822a4f50 tempest-VolumesListAdminTestJSON-426575821 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4259ad6f-07a9-430e-abed-30e797f3bb07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:07:23.896638 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-a21d01a5-0d78-458c-b466-f6c9822a4f50 tempest-VolumesListAdminTestJSON-426575821 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4259ad6f-07a9-430e-abed-30e797f3bb07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:07:23.899362 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-a21d01a5-0d78-458c-b466-f6c9822a4f50 tempest-VolumesListAdminTestJSON-426575821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (684167d0-3216-4d45-adfe-69d96a11414d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:07:23.900089 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.flows.manager.create_volume [None req-a21d01a5-0d78-458c-b466-f6c9822a4f50 tempest-VolumesListAdminTestJSON-426575821 None] Volume b628a8b0-f3cb-44e6-9705-2cf5180377aa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b628a8b0-f3cb-44e6-9705-2cf5180377aa', 'volume_size': 1} Dec 18 21:07:23.900435 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-a21d01a5-0d78-458c-b466-f6c9822a4f50 tempest-VolumesListAdminTestJSON-426575821 None] creating volume 'volume-b628a8b0-f3cb-44e6-9705-2cf5180377aa' {{(pid=134148) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Dec 18 21:07:23.911116 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-a21d01a5-0d78-458c-b466-f6c9822a4f50 tempest-VolumesListAdminTestJSON-426575821 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:07:24.035592 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-a21d01a5-0d78-458c-b466-f6c9822a4f50 tempest-VolumesListAdminTestJSON-426575821 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134148) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 18 21:07:24.036151 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-a21d01a5-0d78-458c-b466-f6c9822a4f50 tempest-VolumesListAdminTestJSON-426575821 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134148) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 18 21:07:24.038420 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-a21d01a5-0d78-458c-b466-f6c9822a4f50 tempest-VolumesListAdminTestJSON-426575821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (684167d0-3216-4d45-adfe-69d96a11414d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b628a8b0-f3cb-44e6-9705-2cf5180377aa', 'volume_size': 1}' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:07:24.040875 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-a21d01a5-0d78-458c-b466-f6c9822a4f50 tempest-VolumesListAdminTestJSON-426575821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37628c28-4276-49ec-b5a6-24d3b437dd22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:07:24.053388 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.flows.manager.create_volume [None req-a21d01a5-0d78-458c-b466-f6c9822a4f50 tempest-VolumesListAdminTestJSON-426575821 None] Volume volume-b628a8b0-f3cb-44e6-9705-2cf5180377aa (b628a8b0-f3cb-44e6-9705-2cf5180377aa): created successfully Dec 18 21:07:24.055528 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-a21d01a5-0d78-458c-b466-f6c9822a4f50 tempest-VolumesListAdminTestJSON-426575821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37628c28-4276-49ec-b5a6-24d3b437dd22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:07:24.058907 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-a21d01a5-0d78-458c-b466-f6c9822a4f50 tempest-VolumesListAdminTestJSON-426575821 None] Flow 'volume_create_manager' (bf800a4d-a7ae-4dfb-8f06-e28700c201f6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134148) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 18 21:07:24.076953 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-a21d01a5-0d78-458c-b466-f6c9822a4f50 tempest-VolumesListAdminTestJSON-426575821 None] Created volume successfully. Dec 18 21:07:25.454169 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.flows.manager.create_volume [None req-8f7a6216-b82f-4982-a4a1-24a92a1a0d47 tempest-VolumesListAdminTestJSON-426575821 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134148) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Dec 18 21:07:25.457611 ncdv-master-1 cinder-volume[134148]: WARNING stevedore.named [None req-8f7a6216-b82f-4982-a4a1-24a92a1a0d47 tempest-VolumesListAdminTestJSON-426575821 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Dec 18 21:07:25.458047 ncdv-master-1 cinder-volume[134148]: WARNING castellan.key_manager [None req-8f7a6216-b82f-4982-a4a1-24a92a1a0d47 tempest-VolumesListAdminTestJSON-426575821 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Dec 18 21:07:25.512617 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-8f7a6216-b82f-4982-a4a1-24a92a1a0d47 tempest-VolumesListAdminTestJSON-426575821 None] Flow 'volume_create_manager' (94f9c4f6-183a-4821-bedf-410e1fbc0804) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 18 21:07:25.550757 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-8f7a6216-b82f-4982-a4a1-24a92a1a0d47 tempest-VolumesListAdminTestJSON-426575821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c14ada11-1f6a-4564-9deb-1344c27bfaa6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:07:25.570299 ncdv-master-1 cinder-volume[134148]: DEBUG oslo_db.sqlalchemy.engines [None req-8f7a6216-b82f-4982-a4a1-24a92a1a0d47 tempest-VolumesListAdminTestJSON-426575821 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134148) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 18 21:07:25.607896 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-8f7a6216-b82f-4982-a4a1-24a92a1a0d47 tempest-VolumesListAdminTestJSON-426575821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c14ada11-1f6a-4564-9deb-1344c27bfaa6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-12-18T21:07:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-806059948',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=209db7ef-d8ce-4ee5-8d98-34621dd9841c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e339ef82bc39461dabd675419b8e591c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-12-18T21:07:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-12-18T21:07:25Z,use_quota=True,user_id='a8e583ad9fc14e4d81ebbf714f89f56b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f2e1fe1-9fd6-411e-9ed9-368f463ccb6f),volume_type_id=1f2e1fe1-9fd6-411e-9ed9-368f463ccb6f)' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:07:25.610905 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-8f7a6216-b82f-4982-a4a1-24a92a1a0d47 tempest-VolumesListAdminTestJSON-426575821 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9bd6ea3b-f4c0-44af-8ace-450e67b0658c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:07:25.613505 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-8f7a6216-b82f-4982-a4a1-24a92a1a0d47 tempest-VolumesListAdminTestJSON-426575821 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9bd6ea3b-f4c0-44af-8ace-450e67b0658c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:07:25.616498 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-8f7a6216-b82f-4982-a4a1-24a92a1a0d47 tempest-VolumesListAdminTestJSON-426575821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3657494-7a05-40aa-9a94-76dc97bb6271) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:07:25.619074 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-8f7a6216-b82f-4982-a4a1-24a92a1a0d47 tempest-VolumesListAdminTestJSON-426575821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3657494-7a05-40aa-9a94-76dc97bb6271) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '209db7ef-d8ce-4ee5-8d98-34621dd9841c', 'volume_name': 'volume-209db7ef-d8ce-4ee5-8d98-34621dd9841c', 'volume_size': 1}' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:07:25.643181 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-8f7a6216-b82f-4982-a4a1-24a92a1a0d47 tempest-VolumesListAdminTestJSON-426575821 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ecb8caa-3934-4d8d-9bd8-934f1609813a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:07:25.645929 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-8f7a6216-b82f-4982-a4a1-24a92a1a0d47 tempest-VolumesListAdminTestJSON-426575821 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ecb8caa-3934-4d8d-9bd8-934f1609813a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:07:25.648488 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-8f7a6216-b82f-4982-a4a1-24a92a1a0d47 tempest-VolumesListAdminTestJSON-426575821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9843a1b-cb56-4b1c-b129-ab2ee8acbd78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:07:25.653633 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.flows.manager.create_volume [None req-8f7a6216-b82f-4982-a4a1-24a92a1a0d47 tempest-VolumesListAdminTestJSON-426575821 None] Volume 209db7ef-d8ce-4ee5-8d98-34621dd9841c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-209db7ef-d8ce-4ee5-8d98-34621dd9841c', 'volume_size': 1} Dec 18 21:07:25.654740 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-8f7a6216-b82f-4982-a4a1-24a92a1a0d47 tempest-VolumesListAdminTestJSON-426575821 None] creating volume 'volume-209db7ef-d8ce-4ee5-8d98-34621dd9841c' {{(pid=134148) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Dec 18 21:07:25.656620 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-8f7a6216-b82f-4982-a4a1-24a92a1a0d47 tempest-VolumesListAdminTestJSON-426575821 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:07:25.823186 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-8f7a6216-b82f-4982-a4a1-24a92a1a0d47 tempest-VolumesListAdminTestJSON-426575821 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134148) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 18 21:07:25.823575 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-8f7a6216-b82f-4982-a4a1-24a92a1a0d47 tempest-VolumesListAdminTestJSON-426575821 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134148) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 18 21:07:25.826841 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-8f7a6216-b82f-4982-a4a1-24a92a1a0d47 tempest-VolumesListAdminTestJSON-426575821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9843a1b-cb56-4b1c-b129-ab2ee8acbd78) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-209db7ef-d8ce-4ee5-8d98-34621dd9841c', 'volume_size': 1}' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:07:25.829543 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-8f7a6216-b82f-4982-a4a1-24a92a1a0d47 tempest-VolumesListAdminTestJSON-426575821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d48f36d-5a9e-46c8-b5e1-cb6e680bc448) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:07:25.850208 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.flows.manager.create_volume [None req-8f7a6216-b82f-4982-a4a1-24a92a1a0d47 tempest-VolumesListAdminTestJSON-426575821 None] Volume volume-209db7ef-d8ce-4ee5-8d98-34621dd9841c (209db7ef-d8ce-4ee5-8d98-34621dd9841c): created successfully Dec 18 21:07:25.852768 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-8f7a6216-b82f-4982-a4a1-24a92a1a0d47 tempest-VolumesListAdminTestJSON-426575821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d48f36d-5a9e-46c8-b5e1-cb6e680bc448) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:07:25.858963 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-8f7a6216-b82f-4982-a4a1-24a92a1a0d47 tempest-VolumesListAdminTestJSON-426575821 None] Flow 'volume_create_manager' (94f9c4f6-183a-4821-bedf-410e1fbc0804) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134148) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 18 21:07:25.869537 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-8f7a6216-b82f-4982-a4a1-24a92a1a0d47 tempest-VolumesListAdminTestJSON-426575821 None] Created volume successfully. Dec 18 21:07:27.212547 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.flows.manager.create_volume [None req-048b8f3d-ca13-4a63-91d9-295295561b19 tempest-VolumesListAdminTestJSON-426575821 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134148) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Dec 18 21:07:27.224808 ncdv-master-1 cinder-volume[134148]: WARNING stevedore.named [None req-048b8f3d-ca13-4a63-91d9-295295561b19 tempest-VolumesListAdminTestJSON-426575821 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Dec 18 21:07:27.224808 ncdv-master-1 cinder-volume[134148]: WARNING castellan.key_manager [None req-048b8f3d-ca13-4a63-91d9-295295561b19 tempest-VolumesListAdminTestJSON-426575821 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Dec 18 21:07:27.262455 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-048b8f3d-ca13-4a63-91d9-295295561b19 tempest-VolumesListAdminTestJSON-426575821 None] Flow 'volume_create_manager' (40949fab-a492-499e-89ad-5d730549f744) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 18 21:07:27.272071 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-048b8f3d-ca13-4a63-91d9-295295561b19 tempest-VolumesListAdminTestJSON-426575821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5bb23a93-488c-4089-8e10-e539464e0b22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:07:27.283013 ncdv-master-1 cinder-volume[134148]: DEBUG oslo_db.sqlalchemy.engines [None req-048b8f3d-ca13-4a63-91d9-295295561b19 tempest-VolumesListAdminTestJSON-426575821 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134148) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 18 21:07:27.299759 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-048b8f3d-ca13-4a63-91d9-295295561b19 tempest-VolumesListAdminTestJSON-426575821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5bb23a93-488c-4089-8e10-e539464e0b22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-12-18T21:07:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-532882334',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=6518a0a6-6c58-49eb-b684-57d18177cfaf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e339ef82bc39461dabd675419b8e591c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-12-18T21:07:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-12-18T21:07:27Z,use_quota=True,user_id='a8e583ad9fc14e4d81ebbf714f89f56b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f2e1fe1-9fd6-411e-9ed9-368f463ccb6f),volume_type_id=1f2e1fe1-9fd6-411e-9ed9-368f463ccb6f)' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:07:27.303666 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-048b8f3d-ca13-4a63-91d9-295295561b19 tempest-VolumesListAdminTestJSON-426575821 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9808db02-895e-44d4-a523-0bcd3fc42430) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:07:27.307325 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-048b8f3d-ca13-4a63-91d9-295295561b19 tempest-VolumesListAdminTestJSON-426575821 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9808db02-895e-44d4-a523-0bcd3fc42430) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:07:27.312445 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-048b8f3d-ca13-4a63-91d9-295295561b19 tempest-VolumesListAdminTestJSON-426575821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ede4bd4-1507-4f4b-b3bd-3257d8d67df7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:07:27.315883 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-048b8f3d-ca13-4a63-91d9-295295561b19 tempest-VolumesListAdminTestJSON-426575821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ede4bd4-1507-4f4b-b3bd-3257d8d67df7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6518a0a6-6c58-49eb-b684-57d18177cfaf', 'volume_name': 'volume-6518a0a6-6c58-49eb-b684-57d18177cfaf', 'volume_size': 1}' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:07:27.321179 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-048b8f3d-ca13-4a63-91d9-295295561b19 tempest-VolumesListAdminTestJSON-426575821 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87a0392d-0c8b-488b-84dc-aa6c02f1b870) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:07:27.326618 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-048b8f3d-ca13-4a63-91d9-295295561b19 tempest-VolumesListAdminTestJSON-426575821 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87a0392d-0c8b-488b-84dc-aa6c02f1b870) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:07:27.333576 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-048b8f3d-ca13-4a63-91d9-295295561b19 tempest-VolumesListAdminTestJSON-426575821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (901b5c02-db43-4907-8826-9038b4101931) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:07:27.337446 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.flows.manager.create_volume [None req-048b8f3d-ca13-4a63-91d9-295295561b19 tempest-VolumesListAdminTestJSON-426575821 None] Volume 6518a0a6-6c58-49eb-b684-57d18177cfaf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6518a0a6-6c58-49eb-b684-57d18177cfaf', 'volume_size': 1} Dec 18 21:07:27.337446 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-048b8f3d-ca13-4a63-91d9-295295561b19 tempest-VolumesListAdminTestJSON-426575821 None] creating volume 'volume-6518a0a6-6c58-49eb-b684-57d18177cfaf' {{(pid=134148) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Dec 18 21:07:27.337446 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-048b8f3d-ca13-4a63-91d9-295295561b19 tempest-VolumesListAdminTestJSON-426575821 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:07:27.513764 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-048b8f3d-ca13-4a63-91d9-295295561b19 tempest-VolumesListAdminTestJSON-426575821 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134148) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 18 21:07:27.514160 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-048b8f3d-ca13-4a63-91d9-295295561b19 tempest-VolumesListAdminTestJSON-426575821 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134148) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 18 21:07:27.516563 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-048b8f3d-ca13-4a63-91d9-295295561b19 tempest-VolumesListAdminTestJSON-426575821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (901b5c02-db43-4907-8826-9038b4101931) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6518a0a6-6c58-49eb-b684-57d18177cfaf', 'volume_size': 1}' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:07:27.522694 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-048b8f3d-ca13-4a63-91d9-295295561b19 tempest-VolumesListAdminTestJSON-426575821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5b681fa-e961-4b58-a6c6-30a6f3938d53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:07:27.545442 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.flows.manager.create_volume [None req-048b8f3d-ca13-4a63-91d9-295295561b19 tempest-VolumesListAdminTestJSON-426575821 None] Volume volume-6518a0a6-6c58-49eb-b684-57d18177cfaf (6518a0a6-6c58-49eb-b684-57d18177cfaf): created successfully Dec 18 21:07:27.549790 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-048b8f3d-ca13-4a63-91d9-295295561b19 tempest-VolumesListAdminTestJSON-426575821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5b681fa-e961-4b58-a6c6-30a6f3938d53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:07:27.577440 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-048b8f3d-ca13-4a63-91d9-295295561b19 tempest-VolumesListAdminTestJSON-426575821 None] Flow 'volume_create_manager' (40949fab-a492-499e-89ad-5d730549f744) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134148) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 18 21:07:27.606435 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-048b8f3d-ca13-4a63-91d9-295295561b19 tempest-VolumesListAdminTestJSON-426575821 None] Created volume successfully. Dec 18 21:07:29.079266 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.flows.manager.create_volume [None req-aa4731c7-38e4-44b9-bd13-1965b782455b tempest-VolumesListAdminTestJSON-171257594 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134148) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Dec 18 21:07:29.090658 ncdv-master-1 cinder-volume[134148]: WARNING stevedore.named [None req-aa4731c7-38e4-44b9-bd13-1965b782455b tempest-VolumesListAdminTestJSON-171257594 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Dec 18 21:07:29.093145 ncdv-master-1 cinder-volume[134148]: WARNING castellan.key_manager [None req-aa4731c7-38e4-44b9-bd13-1965b782455b tempest-VolumesListAdminTestJSON-171257594 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Dec 18 21:07:29.123714 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-aa4731c7-38e4-44b9-bd13-1965b782455b tempest-VolumesListAdminTestJSON-171257594 None] Flow 'volume_create_manager' (c5317639-dfd4-46db-a0c0-7153b49c418a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 18 21:07:29.133420 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-aa4731c7-38e4-44b9-bd13-1965b782455b tempest-VolumesListAdminTestJSON-171257594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d71e899-d40b-429e-bd74-8367376bcf44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:07:29.148039 ncdv-master-1 cinder-volume[134148]: DEBUG oslo_db.sqlalchemy.engines [None req-aa4731c7-38e4-44b9-bd13-1965b782455b tempest-VolumesListAdminTestJSON-171257594 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134148) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 18 21:07:29.166691 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-aa4731c7-38e4-44b9-bd13-1965b782455b tempest-VolumesListAdminTestJSON-171257594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d71e899-d40b-429e-bd74-8367376bcf44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-12-18T21:07:29Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=35282049-8155-43e1-9024-aea1de519270,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e9441fe30504435180b744da14d9da33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-12-18T21:07:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-12-18T21:07:29Z,use_quota=True,user_id='1a1270bfab5448e297212c7edce096ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f2e1fe1-9fd6-411e-9ed9-368f463ccb6f),volume_type_id=1f2e1fe1-9fd6-411e-9ed9-368f463ccb6f)' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:07:29.169898 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-aa4731c7-38e4-44b9-bd13-1965b782455b tempest-VolumesListAdminTestJSON-171257594 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c34db4b7-548e-4c82-9619-5140ad670c39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:07:29.174592 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-aa4731c7-38e4-44b9-bd13-1965b782455b tempest-VolumesListAdminTestJSON-171257594 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c34db4b7-548e-4c82-9619-5140ad670c39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:07:29.177221 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-aa4731c7-38e4-44b9-bd13-1965b782455b tempest-VolumesListAdminTestJSON-171257594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3a496aa-e29d-48df-8270-b0a8b329cfbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:07:29.181924 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-aa4731c7-38e4-44b9-bd13-1965b782455b tempest-VolumesListAdminTestJSON-171257594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3a496aa-e29d-48df-8270-b0a8b329cfbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '35282049-8155-43e1-9024-aea1de519270', 'volume_name': 'volume-35282049-8155-43e1-9024-aea1de519270', 'volume_size': 1}' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:07:29.185852 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-aa4731c7-38e4-44b9-bd13-1965b782455b tempest-VolumesListAdminTestJSON-171257594 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57290291-b3a1-44ae-806b-4199da690eac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:07:29.189194 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-aa4731c7-38e4-44b9-bd13-1965b782455b tempest-VolumesListAdminTestJSON-171257594 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57290291-b3a1-44ae-806b-4199da690eac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:07:29.191867 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-aa4731c7-38e4-44b9-bd13-1965b782455b tempest-VolumesListAdminTestJSON-171257594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3bbd87a-34e2-48ed-8a93-fed05ca3147b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:07:29.193121 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.flows.manager.create_volume [None req-aa4731c7-38e4-44b9-bd13-1965b782455b tempest-VolumesListAdminTestJSON-171257594 None] Volume 35282049-8155-43e1-9024-aea1de519270: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-35282049-8155-43e1-9024-aea1de519270', 'volume_size': 1} Dec 18 21:07:29.193989 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-aa4731c7-38e4-44b9-bd13-1965b782455b tempest-VolumesListAdminTestJSON-171257594 None] creating volume 'volume-35282049-8155-43e1-9024-aea1de519270' {{(pid=134148) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Dec 18 21:07:29.195359 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-aa4731c7-38e4-44b9-bd13-1965b782455b tempest-VolumesListAdminTestJSON-171257594 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:07:29.292328 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-aa4731c7-38e4-44b9-bd13-1965b782455b tempest-VolumesListAdminTestJSON-171257594 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134148) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 18 21:07:29.292999 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-aa4731c7-38e4-44b9-bd13-1965b782455b tempest-VolumesListAdminTestJSON-171257594 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134148) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 18 21:07:29.295502 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-aa4731c7-38e4-44b9-bd13-1965b782455b tempest-VolumesListAdminTestJSON-171257594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3bbd87a-34e2-48ed-8a93-fed05ca3147b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-35282049-8155-43e1-9024-aea1de519270', 'volume_size': 1}' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:07:29.298723 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-aa4731c7-38e4-44b9-bd13-1965b782455b tempest-VolumesListAdminTestJSON-171257594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7aabe47-6e27-453a-b99b-14f3f32d7a02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:07:29.311059 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.flows.manager.create_volume [None req-aa4731c7-38e4-44b9-bd13-1965b782455b tempest-VolumesListAdminTestJSON-171257594 None] Volume volume-35282049-8155-43e1-9024-aea1de519270 (35282049-8155-43e1-9024-aea1de519270): created successfully Dec 18 21:07:29.314357 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-aa4731c7-38e4-44b9-bd13-1965b782455b tempest-VolumesListAdminTestJSON-171257594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7aabe47-6e27-453a-b99b-14f3f32d7a02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:07:29.319713 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-aa4731c7-38e4-44b9-bd13-1965b782455b tempest-VolumesListAdminTestJSON-171257594 None] Flow 'volume_create_manager' (c5317639-dfd4-46db-a0c0-7153b49c418a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134148) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 18 21:07:29.329637 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-aa4731c7-38e4-44b9-bd13-1965b782455b tempest-VolumesListAdminTestJSON-171257594 None] Created volume successfully. Dec 18 21:07:30.173205 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.coordination [None req-15bc579b-3ee0-4a43-97a1-670709a0c4ea tempest-VolumesListAdminTestJSON-171257594 None] Lock "b'cinder-35282049-8155-43e1-9024-aea1de519270-delete_volume'" acquired by "delete_volume" :: waited 0.023s {{(pid=134148) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 18 21:07:30.254738 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-15bc579b-3ee0-4a43-97a1-670709a0c4ea tempest-VolumesListAdminTestJSON-171257594 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:07:30.349084 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-15bc579b-3ee0-4a43-97a1-670709a0c4ea tempest-VolumesListAdminTestJSON-171257594 None] volume has no backup snaps {{(pid=134148) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Dec 18 21:07:30.349513 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-15bc579b-3ee0-4a43-97a1-670709a0c4ea tempest-VolumesListAdminTestJSON-171257594 None] Volume volume-35282049-8155-43e1-9024-aea1de519270 is not a clone. {{(pid=134148) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Dec 18 21:07:30.363967 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-15bc579b-3ee0-4a43-97a1-670709a0c4ea tempest-VolumesListAdminTestJSON-171257594 None] deleting rbd volume volume-35282049-8155-43e1-9024-aea1de519270 {{(pid=134148) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Dec 18 21:07:30.405888 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.coordination [None req-e22ebabe-bdcf-4f7f-8e66-56c2d81d87b7 tempest-VolumesListAdminTestJSON-426575821 None] Lock "b'cinder-6518a0a6-6c58-49eb-b684-57d18177cfaf-delete_volume'" acquired by "delete_volume" :: waited 0.037s {{(pid=134148) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 18 21:07:30.538456 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-e22ebabe-bdcf-4f7f-8e66-56c2d81d87b7 tempest-VolumesListAdminTestJSON-426575821 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:07:30.682051 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-e22ebabe-bdcf-4f7f-8e66-56c2d81d87b7 tempest-VolumesListAdminTestJSON-426575821 None] volume has no backup snaps {{(pid=134148) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Dec 18 21:07:30.682489 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-e22ebabe-bdcf-4f7f-8e66-56c2d81d87b7 tempest-VolumesListAdminTestJSON-426575821 None] Volume volume-6518a0a6-6c58-49eb-b684-57d18177cfaf is not a clone. {{(pid=134148) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Dec 18 21:07:30.707659 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-e22ebabe-bdcf-4f7f-8e66-56c2d81d87b7 tempest-VolumesListAdminTestJSON-426575821 None] deleting rbd volume volume-6518a0a6-6c58-49eb-b684-57d18177cfaf {{(pid=134148) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Dec 18 21:07:30.962414 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.quota [None req-15bc579b-3ee0-4a43-97a1-670709a0c4ea tempest-VolumesListAdminTestJSON-171257594 None] Created reservations ['0a0f337d-c233-46e5-b134-5f21b407a572', '01f82937-bb7e-4f52-af4f-f552297f07af', 'fd32f660-bb06-4362-b6ed-e5a7c99bcc42', 'e99d535b-c454-4e7e-912d-0eb122c4ce2f'] {{(pid=134148) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 18 21:07:31.059586 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-15bc579b-3ee0-4a43-97a1-670709a0c4ea tempest-VolumesListAdminTestJSON-171257594 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:07:31.116118 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-15bc579b-3ee0-4a43-97a1-670709a0c4ea tempest-VolumesListAdminTestJSON-171257594 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:07:31.181607 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.manager [None req-15bc579b-3ee0-4a43-97a1-670709a0c4ea tempest-VolumesListAdminTestJSON-171257594 None] Notifying Schedulers of capabilities ... {{(pid=134148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 18 21:07:31.191634 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-15bc579b-3ee0-4a43-97a1-670709a0c4ea tempest-VolumesListAdminTestJSON-171257594 None] Deleted volume successfully. Dec 18 21:07:31.224475 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.coordination [None req-15bc579b-3ee0-4a43-97a1-670709a0c4ea tempest-VolumesListAdminTestJSON-171257594 None] Lock "b'cinder-35282049-8155-43e1-9024-aea1de519270-delete_volume'" released by "delete_volume" :: held 1.051s {{(pid=134148) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 18 21:07:31.303200 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.quota [None req-e22ebabe-bdcf-4f7f-8e66-56c2d81d87b7 tempest-VolumesListAdminTestJSON-426575821 None] Created reservations ['5a98b4d1-7bff-4a27-beb2-d0dab8d847dd', '4fc94b13-19cd-4f25-90de-c2ce18b1ed73', '8064b879-20ce-4799-b5c5-ec3d22f63acc', '3cc5634a-a163-411b-8264-78feb7c99808'] {{(pid=134148) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 18 21:07:31.383790 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-e22ebabe-bdcf-4f7f-8e66-56c2d81d87b7 tempest-VolumesListAdminTestJSON-426575821 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:07:31.466992 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-e22ebabe-bdcf-4f7f-8e66-56c2d81d87b7 tempest-VolumesListAdminTestJSON-426575821 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:07:31.542339 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.manager [None req-e22ebabe-bdcf-4f7f-8e66-56c2d81d87b7 tempest-VolumesListAdminTestJSON-426575821 None] Notifying Schedulers of capabilities ... {{(pid=134148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 18 21:07:31.562009 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-e22ebabe-bdcf-4f7f-8e66-56c2d81d87b7 tempest-VolumesListAdminTestJSON-426575821 None] Deleted volume successfully. Dec 18 21:07:31.599250 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.coordination [None req-c9bd58a3-7314-41a4-b57e-ba00fed60e7b tempest-VolumesListAdminTestJSON-426575821 None] Lock "b'cinder-209db7ef-d8ce-4ee5-8d98-34621dd9841c-delete_volume'" acquired by "delete_volume" :: waited 0.039s {{(pid=134148) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 18 21:07:31.635731 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-c9bd58a3-7314-41a4-b57e-ba00fed60e7b tempest-VolumesListAdminTestJSON-426575821 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:07:31.698563 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-c9bd58a3-7314-41a4-b57e-ba00fed60e7b tempest-VolumesListAdminTestJSON-426575821 None] volume has no backup snaps {{(pid=134148) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Dec 18 21:07:31.698994 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-c9bd58a3-7314-41a4-b57e-ba00fed60e7b tempest-VolumesListAdminTestJSON-426575821 None] Volume volume-209db7ef-d8ce-4ee5-8d98-34621dd9841c is not a clone. {{(pid=134148) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Dec 18 21:07:31.709718 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-c9bd58a3-7314-41a4-b57e-ba00fed60e7b tempest-VolumesListAdminTestJSON-426575821 None] deleting rbd volume volume-209db7ef-d8ce-4ee5-8d98-34621dd9841c {{(pid=134148) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Dec 18 21:07:31.714310 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.coordination [None req-e22ebabe-bdcf-4f7f-8e66-56c2d81d87b7 tempest-VolumesListAdminTestJSON-426575821 None] Lock "b'cinder-6518a0a6-6c58-49eb-b684-57d18177cfaf-delete_volume'" released by "delete_volume" :: held 1.306s {{(pid=134148) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 18 21:07:32.072976 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.quota [None req-c9bd58a3-7314-41a4-b57e-ba00fed60e7b tempest-VolumesListAdminTestJSON-426575821 None] Created reservations ['875de2db-bf0d-4123-a212-b6a65c286832', 'c9ebb966-cf7a-4ad4-a920-ced285edcac3', '159db0d7-5e9d-42d7-9be1-365ac27bc132', 'a41ce1b3-d236-41f4-8c45-43e7d2bde24e'] {{(pid=134148) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 18 21:07:32.142476 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-c9bd58a3-7314-41a4-b57e-ba00fed60e7b tempest-VolumesListAdminTestJSON-426575821 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:07:32.199753 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-c9bd58a3-7314-41a4-b57e-ba00fed60e7b tempest-VolumesListAdminTestJSON-426575821 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:07:32.254054 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.manager [None req-c9bd58a3-7314-41a4-b57e-ba00fed60e7b tempest-VolumesListAdminTestJSON-426575821 None] Notifying Schedulers of capabilities ... {{(pid=134148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 18 21:07:32.259227 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-c9bd58a3-7314-41a4-b57e-ba00fed60e7b tempest-VolumesListAdminTestJSON-426575821 None] Deleted volume successfully. Dec 18 21:07:32.277159 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.coordination [None req-c9bd58a3-7314-41a4-b57e-ba00fed60e7b tempest-VolumesListAdminTestJSON-426575821 None] Lock "b'cinder-209db7ef-d8ce-4ee5-8d98-34621dd9841c-delete_volume'" released by "delete_volume" :: held 0.678s {{(pid=134148) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 18 21:07:32.752482 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.coordination [None req-496b5c08-4dea-4c19-b21d-fd1d4182116f tempest-VolumesListAdminTestJSON-426575821 None] Lock "b'cinder-b628a8b0-f3cb-44e6-9705-2cf5180377aa-delete_volume'" acquired by "delete_volume" :: waited 0.022s {{(pid=134148) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 18 21:07:32.810151 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-496b5c08-4dea-4c19-b21d-fd1d4182116f tempest-VolumesListAdminTestJSON-426575821 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:07:32.870348 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-496b5c08-4dea-4c19-b21d-fd1d4182116f tempest-VolumesListAdminTestJSON-426575821 None] volume has no backup snaps {{(pid=134148) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Dec 18 21:07:32.870778 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-496b5c08-4dea-4c19-b21d-fd1d4182116f tempest-VolumesListAdminTestJSON-426575821 None] Volume volume-b628a8b0-f3cb-44e6-9705-2cf5180377aa is not a clone. {{(pid=134148) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Dec 18 21:07:32.880239 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-496b5c08-4dea-4c19-b21d-fd1d4182116f tempest-VolumesListAdminTestJSON-426575821 None] deleting rbd volume volume-b628a8b0-f3cb-44e6-9705-2cf5180377aa {{(pid=134148) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Dec 18 21:07:33.261043 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.quota [None req-496b5c08-4dea-4c19-b21d-fd1d4182116f tempest-VolumesListAdminTestJSON-426575821 None] Created reservations ['98b77303-b847-4e7f-9b92-ba5541667782', '915baff2-9bef-4e47-b1f4-c445500e4775', '6ed230ee-3153-4b4f-8808-dedaaa8b2ee2', 'ab6869ff-01f9-46bf-a54f-2490614533f9'] {{(pid=134148) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 18 21:07:33.348564 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-496b5c08-4dea-4c19-b21d-fd1d4182116f tempest-VolumesListAdminTestJSON-426575821 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:07:33.404569 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-496b5c08-4dea-4c19-b21d-fd1d4182116f tempest-VolumesListAdminTestJSON-426575821 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:07:33.459918 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.manager [None req-496b5c08-4dea-4c19-b21d-fd1d4182116f tempest-VolumesListAdminTestJSON-426575821 None] Notifying Schedulers of capabilities ... {{(pid=134148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 18 21:07:33.465155 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-496b5c08-4dea-4c19-b21d-fd1d4182116f tempest-VolumesListAdminTestJSON-426575821 None] Deleted volume successfully. Dec 18 21:07:33.490718 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.coordination [None req-496b5c08-4dea-4c19-b21d-fd1d4182116f tempest-VolumesListAdminTestJSON-426575821 None] Lock "b'cinder-b628a8b0-f3cb-44e6-9705-2cf5180377aa-delete_volume'" released by "delete_volume" :: held 0.738s {{(pid=134148) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 18 21:07:33.812645 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.flows.manager.create_volume [None req-23ae4e08-e10d-4a7f-9cbb-ca535ead8a19 tempest-VolumeQuotasAdminTestJSON-1315855869 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134148) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Dec 18 21:07:33.830245 ncdv-master-1 cinder-volume[134148]: WARNING stevedore.named [None req-23ae4e08-e10d-4a7f-9cbb-ca535ead8a19 tempest-VolumeQuotasAdminTestJSON-1315855869 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Dec 18 21:07:33.831813 ncdv-master-1 cinder-volume[134148]: WARNING castellan.key_manager [None req-23ae4e08-e10d-4a7f-9cbb-ca535ead8a19 tempest-VolumeQuotasAdminTestJSON-1315855869 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Dec 18 21:07:33.854024 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-23ae4e08-e10d-4a7f-9cbb-ca535ead8a19 tempest-VolumeQuotasAdminTestJSON-1315855869 None] Flow 'volume_create_manager' (e01a756d-1b8e-4963-982e-449340855011) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 18 21:07:33.857348 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-23ae4e08-e10d-4a7f-9cbb-ca535ead8a19 tempest-VolumeQuotasAdminTestJSON-1315855869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ef06793-b4b6-414e-9adc-5cd4f9aa9906) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:07:33.875159 ncdv-master-1 cinder-volume[134148]: DEBUG oslo_db.sqlalchemy.engines [None req-23ae4e08-e10d-4a7f-9cbb-ca535ead8a19 tempest-VolumeQuotasAdminTestJSON-1315855869 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134148) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 18 21:07:33.890505 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-23ae4e08-e10d-4a7f-9cbb-ca535ead8a19 tempest-VolumeQuotasAdminTestJSON-1315855869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ef06793-b4b6-414e-9adc-5cd4f9aa9906) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-12-18T21:07:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1230629852',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=6cc9ba3b-29ba-4b6d-996f-61ba719661a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='acea01b4f65f48c293ebed946c7a40f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-12-18T21:07:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-12-18T21:07:34Z,use_quota=True,user_id='0d84c26a51ff42899ea8720f725b75a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f2e1fe1-9fd6-411e-9ed9-368f463ccb6f),volume_type_id=1f2e1fe1-9fd6-411e-9ed9-368f463ccb6f)' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:07:33.893202 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-23ae4e08-e10d-4a7f-9cbb-ca535ead8a19 tempest-VolumeQuotasAdminTestJSON-1315855869 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4e4094a-1a26-492a-9a2b-f83eee129df0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:07:33.895490 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-23ae4e08-e10d-4a7f-9cbb-ca535ead8a19 tempest-VolumeQuotasAdminTestJSON-1315855869 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4e4094a-1a26-492a-9a2b-f83eee129df0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:07:33.897992 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-23ae4e08-e10d-4a7f-9cbb-ca535ead8a19 tempest-VolumeQuotasAdminTestJSON-1315855869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62d1f94f-e37c-4d7b-a25c-71f3535b88c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:07:33.912105 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-23ae4e08-e10d-4a7f-9cbb-ca535ead8a19 tempest-VolumeQuotasAdminTestJSON-1315855869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62d1f94f-e37c-4d7b-a25c-71f3535b88c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6cc9ba3b-29ba-4b6d-996f-61ba719661a1', 'volume_name': 'volume-6cc9ba3b-29ba-4b6d-996f-61ba719661a1', 'volume_size': 1}' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:07:33.914574 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-23ae4e08-e10d-4a7f-9cbb-ca535ead8a19 tempest-VolumeQuotasAdminTestJSON-1315855869 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3048c49f-f750-4da1-97e8-8853c2491501) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:07:33.916844 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-23ae4e08-e10d-4a7f-9cbb-ca535ead8a19 tempest-VolumeQuotasAdminTestJSON-1315855869 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3048c49f-f750-4da1-97e8-8853c2491501) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:07:33.926029 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-23ae4e08-e10d-4a7f-9cbb-ca535ead8a19 tempest-VolumeQuotasAdminTestJSON-1315855869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d99e45b1-5ead-43cc-a279-01fe1d284914) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:07:33.933297 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.flows.manager.create_volume [None req-23ae4e08-e10d-4a7f-9cbb-ca535ead8a19 tempest-VolumeQuotasAdminTestJSON-1315855869 None] Volume 6cc9ba3b-29ba-4b6d-996f-61ba719661a1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6cc9ba3b-29ba-4b6d-996f-61ba719661a1', 'volume_size': 1} Dec 18 21:07:33.933603 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-23ae4e08-e10d-4a7f-9cbb-ca535ead8a19 tempest-VolumeQuotasAdminTestJSON-1315855869 None] creating volume 'volume-6cc9ba3b-29ba-4b6d-996f-61ba719661a1' {{(pid=134148) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Dec 18 21:07:33.934668 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-23ae4e08-e10d-4a7f-9cbb-ca535ead8a19 tempest-VolumeQuotasAdminTestJSON-1315855869 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:07:34.082441 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-23ae4e08-e10d-4a7f-9cbb-ca535ead8a19 tempest-VolumeQuotasAdminTestJSON-1315855869 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134148) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 18 21:07:34.082822 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-23ae4e08-e10d-4a7f-9cbb-ca535ead8a19 tempest-VolumeQuotasAdminTestJSON-1315855869 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134148) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 18 21:07:34.084951 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-23ae4e08-e10d-4a7f-9cbb-ca535ead8a19 tempest-VolumeQuotasAdminTestJSON-1315855869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d99e45b1-5ead-43cc-a279-01fe1d284914) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6cc9ba3b-29ba-4b6d-996f-61ba719661a1', 'volume_size': 1}' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:07:34.087549 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-23ae4e08-e10d-4a7f-9cbb-ca535ead8a19 tempest-VolumeQuotasAdminTestJSON-1315855869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0cbdaf60-9ca1-4f01-93e3-dd4a809a0a3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:07:34.110752 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.flows.manager.create_volume [None req-23ae4e08-e10d-4a7f-9cbb-ca535ead8a19 tempest-VolumeQuotasAdminTestJSON-1315855869 None] Volume volume-6cc9ba3b-29ba-4b6d-996f-61ba719661a1 (6cc9ba3b-29ba-4b6d-996f-61ba719661a1): created successfully Dec 18 21:07:34.112889 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-23ae4e08-e10d-4a7f-9cbb-ca535ead8a19 tempest-VolumeQuotasAdminTestJSON-1315855869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0cbdaf60-9ca1-4f01-93e3-dd4a809a0a3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:07:34.116119 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-23ae4e08-e10d-4a7f-9cbb-ca535ead8a19 tempest-VolumeQuotasAdminTestJSON-1315855869 None] Flow 'volume_create_manager' (e01a756d-1b8e-4963-982e-449340855011) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134148) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 18 21:07:34.144056 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-23ae4e08-e10d-4a7f-9cbb-ca535ead8a19 tempest-VolumeQuotasAdminTestJSON-1315855869 None] Created volume successfully. Dec 18 21:07:34.344453 ncdv-master-1 cinder-volume[134148]: DEBUG oslo_service.periodic_task [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134148) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Dec 18 21:07:34.345504 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:07:34.444249 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:07:34.495611 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.manager [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] Notifying Schedulers of capabilities ... {{(pid=134148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 18 21:07:34.936082 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.coordination [None req-b3bd622f-981a-46ee-a731-e063de5ed99a tempest-VolumeQuotasAdminTestJSON-1315855869 None] Lock "b'cinder-6cc9ba3b-29ba-4b6d-996f-61ba719661a1-delete_volume'" acquired by "delete_volume" :: waited 0.009s {{(pid=134148) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 18 21:07:34.989967 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-b3bd622f-981a-46ee-a731-e063de5ed99a tempest-VolumeQuotasAdminTestJSON-1315855869 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:07:35.059663 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-b3bd622f-981a-46ee-a731-e063de5ed99a tempest-VolumeQuotasAdminTestJSON-1315855869 None] volume has no backup snaps {{(pid=134148) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Dec 18 21:07:35.060093 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-b3bd622f-981a-46ee-a731-e063de5ed99a tempest-VolumeQuotasAdminTestJSON-1315855869 None] Volume volume-6cc9ba3b-29ba-4b6d-996f-61ba719661a1 is not a clone. {{(pid=134148) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Dec 18 21:07:35.067932 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-b3bd622f-981a-46ee-a731-e063de5ed99a tempest-VolumeQuotasAdminTestJSON-1315855869 None] deleting rbd volume volume-6cc9ba3b-29ba-4b6d-996f-61ba719661a1 {{(pid=134148) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Dec 18 21:07:35.490239 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.quota [None req-b3bd622f-981a-46ee-a731-e063de5ed99a tempest-VolumeQuotasAdminTestJSON-1315855869 None] Created reservations ['c6fc61d1-960a-4af2-8afa-3bc91c231aa0', '3ecd1715-55b6-4d5a-8f23-2bd0e016c76a', '8a8c3e47-5bf1-43d1-b29c-271d2d50de27', '8ea3b95d-393b-43f9-88b6-ed327706bb72'] {{(pid=134148) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 18 21:07:35.577630 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-b3bd622f-981a-46ee-a731-e063de5ed99a tempest-VolumeQuotasAdminTestJSON-1315855869 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:07:35.659806 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-b3bd622f-981a-46ee-a731-e063de5ed99a tempest-VolumeQuotasAdminTestJSON-1315855869 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:07:35.721901 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.manager [None req-b3bd622f-981a-46ee-a731-e063de5ed99a tempest-VolumeQuotasAdminTestJSON-1315855869 None] Notifying Schedulers of capabilities ... {{(pid=134148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 18 21:07:35.729785 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-b3bd622f-981a-46ee-a731-e063de5ed99a tempest-VolumeQuotasAdminTestJSON-1315855869 None] Deleted volume successfully. Dec 18 21:07:35.760951 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.coordination [None req-b3bd622f-981a-46ee-a731-e063de5ed99a tempest-VolumeQuotasAdminTestJSON-1315855869 None] Lock "b'cinder-6cc9ba3b-29ba-4b6d-996f-61ba719661a1-delete_volume'" released by "delete_volume" :: held 0.825s {{(pid=134148) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 18 21:07:36.540522 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.flows.manager.create_volume [None req-20600885-98a5-4cff-a135-5a4e505ac7b1 tempest-VolumeQuotasAdminTestJSON-1315855869 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134148) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Dec 18 21:07:36.546595 ncdv-master-1 cinder-volume[134148]: WARNING stevedore.named [None req-20600885-98a5-4cff-a135-5a4e505ac7b1 tempest-VolumeQuotasAdminTestJSON-1315855869 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Dec 18 21:07:36.547268 ncdv-master-1 cinder-volume[134148]: WARNING castellan.key_manager [None req-20600885-98a5-4cff-a135-5a4e505ac7b1 tempest-VolumeQuotasAdminTestJSON-1315855869 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Dec 18 21:07:36.561873 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-20600885-98a5-4cff-a135-5a4e505ac7b1 tempest-VolumeQuotasAdminTestJSON-1315855869 None] Flow 'volume_create_manager' (bc5f4c3a-cd5e-4c6e-ac17-5d5026e41d89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 18 21:07:36.565875 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-20600885-98a5-4cff-a135-5a4e505ac7b1 tempest-VolumeQuotasAdminTestJSON-1315855869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (805577f4-248d-4f48-9c88-ebbec191ee26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:07:36.575034 ncdv-master-1 cinder-volume[134148]: DEBUG oslo_db.sqlalchemy.engines [None req-20600885-98a5-4cff-a135-5a4e505ac7b1 tempest-VolumeQuotasAdminTestJSON-1315855869 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134148) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 18 21:07:36.591419 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-20600885-98a5-4cff-a135-5a4e505ac7b1 tempest-VolumeQuotasAdminTestJSON-1315855869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (805577f4-248d-4f48-9c88-ebbec191ee26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-12-18T21:07:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-2042858922',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=4872bc05-17a6-4b20-a2ad-10d4f9663417,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='acea01b4f65f48c293ebed946c7a40f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-12-18T21:07:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-12-18T21:07:36Z,use_quota=True,user_id='0d84c26a51ff42899ea8720f725b75a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f2e1fe1-9fd6-411e-9ed9-368f463ccb6f),volume_type_id=1f2e1fe1-9fd6-411e-9ed9-368f463ccb6f)' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:07:36.594213 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-20600885-98a5-4cff-a135-5a4e505ac7b1 tempest-VolumeQuotasAdminTestJSON-1315855869 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4eeecb2-4399-4b69-b31b-f89c08f004f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:07:36.615366 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-20600885-98a5-4cff-a135-5a4e505ac7b1 tempest-VolumeQuotasAdminTestJSON-1315855869 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4eeecb2-4399-4b69-b31b-f89c08f004f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:07:36.622337 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-20600885-98a5-4cff-a135-5a4e505ac7b1 tempest-VolumeQuotasAdminTestJSON-1315855869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c591c019-34de-4927-8f25-249a0b98a027) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:07:36.629583 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-20600885-98a5-4cff-a135-5a4e505ac7b1 tempest-VolumeQuotasAdminTestJSON-1315855869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c591c019-34de-4927-8f25-249a0b98a027) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4872bc05-17a6-4b20-a2ad-10d4f9663417', 'volume_name': 'volume-4872bc05-17a6-4b20-a2ad-10d4f9663417', 'volume_size': 1}' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:07:36.632554 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-20600885-98a5-4cff-a135-5a4e505ac7b1 tempest-VolumeQuotasAdminTestJSON-1315855869 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eefc7a69-41d9-4d71-b744-68f11dfd11a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:07:36.637611 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-20600885-98a5-4cff-a135-5a4e505ac7b1 tempest-VolumeQuotasAdminTestJSON-1315855869 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eefc7a69-41d9-4d71-b744-68f11dfd11a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:07:36.643625 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-20600885-98a5-4cff-a135-5a4e505ac7b1 tempest-VolumeQuotasAdminTestJSON-1315855869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (096e0b94-373d-4225-938a-5f73a28e5bcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:07:36.644664 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.flows.manager.create_volume [None req-20600885-98a5-4cff-a135-5a4e505ac7b1 tempest-VolumeQuotasAdminTestJSON-1315855869 None] Volume 4872bc05-17a6-4b20-a2ad-10d4f9663417: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4872bc05-17a6-4b20-a2ad-10d4f9663417', 'volume_size': 1} Dec 18 21:07:36.645259 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-20600885-98a5-4cff-a135-5a4e505ac7b1 tempest-VolumeQuotasAdminTestJSON-1315855869 None] creating volume 'volume-4872bc05-17a6-4b20-a2ad-10d4f9663417' {{(pid=134148) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Dec 18 21:07:36.646911 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-20600885-98a5-4cff-a135-5a4e505ac7b1 tempest-VolumeQuotasAdminTestJSON-1315855869 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:07:36.746394 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-20600885-98a5-4cff-a135-5a4e505ac7b1 tempest-VolumeQuotasAdminTestJSON-1315855869 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134148) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 18 21:07:36.747057 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-20600885-98a5-4cff-a135-5a4e505ac7b1 tempest-VolumeQuotasAdminTestJSON-1315855869 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134148) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 18 21:07:36.749961 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-20600885-98a5-4cff-a135-5a4e505ac7b1 tempest-VolumeQuotasAdminTestJSON-1315855869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (096e0b94-373d-4225-938a-5f73a28e5bcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4872bc05-17a6-4b20-a2ad-10d4f9663417', 'volume_size': 1}' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:07:36.753564 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-20600885-98a5-4cff-a135-5a4e505ac7b1 tempest-VolumeQuotasAdminTestJSON-1315855869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6adb402-611b-4ecc-8d93-0632f82ffd24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:07:36.764862 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.flows.manager.create_volume [None req-20600885-98a5-4cff-a135-5a4e505ac7b1 tempest-VolumeQuotasAdminTestJSON-1315855869 None] Volume volume-4872bc05-17a6-4b20-a2ad-10d4f9663417 (4872bc05-17a6-4b20-a2ad-10d4f9663417): created successfully Dec 18 21:07:36.768931 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-20600885-98a5-4cff-a135-5a4e505ac7b1 tempest-VolumeQuotasAdminTestJSON-1315855869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6adb402-611b-4ecc-8d93-0632f82ffd24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:07:36.771812 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-20600885-98a5-4cff-a135-5a4e505ac7b1 tempest-VolumeQuotasAdminTestJSON-1315855869 None] Flow 'volume_create_manager' (bc5f4c3a-cd5e-4c6e-ac17-5d5026e41d89) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134148) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 18 21:07:36.786832 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-20600885-98a5-4cff-a135-5a4e505ac7b1 tempest-VolumeQuotasAdminTestJSON-1315855869 None] Created volume successfully. Dec 18 21:07:38.553572 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-d2d243ac-4ad3-4a0e-9407-ee3df4305038 tempest-VolumeQuotasAdminTestJSON-1709074387 None] Transfer volume completed successfully. Dec 18 21:07:39.046470 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.coordination [None req-4edab07f-6154-4580-90d6-bd7a7ba3ab8b tempest-VolumeQuotasAdminTestJSON-909946085 None] Lock "b'cinder-4872bc05-17a6-4b20-a2ad-10d4f9663417-delete_volume'" acquired by "delete_volume" :: waited 0.013s {{(pid=134148) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 18 21:07:39.106365 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-4edab07f-6154-4580-90d6-bd7a7ba3ab8b tempest-VolumeQuotasAdminTestJSON-909946085 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:07:39.164669 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-4edab07f-6154-4580-90d6-bd7a7ba3ab8b tempest-VolumeQuotasAdminTestJSON-909946085 None] volume has no backup snaps {{(pid=134148) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Dec 18 21:07:39.165220 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-4edab07f-6154-4580-90d6-bd7a7ba3ab8b tempest-VolumeQuotasAdminTestJSON-909946085 None] Volume volume-4872bc05-17a6-4b20-a2ad-10d4f9663417 is not a clone. {{(pid=134148) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Dec 18 21:07:39.170693 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-4edab07f-6154-4580-90d6-bd7a7ba3ab8b tempest-VolumeQuotasAdminTestJSON-909946085 None] deleting rbd volume volume-4872bc05-17a6-4b20-a2ad-10d4f9663417 {{(pid=134148) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Dec 18 21:07:39.193918 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.flows.manager.create_volume [None req-b4fc47f0-bfb6-4ec0-ad51-bd2731899ecf tempest-AbsoluteLimitsTests-1462835604 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134148) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Dec 18 21:07:39.199527 ncdv-master-1 cinder-volume[134148]: WARNING stevedore.named [None req-b4fc47f0-bfb6-4ec0-ad51-bd2731899ecf tempest-AbsoluteLimitsTests-1462835604 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Dec 18 21:07:39.200005 ncdv-master-1 cinder-volume[134148]: WARNING castellan.key_manager [None req-b4fc47f0-bfb6-4ec0-ad51-bd2731899ecf tempest-AbsoluteLimitsTests-1462835604 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Dec 18 21:07:39.215847 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-b4fc47f0-bfb6-4ec0-ad51-bd2731899ecf tempest-AbsoluteLimitsTests-1462835604 None] Flow 'volume_create_manager' (fdbaa419-62ec-4bb2-ba75-8084151b6248) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 18 21:07:39.220494 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-b4fc47f0-bfb6-4ec0-ad51-bd2731899ecf tempest-AbsoluteLimitsTests-1462835604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c13279da-4022-4535-a9eb-4e211107d8f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:07:39.231338 ncdv-master-1 cinder-volume[134148]: DEBUG oslo_db.sqlalchemy.engines [None req-b4fc47f0-bfb6-4ec0-ad51-bd2731899ecf tempest-AbsoluteLimitsTests-1462835604 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134148) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 18 21:07:39.251029 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-b4fc47f0-bfb6-4ec0-ad51-bd2731899ecf tempest-AbsoluteLimitsTests-1462835604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c13279da-4022-4535-a9eb-4e211107d8f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-12-18T21:07:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1080218162',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=d1121ae7-9606-4548-8b21-aa275c19982f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='08bcff41c7054632b8308278820559a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-12-18T21:07:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-12-18T21:07:39Z,use_quota=True,user_id='5465787a1dcf4d4faa4cbb2308658670',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f2e1fe1-9fd6-411e-9ed9-368f463ccb6f),volume_type_id=1f2e1fe1-9fd6-411e-9ed9-368f463ccb6f)' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:07:39.260173 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-b4fc47f0-bfb6-4ec0-ad51-bd2731899ecf tempest-AbsoluteLimitsTests-1462835604 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c2acb9c-5e28-4954-975c-58e3a5d76327) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:07:39.262812 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-b4fc47f0-bfb6-4ec0-ad51-bd2731899ecf tempest-AbsoluteLimitsTests-1462835604 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c2acb9c-5e28-4954-975c-58e3a5d76327) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:07:39.266184 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-b4fc47f0-bfb6-4ec0-ad51-bd2731899ecf tempest-AbsoluteLimitsTests-1462835604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ead1059-ff2f-4bc7-88dd-98aa8e6641df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:07:39.269856 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-b4fc47f0-bfb6-4ec0-ad51-bd2731899ecf tempest-AbsoluteLimitsTests-1462835604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ead1059-ff2f-4bc7-88dd-98aa8e6641df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd1121ae7-9606-4548-8b21-aa275c19982f', 'volume_name': 'volume-d1121ae7-9606-4548-8b21-aa275c19982f', 'volume_size': 1}' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:07:39.273218 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-b4fc47f0-bfb6-4ec0-ad51-bd2731899ecf tempest-AbsoluteLimitsTests-1462835604 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d78b232b-784f-4904-a0b9-f8cd5e7ec682) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:07:39.275593 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-b4fc47f0-bfb6-4ec0-ad51-bd2731899ecf tempest-AbsoluteLimitsTests-1462835604 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d78b232b-784f-4904-a0b9-f8cd5e7ec682) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:07:39.278162 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-b4fc47f0-bfb6-4ec0-ad51-bd2731899ecf tempest-AbsoluteLimitsTests-1462835604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9aa2c2ba-19d2-46cd-ae3a-c4fbb4b6c46a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:07:39.279336 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.flows.manager.create_volume [None req-b4fc47f0-bfb6-4ec0-ad51-bd2731899ecf tempest-AbsoluteLimitsTests-1462835604 None] Volume d1121ae7-9606-4548-8b21-aa275c19982f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d1121ae7-9606-4548-8b21-aa275c19982f', 'volume_size': 1} Dec 18 21:07:39.280457 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-b4fc47f0-bfb6-4ec0-ad51-bd2731899ecf tempest-AbsoluteLimitsTests-1462835604 None] creating volume 'volume-d1121ae7-9606-4548-8b21-aa275c19982f' {{(pid=134148) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Dec 18 21:07:39.281752 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-b4fc47f0-bfb6-4ec0-ad51-bd2731899ecf tempest-AbsoluteLimitsTests-1462835604 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:07:39.382794 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-b4fc47f0-bfb6-4ec0-ad51-bd2731899ecf tempest-AbsoluteLimitsTests-1462835604 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134148) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 18 21:07:39.383240 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-b4fc47f0-bfb6-4ec0-ad51-bd2731899ecf tempest-AbsoluteLimitsTests-1462835604 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134148) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 18 21:07:39.385365 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-b4fc47f0-bfb6-4ec0-ad51-bd2731899ecf tempest-AbsoluteLimitsTests-1462835604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9aa2c2ba-19d2-46cd-ae3a-c4fbb4b6c46a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d1121ae7-9606-4548-8b21-aa275c19982f', 'volume_size': 1}' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:07:39.388020 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-b4fc47f0-bfb6-4ec0-ad51-bd2731899ecf tempest-AbsoluteLimitsTests-1462835604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f20c886-7f47-4df7-bc93-f26a5af5cb09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:07:39.405192 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.flows.manager.create_volume [None req-b4fc47f0-bfb6-4ec0-ad51-bd2731899ecf tempest-AbsoluteLimitsTests-1462835604 None] Volume volume-d1121ae7-9606-4548-8b21-aa275c19982f (d1121ae7-9606-4548-8b21-aa275c19982f): created successfully Dec 18 21:07:39.407449 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-b4fc47f0-bfb6-4ec0-ad51-bd2731899ecf tempest-AbsoluteLimitsTests-1462835604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f20c886-7f47-4df7-bc93-f26a5af5cb09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:07:39.411614 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-b4fc47f0-bfb6-4ec0-ad51-bd2731899ecf tempest-AbsoluteLimitsTests-1462835604 None] Flow 'volume_create_manager' (fdbaa419-62ec-4bb2-ba75-8084151b6248) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134148) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 18 21:07:39.428243 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-b4fc47f0-bfb6-4ec0-ad51-bd2731899ecf tempest-AbsoluteLimitsTests-1462835604 None] Created volume successfully. Dec 18 21:07:39.531984 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.quota [None req-4edab07f-6154-4580-90d6-bd7a7ba3ab8b tempest-VolumeQuotasAdminTestJSON-909946085 None] Created reservations ['322889e4-9fad-401f-b205-9e4420b4b2a1', '9e64af0b-afd5-43b6-8b66-66b22891f593', 'c0dbd117-1998-42b2-925e-e461a405612e', '77520c3f-7261-4275-935e-1eb0458a1447'] {{(pid=134148) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 18 21:07:39.590484 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-4edab07f-6154-4580-90d6-bd7a7ba3ab8b tempest-VolumeQuotasAdminTestJSON-909946085 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:07:39.652244 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-4edab07f-6154-4580-90d6-bd7a7ba3ab8b tempest-VolumeQuotasAdminTestJSON-909946085 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:07:39.737573 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.manager [None req-4edab07f-6154-4580-90d6-bd7a7ba3ab8b tempest-VolumeQuotasAdminTestJSON-909946085 None] Notifying Schedulers of capabilities ... {{(pid=134148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 18 21:07:39.744339 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-4edab07f-6154-4580-90d6-bd7a7ba3ab8b tempest-VolumeQuotasAdminTestJSON-909946085 None] Deleted volume successfully. Dec 18 21:07:39.767471 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.coordination [None req-4edab07f-6154-4580-90d6-bd7a7ba3ab8b tempest-VolumeQuotasAdminTestJSON-909946085 None] Lock "b'cinder-4872bc05-17a6-4b20-a2ad-10d4f9663417-delete_volume'" released by "delete_volume" :: held 0.721s {{(pid=134148) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 18 21:07:40.294564 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.coordination [None req-29d494c3-6b2b-4b9a-815e-c55e0c426730 tempest-AbsoluteLimitsTests-1462835604 None] Lock "b'cinder-d1121ae7-9606-4548-8b21-aa275c19982f-delete_volume'" acquired by "delete_volume" :: waited 0.014s {{(pid=134148) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 18 21:07:40.393782 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-29d494c3-6b2b-4b9a-815e-c55e0c426730 tempest-AbsoluteLimitsTests-1462835604 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:07:40.483334 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-29d494c3-6b2b-4b9a-815e-c55e0c426730 tempest-AbsoluteLimitsTests-1462835604 None] volume has no backup snaps {{(pid=134148) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Dec 18 21:07:40.483851 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-29d494c3-6b2b-4b9a-815e-c55e0c426730 tempest-AbsoluteLimitsTests-1462835604 None] Volume volume-d1121ae7-9606-4548-8b21-aa275c19982f is not a clone. {{(pid=134148) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Dec 18 21:07:40.499099 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-29d494c3-6b2b-4b9a-815e-c55e0c426730 tempest-AbsoluteLimitsTests-1462835604 None] deleting rbd volume volume-d1121ae7-9606-4548-8b21-aa275c19982f {{(pid=134148) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Dec 18 21:07:40.967864 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.quota [None req-29d494c3-6b2b-4b9a-815e-c55e0c426730 tempest-AbsoluteLimitsTests-1462835604 None] Created reservations ['ae6baf25-17d8-4204-b926-f781ad64dd04', 'ba4bc8cb-eff3-47ce-b753-8ad75c522487', '8f58aef7-40f4-495f-b8e5-b5c6229b57fd', '9b398cf0-29d2-4bdb-a316-408ccfadf97c'] {{(pid=134148) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 18 21:07:41.057328 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-29d494c3-6b2b-4b9a-815e-c55e0c426730 tempest-AbsoluteLimitsTests-1462835604 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:07:41.128993 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-29d494c3-6b2b-4b9a-815e-c55e0c426730 tempest-AbsoluteLimitsTests-1462835604 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:07:41.210898 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.manager [None req-29d494c3-6b2b-4b9a-815e-c55e0c426730 tempest-AbsoluteLimitsTests-1462835604 None] Notifying Schedulers of capabilities ... {{(pid=134148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 18 21:07:41.223953 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-29d494c3-6b2b-4b9a-815e-c55e0c426730 tempest-AbsoluteLimitsTests-1462835604 None] Deleted volume successfully. Dec 18 21:07:41.245230 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.coordination [None req-29d494c3-6b2b-4b9a-815e-c55e0c426730 tempest-AbsoluteLimitsTests-1462835604 None] Lock "b'cinder-d1121ae7-9606-4548-8b21-aa275c19982f-delete_volume'" released by "delete_volume" :: held 0.951s {{(pid=134148) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 18 21:07:45.988295 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.flows.manager.create_volume [None req-9c7fd70d-d23a-49be-88b9-b1e8119ba1fd tempest-VolumesMetadataTest-43779810 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134148) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Dec 18 21:07:46.004241 ncdv-master-1 cinder-volume[134148]: WARNING stevedore.named [None req-9c7fd70d-d23a-49be-88b9-b1e8119ba1fd tempest-VolumesMetadataTest-43779810 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Dec 18 21:07:46.004939 ncdv-master-1 cinder-volume[134148]: WARNING castellan.key_manager [None req-9c7fd70d-d23a-49be-88b9-b1e8119ba1fd tempest-VolumesMetadataTest-43779810 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Dec 18 21:07:46.024058 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-9c7fd70d-d23a-49be-88b9-b1e8119ba1fd tempest-VolumesMetadataTest-43779810 None] Flow 'volume_create_manager' (13d0750f-679c-43fe-bb13-5044f9ae2a6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 18 21:07:46.027550 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-9c7fd70d-d23a-49be-88b9-b1e8119ba1fd tempest-VolumesMetadataTest-43779810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04f44c4f-bcd1-4d54-a5e3-d1b9d4e8808b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:07:46.033990 ncdv-master-1 cinder-volume[134148]: DEBUG oslo_db.sqlalchemy.engines [None req-9c7fd70d-d23a-49be-88b9-b1e8119ba1fd tempest-VolumesMetadataTest-43779810 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134148) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 18 21:07:46.056468 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-9c7fd70d-d23a-49be-88b9-b1e8119ba1fd tempest-VolumesMetadataTest-43779810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04f44c4f-bcd1-4d54-a5e3-d1b9d4e8808b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-12-18T21:07:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-176432100',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=83a98fd5-250b-4992-8ca2-adf612f9dfbe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b888baac6cf4b2aaff70b2f05bfe934',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-12-18T21:07:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-12-18T21:07:46Z,use_quota=True,user_id='50a3aaa73fbc48f691b0ed513fdd36cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f2e1fe1-9fd6-411e-9ed9-368f463ccb6f),volume_type_id=1f2e1fe1-9fd6-411e-9ed9-368f463ccb6f)' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:07:46.062991 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-9c7fd70d-d23a-49be-88b9-b1e8119ba1fd tempest-VolumesMetadataTest-43779810 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (444484cb-7819-4d1f-806e-6d51b6e79e18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:07:46.065376 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-9c7fd70d-d23a-49be-88b9-b1e8119ba1fd tempest-VolumesMetadataTest-43779810 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (444484cb-7819-4d1f-806e-6d51b6e79e18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:07:46.068298 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-9c7fd70d-d23a-49be-88b9-b1e8119ba1fd tempest-VolumesMetadataTest-43779810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51ff911e-11de-408e-9700-73753da4749b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:07:46.070626 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-9c7fd70d-d23a-49be-88b9-b1e8119ba1fd tempest-VolumesMetadataTest-43779810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51ff911e-11de-408e-9700-73753da4749b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '83a98fd5-250b-4992-8ca2-adf612f9dfbe', 'volume_name': 'volume-83a98fd5-250b-4992-8ca2-adf612f9dfbe', 'volume_size': 1}' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:07:46.072981 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-9c7fd70d-d23a-49be-88b9-b1e8119ba1fd tempest-VolumesMetadataTest-43779810 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad3da2a0-0b91-42aa-8282-0ca3eea9e196) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:07:46.075284 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-9c7fd70d-d23a-49be-88b9-b1e8119ba1fd tempest-VolumesMetadataTest-43779810 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad3da2a0-0b91-42aa-8282-0ca3eea9e196) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:07:46.078339 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-9c7fd70d-d23a-49be-88b9-b1e8119ba1fd tempest-VolumesMetadataTest-43779810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ce5c116-1ade-441c-826f-f057bfe37de0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:07:46.079220 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.flows.manager.create_volume [None req-9c7fd70d-d23a-49be-88b9-b1e8119ba1fd tempest-VolumesMetadataTest-43779810 None] Volume 83a98fd5-250b-4992-8ca2-adf612f9dfbe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-83a98fd5-250b-4992-8ca2-adf612f9dfbe', 'volume_size': 1} Dec 18 21:07:46.079556 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-9c7fd70d-d23a-49be-88b9-b1e8119ba1fd tempest-VolumesMetadataTest-43779810 None] creating volume 'volume-83a98fd5-250b-4992-8ca2-adf612f9dfbe' {{(pid=134148) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Dec 18 21:07:46.080563 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-9c7fd70d-d23a-49be-88b9-b1e8119ba1fd tempest-VolumesMetadataTest-43779810 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:07:46.162382 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-9c7fd70d-d23a-49be-88b9-b1e8119ba1fd tempest-VolumesMetadataTest-43779810 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134148) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 18 21:07:46.163089 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-9c7fd70d-d23a-49be-88b9-b1e8119ba1fd tempest-VolumesMetadataTest-43779810 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134148) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 18 21:07:46.166666 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-9c7fd70d-d23a-49be-88b9-b1e8119ba1fd tempest-VolumesMetadataTest-43779810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ce5c116-1ade-441c-826f-f057bfe37de0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-83a98fd5-250b-4992-8ca2-adf612f9dfbe', 'volume_size': 1}' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:07:46.171563 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-9c7fd70d-d23a-49be-88b9-b1e8119ba1fd tempest-VolumesMetadataTest-43779810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e5426d5-b2b2-4afd-ab6f-62285b6a4faa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:07:46.183229 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.flows.manager.create_volume [None req-9c7fd70d-d23a-49be-88b9-b1e8119ba1fd tempest-VolumesMetadataTest-43779810 None] Volume volume-83a98fd5-250b-4992-8ca2-adf612f9dfbe (83a98fd5-250b-4992-8ca2-adf612f9dfbe): created successfully Dec 18 21:07:46.184952 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-9c7fd70d-d23a-49be-88b9-b1e8119ba1fd tempest-VolumesMetadataTest-43779810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e5426d5-b2b2-4afd-ab6f-62285b6a4faa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:07:46.188306 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-9c7fd70d-d23a-49be-88b9-b1e8119ba1fd tempest-VolumesMetadataTest-43779810 None] Flow 'volume_create_manager' (13d0750f-679c-43fe-bb13-5044f9ae2a6a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134148) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 18 21:07:46.199309 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-9c7fd70d-d23a-49be-88b9-b1e8119ba1fd tempest-VolumesMetadataTest-43779810 None] Created volume successfully. Dec 18 21:07:47.789289 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.coordination [None req-223be35d-55a0-4952-a8ca-b5329cefc65d tempest-VolumesMetadataTest-43779810 None] Lock "b'cinder-83a98fd5-250b-4992-8ca2-adf612f9dfbe-delete_volume'" acquired by "delete_volume" :: waited 0.021s {{(pid=134148) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 18 21:07:47.842942 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-223be35d-55a0-4952-a8ca-b5329cefc65d tempest-VolumesMetadataTest-43779810 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:07:47.939654 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-223be35d-55a0-4952-a8ca-b5329cefc65d tempest-VolumesMetadataTest-43779810 None] volume has no backup snaps {{(pid=134148) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Dec 18 21:07:47.940892 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-223be35d-55a0-4952-a8ca-b5329cefc65d tempest-VolumesMetadataTest-43779810 None] Volume volume-83a98fd5-250b-4992-8ca2-adf612f9dfbe is not a clone. {{(pid=134148) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Dec 18 21:07:47.955667 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-223be35d-55a0-4952-a8ca-b5329cefc65d tempest-VolumesMetadataTest-43779810 None] deleting rbd volume volume-83a98fd5-250b-4992-8ca2-adf612f9dfbe {{(pid=134148) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Dec 18 21:07:48.224193 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.quota [None req-223be35d-55a0-4952-a8ca-b5329cefc65d tempest-VolumesMetadataTest-43779810 None] Created reservations ['697e3db4-fa12-4ee9-998d-c2635eb97457', '8eb416e9-3224-4fa8-8975-cbd1761964af', 'd93e7c99-4225-41e5-b284-a5f9c11890de', 'e6c2786a-bc79-4505-94c3-484ddf55bb73'] {{(pid=134148) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 18 21:07:48.297754 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-223be35d-55a0-4952-a8ca-b5329cefc65d tempest-VolumesMetadataTest-43779810 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:07:48.371281 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-223be35d-55a0-4952-a8ca-b5329cefc65d tempest-VolumesMetadataTest-43779810 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:07:48.445668 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.manager [None req-223be35d-55a0-4952-a8ca-b5329cefc65d tempest-VolumesMetadataTest-43779810 None] Notifying Schedulers of capabilities ... {{(pid=134148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 18 21:07:48.453949 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-223be35d-55a0-4952-a8ca-b5329cefc65d tempest-VolumesMetadataTest-43779810 None] Deleted volume successfully. Dec 18 21:07:48.500473 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.coordination [None req-223be35d-55a0-4952-a8ca-b5329cefc65d tempest-VolumesMetadataTest-43779810 None] Lock "b'cinder-83a98fd5-250b-4992-8ca2-adf612f9dfbe-delete_volume'" released by "delete_volume" :: held 0.711s {{(pid=134148) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 18 21:07:48.503558 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.flows.manager.create_volume [None req-3f01ca0b-dfdd-42c2-9a76-f0df7a32fddf tempest-VolumeTypesAccessTest-1437907254 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134148) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Dec 18 21:07:48.507143 ncdv-master-1 cinder-volume[134148]: WARNING stevedore.named [None req-3f01ca0b-dfdd-42c2-9a76-f0df7a32fddf tempest-VolumeTypesAccessTest-1437907254 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Dec 18 21:07:48.507726 ncdv-master-1 cinder-volume[134148]: WARNING castellan.key_manager [None req-3f01ca0b-dfdd-42c2-9a76-f0df7a32fddf tempest-VolumeTypesAccessTest-1437907254 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Dec 18 21:07:48.523072 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-3f01ca0b-dfdd-42c2-9a76-f0df7a32fddf tempest-VolumeTypesAccessTest-1437907254 None] Flow 'volume_create_manager' (33f2f0c0-dab8-48a9-952d-3d3b2341e45c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 18 21:07:48.526580 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-3f01ca0b-dfdd-42c2-9a76-f0df7a32fddf tempest-VolumeTypesAccessTest-1437907254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8c9dc1a-f11a-4263-a1ba-14083dc31266) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:07:48.533432 ncdv-master-1 cinder-volume[134148]: DEBUG oslo_db.sqlalchemy.engines [None req-3f01ca0b-dfdd-42c2-9a76-f0df7a32fddf tempest-VolumeTypesAccessTest-1437907254 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134148) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 18 21:07:48.571056 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-3f01ca0b-dfdd-42c2-9a76-f0df7a32fddf tempest-VolumeTypesAccessTest-1437907254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8c9dc1a-f11a-4263-a1ba-14083dc31266) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-12-18T21:07:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-601977007',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=76bbe6fa-06b3-4ba0-b689-f69d1a71cebc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e60600edf12344cc92541fd4f78df827',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-12-18T21:07:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-12-18T21:07:48Z,use_quota=True,user_id='5b9f1842c1fc4d84b1975a3814c2da30',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(702e1dd0-a4f4-4fde-8e57-b9a522df7109),volume_type_id=702e1dd0-a4f4-4fde-8e57-b9a522df7109)' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:07:48.580820 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-3f01ca0b-dfdd-42c2-9a76-f0df7a32fddf tempest-VolumeTypesAccessTest-1437907254 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d74b4787-dc31-4e05-8ac0-4b40ea12ea58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:07:48.587540 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-3f01ca0b-dfdd-42c2-9a76-f0df7a32fddf tempest-VolumeTypesAccessTest-1437907254 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d74b4787-dc31-4e05-8ac0-4b40ea12ea58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:07:48.591576 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-3f01ca0b-dfdd-42c2-9a76-f0df7a32fddf tempest-VolumeTypesAccessTest-1437907254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (036cc9b9-364b-4667-9616-300dccac4e25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:07:48.594500 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-3f01ca0b-dfdd-42c2-9a76-f0df7a32fddf tempest-VolumeTypesAccessTest-1437907254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (036cc9b9-364b-4667-9616-300dccac4e25) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '76bbe6fa-06b3-4ba0-b689-f69d1a71cebc', 'volume_name': 'volume-76bbe6fa-06b3-4ba0-b689-f69d1a71cebc', 'volume_size': 1}' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:07:48.597298 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-3f01ca0b-dfdd-42c2-9a76-f0df7a32fddf tempest-VolumeTypesAccessTest-1437907254 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a46edd1c-1d27-4187-8412-c10cd30c8f0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:07:48.599652 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-3f01ca0b-dfdd-42c2-9a76-f0df7a32fddf tempest-VolumeTypesAccessTest-1437907254 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a46edd1c-1d27-4187-8412-c10cd30c8f0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:07:48.601891 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-3f01ca0b-dfdd-42c2-9a76-f0df7a32fddf tempest-VolumeTypesAccessTest-1437907254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad971878-d36d-4da3-89fe-6dc2fe07db39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:07:48.602945 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.flows.manager.create_volume [None req-3f01ca0b-dfdd-42c2-9a76-f0df7a32fddf tempest-VolumeTypesAccessTest-1437907254 None] Volume 76bbe6fa-06b3-4ba0-b689-f69d1a71cebc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-76bbe6fa-06b3-4ba0-b689-f69d1a71cebc', 'volume_size': 1} Dec 18 21:07:48.603343 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-3f01ca0b-dfdd-42c2-9a76-f0df7a32fddf tempest-VolumeTypesAccessTest-1437907254 None] creating volume 'volume-76bbe6fa-06b3-4ba0-b689-f69d1a71cebc' {{(pid=134148) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Dec 18 21:07:48.604362 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-3f01ca0b-dfdd-42c2-9a76-f0df7a32fddf tempest-VolumeTypesAccessTest-1437907254 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:07:48.701860 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-3f01ca0b-dfdd-42c2-9a76-f0df7a32fddf tempest-VolumeTypesAccessTest-1437907254 None] extra_specs: {} {{(pid=134148) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 18 21:07:48.702393 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-3f01ca0b-dfdd-42c2-9a76-f0df7a32fddf tempest-VolumeTypesAccessTest-1437907254 None] extra_specs: {} {{(pid=134148) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 18 21:07:48.704584 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-3f01ca0b-dfdd-42c2-9a76-f0df7a32fddf tempest-VolumeTypesAccessTest-1437907254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad971878-d36d-4da3-89fe-6dc2fe07db39) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-76bbe6fa-06b3-4ba0-b689-f69d1a71cebc', 'volume_size': 1}' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:07:48.707079 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-3f01ca0b-dfdd-42c2-9a76-f0df7a32fddf tempest-VolumeTypesAccessTest-1437907254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a9ab6f0-5a5e-4c2e-b613-f4e053827cac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:07:48.722237 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.flows.manager.create_volume [None req-3f01ca0b-dfdd-42c2-9a76-f0df7a32fddf tempest-VolumeTypesAccessTest-1437907254 None] Volume volume-76bbe6fa-06b3-4ba0-b689-f69d1a71cebc (76bbe6fa-06b3-4ba0-b689-f69d1a71cebc): created successfully Dec 18 21:07:48.724345 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-3f01ca0b-dfdd-42c2-9a76-f0df7a32fddf tempest-VolumeTypesAccessTest-1437907254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a9ab6f0-5a5e-4c2e-b613-f4e053827cac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:07:48.727445 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-3f01ca0b-dfdd-42c2-9a76-f0df7a32fddf tempest-VolumeTypesAccessTest-1437907254 None] Flow 'volume_create_manager' (33f2f0c0-dab8-48a9-952d-3d3b2341e45c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134148) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 18 21:07:48.747626 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-3f01ca0b-dfdd-42c2-9a76-f0df7a32fddf tempest-VolumeTypesAccessTest-1437907254 None] Created volume successfully. Dec 18 21:07:49.946674 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.coordination [None req-5c7a0595-6882-42e2-9990-af863f8daa4e tempest-VolumeTypesAccessTest-1437907254 None] Lock "b'cinder-76bbe6fa-06b3-4ba0-b689-f69d1a71cebc-delete_volume'" acquired by "delete_volume" :: waited 0.042s {{(pid=134148) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 18 21:07:50.000496 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-5c7a0595-6882-42e2-9990-af863f8daa4e tempest-VolumeTypesAccessTest-1437907254 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:07:50.102723 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-5c7a0595-6882-42e2-9990-af863f8daa4e tempest-VolumeTypesAccessTest-1437907254 None] volume has no backup snaps {{(pid=134148) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Dec 18 21:07:50.103152 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-5c7a0595-6882-42e2-9990-af863f8daa4e tempest-VolumeTypesAccessTest-1437907254 None] Volume volume-76bbe6fa-06b3-4ba0-b689-f69d1a71cebc is not a clone. {{(pid=134148) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Dec 18 21:07:50.110675 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-5c7a0595-6882-42e2-9990-af863f8daa4e tempest-VolumeTypesAccessTest-1437907254 None] deleting rbd volume volume-76bbe6fa-06b3-4ba0-b689-f69d1a71cebc {{(pid=134148) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Dec 18 21:07:50.404169 ncdv-master-1 cinder-volume[134148]: WARNING cinder.quota [None req-5c7a0595-6882-42e2-9990-af863f8daa4e tempest-VolumeTypesAccessTest-1437907254 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-1062043135 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-1062043135, it is now deprecated. Please use the default quota class for default quota. Dec 18 21:07:50.406373 ncdv-master-1 cinder-volume[134148]: WARNING cinder.quota [None req-5c7a0595-6882-42e2-9990-af863f8daa4e tempest-VolumeTypesAccessTest-1437907254 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-1062043135 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-1062043135, it is now deprecated. Please use the default quota class for default quota. Dec 18 21:07:50.428361 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.quota [None req-5c7a0595-6882-42e2-9990-af863f8daa4e tempest-VolumeTypesAccessTest-1437907254 None] Created reservations ['40c8c664-f59c-4ea4-9f82-2059df81e849', '08966c46-cc47-40db-913f-bf7ecc985487', '3278cef6-ebe6-4dac-a727-2b5d6fbf14fd', 'af4cc60b-ad0b-42bd-ad0d-2eeb3471f217'] {{(pid=134148) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 18 21:07:50.476528 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-5c7a0595-6882-42e2-9990-af863f8daa4e tempest-VolumeTypesAccessTest-1437907254 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:07:50.561768 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-5c7a0595-6882-42e2-9990-af863f8daa4e tempest-VolumeTypesAccessTest-1437907254 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:07:50.657917 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.manager [None req-5c7a0595-6882-42e2-9990-af863f8daa4e tempest-VolumeTypesAccessTest-1437907254 None] Notifying Schedulers of capabilities ... {{(pid=134148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 18 21:07:50.679715 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-5c7a0595-6882-42e2-9990-af863f8daa4e tempest-VolumeTypesAccessTest-1437907254 None] Deleted volume successfully. Dec 18 21:07:50.716716 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.coordination [None req-5c7a0595-6882-42e2-9990-af863f8daa4e tempest-VolumeTypesAccessTest-1437907254 None] Lock "b'cinder-76bbe6fa-06b3-4ba0-b689-f69d1a71cebc-delete_volume'" released by "delete_volume" :: held 0.772s {{(pid=134148) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 18 21:07:54.616329 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.flows.manager.create_volume [None req-d168f51a-1afc-414e-8711-d6e6b8c62a8f tempest-VolumesTransfersTest-1302684122 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134148) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Dec 18 21:07:54.621086 ncdv-master-1 cinder-volume[134148]: WARNING stevedore.named [None req-d168f51a-1afc-414e-8711-d6e6b8c62a8f tempest-VolumesTransfersTest-1302684122 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Dec 18 21:07:54.622223 ncdv-master-1 cinder-volume[134148]: WARNING castellan.key_manager [None req-d168f51a-1afc-414e-8711-d6e6b8c62a8f tempest-VolumesTransfersTest-1302684122 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Dec 18 21:07:54.640638 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-d168f51a-1afc-414e-8711-d6e6b8c62a8f tempest-VolumesTransfersTest-1302684122 None] Flow 'volume_create_manager' (b6955a05-8fe4-4215-a89a-83159a81d75c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 18 21:07:54.650073 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-d168f51a-1afc-414e-8711-d6e6b8c62a8f tempest-VolumesTransfersTest-1302684122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93b9cbaf-f7ad-4d8c-925c-d91112467cd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:07:54.661567 ncdv-master-1 cinder-volume[134148]: DEBUG oslo_db.sqlalchemy.engines [None req-d168f51a-1afc-414e-8711-d6e6b8c62a8f tempest-VolumesTransfersTest-1302684122 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134148) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 18 21:07:54.682411 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-d168f51a-1afc-414e-8711-d6e6b8c62a8f tempest-VolumesTransfersTest-1302684122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93b9cbaf-f7ad-4d8c-925c-d91112467cd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-12-18T21:07:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1266633364',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=bdde5e34-19ed-4ada-970e-d5aeb3130f5c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59ca1dfad3564b5ab798abcccc7333fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-12-18T21:07:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-12-18T21:07:55Z,use_quota=True,user_id='c3c2db616c524b5d98c030f87fd74034',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f2e1fe1-9fd6-411e-9ed9-368f463ccb6f),volume_type_id=1f2e1fe1-9fd6-411e-9ed9-368f463ccb6f)' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:07:54.685606 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-d168f51a-1afc-414e-8711-d6e6b8c62a8f tempest-VolumesTransfersTest-1302684122 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8213203-cd0a-42a4-9da7-36b26844847b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:07:54.688069 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-d168f51a-1afc-414e-8711-d6e6b8c62a8f tempest-VolumesTransfersTest-1302684122 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8213203-cd0a-42a4-9da7-36b26844847b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:07:54.691554 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-d168f51a-1afc-414e-8711-d6e6b8c62a8f tempest-VolumesTransfersTest-1302684122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (961d1d82-a877-4208-ab2b-6f90f2189071) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:07:54.696262 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-d168f51a-1afc-414e-8711-d6e6b8c62a8f tempest-VolumesTransfersTest-1302684122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (961d1d82-a877-4208-ab2b-6f90f2189071) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bdde5e34-19ed-4ada-970e-d5aeb3130f5c', 'volume_name': 'volume-bdde5e34-19ed-4ada-970e-d5aeb3130f5c', 'volume_size': 1}' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:07:54.698670 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-d168f51a-1afc-414e-8711-d6e6b8c62a8f tempest-VolumesTransfersTest-1302684122 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (892251c5-f823-4d58-b896-ae87af3e0881) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:07:54.700785 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-d168f51a-1afc-414e-8711-d6e6b8c62a8f tempest-VolumesTransfersTest-1302684122 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (892251c5-f823-4d58-b896-ae87af3e0881) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:07:54.707927 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-d168f51a-1afc-414e-8711-d6e6b8c62a8f tempest-VolumesTransfersTest-1302684122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7acb234c-5d4c-40a5-bb4a-730066f278b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:07:54.708773 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.flows.manager.create_volume [None req-d168f51a-1afc-414e-8711-d6e6b8c62a8f tempest-VolumesTransfersTest-1302684122 None] Volume bdde5e34-19ed-4ada-970e-d5aeb3130f5c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bdde5e34-19ed-4ada-970e-d5aeb3130f5c', 'volume_size': 1} Dec 18 21:07:54.709181 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-d168f51a-1afc-414e-8711-d6e6b8c62a8f tempest-VolumesTransfersTest-1302684122 None] creating volume 'volume-bdde5e34-19ed-4ada-970e-d5aeb3130f5c' {{(pid=134148) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Dec 18 21:07:54.711084 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-d168f51a-1afc-414e-8711-d6e6b8c62a8f tempest-VolumesTransfersTest-1302684122 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:07:54.830630 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-d168f51a-1afc-414e-8711-d6e6b8c62a8f tempest-VolumesTransfersTest-1302684122 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134148) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 18 21:07:54.831796 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-d168f51a-1afc-414e-8711-d6e6b8c62a8f tempest-VolumesTransfersTest-1302684122 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134148) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 18 21:07:54.834219 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-d168f51a-1afc-414e-8711-d6e6b8c62a8f tempest-VolumesTransfersTest-1302684122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7acb234c-5d4c-40a5-bb4a-730066f278b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bdde5e34-19ed-4ada-970e-d5aeb3130f5c', 'volume_size': 1}' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:07:54.836781 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-d168f51a-1afc-414e-8711-d6e6b8c62a8f tempest-VolumesTransfersTest-1302684122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d82e0e7a-5bb4-4f2b-aa29-1f81476e0dd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:07:54.855488 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.flows.manager.create_volume [None req-d168f51a-1afc-414e-8711-d6e6b8c62a8f tempest-VolumesTransfersTest-1302684122 None] Volume volume-bdde5e34-19ed-4ada-970e-d5aeb3130f5c (bdde5e34-19ed-4ada-970e-d5aeb3130f5c): created successfully Dec 18 21:07:54.858773 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-d168f51a-1afc-414e-8711-d6e6b8c62a8f tempest-VolumesTransfersTest-1302684122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d82e0e7a-5bb4-4f2b-aa29-1f81476e0dd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:07:54.862130 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-d168f51a-1afc-414e-8711-d6e6b8c62a8f tempest-VolumesTransfersTest-1302684122 None] Flow 'volume_create_manager' (b6955a05-8fe4-4215-a89a-83159a81d75c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134148) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 18 21:07:54.882173 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-d168f51a-1afc-414e-8711-d6e6b8c62a8f tempest-VolumesTransfersTest-1302684122 None] Created volume successfully. Dec 18 21:07:56.578280 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-bb8c52fc-bcf8-4eb1-b12a-a6436f96606c tempest-VolumesTransfersTest-1213009165 None] Transfer volume completed successfully. Dec 18 21:07:57.398294 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.coordination [None req-44bbf4b7-59b6-483a-bdcd-16837f74d159 tempest-VolumesTransfersTest-605349446 None] Lock "b'cinder-bdde5e34-19ed-4ada-970e-d5aeb3130f5c-delete_volume'" acquired by "delete_volume" :: waited 0.014s {{(pid=134148) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 18 21:07:57.476498 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-44bbf4b7-59b6-483a-bdcd-16837f74d159 tempest-VolumesTransfersTest-605349446 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:07:57.540167 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-44bbf4b7-59b6-483a-bdcd-16837f74d159 tempest-VolumesTransfersTest-605349446 None] volume has no backup snaps {{(pid=134148) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Dec 18 21:07:57.541439 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-44bbf4b7-59b6-483a-bdcd-16837f74d159 tempest-VolumesTransfersTest-605349446 None] Volume volume-bdde5e34-19ed-4ada-970e-d5aeb3130f5c is not a clone. {{(pid=134148) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Dec 18 21:07:57.551215 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-44bbf4b7-59b6-483a-bdcd-16837f74d159 tempest-VolumesTransfersTest-605349446 None] deleting rbd volume volume-bdde5e34-19ed-4ada-970e-d5aeb3130f5c {{(pid=134148) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Dec 18 21:07:58.054539 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.quota [None req-44bbf4b7-59b6-483a-bdcd-16837f74d159 tempest-VolumesTransfersTest-605349446 None] Created reservations ['5abb4e52-db1c-4486-b1a8-b28a4a6bf869', 'a291d988-b62c-49e0-b947-e7021ce37179', 'f06cfa70-e137-4b79-812c-5e7a13f6a4ba', '46c4d09a-5263-470c-a508-52b08e693ffc'] {{(pid=134148) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 18 21:07:58.152194 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-44bbf4b7-59b6-483a-bdcd-16837f74d159 tempest-VolumesTransfersTest-605349446 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:07:58.228830 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-44bbf4b7-59b6-483a-bdcd-16837f74d159 tempest-VolumesTransfersTest-605349446 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:07:58.308449 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.manager [None req-44bbf4b7-59b6-483a-bdcd-16837f74d159 tempest-VolumesTransfersTest-605349446 None] Notifying Schedulers of capabilities ... {{(pid=134148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 18 21:07:58.312739 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-44bbf4b7-59b6-483a-bdcd-16837f74d159 tempest-VolumesTransfersTest-605349446 None] Deleted volume successfully. Dec 18 21:07:58.335528 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.coordination [None req-44bbf4b7-59b6-483a-bdcd-16837f74d159 tempest-VolumesTransfersTest-605349446 None] Lock "b'cinder-bdde5e34-19ed-4ada-970e-d5aeb3130f5c-delete_volume'" released by "delete_volume" :: held 0.936s {{(pid=134148) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 18 21:07:59.187552 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.flows.manager.create_volume [None req-cfde6b51-615b-4a33-84a5-c9e51f4c038d tempest-VolumesTransfersTest-1302684122 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134148) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Dec 18 21:07:59.191837 ncdv-master-1 cinder-volume[134148]: WARNING stevedore.named [None req-cfde6b51-615b-4a33-84a5-c9e51f4c038d tempest-VolumesTransfersTest-1302684122 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Dec 18 21:07:59.192762 ncdv-master-1 cinder-volume[134148]: WARNING castellan.key_manager [None req-cfde6b51-615b-4a33-84a5-c9e51f4c038d tempest-VolumesTransfersTest-1302684122 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Dec 18 21:07:59.208254 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-cfde6b51-615b-4a33-84a5-c9e51f4c038d tempest-VolumesTransfersTest-1302684122 None] Flow 'volume_create_manager' (1af9e6c9-26a8-4835-9567-b524190e5ba4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 18 21:07:59.211803 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-cfde6b51-615b-4a33-84a5-c9e51f4c038d tempest-VolumesTransfersTest-1302684122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df61acfa-b5ab-4f3a-8008-6a6879dea685) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:07:59.225940 ncdv-master-1 cinder-volume[134148]: DEBUG oslo_db.sqlalchemy.engines [None req-cfde6b51-615b-4a33-84a5-c9e51f4c038d tempest-VolumesTransfersTest-1302684122 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134148) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 18 21:07:59.260330 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-cfde6b51-615b-4a33-84a5-c9e51f4c038d tempest-VolumesTransfersTest-1302684122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df61acfa-b5ab-4f3a-8008-6a6879dea685) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-12-18T21:07:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-496387951',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=22ab60f2-a894-4a64-8adb-c4ae0b8a60a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59ca1dfad3564b5ab798abcccc7333fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-12-18T21:07:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-12-18T21:07:59Z,use_quota=True,user_id='c3c2db616c524b5d98c030f87fd74034',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f2e1fe1-9fd6-411e-9ed9-368f463ccb6f),volume_type_id=1f2e1fe1-9fd6-411e-9ed9-368f463ccb6f)' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:07:59.267257 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-cfde6b51-615b-4a33-84a5-c9e51f4c038d tempest-VolumesTransfersTest-1302684122 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (245b9f63-2b64-4a37-bae6-8d0a8938d0e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:07:59.273640 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-cfde6b51-615b-4a33-84a5-c9e51f4c038d tempest-VolumesTransfersTest-1302684122 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (245b9f63-2b64-4a37-bae6-8d0a8938d0e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:07:59.283509 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-cfde6b51-615b-4a33-84a5-c9e51f4c038d tempest-VolumesTransfersTest-1302684122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f07243f7-c4d6-4346-8d6c-64d836168960) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:07:59.289226 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-cfde6b51-615b-4a33-84a5-c9e51f4c038d tempest-VolumesTransfersTest-1302684122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f07243f7-c4d6-4346-8d6c-64d836168960) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '22ab60f2-a894-4a64-8adb-c4ae0b8a60a6', 'volume_name': 'volume-22ab60f2-a894-4a64-8adb-c4ae0b8a60a6', 'volume_size': 1}' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:07:59.305827 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-cfde6b51-615b-4a33-84a5-c9e51f4c038d tempest-VolumesTransfersTest-1302684122 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40cba6ce-f8ce-4aeb-84c2-deaa7be1f54b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:07:59.313888 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-cfde6b51-615b-4a33-84a5-c9e51f4c038d tempest-VolumesTransfersTest-1302684122 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40cba6ce-f8ce-4aeb-84c2-deaa7be1f54b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:07:59.318516 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-cfde6b51-615b-4a33-84a5-c9e51f4c038d tempest-VolumesTransfersTest-1302684122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e121d16-e1f5-4347-ae1d-8cb42019976d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:07:59.323091 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.flows.manager.create_volume [None req-cfde6b51-615b-4a33-84a5-c9e51f4c038d tempest-VolumesTransfersTest-1302684122 None] Volume 22ab60f2-a894-4a64-8adb-c4ae0b8a60a6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-22ab60f2-a894-4a64-8adb-c4ae0b8a60a6', 'volume_size': 1} Dec 18 21:07:59.323955 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-cfde6b51-615b-4a33-84a5-c9e51f4c038d tempest-VolumesTransfersTest-1302684122 None] creating volume 'volume-22ab60f2-a894-4a64-8adb-c4ae0b8a60a6' {{(pid=134148) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Dec 18 21:07:59.330021 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-cfde6b51-615b-4a33-84a5-c9e51f4c038d tempest-VolumesTransfersTest-1302684122 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:07:59.481362 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-cfde6b51-615b-4a33-84a5-c9e51f4c038d tempest-VolumesTransfersTest-1302684122 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134148) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 18 21:07:59.482967 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-cfde6b51-615b-4a33-84a5-c9e51f4c038d tempest-VolumesTransfersTest-1302684122 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134148) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 18 21:07:59.485192 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-cfde6b51-615b-4a33-84a5-c9e51f4c038d tempest-VolumesTransfersTest-1302684122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e121d16-e1f5-4347-ae1d-8cb42019976d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-22ab60f2-a894-4a64-8adb-c4ae0b8a60a6', 'volume_size': 1}' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:07:59.488119 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-cfde6b51-615b-4a33-84a5-c9e51f4c038d tempest-VolumesTransfersTest-1302684122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0205a3e4-881d-4ce2-80d0-87ef208d4b9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:07:59.503671 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.flows.manager.create_volume [None req-cfde6b51-615b-4a33-84a5-c9e51f4c038d tempest-VolumesTransfersTest-1302684122 None] Volume volume-22ab60f2-a894-4a64-8adb-c4ae0b8a60a6 (22ab60f2-a894-4a64-8adb-c4ae0b8a60a6): created successfully Dec 18 21:07:59.516683 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-cfde6b51-615b-4a33-84a5-c9e51f4c038d tempest-VolumesTransfersTest-1302684122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0205a3e4-881d-4ce2-80d0-87ef208d4b9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:07:59.525465 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-cfde6b51-615b-4a33-84a5-c9e51f4c038d tempest-VolumesTransfersTest-1302684122 None] Flow 'volume_create_manager' (1af9e6c9-26a8-4835-9567-b524190e5ba4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134148) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 18 21:07:59.540246 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-cfde6b51-615b-4a33-84a5-c9e51f4c038d tempest-VolumesTransfersTest-1302684122 None] Created volume successfully. Dec 18 21:08:00.820927 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.coordination [None req-e60cccaf-5b62-4856-9d0d-5bb9ed482bf1 tempest-VolumesTransfersTest-605349446 None] Lock "b'cinder-22ab60f2-a894-4a64-8adb-c4ae0b8a60a6-delete_volume'" acquired by "delete_volume" :: waited 0.022s {{(pid=134148) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 18 21:08:00.892230 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-e60cccaf-5b62-4856-9d0d-5bb9ed482bf1 tempest-VolumesTransfersTest-605349446 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:08:00.989988 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-e60cccaf-5b62-4856-9d0d-5bb9ed482bf1 tempest-VolumesTransfersTest-605349446 None] volume has no backup snaps {{(pid=134148) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Dec 18 21:08:00.991184 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-e60cccaf-5b62-4856-9d0d-5bb9ed482bf1 tempest-VolumesTransfersTest-605349446 None] Volume volume-22ab60f2-a894-4a64-8adb-c4ae0b8a60a6 is not a clone. {{(pid=134148) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Dec 18 21:08:01.004443 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-e60cccaf-5b62-4856-9d0d-5bb9ed482bf1 tempest-VolumesTransfersTest-605349446 None] deleting rbd volume volume-22ab60f2-a894-4a64-8adb-c4ae0b8a60a6 {{(pid=134148) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Dec 18 21:08:01.536151 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.quota [None req-e60cccaf-5b62-4856-9d0d-5bb9ed482bf1 tempest-VolumesTransfersTest-605349446 None] Created reservations ['bf9bb0de-8574-440c-abb6-7fc279c9615b', '46eacff9-2af2-478c-b8b4-149abcbf1b19', 'd06a7975-7815-42de-911e-08e59fde46a6', '55d55f03-419f-4ce7-ab75-e35308ccb4b0'] {{(pid=134148) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 18 21:08:01.652547 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-e60cccaf-5b62-4856-9d0d-5bb9ed482bf1 tempest-VolumesTransfersTest-605349446 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:08:01.725898 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-e60cccaf-5b62-4856-9d0d-5bb9ed482bf1 tempest-VolumesTransfersTest-605349446 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:08:01.785010 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.manager [None req-e60cccaf-5b62-4856-9d0d-5bb9ed482bf1 tempest-VolumesTransfersTest-605349446 None] Notifying Schedulers of capabilities ... {{(pid=134148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 18 21:08:01.799118 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-e60cccaf-5b62-4856-9d0d-5bb9ed482bf1 tempest-VolumesTransfersTest-605349446 None] Deleted volume successfully. Dec 18 21:08:01.815283 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.flows.manager.create_volume [None req-3d48d9a7-f5e2-4a29-9cfb-87addbad09ff tempest-VolumesDeleteCascade-918914928 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134148) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Dec 18 21:08:01.821618 ncdv-master-1 cinder-volume[134148]: WARNING stevedore.named [None req-3d48d9a7-f5e2-4a29-9cfb-87addbad09ff tempest-VolumesDeleteCascade-918914928 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Dec 18 21:08:01.823306 ncdv-master-1 cinder-volume[134148]: WARNING castellan.key_manager [None req-3d48d9a7-f5e2-4a29-9cfb-87addbad09ff tempest-VolumesDeleteCascade-918914928 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Dec 18 21:08:01.854579 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-3d48d9a7-f5e2-4a29-9cfb-87addbad09ff tempest-VolumesDeleteCascade-918914928 None] Flow 'volume_create_manager' (9d354e21-d5ba-4615-8e55-47c801f3d715) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 18 21:08:01.858629 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-3d48d9a7-f5e2-4a29-9cfb-87addbad09ff tempest-VolumesDeleteCascade-918914928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (113f337a-d806-48bb-ba49-96799254dc42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:08:01.867992 ncdv-master-1 cinder-volume[134148]: DEBUG oslo_db.sqlalchemy.engines [None req-3d48d9a7-f5e2-4a29-9cfb-87addbad09ff tempest-VolumesDeleteCascade-918914928 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134148) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 18 21:08:01.883371 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.coordination [None req-e60cccaf-5b62-4856-9d0d-5bb9ed482bf1 tempest-VolumesTransfersTest-605349446 None] Lock "b'cinder-22ab60f2-a894-4a64-8adb-c4ae0b8a60a6-delete_volume'" released by "delete_volume" :: held 1.062s {{(pid=134148) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 18 21:08:01.890150 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-3d48d9a7-f5e2-4a29-9cfb-87addbad09ff tempest-VolumesDeleteCascade-918914928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (113f337a-d806-48bb-ba49-96799254dc42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-12-18T21:08:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-286017680',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=0bd61e3d-6941-4dc7-bd17-dc3c97ab282d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1993bfd02e94412d835129f98b8e529d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-12-18T21:08:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-12-18T21:08:02Z,use_quota=True,user_id='9467ccf6f7494cdc811aaa555a657cca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f2e1fe1-9fd6-411e-9ed9-368f463ccb6f),volume_type_id=1f2e1fe1-9fd6-411e-9ed9-368f463ccb6f)' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:08:01.893074 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-3d48d9a7-f5e2-4a29-9cfb-87addbad09ff tempest-VolumesDeleteCascade-918914928 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0460ca7e-9669-4e59-a7b3-e98dfcd5d5be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:08:01.895946 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-3d48d9a7-f5e2-4a29-9cfb-87addbad09ff tempest-VolumesDeleteCascade-918914928 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0460ca7e-9669-4e59-a7b3-e98dfcd5d5be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:08:01.898710 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-3d48d9a7-f5e2-4a29-9cfb-87addbad09ff tempest-VolumesDeleteCascade-918914928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dbf6f152-e7c0-460b-8bd8-83058d211807) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:08:01.901413 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-3d48d9a7-f5e2-4a29-9cfb-87addbad09ff tempest-VolumesDeleteCascade-918914928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dbf6f152-e7c0-460b-8bd8-83058d211807) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0bd61e3d-6941-4dc7-bd17-dc3c97ab282d', 'volume_name': 'volume-0bd61e3d-6941-4dc7-bd17-dc3c97ab282d', 'volume_size': 1}' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:08:01.904524 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-3d48d9a7-f5e2-4a29-9cfb-87addbad09ff tempest-VolumesDeleteCascade-918914928 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (165664d1-37d4-4564-9fc1-0238cc3fb3e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:08:01.907141 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-3d48d9a7-f5e2-4a29-9cfb-87addbad09ff tempest-VolumesDeleteCascade-918914928 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (165664d1-37d4-4564-9fc1-0238cc3fb3e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:08:01.910114 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-3d48d9a7-f5e2-4a29-9cfb-87addbad09ff tempest-VolumesDeleteCascade-918914928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30278f30-cec9-4ef1-9acd-ece40f4baed4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:08:01.911094 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.flows.manager.create_volume [None req-3d48d9a7-f5e2-4a29-9cfb-87addbad09ff tempest-VolumesDeleteCascade-918914928 None] Volume 0bd61e3d-6941-4dc7-bd17-dc3c97ab282d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0bd61e3d-6941-4dc7-bd17-dc3c97ab282d', 'volume_size': 1} Dec 18 21:08:01.911649 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-3d48d9a7-f5e2-4a29-9cfb-87addbad09ff tempest-VolumesDeleteCascade-918914928 None] creating volume 'volume-0bd61e3d-6941-4dc7-bd17-dc3c97ab282d' {{(pid=134148) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Dec 18 21:08:01.912800 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-3d48d9a7-f5e2-4a29-9cfb-87addbad09ff tempest-VolumesDeleteCascade-918914928 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:08:02.049429 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-3d48d9a7-f5e2-4a29-9cfb-87addbad09ff tempest-VolumesDeleteCascade-918914928 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134148) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 18 21:08:02.049809 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-3d48d9a7-f5e2-4a29-9cfb-87addbad09ff tempest-VolumesDeleteCascade-918914928 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134148) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 18 21:08:02.052122 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-3d48d9a7-f5e2-4a29-9cfb-87addbad09ff tempest-VolumesDeleteCascade-918914928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30278f30-cec9-4ef1-9acd-ece40f4baed4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0bd61e3d-6941-4dc7-bd17-dc3c97ab282d', 'volume_size': 1}' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:08:02.055011 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-3d48d9a7-f5e2-4a29-9cfb-87addbad09ff tempest-VolumesDeleteCascade-918914928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70c307b4-6256-4f0f-9f18-3278bee79be9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:08:02.081918 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.flows.manager.create_volume [None req-3d48d9a7-f5e2-4a29-9cfb-87addbad09ff tempest-VolumesDeleteCascade-918914928 None] Volume volume-0bd61e3d-6941-4dc7-bd17-dc3c97ab282d (0bd61e3d-6941-4dc7-bd17-dc3c97ab282d): created successfully Dec 18 21:08:02.089321 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-3d48d9a7-f5e2-4a29-9cfb-87addbad09ff tempest-VolumesDeleteCascade-918914928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70c307b4-6256-4f0f-9f18-3278bee79be9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:08:02.099178 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-3d48d9a7-f5e2-4a29-9cfb-87addbad09ff tempest-VolumesDeleteCascade-918914928 None] Flow 'volume_create_manager' (9d354e21-d5ba-4615-8e55-47c801f3d715) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134148) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 18 21:08:02.128595 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-3d48d9a7-f5e2-4a29-9cfb-87addbad09ff tempest-VolumesDeleteCascade-918914928 None] Created volume successfully. Dec 18 21:08:03.410205 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-5948f58d-9086-45f9-8986-44320c213122 tempest-VolumesDeleteCascade-918914928 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:08:03.547474 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.coordination [None req-fb2cb338-7c25-447b-b81b-13d26dd44d2e tempest-DeleteServersTestJSON-508589951 None] Lock "b'cinder-fbf7eaf2-c408-4d24-9a0e-9cee7a2427a8-delete_volume'" acquired by "delete_volume" :: waited 0.036s {{(pid=134148) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 18 21:08:03.657833 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-fb2cb338-7c25-447b-b81b-13d26dd44d2e tempest-DeleteServersTestJSON-508589951 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:08:03.780345 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-fb2cb338-7c25-447b-b81b-13d26dd44d2e tempest-DeleteServersTestJSON-508589951 None] volume has no backup snaps {{(pid=134148) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Dec 18 21:08:03.781006 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-fb2cb338-7c25-447b-b81b-13d26dd44d2e tempest-DeleteServersTestJSON-508589951 None] Volume volume-fbf7eaf2-c408-4d24-9a0e-9cee7a2427a8 is not a clone. {{(pid=134148) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Dec 18 21:08:03.792227 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-fb2cb338-7c25-447b-b81b-13d26dd44d2e tempest-DeleteServersTestJSON-508589951 None] deleting rbd volume volume-fbf7eaf2-c408-4d24-9a0e-9cee7a2427a8 {{(pid=134148) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Dec 18 21:08:04.291017 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.quota [None req-fb2cb338-7c25-447b-b81b-13d26dd44d2e tempest-DeleteServersTestJSON-508589951 None] Created reservations ['5c0804ce-58f6-45e9-b0e2-3eb6e4f4d625', 'b69a3def-5691-4b51-b2e2-14f811a4e42d', '1022206d-0210-41bf-9b8f-d1545bbc5275', 'fd5a8f13-c669-43b3-beb2-301987f36672'] {{(pid=134148) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 18 21:08:04.326470 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-5948f58d-9086-45f9-8986-44320c213122 tempest-VolumesDeleteCascade-918914928 None] Create snapshot completed successfully Dec 18 21:08:04.396323 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-fb2cb338-7c25-447b-b81b-13d26dd44d2e tempest-DeleteServersTestJSON-508589951 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:08:04.457403 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-fb2cb338-7c25-447b-b81b-13d26dd44d2e tempest-DeleteServersTestJSON-508589951 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:08:04.534408 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.manager [None req-fb2cb338-7c25-447b-b81b-13d26dd44d2e tempest-DeleteServersTestJSON-508589951 None] Notifying Schedulers of capabilities ... {{(pid=134148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 18 21:08:04.540800 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-fb2cb338-7c25-447b-b81b-13d26dd44d2e tempest-DeleteServersTestJSON-508589951 None] Deleted volume successfully. Dec 18 21:08:04.572306 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.coordination [None req-fb2cb338-7c25-447b-b81b-13d26dd44d2e tempest-DeleteServersTestJSON-508589951 None] Lock "b'cinder-fbf7eaf2-c408-4d24-9a0e-9cee7a2427a8-delete_volume'" released by "delete_volume" :: held 1.024s {{(pid=134148) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 18 21:08:04.794319 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-ad325577-ab1c-4ce8-b67d-39ddc0a35e16 tempest-VolumesDeleteCascade-918914928 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:08:05.288526 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-ad325577-ab1c-4ce8-b67d-39ddc0a35e16 tempest-VolumesDeleteCascade-918914928 None] Create snapshot completed successfully Dec 18 21:08:05.960326 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.coordination [None req-80baff9a-5592-4647-9573-7ceb80e1ca44 tempest-VolumesDeleteCascade-918914928 None] Lock "b'cinder-0bd61e3d-6941-4dc7-bd17-dc3c97ab282d-delete_volume'" acquired by "delete_volume" :: waited 0.024s {{(pid=134148) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 18 21:08:06.058047 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-80baff9a-5592-4647-9573-7ceb80e1ca44 tempest-VolumesDeleteCascade-918914928 None] Performing cascade delete. {{(pid=134148) delete_volume /opt/stack/cinder/cinder/volume/manager.py:959}} Dec 18 21:08:06.098900 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.coordination [None req-80baff9a-5592-4647-9573-7ceb80e1ca44 tempest-VolumesDeleteCascade-918914928 None] Lock "b'cinder-5fc4a812-00b5-476d-a6bb-1c941fff4b40-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.019s {{(pid=134148) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 18 21:08:06.111973 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-80baff9a-5592-4647-9573-7ceb80e1ca44 tempest-VolumesDeleteCascade-918914928 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:08:07.326057 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.quota [None req-80baff9a-5592-4647-9573-7ceb80e1ca44 tempest-VolumesDeleteCascade-918914928 None] Created reservations ['20b2dacb-ffa0-4801-9aa3-bdc28fd5b1f1', '30a031d7-338e-47c5-ae37-38d707dd2148', '9e35e7e5-4447-40c6-a997-6a0675a0f76f', '588fa13f-3bd1-437d-80be-0b6b664b2112'] {{(pid=134148) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 18 21:08:07.442664 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-80baff9a-5592-4647-9573-7ceb80e1ca44 tempest-VolumesDeleteCascade-918914928 None] Delete snapshot completed successfully. Dec 18 21:08:07.451128 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.coordination [None req-80baff9a-5592-4647-9573-7ceb80e1ca44 tempest-VolumesDeleteCascade-918914928 None] Lock "b'cinder-5fc4a812-00b5-476d-a6bb-1c941fff4b40-delete_snapshot'" released by "delete_snapshot" :: held 1.352s {{(pid=134148) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 18 21:08:07.474953 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.coordination [None req-80baff9a-5592-4647-9573-7ceb80e1ca44 tempest-VolumesDeleteCascade-918914928 None] Lock "b'cinder-9a10304a-ed73-4614-8143-f2370bcbb4c1-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.023s {{(pid=134148) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 18 21:08:07.504965 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-80baff9a-5592-4647-9573-7ceb80e1ca44 tempest-VolumesDeleteCascade-918914928 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:08:08.332394 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.quota [None req-80baff9a-5592-4647-9573-7ceb80e1ca44 tempest-VolumesDeleteCascade-918914928 None] Created reservations ['b1e4c063-f951-4d92-bcd5-f9711ae21f94', '801d8854-19f7-4004-a0ff-ce8903fbab12', 'c5274a60-ae97-4289-8a19-cd6d0386f478', '12f26f4d-3c0c-46e9-b3f7-bfdbd6ee5543'] {{(pid=134148) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 18 21:08:08.393817 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-80baff9a-5592-4647-9573-7ceb80e1ca44 tempest-VolumesDeleteCascade-918914928 None] Delete snapshot completed successfully. Dec 18 21:08:08.404462 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.coordination [None req-80baff9a-5592-4647-9573-7ceb80e1ca44 tempest-VolumesDeleteCascade-918914928 None] Lock "b'cinder-9a10304a-ed73-4614-8143-f2370bcbb4c1-delete_snapshot'" released by "delete_snapshot" :: held 0.929s {{(pid=134148) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 18 21:08:08.405338 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-80baff9a-5592-4647-9573-7ceb80e1ca44 tempest-VolumesDeleteCascade-918914928 None] Snapshots deleted, issuing volume delete {{(pid=134148) delete_volume /opt/stack/cinder/cinder/volume/manager.py:974}} Dec 18 21:08:08.406951 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-80baff9a-5592-4647-9573-7ceb80e1ca44 tempest-VolumesDeleteCascade-918914928 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:08:08.511549 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-80baff9a-5592-4647-9573-7ceb80e1ca44 tempest-VolumesDeleteCascade-918914928 None] volume has no backup snaps {{(pid=134148) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Dec 18 21:08:08.512311 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-80baff9a-5592-4647-9573-7ceb80e1ca44 tempest-VolumesDeleteCascade-918914928 None] Volume volume-0bd61e3d-6941-4dc7-bd17-dc3c97ab282d is not a clone. {{(pid=134148) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Dec 18 21:08:08.531743 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-80baff9a-5592-4647-9573-7ceb80e1ca44 tempest-VolumesDeleteCascade-918914928 None] deleting rbd volume volume-0bd61e3d-6941-4dc7-bd17-dc3c97ab282d {{(pid=134148) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Dec 18 21:08:08.977312 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.quota [None req-80baff9a-5592-4647-9573-7ceb80e1ca44 tempest-VolumesDeleteCascade-918914928 None] Created reservations ['9e6920fe-ab2a-453b-8925-d6b51c7bfda2', '512242d2-db77-4cf4-8020-78d18aca1365', '13247227-23df-4017-987b-fa387d4a08c8', '65e7cbcb-c6bb-47c2-9632-f6f7511fc9ca'] {{(pid=134148) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 18 21:08:09.036898 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-80baff9a-5592-4647-9573-7ceb80e1ca44 tempest-VolumesDeleteCascade-918914928 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:08:09.103583 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-80baff9a-5592-4647-9573-7ceb80e1ca44 tempest-VolumesDeleteCascade-918914928 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:08:09.163997 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.manager [None req-80baff9a-5592-4647-9573-7ceb80e1ca44 tempest-VolumesDeleteCascade-918914928 None] Notifying Schedulers of capabilities ... {{(pid=134148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 18 21:08:09.168376 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-80baff9a-5592-4647-9573-7ceb80e1ca44 tempest-VolumesDeleteCascade-918914928 None] Deleted volume successfully. Dec 18 21:08:09.194283 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.coordination [None req-80baff9a-5592-4647-9573-7ceb80e1ca44 tempest-VolumesDeleteCascade-918914928 None] Lock "b'cinder-0bd61e3d-6941-4dc7-bd17-dc3c97ab282d-delete_volume'" released by "delete_volume" :: held 3.236s {{(pid=134148) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 18 21:08:11.891774 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.flows.manager.create_volume [None req-f92513c8-aa66-4792-adfc-a0490f47923c tempest-VolumesListTestJSON-1619846612 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134148) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Dec 18 21:08:11.896653 ncdv-master-1 cinder-volume[134148]: WARNING stevedore.named [None req-f92513c8-aa66-4792-adfc-a0490f47923c tempest-VolumesListTestJSON-1619846612 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Dec 18 21:08:11.897095 ncdv-master-1 cinder-volume[134148]: WARNING castellan.key_manager [None req-f92513c8-aa66-4792-adfc-a0490f47923c tempest-VolumesListTestJSON-1619846612 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Dec 18 21:08:11.955605 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-f92513c8-aa66-4792-adfc-a0490f47923c tempest-VolumesListTestJSON-1619846612 None] Flow 'volume_create_manager' (38404b28-bfd8-452f-aafd-d3ffcfae4e13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 18 21:08:11.970193 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-f92513c8-aa66-4792-adfc-a0490f47923c tempest-VolumesListTestJSON-1619846612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3aef792d-8ff6-41d5-a4d9-6b0115ebb767) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:08:11.993476 ncdv-master-1 cinder-volume[134148]: DEBUG oslo_db.sqlalchemy.engines [None req-f92513c8-aa66-4792-adfc-a0490f47923c tempest-VolumesListTestJSON-1619846612 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134148) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 18 21:08:12.052508 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-f92513c8-aa66-4792-adfc-a0490f47923c tempest-VolumesListTestJSON-1619846612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3aef792d-8ff6-41d5-a4d9-6b0115ebb767) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-12-18T21:08:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-17652489',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=af2cc1cc-7181-4014-852d-b4616e8bb17b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b95f79502f564ca1ac30fb7eeaa4d0c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-12-18T21:08:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-12-18T21:08:12Z,use_quota=True,user_id='cef85da08a92421382f7ebd7a3e9af66',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f2e1fe1-9fd6-411e-9ed9-368f463ccb6f),volume_type_id=1f2e1fe1-9fd6-411e-9ed9-368f463ccb6f)' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:08:12.059233 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-f92513c8-aa66-4792-adfc-a0490f47923c tempest-VolumesListTestJSON-1619846612 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5fe09a1-c07d-4852-a933-2a523440e3a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:08:12.067839 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-f92513c8-aa66-4792-adfc-a0490f47923c tempest-VolumesListTestJSON-1619846612 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5fe09a1-c07d-4852-a933-2a523440e3a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:08:12.076752 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-f92513c8-aa66-4792-adfc-a0490f47923c tempest-VolumesListTestJSON-1619846612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bfe58880-8e8f-4064-9e24-7079ee439943) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:08:12.083533 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-f92513c8-aa66-4792-adfc-a0490f47923c tempest-VolumesListTestJSON-1619846612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bfe58880-8e8f-4064-9e24-7079ee439943) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'af2cc1cc-7181-4014-852d-b4616e8bb17b', 'volume_name': 'volume-af2cc1cc-7181-4014-852d-b4616e8bb17b', 'volume_size': 1}' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:08:12.092877 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-f92513c8-aa66-4792-adfc-a0490f47923c tempest-VolumesListTestJSON-1619846612 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51c742d6-3227-439c-a790-f1fb7558f426) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:08:12.104000 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-f92513c8-aa66-4792-adfc-a0490f47923c tempest-VolumesListTestJSON-1619846612 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51c742d6-3227-439c-a790-f1fb7558f426) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:08:12.108801 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-f92513c8-aa66-4792-adfc-a0490f47923c tempest-VolumesListTestJSON-1619846612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44d9a0c6-9725-4126-b6ae-b627e28a7c9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:08:12.114140 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.flows.manager.create_volume [None req-f92513c8-aa66-4792-adfc-a0490f47923c tempest-VolumesListTestJSON-1619846612 None] Volume af2cc1cc-7181-4014-852d-b4616e8bb17b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-af2cc1cc-7181-4014-852d-b4616e8bb17b', 'volume_size': 1} Dec 18 21:08:12.115778 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-f92513c8-aa66-4792-adfc-a0490f47923c tempest-VolumesListTestJSON-1619846612 None] creating volume 'volume-af2cc1cc-7181-4014-852d-b4616e8bb17b' {{(pid=134148) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Dec 18 21:08:12.117391 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-f92513c8-aa66-4792-adfc-a0490f47923c tempest-VolumesListTestJSON-1619846612 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:08:12.268931 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-f92513c8-aa66-4792-adfc-a0490f47923c tempest-VolumesListTestJSON-1619846612 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134148) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 18 21:08:12.269794 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-f92513c8-aa66-4792-adfc-a0490f47923c tempest-VolumesListTestJSON-1619846612 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134148) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 18 21:08:12.272149 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-f92513c8-aa66-4792-adfc-a0490f47923c tempest-VolumesListTestJSON-1619846612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44d9a0c6-9725-4126-b6ae-b627e28a7c9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-af2cc1cc-7181-4014-852d-b4616e8bb17b', 'volume_size': 1}' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:08:12.274533 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-f92513c8-aa66-4792-adfc-a0490f47923c tempest-VolumesListTestJSON-1619846612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb7d4248-db62-404a-b169-dd9ea8885412) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:08:12.287192 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.flows.manager.create_volume [None req-f92513c8-aa66-4792-adfc-a0490f47923c tempest-VolumesListTestJSON-1619846612 None] Volume volume-af2cc1cc-7181-4014-852d-b4616e8bb17b (af2cc1cc-7181-4014-852d-b4616e8bb17b): created successfully Dec 18 21:08:12.289865 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-f92513c8-aa66-4792-adfc-a0490f47923c tempest-VolumesListTestJSON-1619846612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb7d4248-db62-404a-b169-dd9ea8885412) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:08:12.294634 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-f92513c8-aa66-4792-adfc-a0490f47923c tempest-VolumesListTestJSON-1619846612 None] Flow 'volume_create_manager' (38404b28-bfd8-452f-aafd-d3ffcfae4e13) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134148) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 18 21:08:12.311461 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-f92513c8-aa66-4792-adfc-a0490f47923c tempest-VolumesListTestJSON-1619846612 None] Created volume successfully. Dec 18 21:08:13.564159 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.flows.manager.create_volume [None req-30db8905-d776-4983-bf30-89ef98774779 tempest-VolumesListTestJSON-1619846612 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134148) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Dec 18 21:08:13.572625 ncdv-master-1 cinder-volume[134148]: WARNING stevedore.named [None req-30db8905-d776-4983-bf30-89ef98774779 tempest-VolumesListTestJSON-1619846612 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Dec 18 21:08:13.573087 ncdv-master-1 cinder-volume[134148]: WARNING castellan.key_manager [None req-30db8905-d776-4983-bf30-89ef98774779 tempest-VolumesListTestJSON-1619846612 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Dec 18 21:08:13.607990 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-30db8905-d776-4983-bf30-89ef98774779 tempest-VolumesListTestJSON-1619846612 None] Flow 'volume_create_manager' (d89abc67-3a5e-457a-ace8-faa818703faf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 18 21:08:13.612308 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-30db8905-d776-4983-bf30-89ef98774779 tempest-VolumesListTestJSON-1619846612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc747514-51d7-401b-b9b4-c9681a45adb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:08:13.619985 ncdv-master-1 cinder-volume[134148]: DEBUG oslo_db.sqlalchemy.engines [None req-30db8905-d776-4983-bf30-89ef98774779 tempest-VolumesListTestJSON-1619846612 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134148) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 18 21:08:13.634866 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-30db8905-d776-4983-bf30-89ef98774779 tempest-VolumesListTestJSON-1619846612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc747514-51d7-401b-b9b4-c9681a45adb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-12-18T21:08:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-2144172197',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=c72dc49d-7a0a-4ae1-8c1e-849897fbaf44,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b95f79502f564ca1ac30fb7eeaa4d0c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-12-18T21:08:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-12-18T21:08:14Z,use_quota=True,user_id='cef85da08a92421382f7ebd7a3e9af66',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f2e1fe1-9fd6-411e-9ed9-368f463ccb6f),volume_type_id=1f2e1fe1-9fd6-411e-9ed9-368f463ccb6f)' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:08:13.638673 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-30db8905-d776-4983-bf30-89ef98774779 tempest-VolumesListTestJSON-1619846612 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1c3619c-7b12-4cca-9aa6-46d0d71b04d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:08:13.641408 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-30db8905-d776-4983-bf30-89ef98774779 tempest-VolumesListTestJSON-1619846612 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1c3619c-7b12-4cca-9aa6-46d0d71b04d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:08:13.644138 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-30db8905-d776-4983-bf30-89ef98774779 tempest-VolumesListTestJSON-1619846612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b0bca04-43a7-449c-88de-164bcdc124de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:08:13.648027 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-30db8905-d776-4983-bf30-89ef98774779 tempest-VolumesListTestJSON-1619846612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b0bca04-43a7-449c-88de-164bcdc124de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c72dc49d-7a0a-4ae1-8c1e-849897fbaf44', 'volume_name': 'volume-c72dc49d-7a0a-4ae1-8c1e-849897fbaf44', 'volume_size': 1}' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:08:13.650466 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-30db8905-d776-4983-bf30-89ef98774779 tempest-VolumesListTestJSON-1619846612 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff1ae342-fbf0-41a4-8d1a-84a68d81a297) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:08:13.652928 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-30db8905-d776-4983-bf30-89ef98774779 tempest-VolumesListTestJSON-1619846612 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff1ae342-fbf0-41a4-8d1a-84a68d81a297) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:08:13.655400 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-30db8905-d776-4983-bf30-89ef98774779 tempest-VolumesListTestJSON-1619846612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (791ba4ba-c522-4c24-b3ab-7cc3fae84845) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:08:13.656627 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.flows.manager.create_volume [None req-30db8905-d776-4983-bf30-89ef98774779 tempest-VolumesListTestJSON-1619846612 None] Volume c72dc49d-7a0a-4ae1-8c1e-849897fbaf44: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c72dc49d-7a0a-4ae1-8c1e-849897fbaf44', 'volume_size': 1} Dec 18 21:08:13.657179 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-30db8905-d776-4983-bf30-89ef98774779 tempest-VolumesListTestJSON-1619846612 None] creating volume 'volume-c72dc49d-7a0a-4ae1-8c1e-849897fbaf44' {{(pid=134148) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Dec 18 21:08:13.658694 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-30db8905-d776-4983-bf30-89ef98774779 tempest-VolumesListTestJSON-1619846612 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:08:13.757937 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-30db8905-d776-4983-bf30-89ef98774779 tempest-VolumesListTestJSON-1619846612 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134148) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 18 21:08:13.758671 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-30db8905-d776-4983-bf30-89ef98774779 tempest-VolumesListTestJSON-1619846612 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134148) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 18 21:08:13.761705 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-30db8905-d776-4983-bf30-89ef98774779 tempest-VolumesListTestJSON-1619846612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (791ba4ba-c522-4c24-b3ab-7cc3fae84845) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c72dc49d-7a0a-4ae1-8c1e-849897fbaf44', 'volume_size': 1}' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:08:13.764283 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-30db8905-d776-4983-bf30-89ef98774779 tempest-VolumesListTestJSON-1619846612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16248736-ceac-49b1-8c27-a98afb8faf09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:08:13.792049 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.flows.manager.create_volume [None req-30db8905-d776-4983-bf30-89ef98774779 tempest-VolumesListTestJSON-1619846612 None] Volume volume-c72dc49d-7a0a-4ae1-8c1e-849897fbaf44 (c72dc49d-7a0a-4ae1-8c1e-849897fbaf44): created successfully Dec 18 21:08:13.796913 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-30db8905-d776-4983-bf30-89ef98774779 tempest-VolumesListTestJSON-1619846612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16248736-ceac-49b1-8c27-a98afb8faf09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:08:13.805027 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-30db8905-d776-4983-bf30-89ef98774779 tempest-VolumesListTestJSON-1619846612 None] Flow 'volume_create_manager' (d89abc67-3a5e-457a-ace8-faa818703faf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134148) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 18 21:08:13.824406 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-30db8905-d776-4983-bf30-89ef98774779 tempest-VolumesListTestJSON-1619846612 None] Created volume successfully. Dec 18 21:08:15.314655 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.flows.manager.create_volume [None req-076fca0c-a0aa-478a-b36b-8960f475b0cf tempest-VolumesListTestJSON-1619846612 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134148) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Dec 18 21:08:15.318597 ncdv-master-1 cinder-volume[134148]: WARNING stevedore.named [None req-076fca0c-a0aa-478a-b36b-8960f475b0cf tempest-VolumesListTestJSON-1619846612 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Dec 18 21:08:15.319246 ncdv-master-1 cinder-volume[134148]: WARNING castellan.key_manager [None req-076fca0c-a0aa-478a-b36b-8960f475b0cf tempest-VolumesListTestJSON-1619846612 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Dec 18 21:08:15.333781 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-076fca0c-a0aa-478a-b36b-8960f475b0cf tempest-VolumesListTestJSON-1619846612 None] Flow 'volume_create_manager' (4bcb3f35-ebe5-4c8d-8519-6e9c07dfab73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 18 21:08:15.338175 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-076fca0c-a0aa-478a-b36b-8960f475b0cf tempest-VolumesListTestJSON-1619846612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18e676a4-e885-45d3-928d-989110930cbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:08:15.346862 ncdv-master-1 cinder-volume[134148]: DEBUG oslo_db.sqlalchemy.engines [None req-076fca0c-a0aa-478a-b36b-8960f475b0cf tempest-VolumesListTestJSON-1619846612 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134148) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 18 21:08:15.368635 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-076fca0c-a0aa-478a-b36b-8960f475b0cf tempest-VolumesListTestJSON-1619846612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18e676a4-e885-45d3-928d-989110930cbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-12-18T21:08:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-881174205',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=26d96f52-afe5-48c4-a588-5bd3e9b18c69,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b95f79502f564ca1ac30fb7eeaa4d0c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-12-18T21:08:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-12-18T21:08:15Z,use_quota=True,user_id='cef85da08a92421382f7ebd7a3e9af66',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f2e1fe1-9fd6-411e-9ed9-368f463ccb6f),volume_type_id=1f2e1fe1-9fd6-411e-9ed9-368f463ccb6f)' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:08:15.372026 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-076fca0c-a0aa-478a-b36b-8960f475b0cf tempest-VolumesListTestJSON-1619846612 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f37ba124-7202-44f6-91fb-a76033d9f7ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:08:15.375148 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-076fca0c-a0aa-478a-b36b-8960f475b0cf tempest-VolumesListTestJSON-1619846612 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f37ba124-7202-44f6-91fb-a76033d9f7ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:08:15.378771 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-076fca0c-a0aa-478a-b36b-8960f475b0cf tempest-VolumesListTestJSON-1619846612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19c27289-13b2-4813-86c2-0084d0074d17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:08:15.381595 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-076fca0c-a0aa-478a-b36b-8960f475b0cf tempest-VolumesListTestJSON-1619846612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19c27289-13b2-4813-86c2-0084d0074d17) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '26d96f52-afe5-48c4-a588-5bd3e9b18c69', 'volume_name': 'volume-26d96f52-afe5-48c4-a588-5bd3e9b18c69', 'volume_size': 1}' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:08:15.384442 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-076fca0c-a0aa-478a-b36b-8960f475b0cf tempest-VolumesListTestJSON-1619846612 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0247ac2e-11b4-4256-b2e1-9e5fce2c2adb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:08:15.388892 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-076fca0c-a0aa-478a-b36b-8960f475b0cf tempest-VolumesListTestJSON-1619846612 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0247ac2e-11b4-4256-b2e1-9e5fce2c2adb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:08:15.391643 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-076fca0c-a0aa-478a-b36b-8960f475b0cf tempest-VolumesListTestJSON-1619846612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81dae483-0ac2-4898-b589-9dcb1bff4e68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:08:15.392612 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.flows.manager.create_volume [None req-076fca0c-a0aa-478a-b36b-8960f475b0cf tempest-VolumesListTestJSON-1619846612 None] Volume 26d96f52-afe5-48c4-a588-5bd3e9b18c69: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-26d96f52-afe5-48c4-a588-5bd3e9b18c69', 'volume_size': 1} Dec 18 21:08:15.393158 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-076fca0c-a0aa-478a-b36b-8960f475b0cf tempest-VolumesListTestJSON-1619846612 None] creating volume 'volume-26d96f52-afe5-48c4-a588-5bd3e9b18c69' {{(pid=134148) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Dec 18 21:08:15.395298 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-076fca0c-a0aa-478a-b36b-8960f475b0cf tempest-VolumesListTestJSON-1619846612 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:08:15.482427 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-076fca0c-a0aa-478a-b36b-8960f475b0cf tempest-VolumesListTestJSON-1619846612 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134148) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 18 21:08:15.482879 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-076fca0c-a0aa-478a-b36b-8960f475b0cf tempest-VolumesListTestJSON-1619846612 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134148) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 18 21:08:15.485394 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-076fca0c-a0aa-478a-b36b-8960f475b0cf tempest-VolumesListTestJSON-1619846612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81dae483-0ac2-4898-b589-9dcb1bff4e68) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-26d96f52-afe5-48c4-a588-5bd3e9b18c69', 'volume_size': 1}' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:08:15.487924 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-076fca0c-a0aa-478a-b36b-8960f475b0cf tempest-VolumesListTestJSON-1619846612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (edebed58-3d7d-46f1-b074-a5a8d1478612) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:08:15.499312 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.flows.manager.create_volume [None req-076fca0c-a0aa-478a-b36b-8960f475b0cf tempest-VolumesListTestJSON-1619846612 None] Volume volume-26d96f52-afe5-48c4-a588-5bd3e9b18c69 (26d96f52-afe5-48c4-a588-5bd3e9b18c69): created successfully Dec 18 21:08:15.501879 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-076fca0c-a0aa-478a-b36b-8960f475b0cf tempest-VolumesListTestJSON-1619846612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (edebed58-3d7d-46f1-b074-a5a8d1478612) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:08:15.505064 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-076fca0c-a0aa-478a-b36b-8960f475b0cf tempest-VolumesListTestJSON-1619846612 None] Flow 'volume_create_manager' (4bcb3f35-ebe5-4c8d-8519-6e9c07dfab73) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134148) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 18 21:08:15.514131 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-076fca0c-a0aa-478a-b36b-8960f475b0cf tempest-VolumesListTestJSON-1619846612 None] Created volume successfully. Dec 18 21:08:19.474899 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.coordination [None req-e24de2d5-299d-4b62-99cf-c955af1e101f tempest-VolumesListTestJSON-1619846612 None] Lock "b'cinder-26d96f52-afe5-48c4-a588-5bd3e9b18c69-delete_volume'" acquired by "delete_volume" :: waited 0.029s {{(pid=134148) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 18 21:08:19.526309 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-e24de2d5-299d-4b62-99cf-c955af1e101f tempest-VolumesListTestJSON-1619846612 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:08:19.621182 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-e24de2d5-299d-4b62-99cf-c955af1e101f tempest-VolumesListTestJSON-1619846612 None] volume has no backup snaps {{(pid=134148) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Dec 18 21:08:19.621983 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-e24de2d5-299d-4b62-99cf-c955af1e101f tempest-VolumesListTestJSON-1619846612 None] Volume volume-26d96f52-afe5-48c4-a588-5bd3e9b18c69 is not a clone. {{(pid=134148) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Dec 18 21:08:19.645007 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-e24de2d5-299d-4b62-99cf-c955af1e101f tempest-VolumesListTestJSON-1619846612 None] deleting rbd volume volume-26d96f52-afe5-48c4-a588-5bd3e9b18c69 {{(pid=134148) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Dec 18 21:08:20.061163 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.quota [None req-e24de2d5-299d-4b62-99cf-c955af1e101f tempest-VolumesListTestJSON-1619846612 None] Created reservations ['7824c14e-9ca9-473b-b6d3-eac431394cb1', 'd2cfb616-08ca-48fe-841b-1124dd54577d', '1d4c9c2b-f8df-4258-aa15-a701c66b071a', '74906268-cab6-4e4e-8e4d-242f9621f5ed'] {{(pid=134148) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 18 21:08:20.137850 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-e24de2d5-299d-4b62-99cf-c955af1e101f tempest-VolumesListTestJSON-1619846612 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:08:20.202131 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-e24de2d5-299d-4b62-99cf-c955af1e101f tempest-VolumesListTestJSON-1619846612 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:08:20.252531 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.manager [None req-e24de2d5-299d-4b62-99cf-c955af1e101f tempest-VolumesListTestJSON-1619846612 None] Notifying Schedulers of capabilities ... {{(pid=134148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 18 21:08:20.256947 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-e24de2d5-299d-4b62-99cf-c955af1e101f tempest-VolumesListTestJSON-1619846612 None] Deleted volume successfully. Dec 18 21:08:20.273870 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.coordination [None req-e24de2d5-299d-4b62-99cf-c955af1e101f tempest-VolumesListTestJSON-1619846612 None] Lock "b'cinder-26d96f52-afe5-48c4-a588-5bd3e9b18c69-delete_volume'" released by "delete_volume" :: held 0.799s {{(pid=134148) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 18 21:08:20.699644 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.coordination [None req-caeef082-2f7a-4df3-bed9-34806dea1211 tempest-VolumesListTestJSON-1619846612 None] Lock "b'cinder-c72dc49d-7a0a-4ae1-8c1e-849897fbaf44-delete_volume'" acquired by "delete_volume" :: waited 0.014s {{(pid=134148) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 18 21:08:20.759033 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-caeef082-2f7a-4df3-bed9-34806dea1211 tempest-VolumesListTestJSON-1619846612 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:08:20.847468 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-caeef082-2f7a-4df3-bed9-34806dea1211 tempest-VolumesListTestJSON-1619846612 None] volume has no backup snaps {{(pid=134148) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Dec 18 21:08:20.847934 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-caeef082-2f7a-4df3-bed9-34806dea1211 tempest-VolumesListTestJSON-1619846612 None] Volume volume-c72dc49d-7a0a-4ae1-8c1e-849897fbaf44 is not a clone. {{(pid=134148) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Dec 18 21:08:20.856258 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-caeef082-2f7a-4df3-bed9-34806dea1211 tempest-VolumesListTestJSON-1619846612 None] deleting rbd volume volume-c72dc49d-7a0a-4ae1-8c1e-849897fbaf44 {{(pid=134148) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Dec 18 21:08:21.358590 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.quota [None req-caeef082-2f7a-4df3-bed9-34806dea1211 tempest-VolumesListTestJSON-1619846612 None] Created reservations ['650f2d34-6f68-4dad-b6ef-d1df0a93dda5', 'e057e787-6ee5-41d3-9c5c-176575ebeaad', '9e35e0dd-e0c8-4bd1-820c-307b86faef6c', 'efce023d-9713-4dc4-ab9f-17a6a58708d7'] {{(pid=134148) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 18 21:08:21.433297 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-caeef082-2f7a-4df3-bed9-34806dea1211 tempest-VolumesListTestJSON-1619846612 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:08:21.513287 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-caeef082-2f7a-4df3-bed9-34806dea1211 tempest-VolumesListTestJSON-1619846612 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:08:21.575951 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.manager [None req-caeef082-2f7a-4df3-bed9-34806dea1211 tempest-VolumesListTestJSON-1619846612 None] Notifying Schedulers of capabilities ... {{(pid=134148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 18 21:08:21.580856 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-caeef082-2f7a-4df3-bed9-34806dea1211 tempest-VolumesListTestJSON-1619846612 None] Deleted volume successfully. Dec 18 21:08:21.611205 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.coordination [None req-caeef082-2f7a-4df3-bed9-34806dea1211 tempest-VolumesListTestJSON-1619846612 None] Lock "b'cinder-c72dc49d-7a0a-4ae1-8c1e-849897fbaf44-delete_volume'" released by "delete_volume" :: held 0.913s {{(pid=134148) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 18 21:08:21.924830 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.coordination [None req-07552014-0e93-4605-ba4f-6665ba72e3de tempest-VolumesListTestJSON-1619846612 None] Lock "b'cinder-af2cc1cc-7181-4014-852d-b4616e8bb17b-delete_volume'" acquired by "delete_volume" :: waited 0.015s {{(pid=134148) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 18 21:08:22.050025 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-07552014-0e93-4605-ba4f-6665ba72e3de tempest-VolumesListTestJSON-1619846612 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:08:22.123672 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-07552014-0e93-4605-ba4f-6665ba72e3de tempest-VolumesListTestJSON-1619846612 None] volume has no backup snaps {{(pid=134148) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Dec 18 21:08:22.124123 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-07552014-0e93-4605-ba4f-6665ba72e3de tempest-VolumesListTestJSON-1619846612 None] Volume volume-af2cc1cc-7181-4014-852d-b4616e8bb17b is not a clone. {{(pid=134148) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Dec 18 21:08:22.141661 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-07552014-0e93-4605-ba4f-6665ba72e3de tempest-VolumesListTestJSON-1619846612 None] deleting rbd volume volume-af2cc1cc-7181-4014-852d-b4616e8bb17b {{(pid=134148) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Dec 18 21:08:22.457378 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.quota [None req-07552014-0e93-4605-ba4f-6665ba72e3de tempest-VolumesListTestJSON-1619846612 None] Created reservations ['f4dea073-47ea-4036-b298-f9c6989edb0e', 'df00f22d-0bbd-4ea6-a8f0-382de7708f4d', '9303f195-72bf-46e3-ae27-0b8bb8932c14', '1271b005-b112-4d2d-a43a-690e14d7c565'] {{(pid=134148) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 18 21:08:22.508601 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-07552014-0e93-4605-ba4f-6665ba72e3de tempest-VolumesListTestJSON-1619846612 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:08:22.550029 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-07552014-0e93-4605-ba4f-6665ba72e3de tempest-VolumesListTestJSON-1619846612 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:08:22.628913 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.manager [None req-07552014-0e93-4605-ba4f-6665ba72e3de tempest-VolumesListTestJSON-1619846612 None] Notifying Schedulers of capabilities ... {{(pid=134148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 18 21:08:22.636227 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-07552014-0e93-4605-ba4f-6665ba72e3de tempest-VolumesListTestJSON-1619846612 None] Deleted volume successfully. Dec 18 21:08:22.675541 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.coordination [None req-07552014-0e93-4605-ba4f-6665ba72e3de tempest-VolumesListTestJSON-1619846612 None] Lock "b'cinder-af2cc1cc-7181-4014-852d-b4616e8bb17b-delete_volume'" released by "delete_volume" :: held 0.751s {{(pid=134148) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 18 21:08:28.233957 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.flows.manager.create_volume [None req-f63bf104-e2a2-4fab-980e-ee462b56c604 tempest-VolumesNegativeTest-1566869411 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134148) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Dec 18 21:08:28.239783 ncdv-master-1 cinder-volume[134148]: WARNING stevedore.named [None req-f63bf104-e2a2-4fab-980e-ee462b56c604 tempest-VolumesNegativeTest-1566869411 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Dec 18 21:08:28.240521 ncdv-master-1 cinder-volume[134148]: WARNING castellan.key_manager [None req-f63bf104-e2a2-4fab-980e-ee462b56c604 tempest-VolumesNegativeTest-1566869411 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Dec 18 21:08:28.254999 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-f63bf104-e2a2-4fab-980e-ee462b56c604 tempest-VolumesNegativeTest-1566869411 None] Flow 'volume_create_manager' (a855d89d-7cda-45e1-b2cf-e9faea6d9acb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 18 21:08:28.259623 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-f63bf104-e2a2-4fab-980e-ee462b56c604 tempest-VolumesNegativeTest-1566869411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (757845e1-9740-4a01-af93-d7934f2a8dba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:08:28.267855 ncdv-master-1 cinder-volume[134148]: DEBUG oslo_db.sqlalchemy.engines [None req-f63bf104-e2a2-4fab-980e-ee462b56c604 tempest-VolumesNegativeTest-1566869411 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134148) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 18 21:08:28.283068 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-f63bf104-e2a2-4fab-980e-ee462b56c604 tempest-VolumesNegativeTest-1566869411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (757845e1-9740-4a01-af93-d7934f2a8dba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-12-18T21:08:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1856257796',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=e524f286-58fd-4a69-b2b1-aaf27fe93eba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6df650339f864e028604b27467d14de8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-12-18T21:08:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-12-18T21:08:28Z,use_quota=True,user_id='4669c1de603a448a91c3b979a632468b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f2e1fe1-9fd6-411e-9ed9-368f463ccb6f),volume_type_id=1f2e1fe1-9fd6-411e-9ed9-368f463ccb6f)' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:08:28.286813 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-f63bf104-e2a2-4fab-980e-ee462b56c604 tempest-VolumesNegativeTest-1566869411 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57ddd4f9-3128-4b6f-ae53-efe13072a743) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:08:28.289466 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-f63bf104-e2a2-4fab-980e-ee462b56c604 tempest-VolumesNegativeTest-1566869411 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57ddd4f9-3128-4b6f-ae53-efe13072a743) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:08:28.292352 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-f63bf104-e2a2-4fab-980e-ee462b56c604 tempest-VolumesNegativeTest-1566869411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3726348-a8c4-4943-bbb5-6013c87b57eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:08:28.296897 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-f63bf104-e2a2-4fab-980e-ee462b56c604 tempest-VolumesNegativeTest-1566869411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3726348-a8c4-4943-bbb5-6013c87b57eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e524f286-58fd-4a69-b2b1-aaf27fe93eba', 'volume_name': 'volume-e524f286-58fd-4a69-b2b1-aaf27fe93eba', 'volume_size': 1}' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:08:28.299974 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-f63bf104-e2a2-4fab-980e-ee462b56c604 tempest-VolumesNegativeTest-1566869411 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab8fad84-bfcd-4a0a-abed-31dfffc24935) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:08:28.302857 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-f63bf104-e2a2-4fab-980e-ee462b56c604 tempest-VolumesNegativeTest-1566869411 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab8fad84-bfcd-4a0a-abed-31dfffc24935) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:08:28.306549 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-f63bf104-e2a2-4fab-980e-ee462b56c604 tempest-VolumesNegativeTest-1566869411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3ae4c46-760f-4b20-bfab-c81472e5e56b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:08:28.307604 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.flows.manager.create_volume [None req-f63bf104-e2a2-4fab-980e-ee462b56c604 tempest-VolumesNegativeTest-1566869411 None] Volume e524f286-58fd-4a69-b2b1-aaf27fe93eba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e524f286-58fd-4a69-b2b1-aaf27fe93eba', 'volume_size': 1} Dec 18 21:08:28.308282 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-f63bf104-e2a2-4fab-980e-ee462b56c604 tempest-VolumesNegativeTest-1566869411 None] creating volume 'volume-e524f286-58fd-4a69-b2b1-aaf27fe93eba' {{(pid=134148) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Dec 18 21:08:28.309544 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-f63bf104-e2a2-4fab-980e-ee462b56c604 tempest-VolumesNegativeTest-1566869411 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:08:28.454625 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-f63bf104-e2a2-4fab-980e-ee462b56c604 tempest-VolumesNegativeTest-1566869411 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134148) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 18 21:08:28.455325 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-f63bf104-e2a2-4fab-980e-ee462b56c604 tempest-VolumesNegativeTest-1566869411 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134148) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 18 21:08:28.457712 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-f63bf104-e2a2-4fab-980e-ee462b56c604 tempest-VolumesNegativeTest-1566869411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3ae4c46-760f-4b20-bfab-c81472e5e56b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e524f286-58fd-4a69-b2b1-aaf27fe93eba', 'volume_size': 1}' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:08:28.460243 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-f63bf104-e2a2-4fab-980e-ee462b56c604 tempest-VolumesNegativeTest-1566869411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (184a4be3-5689-4818-8a53-0227a4abdb91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:08:28.478952 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.flows.manager.create_volume [None req-f63bf104-e2a2-4fab-980e-ee462b56c604 tempest-VolumesNegativeTest-1566869411 None] Volume volume-e524f286-58fd-4a69-b2b1-aaf27fe93eba (e524f286-58fd-4a69-b2b1-aaf27fe93eba): created successfully Dec 18 21:08:28.481414 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-f63bf104-e2a2-4fab-980e-ee462b56c604 tempest-VolumesNegativeTest-1566869411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (184a4be3-5689-4818-8a53-0227a4abdb91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:08:28.485732 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-f63bf104-e2a2-4fab-980e-ee462b56c604 tempest-VolumesNegativeTest-1566869411 None] Flow 'volume_create_manager' (a855d89d-7cda-45e1-b2cf-e9faea6d9acb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134148) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 18 21:08:28.496132 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-f63bf104-e2a2-4fab-980e-ee462b56c604 tempest-VolumesNegativeTest-1566869411 None] Created volume successfully. Dec 18 21:08:34.342632 ncdv-master-1 cinder-volume[134148]: DEBUG oslo_service.periodic_task [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134148) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Dec 18 21:08:34.344241 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:08:34.378352 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:08:34.425725 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.manager [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] Notifying Schedulers of capabilities ... {{(pid=134148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 18 21:08:37.894285 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.flows.manager.create_volume [None req-5f485a36-998b-4cef-9eb5-3349246588e7 tempest-VolumesActionsTest-489501281 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134148) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Dec 18 21:08:37.901710 ncdv-master-1 cinder-volume[134148]: WARNING stevedore.named [None req-5f485a36-998b-4cef-9eb5-3349246588e7 tempest-VolumesActionsTest-489501281 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Dec 18 21:08:37.902102 ncdv-master-1 cinder-volume[134148]: WARNING castellan.key_manager [None req-5f485a36-998b-4cef-9eb5-3349246588e7 tempest-VolumesActionsTest-489501281 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Dec 18 21:08:37.920587 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-5f485a36-998b-4cef-9eb5-3349246588e7 tempest-VolumesActionsTest-489501281 None] Flow 'volume_create_manager' (45a7f765-4a27-4906-89ec-0b9e02d930aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 18 21:08:37.924946 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-5f485a36-998b-4cef-9eb5-3349246588e7 tempest-VolumesActionsTest-489501281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c15b10e2-d57a-429c-9e88-ecef87090798) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:08:37.932505 ncdv-master-1 cinder-volume[134148]: DEBUG oslo_db.sqlalchemy.engines [None req-5f485a36-998b-4cef-9eb5-3349246588e7 tempest-VolumesActionsTest-489501281 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134148) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 18 21:08:37.949803 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-5f485a36-998b-4cef-9eb5-3349246588e7 tempest-VolumesActionsTest-489501281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c15b10e2-d57a-429c-9e88-ecef87090798) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-12-18T21:08:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1199157644',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=8b9655d0-6c61-4c54-b8c6-b2e6902a4e54,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c48b8b9635104eafab5295b3b8709c14',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-12-18T21:08:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-12-18T21:08:38Z,use_quota=True,user_id='e8150e994a4f42e3b014e5e51265213a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f2e1fe1-9fd6-411e-9ed9-368f463ccb6f),volume_type_id=1f2e1fe1-9fd6-411e-9ed9-368f463ccb6f)' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:08:37.953614 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-5f485a36-998b-4cef-9eb5-3349246588e7 tempest-VolumesActionsTest-489501281 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6994ed1-872a-46ee-bb00-9088f852e96b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:08:37.956871 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-5f485a36-998b-4cef-9eb5-3349246588e7 tempest-VolumesActionsTest-489501281 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6994ed1-872a-46ee-bb00-9088f852e96b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:08:37.959628 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-5f485a36-998b-4cef-9eb5-3349246588e7 tempest-VolumesActionsTest-489501281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb7e06ac-b1ce-4a12-bf9b-1ee8eeda21a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:08:37.963953 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-5f485a36-998b-4cef-9eb5-3349246588e7 tempest-VolumesActionsTest-489501281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb7e06ac-b1ce-4a12-bf9b-1ee8eeda21a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8b9655d0-6c61-4c54-b8c6-b2e6902a4e54', 'volume_name': 'volume-8b9655d0-6c61-4c54-b8c6-b2e6902a4e54', 'volume_size': 1}' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:08:37.967932 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-5f485a36-998b-4cef-9eb5-3349246588e7 tempest-VolumesActionsTest-489501281 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2e5683d-ff40-448d-9521-c0f1efafa610) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:08:37.970645 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-5f485a36-998b-4cef-9eb5-3349246588e7 tempest-VolumesActionsTest-489501281 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2e5683d-ff40-448d-9521-c0f1efafa610) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:08:37.973855 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-5f485a36-998b-4cef-9eb5-3349246588e7 tempest-VolumesActionsTest-489501281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77e9222c-eb5e-4008-9c18-9da0a5e26c10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:08:37.975052 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.flows.manager.create_volume [None req-5f485a36-998b-4cef-9eb5-3349246588e7 tempest-VolumesActionsTest-489501281 None] Volume 8b9655d0-6c61-4c54-b8c6-b2e6902a4e54: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8b9655d0-6c61-4c54-b8c6-b2e6902a4e54', 'volume_size': 1} Dec 18 21:08:37.975659 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-5f485a36-998b-4cef-9eb5-3349246588e7 tempest-VolumesActionsTest-489501281 None] creating volume 'volume-8b9655d0-6c61-4c54-b8c6-b2e6902a4e54' {{(pid=134148) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Dec 18 21:08:37.976957 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-5f485a36-998b-4cef-9eb5-3349246588e7 tempest-VolumesActionsTest-489501281 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:08:38.096973 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-5f485a36-998b-4cef-9eb5-3349246588e7 tempest-VolumesActionsTest-489501281 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134148) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 18 21:08:38.097915 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-5f485a36-998b-4cef-9eb5-3349246588e7 tempest-VolumesActionsTest-489501281 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134148) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 18 21:08:38.102062 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-5f485a36-998b-4cef-9eb5-3349246588e7 tempest-VolumesActionsTest-489501281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77e9222c-eb5e-4008-9c18-9da0a5e26c10) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8b9655d0-6c61-4c54-b8c6-b2e6902a4e54', 'volume_size': 1}' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:08:38.105748 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-5f485a36-998b-4cef-9eb5-3349246588e7 tempest-VolumesActionsTest-489501281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54b86dd4-eb54-4239-8a28-a486c801b8ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:08:38.118078 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.flows.manager.create_volume [None req-5f485a36-998b-4cef-9eb5-3349246588e7 tempest-VolumesActionsTest-489501281 None] Volume volume-8b9655d0-6c61-4c54-b8c6-b2e6902a4e54 (8b9655d0-6c61-4c54-b8c6-b2e6902a4e54): created successfully Dec 18 21:08:38.121768 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-5f485a36-998b-4cef-9eb5-3349246588e7 tempest-VolumesActionsTest-489501281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54b86dd4-eb54-4239-8a28-a486c801b8ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:08:38.127370 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-5f485a36-998b-4cef-9eb5-3349246588e7 tempest-VolumesActionsTest-489501281 None] Flow 'volume_create_manager' (45a7f765-4a27-4906-89ec-0b9e02d930aa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134148) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 18 21:08:38.163315 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-5f485a36-998b-4cef-9eb5-3349246588e7 tempest-VolumesActionsTest-489501281 None] Created volume successfully. Dec 18 21:08:38.897737 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.coordination [None req-21128602-58d1-4b6e-bab8-aee413a4a07c tempest-VolumesActionsTest-489501281 None] Lock "b'cinder-8b9655d0-6c61-4c54-b8c6-b2e6902a4e54'" acquired by "attach_volume" :: waited 0.021s {{(pid=134148) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 18 21:08:38.987214 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-21128602-58d1-4b6e-bab8-aee413a4a07c tempest-VolumesActionsTest-489501281 None] Attaching volume 8b9655d0-6c61-4c54-b8c6-b2e6902a4e54 to instance 8668088b-ae76-48a8-bd85-f81eb04d72cc at mountpoint /dev/sdb on host None. Dec 18 21:08:39.064820 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-21128602-58d1-4b6e-bab8-aee413a4a07c tempest-VolumesActionsTest-489501281 None] Attach volume completed successfully. Dec 18 21:08:39.080535 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.coordination [None req-21128602-58d1-4b6e-bab8-aee413a4a07c tempest-VolumesActionsTest-489501281 None] Lock "b'cinder-8b9655d0-6c61-4c54-b8c6-b2e6902a4e54'" released by "attach_volume" :: held 0.183s {{(pid=134148) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 18 21:08:40.180787 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-181906b7-c24a-43c4-aeba-b6d88f809fb7 tempest-VolumesActionsTest-469023560 None] Terminate volume connection completed successfully. Dec 18 21:08:40.210677 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.flows.manager.create_volume [None req-00f8dd47-aa19-40e2-9898-fd78ef9e0aec tempest-TestVolumeBootPattern-1320248540 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134148) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Dec 18 21:08:40.216657 ncdv-master-1 cinder-volume[134148]: WARNING stevedore.named [None req-00f8dd47-aa19-40e2-9898-fd78ef9e0aec tempest-TestVolumeBootPattern-1320248540 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Dec 18 21:08:40.217587 ncdv-master-1 cinder-volume[134148]: WARNING castellan.key_manager [None req-00f8dd47-aa19-40e2-9898-fd78ef9e0aec tempest-TestVolumeBootPattern-1320248540 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Dec 18 21:08:40.235381 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-00f8dd47-aa19-40e2-9898-fd78ef9e0aec tempest-TestVolumeBootPattern-1320248540 None] Flow 'volume_create_manager' (44431bbb-a633-4e31-931c-8e0bb9bdd9f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 18 21:08:40.240142 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-00f8dd47-aa19-40e2-9898-fd78ef9e0aec tempest-TestVolumeBootPattern-1320248540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2055efcc-5225-4f3a-bd82-4523ef35a232) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:08:40.254465 ncdv-master-1 cinder-volume[134148]: DEBUG oslo_db.sqlalchemy.engines [None req-00f8dd47-aa19-40e2-9898-fd78ef9e0aec tempest-TestVolumeBootPattern-1320248540 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134148) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 18 21:08:40.262450 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.coordination [None req-181906b7-c24a-43c4-aeba-b6d88f809fb7 tempest-VolumesActionsTest-469023560 None] Lock "b'cinder-8b9655d0-6c61-4c54-b8c6-b2e6902a4e54-detach_volume'" acquired by "detach_volume" :: waited 0.015s {{(pid=134148) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 18 21:08:40.295015 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-00f8dd47-aa19-40e2-9898-fd78ef9e0aec tempest-TestVolumeBootPattern-1320248540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2055efcc-5225-4f3a-bd82-4523ef35a232) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-12-18T21:08:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeBootPattern-volume-origin-390389410',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=36b45732-3da1-4a6d-9972-06956bf7ad47,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de79cd87d023436a80d3cc5428586e21',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-12-18T21:08:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-12-18T21:08:40Z,use_quota=True,user_id='d32598482c834073b8fe24c84cb57d2f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f2e1fe1-9fd6-411e-9ed9-368f463ccb6f),volume_type_id=1f2e1fe1-9fd6-411e-9ed9-368f463ccb6f)' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:08:40.297702 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-00f8dd47-aa19-40e2-9898-fd78ef9e0aec tempest-TestVolumeBootPattern-1320248540 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7723c340-6370-4e6d-b92f-6d85e473a509) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:08:40.300380 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-00f8dd47-aa19-40e2-9898-fd78ef9e0aec tempest-TestVolumeBootPattern-1320248540 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7723c340-6370-4e6d-b92f-6d85e473a509) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:08:40.303274 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-00f8dd47-aa19-40e2-9898-fd78ef9e0aec tempest-TestVolumeBootPattern-1320248540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b09fa6d6-9766-4c7f-9410-a4b9d4be4f51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:08:40.308387 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-181906b7-c24a-43c4-aeba-b6d88f809fb7 tempest-VolumesActionsTest-469023560 None] Detaching volume 8b9655d0-6c61-4c54-b8c6-b2e6902a4e54 from instance 8668088b-ae76-48a8-bd85-f81eb04d72cc. Dec 18 21:08:40.358878 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-181906b7-c24a-43c4-aeba-b6d88f809fb7 tempest-VolumesActionsTest-469023560 None] Detach volume completed successfully. Dec 18 21:08:40.366016 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.coordination [None req-181906b7-c24a-43c4-aeba-b6d88f809fb7 tempest-VolumesActionsTest-469023560 None] Lock "b'cinder-8b9655d0-6c61-4c54-b8c6-b2e6902a4e54-detach_volume'" released by "detach_volume" :: held 0.104s {{(pid=134148) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 18 21:08:40.433821 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-00f8dd47-aa19-40e2-9898-fd78ef9e0aec tempest-TestVolumeBootPattern-1320248540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b09fa6d6-9766-4c7f-9410-a4b9d4be4f51) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '36b45732-3da1-4a6d-9972-06956bf7ad47', 'volume_name': 'volume-36b45732-3da1-4a6d-9972-06956bf7ad47', 'volume_size': 1, 'image_id': '394b3891-80f2-44c9-a9aa-56fe23a5acb3', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b04c3d19c79d4c208395e97f9d293618', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '394b3891-80f2-44c9-a9aa-56fe23a5acb3', 'created_at': datetime.datetime(2021, 12, 18, 20, 38, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 12, 18, 20, 38, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/394b3891-80f2-44c9-a9aa-56fe23a5acb3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:08:40.449159 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-00f8dd47-aa19-40e2-9898-fd78ef9e0aec tempest-TestVolumeBootPattern-1320248540 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9675b14-41e7-4468-8a66-a834e15a50e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:08:40.452882 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-00f8dd47-aa19-40e2-9898-fd78ef9e0aec tempest-TestVolumeBootPattern-1320248540 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9675b14-41e7-4468-8a66-a834e15a50e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:08:40.455877 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-00f8dd47-aa19-40e2-9898-fd78ef9e0aec tempest-TestVolumeBootPattern-1320248540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35bd5066-abee-4b88-aea9-c5a6485cfa1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:08:40.456937 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.flows.manager.create_volume [None req-00f8dd47-aa19-40e2-9898-fd78ef9e0aec tempest-TestVolumeBootPattern-1320248540 None] Volume 36b45732-3da1-4a6d-9972-06956bf7ad47: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-36b45732-3da1-4a6d-9972-06956bf7ad47', 'volume_size': 1, 'image_id': '394b3891-80f2-44c9-a9aa-56fe23a5acb3', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b04c3d19c79d4c208395e97f9d293618', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '394b3891-80f2-44c9-a9aa-56fe23a5acb3', 'created_at': datetime.datetime(2021, 12, 18, 20, 38, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 12, 18, 20, 38, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/394b3891-80f2-44c9-a9aa-56fe23a5acb3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Dec 18 21:08:40.457743 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.flows.manager.create_volume [None req-00f8dd47-aa19-40e2-9898-fd78ef9e0aec tempest-TestVolumeBootPattern-1320248540 None] Cloning 36b45732-3da1-4a6d-9972-06956bf7ad47 from image 394b3891-80f2-44c9-a9aa-56fe23a5acb3 at location (None, None). {{(pid=134148) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1047}} Dec 18 21:08:40.474603 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.coordination [None req-00f8dd47-aa19-40e2-9898-fd78ef9e0aec tempest-TestVolumeBootPattern-1320248540 None] Lock "b'cinder-394b3891-80f2-44c9-a9aa-56fe23a5acb3'" acquired by "_prepare_image_cache_entry" :: waited 0.015s {{(pid=134148) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 18 21:08:40.487307 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.image.cache [None req-00f8dd47-aa19-40e2-9898-fd78ef9e0aec tempest-TestVolumeBootPattern-1320248540 None] Found image-volume cache entry: {'id': 1, 'image_id': '394b3891-80f2-44c9-a9aa-56fe23a5acb3', 'volume_id': 'e6411a45-48fa-4beb-a5a0-eb6a6ca3f525', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2021, 12, 18, 20, 38, 21), 'last_used': datetime.datetime(2021, 12, 18, 21, 8, 40, 478978)}. {{(pid=134148) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Dec 18 21:08:40.487779 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.image.cache [None req-00f8dd47-aa19-40e2-9898-fd78ef9e0aec tempest-TestVolumeBootPattern-1320248540 None] Image-volume cache entry image_update_at = 2021-12-18 20:38:21+00:00, requested image updated_at = 2021-12-18 20:38:21+00:00. {{(pid=134148) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Dec 18 21:08:40.499100 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.flows.manager.create_volume [None req-00f8dd47-aa19-40e2-9898-fd78ef9e0aec tempest-TestVolumeBootPattern-1320248540 None] Found cache entry for image = 394b3891-80f2-44c9-a9aa-56fe23a5acb3 on host ncdv-master-1@ceph#ceph. {{(pid=134148) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:870}} Dec 18 21:08:40.510085 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.coordination [None req-00f8dd47-aa19-40e2-9898-fd78ef9e0aec tempest-TestVolumeBootPattern-1320248540 None] Lock "b'cinder-394b3891-80f2-44c9-a9aa-56fe23a5acb3'" released by "_prepare_image_cache_entry" :: held 0.036s {{(pid=134148) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 18 21:08:40.511607 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.flows.manager.create_volume [None req-00f8dd47-aa19-40e2-9898-fd78ef9e0aec tempest-TestVolumeBootPattern-1320248540 None] Attempting to retrieve cache entry for image = 394b3891-80f2-44c9-a9aa-56fe23a5acb3 on host ncdv-master-1@ceph#ceph. {{(pid=134148) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:811}} Dec 18 21:08:40.524952 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.image.cache [None req-00f8dd47-aa19-40e2-9898-fd78ef9e0aec tempest-TestVolumeBootPattern-1320248540 None] Found image-volume cache entry: {'id': 1, 'image_id': '394b3891-80f2-44c9-a9aa-56fe23a5acb3', 'volume_id': 'e6411a45-48fa-4beb-a5a0-eb6a6ca3f525', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2021, 12, 18, 20, 38, 21), 'last_used': datetime.datetime(2021, 12, 18, 21, 8, 40, 516629)}. {{(pid=134148) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Dec 18 21:08:40.525741 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.image.cache [None req-00f8dd47-aa19-40e2-9898-fd78ef9e0aec tempest-TestVolumeBootPattern-1320248540 None] Image-volume cache entry image_update_at = 2021-12-18 20:38:21+00:00, requested image updated_at = 2021-12-18 20:38:21+00:00. {{(pid=134148) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Dec 18 21:08:40.526960 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.flows.manager.create_volume [None req-00f8dd47-aa19-40e2-9898-fd78ef9e0aec tempest-TestVolumeBootPattern-1320248540 None] Creating from source image-volume e6411a45-48fa-4beb-a5a0-eb6a6ca3f525 {{(pid=134148) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:825}} Dec 18 21:08:40.547943 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-00f8dd47-aa19-40e2-9898-fd78ef9e0aec tempest-TestVolumeBootPattern-1320248540 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:08:40.657905 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-00f8dd47-aa19-40e2-9898-fd78ef9e0aec tempest-TestVolumeBootPattern-1320248540 None] creating snapshot='volume-36b45732-3da1-4a6d-9972-06956bf7ad47.clone_snap' {{(pid=134148) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:725}} Dec 18 21:08:41.097027 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-00f8dd47-aa19-40e2-9898-fd78ef9e0aec tempest-TestVolumeBootPattern-1320248540 None] cloning 'volume-e6411a45-48fa-4beb-a5a0-eb6a6ca3f525@volume-36b45732-3da1-4a6d-9972-06956bf7ad47.clone_snap' to 'volume-36b45732-3da1-4a6d-9972-06956bf7ad47' {{(pid=134148) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:731}} Dec 18 21:08:41.125963 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.coordination [None req-44ee8433-5340-4521-8ae1-7b1db2e4710a tempest-VolumesActionsTest-489501281 None] Lock "b'cinder-8b9655d0-6c61-4c54-b8c6-b2e6902a4e54-detach_volume'" acquired by "detach_volume" :: waited 0.024s {{(pid=134148) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 18 21:08:41.127142 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-44ee8433-5340-4521-8ae1-7b1db2e4710a tempest-VolumesActionsTest-489501281 None] Volume detach called, but volume not attached. Dec 18 21:08:41.158634 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.coordination [None req-44ee8433-5340-4521-8ae1-7b1db2e4710a tempest-VolumesActionsTest-489501281 None] Lock "b'cinder-8b9655d0-6c61-4c54-b8c6-b2e6902a4e54-detach_volume'" released by "detach_volume" :: held 0.032s {{(pid=134148) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 18 21:08:41.367756 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-00f8dd47-aa19-40e2-9898-fd78ef9e0aec tempest-TestVolumeBootPattern-1320248540 None] Volume volume-9f5f7417-3abc-4462-988f-ef519750d753.deleted is not a clone. {{(pid=134148) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Dec 18 21:08:41.370233 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-00f8dd47-aa19-40e2-9898-fd78ef9e0aec tempest-TestVolumeBootPattern-1320248540 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134148) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 18 21:08:41.372859 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-00f8dd47-aa19-40e2-9898-fd78ef9e0aec tempest-TestVolumeBootPattern-1320248540 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134148) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 18 21:08:41.413505 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-00f8dd47-aa19-40e2-9898-fd78ef9e0aec tempest-TestVolumeBootPattern-1320248540 None] clone created successfully {{(pid=134148) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:803}} Dec 18 21:08:41.414684 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.volume_utils [None req-00f8dd47-aa19-40e2-9898-fd78ef9e0aec tempest-TestVolumeBootPattern-1320248540 None] Marking volume 36b45732-3da1-4a6d-9972-06956bf7ad47 as bootable. {{(pid=134148) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1178}} Dec 18 21:08:41.435788 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.flows.manager.create_volume [None req-00f8dd47-aa19-40e2-9898-fd78ef9e0aec tempest-TestVolumeBootPattern-1320248540 None] Copying metadata from image 394b3891-80f2-44c9-a9aa-56fe23a5acb3 to 36b45732-3da1-4a6d-9972-06956bf7ad47. {{(pid=134148) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:444}} Dec 18 21:08:41.436582 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.flows.manager.create_volume [None req-00f8dd47-aa19-40e2-9898-fd78ef9e0aec tempest-TestVolumeBootPattern-1320248540 None] Creating volume glance metadata for volume 36b45732-3da1-4a6d-9972-06956bf7ad47 backed by image 394b3891-80f2-44c9-a9aa-56fe23a5acb3 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '394b3891-80f2-44c9-a9aa-56fe23a5acb3', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=134148) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:667}} Dec 18 21:08:41.530694 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-00f8dd47-aa19-40e2-9898-fd78ef9e0aec tempest-TestVolumeBootPattern-1320248540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35bd5066-abee-4b88-aea9-c5a6485cfa1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-36b45732-3da1-4a6d-9972-06956bf7ad47', 'volume_size': 1, 'image_id': '394b3891-80f2-44c9-a9aa-56fe23a5acb3', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b04c3d19c79d4c208395e97f9d293618', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '394b3891-80f2-44c9-a9aa-56fe23a5acb3', 'created_at': datetime.datetime(2021, 12, 18, 20, 38, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 12, 18, 20, 38, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/394b3891-80f2-44c9-a9aa-56fe23a5acb3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:08:41.533870 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-00f8dd47-aa19-40e2-9898-fd78ef9e0aec tempest-TestVolumeBootPattern-1320248540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (967be122-1ef9-47fa-b2a7-34da2451c41b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:08:41.547925 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.flows.manager.create_volume [None req-00f8dd47-aa19-40e2-9898-fd78ef9e0aec tempest-TestVolumeBootPattern-1320248540 None] Volume volume-36b45732-3da1-4a6d-9972-06956bf7ad47 (36b45732-3da1-4a6d-9972-06956bf7ad47): created successfully Dec 18 21:08:41.550427 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-00f8dd47-aa19-40e2-9898-fd78ef9e0aec tempest-TestVolumeBootPattern-1320248540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (967be122-1ef9-47fa-b2a7-34da2451c41b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:08:41.553848 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-00f8dd47-aa19-40e2-9898-fd78ef9e0aec tempest-TestVolumeBootPattern-1320248540 None] Flow 'volume_create_manager' (44431bbb-a633-4e31-931c-8e0bb9bdd9f2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134148) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 18 21:08:41.570151 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-00f8dd47-aa19-40e2-9898-fd78ef9e0aec tempest-TestVolumeBootPattern-1320248540 None] Created volume successfully. Dec 18 21:08:42.615750 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-fcb18454-7fb1-447e-a3f2-fb5df89d382f tempest-TestVolumeBootPattern-1320248540 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:08:43.336175 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-fcb18454-7fb1-447e-a3f2-fb5df89d382f tempest-TestVolumeBootPattern-1320248540 None] Create snapshot completed successfully Dec 18 21:08:45.216438 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.flows.manager.create_volume [None req-9aca4485-c39b-4606-aa8d-b58b347cc7b7 tempest-VolumesActionsTest-489501281 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134148) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Dec 18 21:08:45.223172 ncdv-master-1 cinder-volume[134148]: WARNING stevedore.named [None req-9aca4485-c39b-4606-aa8d-b58b347cc7b7 tempest-VolumesActionsTest-489501281 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Dec 18 21:08:45.224064 ncdv-master-1 cinder-volume[134148]: WARNING castellan.key_manager [None req-9aca4485-c39b-4606-aa8d-b58b347cc7b7 tempest-VolumesActionsTest-489501281 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Dec 18 21:08:45.240394 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-9aca4485-c39b-4606-aa8d-b58b347cc7b7 tempest-VolumesActionsTest-489501281 None] Flow 'volume_create_manager' (b63f1fa9-ea41-457f-9e4e-62004bfc8cd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 18 21:08:45.245169 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-9aca4485-c39b-4606-aa8d-b58b347cc7b7 tempest-VolumesActionsTest-489501281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (489acb72-72f0-4de1-b315-41e409d2a1c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:08:45.255125 ncdv-master-1 cinder-volume[134148]: DEBUG oslo_db.sqlalchemy.engines [None req-9aca4485-c39b-4606-aa8d-b58b347cc7b7 tempest-VolumesActionsTest-489501281 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134148) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 18 21:08:45.285653 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-9aca4485-c39b-4606-aa8d-b58b347cc7b7 tempest-VolumesActionsTest-489501281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (489acb72-72f0-4de1-b315-41e409d2a1c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-12-18T21:08:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1692486753',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=8c6331ce-7e9d-442d-9fb6-095aca2f8053,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c48b8b9635104eafab5295b3b8709c14',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-12-18T21:08:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-12-18T21:08:45Z,use_quota=True,user_id='e8150e994a4f42e3b014e5e51265213a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f2e1fe1-9fd6-411e-9ed9-368f463ccb6f),volume_type_id=1f2e1fe1-9fd6-411e-9ed9-368f463ccb6f)' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:08:45.291088 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-9aca4485-c39b-4606-aa8d-b58b347cc7b7 tempest-VolumesActionsTest-489501281 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c329117-718c-4c60-a6df-3a767f567b11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:08:45.293833 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-9aca4485-c39b-4606-aa8d-b58b347cc7b7 tempest-VolumesActionsTest-489501281 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c329117-718c-4c60-a6df-3a767f567b11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:08:45.300238 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-9aca4485-c39b-4606-aa8d-b58b347cc7b7 tempest-VolumesActionsTest-489501281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (725b3ed6-5b85-4bc6-9a9e-fd84b856e83c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:08:45.302858 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-9aca4485-c39b-4606-aa8d-b58b347cc7b7 tempest-VolumesActionsTest-489501281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (725b3ed6-5b85-4bc6-9a9e-fd84b856e83c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8c6331ce-7e9d-442d-9fb6-095aca2f8053', 'volume_name': 'volume-8c6331ce-7e9d-442d-9fb6-095aca2f8053', 'volume_size': 1}' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:08:45.307046 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-9aca4485-c39b-4606-aa8d-b58b347cc7b7 tempest-VolumesActionsTest-489501281 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c9e337f-3284-4ed5-8733-627a00537aba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:08:45.326511 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-9aca4485-c39b-4606-aa8d-b58b347cc7b7 tempest-VolumesActionsTest-489501281 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c9e337f-3284-4ed5-8733-627a00537aba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:08:45.329095 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-9aca4485-c39b-4606-aa8d-b58b347cc7b7 tempest-VolumesActionsTest-489501281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3002ce5c-bb87-4b84-8ab0-d3248553377e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:08:45.329928 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.flows.manager.create_volume [None req-9aca4485-c39b-4606-aa8d-b58b347cc7b7 tempest-VolumesActionsTest-489501281 None] Volume 8c6331ce-7e9d-442d-9fb6-095aca2f8053: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8c6331ce-7e9d-442d-9fb6-095aca2f8053', 'volume_size': 1} Dec 18 21:08:45.330343 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-9aca4485-c39b-4606-aa8d-b58b347cc7b7 tempest-VolumesActionsTest-489501281 None] creating volume 'volume-8c6331ce-7e9d-442d-9fb6-095aca2f8053' {{(pid=134148) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Dec 18 21:08:45.335302 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-9aca4485-c39b-4606-aa8d-b58b347cc7b7 tempest-VolumesActionsTest-489501281 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:08:45.450304 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-9aca4485-c39b-4606-aa8d-b58b347cc7b7 tempest-VolumesActionsTest-489501281 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134148) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 18 21:08:45.450955 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-9aca4485-c39b-4606-aa8d-b58b347cc7b7 tempest-VolumesActionsTest-489501281 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134148) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 18 21:08:45.454574 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-9aca4485-c39b-4606-aa8d-b58b347cc7b7 tempest-VolumesActionsTest-489501281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3002ce5c-bb87-4b84-8ab0-d3248553377e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8c6331ce-7e9d-442d-9fb6-095aca2f8053', 'volume_size': 1}' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:08:45.457349 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-9aca4485-c39b-4606-aa8d-b58b347cc7b7 tempest-VolumesActionsTest-489501281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5201f1ad-69c2-4dcc-bcf9-920734289328) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:08:45.474656 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.flows.manager.create_volume [None req-9aca4485-c39b-4606-aa8d-b58b347cc7b7 tempest-VolumesActionsTest-489501281 None] Volume volume-8c6331ce-7e9d-442d-9fb6-095aca2f8053 (8c6331ce-7e9d-442d-9fb6-095aca2f8053): created successfully Dec 18 21:08:45.477009 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-9aca4485-c39b-4606-aa8d-b58b347cc7b7 tempest-VolumesActionsTest-489501281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5201f1ad-69c2-4dcc-bcf9-920734289328) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:08:45.482637 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-9aca4485-c39b-4606-aa8d-b58b347cc7b7 tempest-VolumesActionsTest-489501281 None] Flow 'volume_create_manager' (b63f1fa9-ea41-457f-9e4e-62004bfc8cd2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134148) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 18 21:08:45.508697 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-9aca4485-c39b-4606-aa8d-b58b347cc7b7 tempest-VolumesActionsTest-489501281 None] Created volume successfully. Dec 18 21:08:46.319912 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.coordination [None req-527c872e-486c-42af-b869-17c16885da7d tempest-VolumesActionsTest-469023560 None] Lock "b'cinder-8c6331ce-7e9d-442d-9fb6-095aca2f8053-delete_volume'" acquired by "delete_volume" :: waited 0.013s {{(pid=134148) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 18 21:08:46.364147 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-527c872e-486c-42af-b869-17c16885da7d tempest-VolumesActionsTest-469023560 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:08:46.447445 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-527c872e-486c-42af-b869-17c16885da7d tempest-VolumesActionsTest-469023560 None] volume has no backup snaps {{(pid=134148) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Dec 18 21:08:46.448137 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-527c872e-486c-42af-b869-17c16885da7d tempest-VolumesActionsTest-469023560 None] Volume volume-8c6331ce-7e9d-442d-9fb6-095aca2f8053 is not a clone. {{(pid=134148) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Dec 18 21:08:46.462680 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-527c872e-486c-42af-b869-17c16885da7d tempest-VolumesActionsTest-469023560 None] deleting rbd volume volume-8c6331ce-7e9d-442d-9fb6-095aca2f8053 {{(pid=134148) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Dec 18 21:08:46.858123 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.quota [None req-527c872e-486c-42af-b869-17c16885da7d tempest-VolumesActionsTest-469023560 None] Created reservations ['c353e695-f0d5-4aac-b14e-10eb02ed425f', '5be8300c-234a-45c5-a77e-caa018f5a70f', '733e9366-f321-4321-a9bd-377f97593764', '34ad2b3b-143e-4477-ae77-1fdee20fdeda'] {{(pid=134148) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 18 21:08:46.919973 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.flows.manager.create_volume [req-34ea38e4-931f-4a45-b87e-83f95b740465 req-902c04de-e637-4017-b0fa-eab41178b6db tempest-TestVolumeBootPattern-1320248540 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134148) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Dec 18 21:08:46.925998 ncdv-master-1 cinder-volume[134148]: WARNING stevedore.named [req-34ea38e4-931f-4a45-b87e-83f95b740465 req-902c04de-e637-4017-b0fa-eab41178b6db tempest-TestVolumeBootPattern-1320248540 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Dec 18 21:08:46.926561 ncdv-master-1 cinder-volume[134148]: WARNING castellan.key_manager [req-34ea38e4-931f-4a45-b87e-83f95b740465 req-902c04de-e637-4017-b0fa-eab41178b6db tempest-TestVolumeBootPattern-1320248540 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Dec 18 21:08:46.961850 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [req-34ea38e4-931f-4a45-b87e-83f95b740465 req-902c04de-e637-4017-b0fa-eab41178b6db tempest-TestVolumeBootPattern-1320248540 None] Flow 'volume_create_manager' (db8ebae5-ce5c-49b8-a65e-99a33afba589) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 18 21:08:46.966467 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [req-34ea38e4-931f-4a45-b87e-83f95b740465 req-902c04de-e637-4017-b0fa-eab41178b6db tempest-TestVolumeBootPattern-1320248540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c923f153-6692-46c0-90f2-831f802fee5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:08:46.974884 ncdv-master-1 cinder-volume[134148]: DEBUG oslo_db.sqlalchemy.engines [req-34ea38e4-931f-4a45-b87e-83f95b740465 req-902c04de-e637-4017-b0fa-eab41178b6db tempest-TestVolumeBootPattern-1320248540 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134148) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 18 21:08:46.980778 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-527c872e-486c-42af-b869-17c16885da7d tempest-VolumesActionsTest-469023560 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:08:47.031782 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-527c872e-486c-42af-b869-17c16885da7d tempest-VolumesActionsTest-469023560 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:08:47.073832 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.manager [None req-527c872e-486c-42af-b869-17c16885da7d tempest-VolumesActionsTest-469023560 None] Notifying Schedulers of capabilities ... {{(pid=134148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 18 21:08:47.091281 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [req-34ea38e4-931f-4a45-b87e-83f95b740465 req-902c04de-e637-4017-b0fa-eab41178b6db tempest-TestVolumeBootPattern-1320248540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c923f153-6692-46c0-90f2-831f802fee5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=True,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-12-18T21:08:47Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=f37747a8-c04a-4777-8d1b-d6b3485de89e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de79cd87d023436a80d3cc5428586e21',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-12-18T21:08:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=ef155ebf-aa5a-4723-a2b7-d2f74c10ca2c,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-12-18T21:08:47Z,use_quota=True,user_id='d32598482c834073b8fe24c84cb57d2f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f2e1fe1-9fd6-411e-9ed9-368f463ccb6f),volume_type_id=1f2e1fe1-9fd6-411e-9ed9-368f463ccb6f)' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:08:47.094715 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [req-34ea38e4-931f-4a45-b87e-83f95b740465 req-902c04de-e637-4017-b0fa-eab41178b6db tempest-TestVolumeBootPattern-1320248540 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (344a26da-b246-458c-b825-b0fa0bb88940) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:08:47.097664 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [req-34ea38e4-931f-4a45-b87e-83f95b740465 req-902c04de-e637-4017-b0fa-eab41178b6db tempest-TestVolumeBootPattern-1320248540 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (344a26da-b246-458c-b825-b0fa0bb88940) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:08:47.100801 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [req-34ea38e4-931f-4a45-b87e-83f95b740465 req-902c04de-e637-4017-b0fa-eab41178b6db tempest-TestVolumeBootPattern-1320248540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f103b8d-b6ed-4b74-994e-033cd53276db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:08:47.103064 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [req-34ea38e4-931f-4a45-b87e-83f95b740465 req-902c04de-e637-4017-b0fa-eab41178b6db tempest-TestVolumeBootPattern-1320248540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f103b8d-b6ed-4b74-994e-033cd53276db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'f37747a8-c04a-4777-8d1b-d6b3485de89e', 'volume_name': 'volume-f37747a8-c04a-4777-8d1b-d6b3485de89e', 'volume_size': 1, 'snapshot_id': 'ef155ebf-aa5a-4723-a2b7-d2f74c10ca2c'}' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:08:47.105797 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [req-34ea38e4-931f-4a45-b87e-83f95b740465 req-902c04de-e637-4017-b0fa-eab41178b6db tempest-TestVolumeBootPattern-1320248540 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d3dd5a2-a67e-4b50-ab39-2f8504d1a355) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:08:47.108634 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [req-34ea38e4-931f-4a45-b87e-83f95b740465 req-902c04de-e637-4017-b0fa-eab41178b6db tempest-TestVolumeBootPattern-1320248540 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d3dd5a2-a67e-4b50-ab39-2f8504d1a355) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:08:47.111396 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [req-34ea38e4-931f-4a45-b87e-83f95b740465 req-902c04de-e637-4017-b0fa-eab41178b6db tempest-TestVolumeBootPattern-1320248540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e405cf8d-7f7f-48e0-87ff-03341baba125) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:08:47.112196 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.flows.manager.create_volume [req-34ea38e4-931f-4a45-b87e-83f95b740465 req-902c04de-e637-4017-b0fa-eab41178b6db tempest-TestVolumeBootPattern-1320248540 None] Volume f37747a8-c04a-4777-8d1b-d6b3485de89e: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-f37747a8-c04a-4777-8d1b-d6b3485de89e', 'volume_size': 1, 'snapshot_id': 'ef155ebf-aa5a-4723-a2b7-d2f74c10ca2c'} Dec 18 21:08:47.114411 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-527c872e-486c-42af-b869-17c16885da7d tempest-VolumesActionsTest-469023560 None] Deleted volume successfully. Dec 18 21:08:47.136121 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [req-34ea38e4-931f-4a45-b87e-83f95b740465 req-902c04de-e637-4017-b0fa-eab41178b6db tempest-TestVolumeBootPattern-1320248540 None] cloning volumes/volume-36b45732-3da1-4a6d-9972-06956bf7ad47@snapshot-ef155ebf-aa5a-4723-a2b7-d2f74c10ca2c to volume-f37747a8-c04a-4777-8d1b-d6b3485de89e {{(pid=134148) _clone /opt/stack/cinder/cinder/volume/drivers/rbd.py:1028}} Dec 18 21:08:47.137598 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [req-34ea38e4-931f-4a45-b87e-83f95b740465 req-902c04de-e637-4017-b0fa-eab41178b6db tempest-TestVolumeBootPattern-1320248540 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:08:47.261737 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [req-34ea38e4-931f-4a45-b87e-83f95b740465 req-902c04de-e637-4017-b0fa-eab41178b6db tempest-TestVolumeBootPattern-1320248540 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:08:47.333135 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.coordination [None req-527c872e-486c-42af-b869-17c16885da7d tempest-VolumesActionsTest-469023560 None] Lock "b'cinder-8c6331ce-7e9d-442d-9fb6-095aca2f8053-delete_volume'" released by "delete_volume" :: held 1.014s {{(pid=134148) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 18 21:08:47.500138 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [req-34ea38e4-931f-4a45-b87e-83f95b740465 req-902c04de-e637-4017-b0fa-eab41178b6db tempest-TestVolumeBootPattern-1320248540 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134148) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 18 21:08:47.500510 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [req-34ea38e4-931f-4a45-b87e-83f95b740465 req-902c04de-e637-4017-b0fa-eab41178b6db tempest-TestVolumeBootPattern-1320248540 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134148) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 18 21:08:47.531364 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.volume_utils [req-34ea38e4-931f-4a45-b87e-83f95b740465 req-902c04de-e637-4017-b0fa-eab41178b6db tempest-TestVolumeBootPattern-1320248540 None] Marking volume f37747a8-c04a-4777-8d1b-d6b3485de89e as bootable. {{(pid=134148) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1178}} Dec 18 21:08:47.548417 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.flows.manager.create_volume [req-34ea38e4-931f-4a45-b87e-83f95b740465 req-902c04de-e637-4017-b0fa-eab41178b6db tempest-TestVolumeBootPattern-1320248540 None] Copying metadata from snapshot ef155ebf-aa5a-4723-a2b7-d2f74c10ca2c to f37747a8-c04a-4777-8d1b-d6b3485de89e. {{(pid=134148) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:423}} Dec 18 21:08:47.595086 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [req-34ea38e4-931f-4a45-b87e-83f95b740465 req-902c04de-e637-4017-b0fa-eab41178b6db tempest-TestVolumeBootPattern-1320248540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e405cf8d-7f7f-48e0-87ff-03341baba125) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f37747a8-c04a-4777-8d1b-d6b3485de89e', 'volume_size': 1, 'snapshot_id': 'ef155ebf-aa5a-4723-a2b7-d2f74c10ca2c'}' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:08:47.597433 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [req-34ea38e4-931f-4a45-b87e-83f95b740465 req-902c04de-e637-4017-b0fa-eab41178b6db tempest-TestVolumeBootPattern-1320248540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52d7f05e-c0c5-4d3d-b5b8-fbad5272102d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:08:47.606727 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.flows.manager.create_volume [req-34ea38e4-931f-4a45-b87e-83f95b740465 req-902c04de-e637-4017-b0fa-eab41178b6db tempest-TestVolumeBootPattern-1320248540 None] Volume volume-f37747a8-c04a-4777-8d1b-d6b3485de89e (f37747a8-c04a-4777-8d1b-d6b3485de89e): created successfully Dec 18 21:08:47.608742 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [req-34ea38e4-931f-4a45-b87e-83f95b740465 req-902c04de-e637-4017-b0fa-eab41178b6db tempest-TestVolumeBootPattern-1320248540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52d7f05e-c0c5-4d3d-b5b8-fbad5272102d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:08:47.611759 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [req-34ea38e4-931f-4a45-b87e-83f95b740465 req-902c04de-e637-4017-b0fa-eab41178b6db tempest-TestVolumeBootPattern-1320248540 None] Flow 'volume_create_manager' (db8ebae5-ce5c-49b8-a65e-99a33afba589) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134148) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 18 21:08:47.629828 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [req-34ea38e4-931f-4a45-b87e-83f95b740465 req-902c04de-e637-4017-b0fa-eab41178b6db tempest-TestVolumeBootPattern-1320248540 None] Created volume successfully. Dec 18 21:08:47.888910 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.flows.manager.create_volume [None req-8e629ae5-31b3-42e0-bba3-3c4bc59b721f tempest-VolumesActionsTest-489501281 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134148) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Dec 18 21:08:47.901241 ncdv-master-1 cinder-volume[134148]: WARNING stevedore.named [None req-8e629ae5-31b3-42e0-bba3-3c4bc59b721f tempest-VolumesActionsTest-489501281 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Dec 18 21:08:47.902163 ncdv-master-1 cinder-volume[134148]: WARNING castellan.key_manager [None req-8e629ae5-31b3-42e0-bba3-3c4bc59b721f tempest-VolumesActionsTest-489501281 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Dec 18 21:08:47.922507 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-8e629ae5-31b3-42e0-bba3-3c4bc59b721f tempest-VolumesActionsTest-489501281 None] Flow 'volume_create_manager' (ef46bc39-e47c-40c5-b863-d95b5d408640) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 18 21:08:47.927324 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-8e629ae5-31b3-42e0-bba3-3c4bc59b721f tempest-VolumesActionsTest-489501281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80998800-84f9-496a-95df-0860362c6aa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:08:47.935318 ncdv-master-1 cinder-volume[134148]: DEBUG oslo_db.sqlalchemy.engines [None req-8e629ae5-31b3-42e0-bba3-3c4bc59b721f tempest-VolumesActionsTest-489501281 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134148) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 18 21:08:47.952431 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-8e629ae5-31b3-42e0-bba3-3c4bc59b721f tempest-VolumesActionsTest-489501281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80998800-84f9-496a-95df-0860362c6aa0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-12-18T21:08:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1427541234',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=f3eab5ba-d2a8-41c8-b97e-5f69ded756d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c48b8b9635104eafab5295b3b8709c14',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-12-18T21:08:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-12-18T21:08:48Z,use_quota=True,user_id='e8150e994a4f42e3b014e5e51265213a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f2e1fe1-9fd6-411e-9ed9-368f463ccb6f),volume_type_id=1f2e1fe1-9fd6-411e-9ed9-368f463ccb6f)' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:08:47.955888 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-8e629ae5-31b3-42e0-bba3-3c4bc59b721f tempest-VolumesActionsTest-489501281 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f4f472d-4a23-46b5-badb-03c6b1b951de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:08:47.959108 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-8e629ae5-31b3-42e0-bba3-3c4bc59b721f tempest-VolumesActionsTest-489501281 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f4f472d-4a23-46b5-badb-03c6b1b951de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:08:47.961888 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-8e629ae5-31b3-42e0-bba3-3c4bc59b721f tempest-VolumesActionsTest-489501281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44b99bd7-8696-4e05-bdbf-3e8eb1ea58ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:08:47.965292 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-8e629ae5-31b3-42e0-bba3-3c4bc59b721f tempest-VolumesActionsTest-489501281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44b99bd7-8696-4e05-bdbf-3e8eb1ea58ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f3eab5ba-d2a8-41c8-b97e-5f69ded756d2', 'volume_name': 'volume-f3eab5ba-d2a8-41c8-b97e-5f69ded756d2', 'volume_size': 1}' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:08:47.968788 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-8e629ae5-31b3-42e0-bba3-3c4bc59b721f tempest-VolumesActionsTest-489501281 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba961713-9094-4983-ba61-8b51fcd8a38b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:08:47.986237 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-8e629ae5-31b3-42e0-bba3-3c4bc59b721f tempest-VolumesActionsTest-489501281 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba961713-9094-4983-ba61-8b51fcd8a38b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:08:47.991854 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-8e629ae5-31b3-42e0-bba3-3c4bc59b721f tempest-VolumesActionsTest-489501281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de74c68b-ef13-403b-a097-184f325f5257) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:08:47.992798 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.flows.manager.create_volume [None req-8e629ae5-31b3-42e0-bba3-3c4bc59b721f tempest-VolumesActionsTest-489501281 None] Volume f3eab5ba-d2a8-41c8-b97e-5f69ded756d2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f3eab5ba-d2a8-41c8-b97e-5f69ded756d2', 'volume_size': 1} Dec 18 21:08:47.993198 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-8e629ae5-31b3-42e0-bba3-3c4bc59b721f tempest-VolumesActionsTest-489501281 None] creating volume 'volume-f3eab5ba-d2a8-41c8-b97e-5f69ded756d2' {{(pid=134148) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Dec 18 21:08:47.995124 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-8e629ae5-31b3-42e0-bba3-3c4bc59b721f tempest-VolumesActionsTest-489501281 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:08:48.106168 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-8e629ae5-31b3-42e0-bba3-3c4bc59b721f tempest-VolumesActionsTest-489501281 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134148) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 18 21:08:48.106598 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-8e629ae5-31b3-42e0-bba3-3c4bc59b721f tempest-VolumesActionsTest-489501281 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134148) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 18 21:08:48.108806 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-8e629ae5-31b3-42e0-bba3-3c4bc59b721f tempest-VolumesActionsTest-489501281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de74c68b-ef13-403b-a097-184f325f5257) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f3eab5ba-d2a8-41c8-b97e-5f69ded756d2', 'volume_size': 1}' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:08:48.111047 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-8e629ae5-31b3-42e0-bba3-3c4bc59b721f tempest-VolumesActionsTest-489501281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35b5adcc-6ecb-4421-a98d-ef8d4f6db4f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:08:48.133025 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.flows.manager.create_volume [None req-8e629ae5-31b3-42e0-bba3-3c4bc59b721f tempest-VolumesActionsTest-489501281 None] Volume volume-f3eab5ba-d2a8-41c8-b97e-5f69ded756d2 (f3eab5ba-d2a8-41c8-b97e-5f69ded756d2): created successfully Dec 18 21:08:48.136253 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-8e629ae5-31b3-42e0-bba3-3c4bc59b721f tempest-VolumesActionsTest-489501281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35b5adcc-6ecb-4421-a98d-ef8d4f6db4f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:08:48.141209 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-8e629ae5-31b3-42e0-bba3-3c4bc59b721f tempest-VolumesActionsTest-489501281 None] Flow 'volume_create_manager' (ef46bc39-e47c-40c5-b863-d95b5d408640) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134148) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 18 21:08:48.158935 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-8e629ae5-31b3-42e0-bba3-3c4bc59b721f tempest-VolumesActionsTest-489501281 None] Created volume successfully. Dec 18 21:08:49.097624 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.coordination [None req-255d9df8-868d-4d70-a2eb-de2f02da8921 tempest-VolumesActionsTest-469023560 None] Lock "b'cinder-f3eab5ba-d2a8-41c8-b97e-5f69ded756d2-delete_volume'" acquired by "delete_volume" :: waited 0.011s {{(pid=134148) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 18 21:08:49.130775 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-255d9df8-868d-4d70-a2eb-de2f02da8921 tempest-VolumesActionsTest-469023560 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:08:49.193269 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-255d9df8-868d-4d70-a2eb-de2f02da8921 tempest-VolumesActionsTest-469023560 None] volume has no backup snaps {{(pid=134148) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Dec 18 21:08:49.193734 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-255d9df8-868d-4d70-a2eb-de2f02da8921 tempest-VolumesActionsTest-469023560 None] Volume volume-f3eab5ba-d2a8-41c8-b97e-5f69ded756d2 is not a clone. {{(pid=134148) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Dec 18 21:08:49.200701 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-255d9df8-868d-4d70-a2eb-de2f02da8921 tempest-VolumesActionsTest-469023560 None] deleting rbd volume volume-f3eab5ba-d2a8-41c8-b97e-5f69ded756d2 {{(pid=134148) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Dec 18 21:08:49.484353 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.quota [None req-255d9df8-868d-4d70-a2eb-de2f02da8921 tempest-VolumesActionsTest-469023560 None] Created reservations ['4074f975-4411-4905-aeb7-9f5e783c8de0', 'af69e5d1-2f01-49ac-9b65-f0850b638324', 'cacc5c2f-06a2-4ace-b6c8-03efc23af9fa', 'e5adff84-07b8-450e-b934-d4c880130bbd'] {{(pid=134148) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 18 21:08:49.532669 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-255d9df8-868d-4d70-a2eb-de2f02da8921 tempest-VolumesActionsTest-469023560 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:08:49.590475 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-255d9df8-868d-4d70-a2eb-de2f02da8921 tempest-VolumesActionsTest-469023560 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:08:49.662581 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.manager [None req-255d9df8-868d-4d70-a2eb-de2f02da8921 tempest-VolumesActionsTest-469023560 None] Notifying Schedulers of capabilities ... {{(pid=134148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 18 21:08:49.667246 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-255d9df8-868d-4d70-a2eb-de2f02da8921 tempest-VolumesActionsTest-469023560 None] Deleted volume successfully. Dec 18 21:08:49.694282 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.coordination [None req-255d9df8-868d-4d70-a2eb-de2f02da8921 tempest-VolumesActionsTest-469023560 None] Lock "b'cinder-f3eab5ba-d2a8-41c8-b97e-5f69ded756d2-delete_volume'" released by "delete_volume" :: held 0.597s {{(pid=134148) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 18 21:08:50.186542 ncdv-master-1 cinder-volume[134148]: DEBUG oslo_concurrency.processutils [req-34ea38e4-931f-4a45-b87e-83f95b740465 req-d41d5cc4-d13b-4ad4-9bd8-575a87eae096 tempest-TestVolumeBootPattern-1320248540 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=134148) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Dec 18 21:08:50.586721 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.flows.manager.create_volume [None req-bc2ac1f5-3c03-402b-9c67-a2f3863a4c00 tempest-VolumesActionsTest-489501281 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134148) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Dec 18 21:08:50.593756 ncdv-master-1 cinder-volume[134148]: WARNING stevedore.named [None req-bc2ac1f5-3c03-402b-9c67-a2f3863a4c00 tempest-VolumesActionsTest-489501281 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Dec 18 21:08:50.596319 ncdv-master-1 cinder-volume[134148]: WARNING castellan.key_manager [None req-bc2ac1f5-3c03-402b-9c67-a2f3863a4c00 tempest-VolumesActionsTest-489501281 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Dec 18 21:08:50.612155 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-bc2ac1f5-3c03-402b-9c67-a2f3863a4c00 tempest-VolumesActionsTest-489501281 None] Flow 'volume_create_manager' (812ffbbd-8743-4ff2-b15e-4ea447e3eaf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 18 21:08:50.617038 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-bc2ac1f5-3c03-402b-9c67-a2f3863a4c00 tempest-VolumesActionsTest-489501281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b61138f0-52f0-4a92-aa24-ff9e2dad5b48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:08:50.624979 ncdv-master-1 cinder-volume[134148]: DEBUG oslo_db.sqlalchemy.engines [None req-bc2ac1f5-3c03-402b-9c67-a2f3863a4c00 tempest-VolumesActionsTest-489501281 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134148) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 18 21:08:50.659841 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-bc2ac1f5-3c03-402b-9c67-a2f3863a4c00 tempest-VolumesActionsTest-489501281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b61138f0-52f0-4a92-aa24-ff9e2dad5b48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-12-18T21:08:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-130000453',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=5c02ac93-8376-4284-aab8-3b40c5a53ad6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c48b8b9635104eafab5295b3b8709c14',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-12-18T21:08:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-12-18T21:08:51Z,use_quota=True,user_id='e8150e994a4f42e3b014e5e51265213a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f2e1fe1-9fd6-411e-9ed9-368f463ccb6f),volume_type_id=1f2e1fe1-9fd6-411e-9ed9-368f463ccb6f)' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:08:50.662506 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-bc2ac1f5-3c03-402b-9c67-a2f3863a4c00 tempest-VolumesActionsTest-489501281 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (956d4abb-9f64-4b4f-bd7d-7920fe08696b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:08:50.664779 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-bc2ac1f5-3c03-402b-9c67-a2f3863a4c00 tempest-VolumesActionsTest-489501281 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (956d4abb-9f64-4b4f-bd7d-7920fe08696b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:08:50.667196 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-bc2ac1f5-3c03-402b-9c67-a2f3863a4c00 tempest-VolumesActionsTest-489501281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ed8fe24-fb35-44b9-a378-f5fd12a83264) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:08:50.671277 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-bc2ac1f5-3c03-402b-9c67-a2f3863a4c00 tempest-VolumesActionsTest-489501281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ed8fe24-fb35-44b9-a378-f5fd12a83264) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5c02ac93-8376-4284-aab8-3b40c5a53ad6', 'volume_name': 'volume-5c02ac93-8376-4284-aab8-3b40c5a53ad6', 'volume_size': 1}' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:08:50.673977 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-bc2ac1f5-3c03-402b-9c67-a2f3863a4c00 tempest-VolumesActionsTest-489501281 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (caa63321-bb53-402c-ba8e-f2621ebbeaad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:08:50.676348 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-bc2ac1f5-3c03-402b-9c67-a2f3863a4c00 tempest-VolumesActionsTest-489501281 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (caa63321-bb53-402c-ba8e-f2621ebbeaad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:08:50.678685 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-bc2ac1f5-3c03-402b-9c67-a2f3863a4c00 tempest-VolumesActionsTest-489501281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c78339d-4bf5-4896-a978-bf79551081bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:08:50.679855 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.flows.manager.create_volume [None req-bc2ac1f5-3c03-402b-9c67-a2f3863a4c00 tempest-VolumesActionsTest-489501281 None] Volume 5c02ac93-8376-4284-aab8-3b40c5a53ad6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5c02ac93-8376-4284-aab8-3b40c5a53ad6', 'volume_size': 1} Dec 18 21:08:50.680264 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-bc2ac1f5-3c03-402b-9c67-a2f3863a4c00 tempest-VolumesActionsTest-489501281 None] creating volume 'volume-5c02ac93-8376-4284-aab8-3b40c5a53ad6' {{(pid=134148) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Dec 18 21:08:50.681372 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-bc2ac1f5-3c03-402b-9c67-a2f3863a4c00 tempest-VolumesActionsTest-489501281 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:08:50.758761 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-bc2ac1f5-3c03-402b-9c67-a2f3863a4c00 tempest-VolumesActionsTest-489501281 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134148) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 18 21:08:50.759139 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-bc2ac1f5-3c03-402b-9c67-a2f3863a4c00 tempest-VolumesActionsTest-489501281 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134148) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 18 21:08:50.761212 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-bc2ac1f5-3c03-402b-9c67-a2f3863a4c00 tempest-VolumesActionsTest-489501281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c78339d-4bf5-4896-a978-bf79551081bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5c02ac93-8376-4284-aab8-3b40c5a53ad6', 'volume_size': 1}' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:08:50.763642 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-bc2ac1f5-3c03-402b-9c67-a2f3863a4c00 tempest-VolumesActionsTest-489501281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69ef92d3-0d5e-4fbf-8d22-e27b92907b22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:08:50.773296 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.flows.manager.create_volume [None req-bc2ac1f5-3c03-402b-9c67-a2f3863a4c00 tempest-VolumesActionsTest-489501281 None] Volume volume-5c02ac93-8376-4284-aab8-3b40c5a53ad6 (5c02ac93-8376-4284-aab8-3b40c5a53ad6): created successfully Dec 18 21:08:50.775862 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-bc2ac1f5-3c03-402b-9c67-a2f3863a4c00 tempest-VolumesActionsTest-489501281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69ef92d3-0d5e-4fbf-8d22-e27b92907b22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:08:50.779890 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-bc2ac1f5-3c03-402b-9c67-a2f3863a4c00 tempest-VolumesActionsTest-489501281 None] Flow 'volume_create_manager' (812ffbbd-8743-4ff2-b15e-4ea447e3eaf5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134148) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 18 21:08:50.790632 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-bc2ac1f5-3c03-402b-9c67-a2f3863a4c00 tempest-VolumesActionsTest-489501281 None] Created volume successfully. Dec 18 21:08:51.096154 ncdv-master-1 cinder-volume[134148]: DEBUG oslo_concurrency.processutils [req-34ea38e4-931f-4a45-b87e-83f95b740465 req-d41d5cc4-d13b-4ad4-9bd8-575a87eae096 tempest-TestVolumeBootPattern-1320248540 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.910s {{(pid=134148) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Dec 18 21:08:51.096843 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [req-34ea38e4-931f-4a45-b87e-83f95b740465 req-d41d5cc4-d13b-4ad4-9bd8-575a87eae096 tempest-TestVolumeBootPattern-1320248540 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-f37747a8-c04a-4777-8d1b-d6b3485de89e', 'hosts': ['10.222.0.13'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '946d1715-d12c-4dbf-8a79-181222df6e2e', 'volume_id': 'f37747a8-c04a-4777-8d1b-d6b3485de89e', 'discard': True}} {{(pid=134148) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Dec 18 21:08:51.117614 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [req-34ea38e4-931f-4a45-b87e-83f95b740465 req-d41d5cc4-d13b-4ad4-9bd8-575a87eae096 tempest-TestVolumeBootPattern-1320248540 None] Connection info returned from driver {'name': 'volumes/volume-f37747a8-c04a-4777-8d1b-d6b3485de89e', 'hosts': ['10.222.0.13'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'f37747a8-c04a-4777-8d1b-d6b3485de89e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '728d5ba1-5d84-4371-8616-97087b14f6f0'} {{(pid=134148) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4812}} Dec 18 21:08:51.166407 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [req-34ea38e4-931f-4a45-b87e-83f95b740465 req-d41d5cc4-d13b-4ad4-9bd8-575a87eae096 tempest-TestVolumeBootPattern-1320248540 None] attachment_update completed successfully. Dec 18 21:08:51.743680 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.coordination [None req-245b526d-0981-467a-8ee1-fc60e7c96280 tempest-VolumesActionsTest-469023560 None] Lock "b'cinder-5c02ac93-8376-4284-aab8-3b40c5a53ad6-delete_volume'" acquired by "delete_volume" :: waited 0.017s {{(pid=134148) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 18 21:08:51.781833 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-245b526d-0981-467a-8ee1-fc60e7c96280 tempest-VolumesActionsTest-469023560 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:08:51.834920 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-245b526d-0981-467a-8ee1-fc60e7c96280 tempest-VolumesActionsTest-469023560 None] volume has no backup snaps {{(pid=134148) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Dec 18 21:08:51.835577 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-245b526d-0981-467a-8ee1-fc60e7c96280 tempest-VolumesActionsTest-469023560 None] Volume volume-5c02ac93-8376-4284-aab8-3b40c5a53ad6 is not a clone. {{(pid=134148) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Dec 18 21:08:51.841436 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-245b526d-0981-467a-8ee1-fc60e7c96280 tempest-VolumesActionsTest-469023560 None] deleting rbd volume volume-5c02ac93-8376-4284-aab8-3b40c5a53ad6 {{(pid=134148) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Dec 18 21:08:52.109857 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.quota [None req-245b526d-0981-467a-8ee1-fc60e7c96280 tempest-VolumesActionsTest-469023560 None] Created reservations ['9a09bbe5-4cfc-4b10-a7f8-cebdb0130151', '1e3556e1-9213-4404-83bc-0340e48790f6', '99db0d91-9a76-46ec-91e8-52b3e3bb010b', 'f17131be-ef41-4609-94ba-29a0b00489ed'] {{(pid=134148) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 18 21:08:52.160708 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-245b526d-0981-467a-8ee1-fc60e7c96280 tempest-VolumesActionsTest-469023560 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:08:52.205948 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-245b526d-0981-467a-8ee1-fc60e7c96280 tempest-VolumesActionsTest-469023560 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:08:52.250171 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.manager [None req-245b526d-0981-467a-8ee1-fc60e7c96280 tempest-VolumesActionsTest-469023560 None] Notifying Schedulers of capabilities ... {{(pid=134148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 18 21:08:52.255166 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-245b526d-0981-467a-8ee1-fc60e7c96280 tempest-VolumesActionsTest-469023560 None] Deleted volume successfully. Dec 18 21:08:52.271951 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.coordination [None req-245b526d-0981-467a-8ee1-fc60e7c96280 tempest-VolumesActionsTest-469023560 None] Lock "b'cinder-5c02ac93-8376-4284-aab8-3b40c5a53ad6-delete_volume'" released by "delete_volume" :: held 0.528s {{(pid=134148) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 18 21:08:53.245989 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.flows.manager.create_volume [None req-c0f7ee5d-0df6-4430-a37b-5870e936c086 tempest-VolumesActionsTest-489501281 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134148) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Dec 18 21:08:53.252430 ncdv-master-1 cinder-volume[134148]: WARNING stevedore.named [None req-c0f7ee5d-0df6-4430-a37b-5870e936c086 tempest-VolumesActionsTest-489501281 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Dec 18 21:08:53.252871 ncdv-master-1 cinder-volume[134148]: WARNING castellan.key_manager [None req-c0f7ee5d-0df6-4430-a37b-5870e936c086 tempest-VolumesActionsTest-489501281 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Dec 18 21:08:53.267475 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-c0f7ee5d-0df6-4430-a37b-5870e936c086 tempest-VolumesActionsTest-489501281 None] Flow 'volume_create_manager' (9de2d8d7-a5c5-40eb-a50f-a02e05810df8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 18 21:08:53.270830 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-c0f7ee5d-0df6-4430-a37b-5870e936c086 tempest-VolumesActionsTest-489501281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d91707a7-f4a1-45cc-a33b-5bb2a5ac07ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:08:53.279418 ncdv-master-1 cinder-volume[134148]: DEBUG oslo_db.sqlalchemy.engines [None req-c0f7ee5d-0df6-4430-a37b-5870e936c086 tempest-VolumesActionsTest-489501281 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134148) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 18 21:08:53.293226 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-c0f7ee5d-0df6-4430-a37b-5870e936c086 tempest-VolumesActionsTest-489501281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d91707a7-f4a1-45cc-a33b-5bb2a5ac07ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-12-18T21:08:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-17149963',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=037e718a-9834-4a16-8adb-d9fcaacfb900,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c48b8b9635104eafab5295b3b8709c14',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-12-18T21:08:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-12-18T21:08:53Z,use_quota=True,user_id='e8150e994a4f42e3b014e5e51265213a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f2e1fe1-9fd6-411e-9ed9-368f463ccb6f),volume_type_id=1f2e1fe1-9fd6-411e-9ed9-368f463ccb6f)' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:08:53.296639 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-c0f7ee5d-0df6-4430-a37b-5870e936c086 tempest-VolumesActionsTest-489501281 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05a70350-c4cb-4ceb-8a5b-09bddb31261b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:08:53.298988 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-c0f7ee5d-0df6-4430-a37b-5870e936c086 tempest-VolumesActionsTest-489501281 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05a70350-c4cb-4ceb-8a5b-09bddb31261b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:08:53.301458 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-c0f7ee5d-0df6-4430-a37b-5870e936c086 tempest-VolumesActionsTest-489501281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88ff91d8-e00d-4c59-97cd-177b64641f54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:08:53.303979 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-c0f7ee5d-0df6-4430-a37b-5870e936c086 tempest-VolumesActionsTest-489501281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88ff91d8-e00d-4c59-97cd-177b64641f54) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '037e718a-9834-4a16-8adb-d9fcaacfb900', 'volume_name': 'volume-037e718a-9834-4a16-8adb-d9fcaacfb900', 'volume_size': 1}' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:08:53.306597 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-c0f7ee5d-0df6-4430-a37b-5870e936c086 tempest-VolumesActionsTest-489501281 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3a85504-2f34-4abc-a050-5e7ee2a00435) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:08:53.308917 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-c0f7ee5d-0df6-4430-a37b-5870e936c086 tempest-VolumesActionsTest-489501281 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3a85504-2f34-4abc-a050-5e7ee2a00435) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:08:53.311161 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-c0f7ee5d-0df6-4430-a37b-5870e936c086 tempest-VolumesActionsTest-489501281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (849cb1bd-c065-4c82-9ca1-23e5963d74f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:08:53.311931 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.flows.manager.create_volume [None req-c0f7ee5d-0df6-4430-a37b-5870e936c086 tempest-VolumesActionsTest-489501281 None] Volume 037e718a-9834-4a16-8adb-d9fcaacfb900: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-037e718a-9834-4a16-8adb-d9fcaacfb900', 'volume_size': 1} Dec 18 21:08:53.312362 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-c0f7ee5d-0df6-4430-a37b-5870e936c086 tempest-VolumesActionsTest-489501281 None] creating volume 'volume-037e718a-9834-4a16-8adb-d9fcaacfb900' {{(pid=134148) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Dec 18 21:08:53.313357 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-c0f7ee5d-0df6-4430-a37b-5870e936c086 tempest-VolumesActionsTest-489501281 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:08:53.384541 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-c0f7ee5d-0df6-4430-a37b-5870e936c086 tempest-VolumesActionsTest-489501281 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134148) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 18 21:08:53.384920 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-c0f7ee5d-0df6-4430-a37b-5870e936c086 tempest-VolumesActionsTest-489501281 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134148) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 18 21:08:53.387525 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-c0f7ee5d-0df6-4430-a37b-5870e936c086 tempest-VolumesActionsTest-489501281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (849cb1bd-c065-4c82-9ca1-23e5963d74f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-037e718a-9834-4a16-8adb-d9fcaacfb900', 'volume_size': 1}' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:08:53.389757 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-c0f7ee5d-0df6-4430-a37b-5870e936c086 tempest-VolumesActionsTest-489501281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28db746b-37ee-4929-a0bf-d1b1c61efe56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:08:53.398766 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.flows.manager.create_volume [None req-c0f7ee5d-0df6-4430-a37b-5870e936c086 tempest-VolumesActionsTest-489501281 None] Volume volume-037e718a-9834-4a16-8adb-d9fcaacfb900 (037e718a-9834-4a16-8adb-d9fcaacfb900): created successfully Dec 18 21:08:53.400711 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-c0f7ee5d-0df6-4430-a37b-5870e936c086 tempest-VolumesActionsTest-489501281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28db746b-37ee-4929-a0bf-d1b1c61efe56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:08:53.404501 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-c0f7ee5d-0df6-4430-a37b-5870e936c086 tempest-VolumesActionsTest-489501281 None] Flow 'volume_create_manager' (9de2d8d7-a5c5-40eb-a50f-a02e05810df8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134148) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 18 21:08:53.412125 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-c0f7ee5d-0df6-4430-a37b-5870e936c086 tempest-VolumesActionsTest-489501281 None] Created volume successfully. Dec 18 21:08:54.405761 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.coordination [None req-c15a5af4-9340-4254-b102-7df4aa9d22d7 tempest-VolumesActionsTest-469023560 None] Lock "b'cinder-037e718a-9834-4a16-8adb-d9fcaacfb900-delete_volume'" acquired by "delete_volume" :: waited 0.013s {{(pid=134148) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 18 21:08:54.432887 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-c15a5af4-9340-4254-b102-7df4aa9d22d7 tempest-VolumesActionsTest-469023560 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:08:54.502745 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-c15a5af4-9340-4254-b102-7df4aa9d22d7 tempest-VolumesActionsTest-469023560 None] volume has no backup snaps {{(pid=134148) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Dec 18 21:08:54.503179 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-c15a5af4-9340-4254-b102-7df4aa9d22d7 tempest-VolumesActionsTest-469023560 None] Volume volume-037e718a-9834-4a16-8adb-d9fcaacfb900 is not a clone. {{(pid=134148) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Dec 18 21:08:54.512439 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-c15a5af4-9340-4254-b102-7df4aa9d22d7 tempest-VolumesActionsTest-469023560 None] deleting rbd volume volume-037e718a-9834-4a16-8adb-d9fcaacfb900 {{(pid=134148) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Dec 18 21:08:54.813749 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.quota [None req-c15a5af4-9340-4254-b102-7df4aa9d22d7 tempest-VolumesActionsTest-469023560 None] Created reservations ['821265c4-63de-4c3e-b421-a9f0fb860680', 'e812259b-a969-48e6-a7d7-ebc02f3769ee', 'f3c5a6ab-c414-4260-9634-095f5a3e17fa', '749b136f-4172-4bf6-b7d6-f5ae0a57d8ca'] {{(pid=134148) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 18 21:08:54.893161 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-c15a5af4-9340-4254-b102-7df4aa9d22d7 tempest-VolumesActionsTest-469023560 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:08:54.956829 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-c15a5af4-9340-4254-b102-7df4aa9d22d7 tempest-VolumesActionsTest-469023560 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:08:55.016449 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.manager [None req-c15a5af4-9340-4254-b102-7df4aa9d22d7 tempest-VolumesActionsTest-469023560 None] Notifying Schedulers of capabilities ... {{(pid=134148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 18 21:08:55.023215 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-c15a5af4-9340-4254-b102-7df4aa9d22d7 tempest-VolumesActionsTest-469023560 None] Deleted volume successfully. Dec 18 21:08:55.036114 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.coordination [None req-c15a5af4-9340-4254-b102-7df4aa9d22d7 tempest-VolumesActionsTest-469023560 None] Lock "b'cinder-037e718a-9834-4a16-8adb-d9fcaacfb900-delete_volume'" released by "delete_volume" :: held 0.630s {{(pid=134148) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 18 21:08:55.875453 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.coordination [None req-a98d2a09-4b13-424d-9e2c-5fda16376037 tempest-ServersNegativeTestJSON-381782243 None] Lock "b'cinder-7cf9ffd2-1a5c-45ac-b99c-8aa62037cc81-delete_volume'" acquired by "delete_volume" :: waited 0.013s {{(pid=134148) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 18 21:08:55.923474 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.flows.manager.create_volume [None req-2e1ae93c-4a29-4173-b603-a81f74b6e35c tempest-VolumesActionsTest-489501281 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134148) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Dec 18 21:08:55.923474 ncdv-master-1 cinder-volume[134148]: WARNING stevedore.named [None req-2e1ae93c-4a29-4173-b603-a81f74b6e35c tempest-VolumesActionsTest-489501281 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Dec 18 21:08:55.923736 ncdv-master-1 cinder-volume[134148]: WARNING castellan.key_manager [None req-2e1ae93c-4a29-4173-b603-a81f74b6e35c tempest-VolumesActionsTest-489501281 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Dec 18 21:08:55.935986 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-2e1ae93c-4a29-4173-b603-a81f74b6e35c tempest-VolumesActionsTest-489501281 None] Flow 'volume_create_manager' (c3bf3800-9d7f-44b7-b327-6b7451b6f89d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 18 21:08:55.942428 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-2e1ae93c-4a29-4173-b603-a81f74b6e35c tempest-VolumesActionsTest-489501281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73bba496-dcbf-472b-b086-fbb161da8cf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:08:55.950631 ncdv-master-1 cinder-volume[134148]: DEBUG oslo_db.sqlalchemy.engines [None req-a98d2a09-4b13-424d-9e2c-5fda16376037 tempest-ServersNegativeTestJSON-381782243 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134148) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 18 21:08:55.957069 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-a98d2a09-4b13-424d-9e2c-5fda16376037 tempest-ServersNegativeTestJSON-381782243 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:08:56.002888 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-a98d2a09-4b13-424d-9e2c-5fda16376037 tempest-ServersNegativeTestJSON-381782243 None] volume has no backup snaps {{(pid=134148) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Dec 18 21:08:56.003414 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-a98d2a09-4b13-424d-9e2c-5fda16376037 tempest-ServersNegativeTestJSON-381782243 None] Volume volume-7cf9ffd2-1a5c-45ac-b99c-8aa62037cc81 is not a clone. {{(pid=134148) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Dec 18 21:08:56.009625 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-a98d2a09-4b13-424d-9e2c-5fda16376037 tempest-ServersNegativeTestJSON-381782243 None] deleting rbd volume volume-7cf9ffd2-1a5c-45ac-b99c-8aa62037cc81 {{(pid=134148) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Dec 18 21:08:56.023514 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-2e1ae93c-4a29-4173-b603-a81f74b6e35c tempest-VolumesActionsTest-489501281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73bba496-dcbf-472b-b086-fbb161da8cf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-12-18T21:08:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1617654673',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=e4860b5e-a22c-4f59-a513-cd8e9d475ad2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c48b8b9635104eafab5295b3b8709c14',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-12-18T21:08:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-12-18T21:08:56Z,use_quota=True,user_id='e8150e994a4f42e3b014e5e51265213a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f2e1fe1-9fd6-411e-9ed9-368f463ccb6f),volume_type_id=1f2e1fe1-9fd6-411e-9ed9-368f463ccb6f)' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:08:56.026735 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-2e1ae93c-4a29-4173-b603-a81f74b6e35c tempest-VolumesActionsTest-489501281 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63c39805-3ecd-4f0c-8b36-ab2ab0d95220) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:08:56.028999 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-2e1ae93c-4a29-4173-b603-a81f74b6e35c tempest-VolumesActionsTest-489501281 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63c39805-3ecd-4f0c-8b36-ab2ab0d95220) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:08:56.031757 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-2e1ae93c-4a29-4173-b603-a81f74b6e35c tempest-VolumesActionsTest-489501281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f079951-5e41-4151-ba08-718d0bdad174) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:08:56.033928 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-2e1ae93c-4a29-4173-b603-a81f74b6e35c tempest-VolumesActionsTest-489501281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f079951-5e41-4151-ba08-718d0bdad174) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e4860b5e-a22c-4f59-a513-cd8e9d475ad2', 'volume_name': 'volume-e4860b5e-a22c-4f59-a513-cd8e9d475ad2', 'volume_size': 1}' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:08:56.037288 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-2e1ae93c-4a29-4173-b603-a81f74b6e35c tempest-VolumesActionsTest-489501281 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29da9c7f-48d8-4a54-9387-69f318d3ec75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:08:56.039606 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-2e1ae93c-4a29-4173-b603-a81f74b6e35c tempest-VolumesActionsTest-489501281 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29da9c7f-48d8-4a54-9387-69f318d3ec75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:08:56.042144 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-2e1ae93c-4a29-4173-b603-a81f74b6e35c tempest-VolumesActionsTest-489501281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14696abb-1e48-463b-a7bd-38e4d1716705) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:08:56.042995 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.flows.manager.create_volume [None req-2e1ae93c-4a29-4173-b603-a81f74b6e35c tempest-VolumesActionsTest-489501281 None] Volume e4860b5e-a22c-4f59-a513-cd8e9d475ad2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e4860b5e-a22c-4f59-a513-cd8e9d475ad2', 'volume_size': 1} Dec 18 21:08:56.043381 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-2e1ae93c-4a29-4173-b603-a81f74b6e35c tempest-VolumesActionsTest-489501281 None] creating volume 'volume-e4860b5e-a22c-4f59-a513-cd8e9d475ad2' {{(pid=134148) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Dec 18 21:08:56.044391 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-2e1ae93c-4a29-4173-b603-a81f74b6e35c tempest-VolumesActionsTest-489501281 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:08:56.108935 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-2e1ae93c-4a29-4173-b603-a81f74b6e35c tempest-VolumesActionsTest-489501281 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134148) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 18 21:08:56.109547 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-2e1ae93c-4a29-4173-b603-a81f74b6e35c tempest-VolumesActionsTest-489501281 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134148) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 18 21:08:56.111615 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-2e1ae93c-4a29-4173-b603-a81f74b6e35c tempest-VolumesActionsTest-489501281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14696abb-1e48-463b-a7bd-38e4d1716705) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e4860b5e-a22c-4f59-a513-cd8e9d475ad2', 'volume_size': 1}' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:08:56.114386 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-2e1ae93c-4a29-4173-b603-a81f74b6e35c tempest-VolumesActionsTest-489501281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d476b0d3-aac4-4455-81a1-76cf7cd0a5ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:08:56.125004 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.flows.manager.create_volume [None req-2e1ae93c-4a29-4173-b603-a81f74b6e35c tempest-VolumesActionsTest-489501281 None] Volume volume-e4860b5e-a22c-4f59-a513-cd8e9d475ad2 (e4860b5e-a22c-4f59-a513-cd8e9d475ad2): created successfully Dec 18 21:08:56.128515 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-2e1ae93c-4a29-4173-b603-a81f74b6e35c tempest-VolumesActionsTest-489501281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d476b0d3-aac4-4455-81a1-76cf7cd0a5ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:08:56.132586 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-2e1ae93c-4a29-4173-b603-a81f74b6e35c tempest-VolumesActionsTest-489501281 None] Flow 'volume_create_manager' (c3bf3800-9d7f-44b7-b327-6b7451b6f89d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134148) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 18 21:08:56.147569 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-2e1ae93c-4a29-4173-b603-a81f74b6e35c tempest-VolumesActionsTest-489501281 None] Created volume successfully. Dec 18 21:08:56.290560 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.quota [None req-a98d2a09-4b13-424d-9e2c-5fda16376037 tempest-ServersNegativeTestJSON-381782243 None] Created reservations ['0a7639a7-6a69-4a09-88b2-381b4c06aaa8', '4b69ff02-3e03-4590-aab8-7d5e6da89179', 'f6d4874d-ea27-4e59-8bcb-8cc5e59a029d', '487959ec-41aa-478e-a497-dbd7f19c89fe'] {{(pid=134148) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 18 21:08:56.331634 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-a98d2a09-4b13-424d-9e2c-5fda16376037 tempest-ServersNegativeTestJSON-381782243 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:08:56.363725 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-a98d2a09-4b13-424d-9e2c-5fda16376037 tempest-ServersNegativeTestJSON-381782243 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:08:56.399120 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.manager [None req-a98d2a09-4b13-424d-9e2c-5fda16376037 tempest-ServersNegativeTestJSON-381782243 None] Notifying Schedulers of capabilities ... {{(pid=134148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 18 21:08:56.403684 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-a98d2a09-4b13-424d-9e2c-5fda16376037 tempest-ServersNegativeTestJSON-381782243 None] Deleted volume successfully. Dec 18 21:08:56.424724 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.coordination [None req-a98d2a09-4b13-424d-9e2c-5fda16376037 tempest-ServersNegativeTestJSON-381782243 None] Lock "b'cinder-7cf9ffd2-1a5c-45ac-b99c-8aa62037cc81-delete_volume'" released by "delete_volume" :: held 0.549s {{(pid=134148) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 18 21:08:56.744676 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.coordination [None req-b5fc473f-ec81-4878-b176-76d519c85b35 tempest-VolumesNegativeTest-1566869411 None] Lock "b'cinder-e524f286-58fd-4a69-b2b1-aaf27fe93eba-delete_volume'" acquired by "delete_volume" :: waited 0.014s {{(pid=134148) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 18 21:08:56.774714 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-b5fc473f-ec81-4878-b176-76d519c85b35 tempest-VolumesNegativeTest-1566869411 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:08:56.812557 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-b5fc473f-ec81-4878-b176-76d519c85b35 tempest-VolumesNegativeTest-1566869411 None] volume has no backup snaps {{(pid=134148) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Dec 18 21:08:56.812907 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-b5fc473f-ec81-4878-b176-76d519c85b35 tempest-VolumesNegativeTest-1566869411 None] Volume volume-e524f286-58fd-4a69-b2b1-aaf27fe93eba is not a clone. {{(pid=134148) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Dec 18 21:08:56.817444 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-b5fc473f-ec81-4878-b176-76d519c85b35 tempest-VolumesNegativeTest-1566869411 None] deleting rbd volume volume-e524f286-58fd-4a69-b2b1-aaf27fe93eba {{(pid=134148) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Dec 18 21:08:57.013339 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.coordination [None req-88158aa8-4f91-42ca-b82a-3afa9ca9d6c7 tempest-ServersNegativeTestJSON-381782243 None] Lock "b'cinder-dd78e899-c855-4e65-bba8-34d29b113975-delete_volume'" acquired by "delete_volume" :: waited 0.014s {{(pid=134148) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 18 21:08:57.062056 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-88158aa8-4f91-42ca-b82a-3afa9ca9d6c7 tempest-ServersNegativeTestJSON-381782243 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:08:57.110895 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-88158aa8-4f91-42ca-b82a-3afa9ca9d6c7 tempest-ServersNegativeTestJSON-381782243 None] volume has no backup snaps {{(pid=134148) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Dec 18 21:08:57.111320 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-88158aa8-4f91-42ca-b82a-3afa9ca9d6c7 tempest-ServersNegativeTestJSON-381782243 None] Volume volume-dd78e899-c855-4e65-bba8-34d29b113975 is not a clone. {{(pid=134148) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Dec 18 21:08:57.119714 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-88158aa8-4f91-42ca-b82a-3afa9ca9d6c7 tempest-ServersNegativeTestJSON-381782243 None] deleting rbd volume volume-dd78e899-c855-4e65-bba8-34d29b113975 {{(pid=134148) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Dec 18 21:08:57.177404 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.quota [None req-b5fc473f-ec81-4878-b176-76d519c85b35 tempest-VolumesNegativeTest-1566869411 None] Created reservations ['80f046fa-deae-4e66-90e0-94bfd76dd938', 'f17b82da-96ed-40e1-a739-7944a72caa21', 'fe6c3c2d-e65f-49e1-a623-9c912b2800b8', 'cb490a9a-edaa-497c-a5ae-923d966d618f'] {{(pid=134148) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 18 21:08:57.228785 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-b5fc473f-ec81-4878-b176-76d519c85b35 tempest-VolumesNegativeTest-1566869411 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:08:57.297590 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-b5fc473f-ec81-4878-b176-76d519c85b35 tempest-VolumesNegativeTest-1566869411 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:08:57.364396 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.manager [None req-b5fc473f-ec81-4878-b176-76d519c85b35 tempest-VolumesNegativeTest-1566869411 None] Notifying Schedulers of capabilities ... {{(pid=134148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 18 21:08:57.371239 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-b5fc473f-ec81-4878-b176-76d519c85b35 tempest-VolumesNegativeTest-1566869411 None] Deleted volume successfully. Dec 18 21:08:57.391598 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.coordination [None req-b5fc473f-ec81-4878-b176-76d519c85b35 tempest-VolumesNegativeTest-1566869411 None] Lock "b'cinder-e524f286-58fd-4a69-b2b1-aaf27fe93eba-delete_volume'" released by "delete_volume" :: held 0.647s {{(pid=134148) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 18 21:08:57.491177 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.quota [None req-88158aa8-4f91-42ca-b82a-3afa9ca9d6c7 tempest-ServersNegativeTestJSON-381782243 None] Created reservations ['2474c31e-6854-4325-a5e1-1c4ed45e1daf', '8dc9dc91-2c31-4d32-a4c2-34eab6b2cea0', 'a6f2f5da-ef28-406c-aa8e-4318a810c845', '09f3255c-91d8-4199-9d28-fc1b9acc7eae'] {{(pid=134148) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 18 21:08:57.585784 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.coordination [None req-ab288857-b623-44b4-ad22-02ebf84e3d7e tempest-VolumesActionsTest-489501281 None] Lock "b'cinder-e4860b5e-a22c-4f59-a513-cd8e9d475ad2-delete_volume'" acquired by "delete_volume" :: waited 0.035s {{(pid=134148) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 18 21:08:57.598301 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-88158aa8-4f91-42ca-b82a-3afa9ca9d6c7 tempest-ServersNegativeTestJSON-381782243 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:08:57.652775 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-88158aa8-4f91-42ca-b82a-3afa9ca9d6c7 tempest-ServersNegativeTestJSON-381782243 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:08:57.713694 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.manager [None req-88158aa8-4f91-42ca-b82a-3afa9ca9d6c7 tempest-ServersNegativeTestJSON-381782243 None] Notifying Schedulers of capabilities ... {{(pid=134148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 18 21:08:57.717927 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-88158aa8-4f91-42ca-b82a-3afa9ca9d6c7 tempest-ServersNegativeTestJSON-381782243 None] Deleted volume successfully. Dec 18 21:08:57.741160 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-ab288857-b623-44b4-ad22-02ebf84e3d7e tempest-VolumesActionsTest-489501281 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:08:57.807014 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-ab288857-b623-44b4-ad22-02ebf84e3d7e tempest-VolumesActionsTest-489501281 None] volume has no backup snaps {{(pid=134148) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Dec 18 21:08:57.807451 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-ab288857-b623-44b4-ad22-02ebf84e3d7e tempest-VolumesActionsTest-489501281 None] Volume volume-e4860b5e-a22c-4f59-a513-cd8e9d475ad2 is not a clone. {{(pid=134148) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Dec 18 21:08:57.821224 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-ab288857-b623-44b4-ad22-02ebf84e3d7e tempest-VolumesActionsTest-489501281 None] deleting rbd volume volume-e4860b5e-a22c-4f59-a513-cd8e9d475ad2 {{(pid=134148) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Dec 18 21:08:57.825667 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.coordination [None req-88158aa8-4f91-42ca-b82a-3afa9ca9d6c7 tempest-ServersNegativeTestJSON-381782243 None] Lock "b'cinder-dd78e899-c855-4e65-bba8-34d29b113975-delete_volume'" released by "delete_volume" :: held 0.812s {{(pid=134148) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 18 21:08:58.081306 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.quota [None req-ab288857-b623-44b4-ad22-02ebf84e3d7e tempest-VolumesActionsTest-489501281 None] Created reservations ['4c1e6cdd-893d-428d-ad00-73efe0906a55', 'f8e59c44-772c-4f88-a952-a36001efeb05', '82fa679d-be02-4710-85b9-29bb94d891ae', 'af6f7aa7-7c7b-4459-816b-3c229360c783'] {{(pid=134148) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 18 21:08:58.146868 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-ab288857-b623-44b4-ad22-02ebf84e3d7e tempest-VolumesActionsTest-489501281 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:08:58.184158 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-ab288857-b623-44b4-ad22-02ebf84e3d7e tempest-VolumesActionsTest-489501281 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:08:58.223036 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.manager [None req-ab288857-b623-44b4-ad22-02ebf84e3d7e tempest-VolumesActionsTest-489501281 None] Notifying Schedulers of capabilities ... {{(pid=134148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 18 21:08:58.227062 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-ab288857-b623-44b4-ad22-02ebf84e3d7e tempest-VolumesActionsTest-489501281 None] Deleted volume successfully. Dec 18 21:08:58.245375 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.coordination [None req-ab288857-b623-44b4-ad22-02ebf84e3d7e tempest-VolumesActionsTest-489501281 None] Lock "b'cinder-e4860b5e-a22c-4f59-a513-cd8e9d475ad2-delete_volume'" released by "delete_volume" :: held 0.660s {{(pid=134148) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 18 21:08:58.797544 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.coordination [None req-133cbf48-b22f-4c5f-aabe-2e6545b6b4f4 tempest-VolumesActionsTest-489501281 None] Lock "b'cinder-8b9655d0-6c61-4c54-b8c6-b2e6902a4e54-delete_volume'" acquired by "delete_volume" :: waited 0.014s {{(pid=134148) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 18 21:08:58.832483 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-133cbf48-b22f-4c5f-aabe-2e6545b6b4f4 tempest-VolumesActionsTest-489501281 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:08:58.874745 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-133cbf48-b22f-4c5f-aabe-2e6545b6b4f4 tempest-VolumesActionsTest-489501281 None] volume has no backup snaps {{(pid=134148) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Dec 18 21:08:58.875172 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-133cbf48-b22f-4c5f-aabe-2e6545b6b4f4 tempest-VolumesActionsTest-489501281 None] Volume volume-8b9655d0-6c61-4c54-b8c6-b2e6902a4e54 is not a clone. {{(pid=134148) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Dec 18 21:08:58.890152 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-133cbf48-b22f-4c5f-aabe-2e6545b6b4f4 tempest-VolumesActionsTest-489501281 None] deleting rbd volume volume-8b9655d0-6c61-4c54-b8c6-b2e6902a4e54 {{(pid=134148) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Dec 18 21:08:59.161046 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.quota [None req-133cbf48-b22f-4c5f-aabe-2e6545b6b4f4 tempest-VolumesActionsTest-489501281 None] Created reservations ['747d2165-0b95-496a-872e-87ffd8ac13cb', '82ba67e3-bbba-4c9c-a64e-c08ef9b5f060', '88ea8979-8e58-4962-8108-938b66ac755a', 'c0a5e1b2-ab72-49c3-9f8a-63c7610ecd9d'] {{(pid=134148) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 18 21:08:59.214098 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-133cbf48-b22f-4c5f-aabe-2e6545b6b4f4 tempest-VolumesActionsTest-489501281 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:08:59.241407 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-133cbf48-b22f-4c5f-aabe-2e6545b6b4f4 tempest-VolumesActionsTest-489501281 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:08:59.270801 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.manager [None req-133cbf48-b22f-4c5f-aabe-2e6545b6b4f4 tempest-VolumesActionsTest-489501281 None] Notifying Schedulers of capabilities ... {{(pid=134148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 18 21:08:59.275441 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-133cbf48-b22f-4c5f-aabe-2e6545b6b4f4 tempest-VolumesActionsTest-489501281 None] Deleted volume successfully. Dec 18 21:08:59.288876 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.coordination [None req-133cbf48-b22f-4c5f-aabe-2e6545b6b4f4 tempest-VolumesActionsTest-489501281 None] Lock "b'cinder-8b9655d0-6c61-4c54-b8c6-b2e6902a4e54-delete_volume'" released by "delete_volume" :: held 0.491s {{(pid=134148) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 18 21:08:59.634397 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.flows.manager.create_volume [None req-db7f81e7-aee0-48ee-85f0-a4438e7a654a tempest-VolumesSnapshotListTestJSON-1056661803 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134148) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Dec 18 21:08:59.638662 ncdv-master-1 cinder-volume[134148]: WARNING stevedore.named [None req-db7f81e7-aee0-48ee-85f0-a4438e7a654a tempest-VolumesSnapshotListTestJSON-1056661803 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Dec 18 21:08:59.639173 ncdv-master-1 cinder-volume[134148]: WARNING castellan.key_manager [None req-db7f81e7-aee0-48ee-85f0-a4438e7a654a tempest-VolumesSnapshotListTestJSON-1056661803 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Dec 18 21:08:59.651028 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-db7f81e7-aee0-48ee-85f0-a4438e7a654a tempest-VolumesSnapshotListTestJSON-1056661803 None] Flow 'volume_create_manager' (241fbb5c-ef21-479b-a7c2-97c9cf7ab55a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 18 21:08:59.654429 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-db7f81e7-aee0-48ee-85f0-a4438e7a654a tempest-VolumesSnapshotListTestJSON-1056661803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01f92715-0859-475b-8f85-34ef63a940fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:08:59.660855 ncdv-master-1 cinder-volume[134148]: DEBUG oslo_db.sqlalchemy.engines [None req-db7f81e7-aee0-48ee-85f0-a4438e7a654a tempest-VolumesSnapshotListTestJSON-1056661803 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134148) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 18 21:08:59.674695 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-db7f81e7-aee0-48ee-85f0-a4438e7a654a tempest-VolumesSnapshotListTestJSON-1056661803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01f92715-0859-475b-8f85-34ef63a940fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-12-18T21:08:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-243484474',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=53711a34-766b-44a2-9485-93a03eda3474,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d050b91d2cd43cfbff6d3e27cd18b5d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-12-18T21:09:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-12-18T21:09:00Z,use_quota=True,user_id='814200cf33934d1b88ab3e9c2fd4859f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f2e1fe1-9fd6-411e-9ed9-368f463ccb6f),volume_type_id=1f2e1fe1-9fd6-411e-9ed9-368f463ccb6f)' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:08:59.677379 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-db7f81e7-aee0-48ee-85f0-a4438e7a654a tempest-VolumesSnapshotListTestJSON-1056661803 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1501a4cb-7e04-4481-9d55-5c6c759b05c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:08:59.680120 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-db7f81e7-aee0-48ee-85f0-a4438e7a654a tempest-VolumesSnapshotListTestJSON-1056661803 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1501a4cb-7e04-4481-9d55-5c6c759b05c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:08:59.691367 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-db7f81e7-aee0-48ee-85f0-a4438e7a654a tempest-VolumesSnapshotListTestJSON-1056661803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8da9664-07b4-47fb-8c03-d4bee816799c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:08:59.691367 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-db7f81e7-aee0-48ee-85f0-a4438e7a654a tempest-VolumesSnapshotListTestJSON-1056661803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8da9664-07b4-47fb-8c03-d4bee816799c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '53711a34-766b-44a2-9485-93a03eda3474', 'volume_name': 'volume-53711a34-766b-44a2-9485-93a03eda3474', 'volume_size': 1}' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:08:59.691367 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-db7f81e7-aee0-48ee-85f0-a4438e7a654a tempest-VolumesSnapshotListTestJSON-1056661803 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09b1f6fc-6f1b-40ac-bc6c-38431c971b15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:08:59.691652 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-db7f81e7-aee0-48ee-85f0-a4438e7a654a tempest-VolumesSnapshotListTestJSON-1056661803 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09b1f6fc-6f1b-40ac-bc6c-38431c971b15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:08:59.696611 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-db7f81e7-aee0-48ee-85f0-a4438e7a654a tempest-VolumesSnapshotListTestJSON-1056661803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e71132f7-f527-46d4-b78a-f4a24cc22a1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:08:59.697421 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.flows.manager.create_volume [None req-db7f81e7-aee0-48ee-85f0-a4438e7a654a tempest-VolumesSnapshotListTestJSON-1056661803 None] Volume 53711a34-766b-44a2-9485-93a03eda3474: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-53711a34-766b-44a2-9485-93a03eda3474', 'volume_size': 1} Dec 18 21:08:59.697813 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-db7f81e7-aee0-48ee-85f0-a4438e7a654a tempest-VolumesSnapshotListTestJSON-1056661803 None] creating volume 'volume-53711a34-766b-44a2-9485-93a03eda3474' {{(pid=134148) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Dec 18 21:08:59.699474 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-db7f81e7-aee0-48ee-85f0-a4438e7a654a tempest-VolumesSnapshotListTestJSON-1056661803 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:08:59.784238 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-db7f81e7-aee0-48ee-85f0-a4438e7a654a tempest-VolumesSnapshotListTestJSON-1056661803 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134148) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 18 21:08:59.785754 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-db7f81e7-aee0-48ee-85f0-a4438e7a654a tempest-VolumesSnapshotListTestJSON-1056661803 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134148) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 18 21:08:59.788804 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-db7f81e7-aee0-48ee-85f0-a4438e7a654a tempest-VolumesSnapshotListTestJSON-1056661803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e71132f7-f527-46d4-b78a-f4a24cc22a1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-53711a34-766b-44a2-9485-93a03eda3474', 'volume_size': 1}' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:08:59.792920 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-db7f81e7-aee0-48ee-85f0-a4438e7a654a tempest-VolumesSnapshotListTestJSON-1056661803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b47a658-c36a-412f-af66-a194b4230d0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:08:59.804114 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.flows.manager.create_volume [None req-db7f81e7-aee0-48ee-85f0-a4438e7a654a tempest-VolumesSnapshotListTestJSON-1056661803 None] Volume volume-53711a34-766b-44a2-9485-93a03eda3474 (53711a34-766b-44a2-9485-93a03eda3474): created successfully Dec 18 21:08:59.806444 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-db7f81e7-aee0-48ee-85f0-a4438e7a654a tempest-VolumesSnapshotListTestJSON-1056661803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b47a658-c36a-412f-af66-a194b4230d0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:08:59.810401 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-db7f81e7-aee0-48ee-85f0-a4438e7a654a tempest-VolumesSnapshotListTestJSON-1056661803 None] Flow 'volume_create_manager' (241fbb5c-ef21-479b-a7c2-97c9cf7ab55a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134148) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 18 21:08:59.821965 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-db7f81e7-aee0-48ee-85f0-a4438e7a654a tempest-VolumesSnapshotListTestJSON-1056661803 None] Created volume successfully. Dec 18 21:09:00.842190 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-50ade955-c131-45cb-be49-262d51c76776 tempest-VolumesSnapshotListTestJSON-1056661803 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:09:01.155645 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-50ade955-c131-45cb-be49-262d51c76776 tempest-VolumesSnapshotListTestJSON-1056661803 None] Create snapshot completed successfully Dec 18 21:09:02.070691 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-5737d198-91b3-4c3b-b80e-4b3fc5615823 tempest-VolumesSnapshotListTestJSON-1056661803 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:09:02.884271 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [req-b44912b5-5d5d-4b31-afa8-a203538670b7 req-219d236c-4af9-44c5-b0e9-b677e07850db tempest-TestVolumeBootPattern-1320248540 None] Terminate volume connection completed successfully. Dec 18 21:09:02.885043 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [req-b44912b5-5d5d-4b31-afa8-a203538670b7 req-219d236c-4af9-44c5-b0e9-b677e07850db tempest-TestVolumeBootPattern-1320248540 None] Deleting attachment 728d5ba1-5d84-4371-8616-97087b14f6f0. {{(pid=134148) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4948}} Dec 18 21:09:03.132605 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.coordination [req-b44912b5-5d5d-4b31-afa8-a203538670b7 req-fc8c2e5b-a12f-4970-bb78-6c4edec35d17 tempest-TestVolumeBootPattern-1320248540 None] Lock "b'cinder-f37747a8-c04a-4777-8d1b-d6b3485de89e-delete_volume'" acquired by "delete_volume" :: waited 0.025s {{(pid=134148) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 18 21:09:03.179424 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [req-b44912b5-5d5d-4b31-afa8-a203538670b7 req-fc8c2e5b-a12f-4970-bb78-6c4edec35d17 tempest-TestVolumeBootPattern-1320248540 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:09:03.282417 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [req-b44912b5-5d5d-4b31-afa8-a203538670b7 req-fc8c2e5b-a12f-4970-bb78-6c4edec35d17 tempest-TestVolumeBootPattern-1320248540 None] volume has no backup snaps {{(pid=134148) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Dec 18 21:09:03.293382 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [req-b44912b5-5d5d-4b31-afa8-a203538670b7 req-fc8c2e5b-a12f-4970-bb78-6c4edec35d17 tempest-TestVolumeBootPattern-1320248540 None] deleting rbd volume volume-f37747a8-c04a-4777-8d1b-d6b3485de89e {{(pid=134148) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Dec 18 21:09:03.335012 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-5737d198-91b3-4c3b-b80e-4b3fc5615823 tempest-VolumesSnapshotListTestJSON-1056661803 None] Create snapshot completed successfully Dec 18 21:09:03.680183 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.quota [req-b44912b5-5d5d-4b31-afa8-a203538670b7 req-fc8c2e5b-a12f-4970-bb78-6c4edec35d17 tempest-TestVolumeBootPattern-1320248540 None] Created reservations ['2b178327-ac38-4c2a-aeff-005a5b9a44f9', 'ea293148-072e-421b-94da-4dc767cd8743', '0cc18901-7240-4887-bcfa-7d0d4e2ae5f3', 'abca503d-78ae-4ec4-842c-45b435c5ecae'] {{(pid=134148) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 18 21:09:03.757962 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [req-b44912b5-5d5d-4b31-afa8-a203538670b7 req-fc8c2e5b-a12f-4970-bb78-6c4edec35d17 tempest-TestVolumeBootPattern-1320248540 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:09:03.815180 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [req-b44912b5-5d5d-4b31-afa8-a203538670b7 req-fc8c2e5b-a12f-4970-bb78-6c4edec35d17 tempest-TestVolumeBootPattern-1320248540 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:09:03.866058 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.manager [req-b44912b5-5d5d-4b31-afa8-a203538670b7 req-fc8c2e5b-a12f-4970-bb78-6c4edec35d17 tempest-TestVolumeBootPattern-1320248540 None] Notifying Schedulers of capabilities ... {{(pid=134148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 18 21:09:03.871416 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [req-b44912b5-5d5d-4b31-afa8-a203538670b7 req-fc8c2e5b-a12f-4970-bb78-6c4edec35d17 tempest-TestVolumeBootPattern-1320248540 None] Deleted volume successfully. Dec 18 21:09:03.886855 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.coordination [req-b44912b5-5d5d-4b31-afa8-a203538670b7 req-fc8c2e5b-a12f-4970-bb78-6c4edec35d17 tempest-TestVolumeBootPattern-1320248540 None] Lock "b'cinder-f37747a8-c04a-4777-8d1b-d6b3485de89e-delete_volume'" released by "delete_volume" :: held 0.754s {{(pid=134148) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 18 21:09:04.340002 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-874d6d79-6c61-4bb6-95eb-32bc63355310 tempest-VolumesSnapshotListTestJSON-1056661803 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:09:04.723460 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.coordination [None req-deb9ccd5-c3dc-413f-a613-99cf474397d5 tempest-TestVolumeBootPattern-1320248540 None] Lock "b'cinder-ef155ebf-aa5a-4723-a2b7-d2f74c10ca2c-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.015s {{(pid=134148) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 18 21:09:04.725065 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-deb9ccd5-c3dc-413f-a613-99cf474397d5 tempest-TestVolumeBootPattern-1320248540 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:09:05.263563 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-874d6d79-6c61-4bb6-95eb-32bc63355310 tempest-VolumesSnapshotListTestJSON-1056661803 None] Create snapshot completed successfully Dec 18 21:09:05.277619 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.quota [None req-deb9ccd5-c3dc-413f-a613-99cf474397d5 tempest-TestVolumeBootPattern-1320248540 None] Created reservations ['c4ebb48e-e4f9-4dda-9dc7-751c6a2f641d', 'fcb5ebd6-5fff-4497-a3e0-dbd0bd6718b4', '143b12b7-adf0-4ae7-bfe8-5088eb668d83', '3922b8fd-cce4-4d2a-ac6a-941629a02f9b'] {{(pid=134148) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 18 21:09:05.341558 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-deb9ccd5-c3dc-413f-a613-99cf474397d5 tempest-TestVolumeBootPattern-1320248540 None] Delete snapshot completed successfully. Dec 18 21:09:05.352273 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.coordination [None req-deb9ccd5-c3dc-413f-a613-99cf474397d5 tempest-TestVolumeBootPattern-1320248540 None] Lock "b'cinder-ef155ebf-aa5a-4723-a2b7-d2f74c10ca2c-delete_snapshot'" released by "delete_snapshot" :: held 0.629s {{(pid=134148) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 18 21:09:05.864120 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.coordination [None req-a4bd0245-1b1a-4391-93af-1a8c0ef640cd tempest-TestVolumeBootPattern-1320248540 None] Lock "b'cinder-36b45732-3da1-4a6d-9972-06956bf7ad47-delete_volume'" acquired by "delete_volume" :: waited 0.014s {{(pid=134148) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 18 21:09:05.914914 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-a4bd0245-1b1a-4391-93af-1a8c0ef640cd tempest-TestVolumeBootPattern-1320248540 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:09:06.039037 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-a4bd0245-1b1a-4391-93af-1a8c0ef640cd tempest-TestVolumeBootPattern-1320248540 None] volume has no backup snaps {{(pid=134148) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Dec 18 21:09:06.056374 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-a4bd0245-1b1a-4391-93af-1a8c0ef640cd tempest-TestVolumeBootPattern-1320248540 None] deleting rbd volume volume-36b45732-3da1-4a6d-9972-06956bf7ad47 {{(pid=134148) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Dec 18 21:09:06.125940 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.flows.manager.create_volume [None req-5e997681-c8a3-4913-8f04-dcefa5f0965c tempest-VolumesBackupsV39Test-1873090783 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134148) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Dec 18 21:09:06.131127 ncdv-master-1 cinder-volume[134148]: WARNING stevedore.named [None req-5e997681-c8a3-4913-8f04-dcefa5f0965c tempest-VolumesBackupsV39Test-1873090783 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Dec 18 21:09:06.131659 ncdv-master-1 cinder-volume[134148]: WARNING castellan.key_manager [None req-5e997681-c8a3-4913-8f04-dcefa5f0965c tempest-VolumesBackupsV39Test-1873090783 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Dec 18 21:09:06.149682 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-5e997681-c8a3-4913-8f04-dcefa5f0965c tempest-VolumesBackupsV39Test-1873090783 None] Flow 'volume_create_manager' (1f7e2c4f-6476-43f1-889e-80550c809d69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 18 21:09:06.153926 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-5e997681-c8a3-4913-8f04-dcefa5f0965c tempest-VolumesBackupsV39Test-1873090783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c234a471-26ef-43b4-8618-f951173bd4ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:09:06.161158 ncdv-master-1 cinder-volume[134148]: DEBUG oslo_db.sqlalchemy.engines [None req-5e997681-c8a3-4913-8f04-dcefa5f0965c tempest-VolumesBackupsV39Test-1873090783 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134148) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 18 21:09:06.176459 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-5e997681-c8a3-4913-8f04-dcefa5f0965c tempest-VolumesBackupsV39Test-1873090783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c234a471-26ef-43b4-8618-f951173bd4ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-12-18T21:09:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsV39Test-Volume-1247451618',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=deaf7c96-01b6-479a-946e-c92f2d37075d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e2128a151c944e66bc3b9d6bc11b3c10',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-12-18T21:09:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-12-18T21:09:06Z,use_quota=True,user_id='15458d34364442e4891c1bc48d71196b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f2e1fe1-9fd6-411e-9ed9-368f463ccb6f),volume_type_id=1f2e1fe1-9fd6-411e-9ed9-368f463ccb6f)' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:09:06.179502 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-5e997681-c8a3-4913-8f04-dcefa5f0965c tempest-VolumesBackupsV39Test-1873090783 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8fa61b88-b5b0-46fb-be6f-3d99b832532f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:09:06.182434 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-5e997681-c8a3-4913-8f04-dcefa5f0965c tempest-VolumesBackupsV39Test-1873090783 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8fa61b88-b5b0-46fb-be6f-3d99b832532f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:09:06.185009 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-5e997681-c8a3-4913-8f04-dcefa5f0965c tempest-VolumesBackupsV39Test-1873090783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07b212b0-c7bb-4bdf-add9-e688b7d6a1cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:09:06.189506 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-5e997681-c8a3-4913-8f04-dcefa5f0965c tempest-VolumesBackupsV39Test-1873090783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07b212b0-c7bb-4bdf-add9-e688b7d6a1cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'deaf7c96-01b6-479a-946e-c92f2d37075d', 'volume_name': 'volume-deaf7c96-01b6-479a-946e-c92f2d37075d', 'volume_size': 1}' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:09:06.193106 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-5e997681-c8a3-4913-8f04-dcefa5f0965c tempest-VolumesBackupsV39Test-1873090783 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dfd9e3ed-2099-4594-9a58-aa307febeead) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:09:06.195662 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-5e997681-c8a3-4913-8f04-dcefa5f0965c tempest-VolumesBackupsV39Test-1873090783 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dfd9e3ed-2099-4594-9a58-aa307febeead) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:09:06.200215 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-5e997681-c8a3-4913-8f04-dcefa5f0965c tempest-VolumesBackupsV39Test-1873090783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22cc48d8-47ee-465e-bde7-8c58d55de5fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:09:06.219825 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.flows.manager.create_volume [None req-5e997681-c8a3-4913-8f04-dcefa5f0965c tempest-VolumesBackupsV39Test-1873090783 None] Volume deaf7c96-01b6-479a-946e-c92f2d37075d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-deaf7c96-01b6-479a-946e-c92f2d37075d', 'volume_size': 1} Dec 18 21:09:06.220692 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-5e997681-c8a3-4913-8f04-dcefa5f0965c tempest-VolumesBackupsV39Test-1873090783 None] creating volume 'volume-deaf7c96-01b6-479a-946e-c92f2d37075d' {{(pid=134148) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Dec 18 21:09:06.222022 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-5e997681-c8a3-4913-8f04-dcefa5f0965c tempest-VolumesBackupsV39Test-1873090783 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:09:06.340809 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-5e997681-c8a3-4913-8f04-dcefa5f0965c tempest-VolumesBackupsV39Test-1873090783 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134148) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 18 21:09:06.341424 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-5e997681-c8a3-4913-8f04-dcefa5f0965c tempest-VolumesBackupsV39Test-1873090783 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134148) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 18 21:09:06.344394 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-5e997681-c8a3-4913-8f04-dcefa5f0965c tempest-VolumesBackupsV39Test-1873090783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22cc48d8-47ee-465e-bde7-8c58d55de5fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-deaf7c96-01b6-479a-946e-c92f2d37075d', 'volume_size': 1}' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:09:06.347070 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-5e997681-c8a3-4913-8f04-dcefa5f0965c tempest-VolumesBackupsV39Test-1873090783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5fdc9ccf-bc0f-48ec-b81c-d330a8e11b60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:09:06.355974 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.coordination [None req-4df732ff-ddd3-4b09-8d32-fc5980e4117c tempest-VolumesSnapshotListTestJSON-1056661803 None] Lock "b'cinder-d2a7cff6-6f48-471a-81ae-d1db377424bb-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.031s {{(pid=134148) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 18 21:09:06.357813 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-4df732ff-ddd3-4b09-8d32-fc5980e4117c tempest-VolumesSnapshotListTestJSON-1056661803 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:09:06.437896 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-a4bd0245-1b1a-4391-93af-1a8c0ef640cd tempest-TestVolumeBootPattern-1320248540 None] volume is a clone so cleaning references {{(pid=134148) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1266}} Dec 18 21:09:06.478722 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-a4bd0245-1b1a-4391-93af-1a8c0ef640cd tempest-TestVolumeBootPattern-1320248540 None] deleting parent snapshot volume-36b45732-3da1-4a6d-9972-06956bf7ad47.clone_snap {{(pid=134148) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1158}} Dec 18 21:09:07.233389 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.flows.manager.create_volume [None req-5e997681-c8a3-4913-8f04-dcefa5f0965c tempest-VolumesBackupsV39Test-1873090783 None] Volume volume-deaf7c96-01b6-479a-946e-c92f2d37075d (deaf7c96-01b6-479a-946e-c92f2d37075d): created successfully Dec 18 21:09:07.236137 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-5e997681-c8a3-4913-8f04-dcefa5f0965c tempest-VolumesBackupsV39Test-1873090783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5fdc9ccf-bc0f-48ec-b81c-d330a8e11b60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:09:07.239992 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-5e997681-c8a3-4913-8f04-dcefa5f0965c tempest-VolumesBackupsV39Test-1873090783 None] Flow 'volume_create_manager' (1f7e2c4f-6476-43f1-889e-80550c809d69) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134148) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 18 21:09:07.255225 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-5e997681-c8a3-4913-8f04-dcefa5f0965c tempest-VolumesBackupsV39Test-1873090783 None] Created volume successfully. Dec 18 21:09:07.334520 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.quota [None req-a4bd0245-1b1a-4391-93af-1a8c0ef640cd tempest-TestVolumeBootPattern-1320248540 None] Created reservations ['1de6ebb5-874b-44a8-ad83-12944490047e', 'bd01176c-9ed7-4738-aee1-231f7cb3157b', 'b5df965f-a89c-4a30-93c9-1be51c2a35ba', '90e1cb5c-181b-4e91-bcca-97cf9990b9f9'] {{(pid=134148) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 18 21:09:07.394457 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-a4bd0245-1b1a-4391-93af-1a8c0ef640cd tempest-TestVolumeBootPattern-1320248540 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:09:07.432501 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-a4bd0245-1b1a-4391-93af-1a8c0ef640cd tempest-TestVolumeBootPattern-1320248540 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:09:07.480128 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.manager [None req-a4bd0245-1b1a-4391-93af-1a8c0ef640cd tempest-TestVolumeBootPattern-1320248540 None] Notifying Schedulers of capabilities ... {{(pid=134148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 18 21:09:07.486199 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-a4bd0245-1b1a-4391-93af-1a8c0ef640cd tempest-TestVolumeBootPattern-1320248540 None] Deleted volume successfully. Dec 18 21:09:07.502864 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.coordination [None req-a4bd0245-1b1a-4391-93af-1a8c0ef640cd tempest-TestVolumeBootPattern-1320248540 None] Lock "b'cinder-36b45732-3da1-4a6d-9972-06956bf7ad47-delete_volume'" released by "delete_volume" :: held 1.639s {{(pid=134148) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 18 21:09:07.554519 ncdv-master-1 cinder-volume[134148]: DEBUG oslo_concurrency.processutils [None req-c88ca725-cd71-4d1e-a84e-2bf6e868e2ab tempest-VolumesBackupsV39Test-1873090783 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=134148) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Dec 18 21:09:08.334484 ncdv-master-1 cinder-volume[134148]: DEBUG oslo_concurrency.processutils [None req-c88ca725-cd71-4d1e-a84e-2bf6e868e2ab tempest-VolumesBackupsV39Test-1873090783 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.780s {{(pid=134148) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Dec 18 21:09:08.336656 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-c88ca725-cd71-4d1e-a84e-2bf6e868e2ab tempest-VolumesBackupsV39Test-1873090783 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-deaf7c96-01b6-479a-946e-c92f2d37075d', 'hosts': ['10.222.0.13'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '946d1715-d12c-4dbf-8a79-181222df6e2e', 'volume_id': 'deaf7c96-01b6-479a-946e-c92f2d37075d', 'discard': True}} {{(pid=134148) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Dec 18 21:09:08.383991 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-c88ca725-cd71-4d1e-a84e-2bf6e868e2ab tempest-VolumesBackupsV39Test-1873090783 None] Initialize volume connection completed successfully. Dec 18 21:09:08.387781 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.quota [None req-4df732ff-ddd3-4b09-8d32-fc5980e4117c tempest-VolumesSnapshotListTestJSON-1056661803 None] Created reservations ['218e19b4-b844-43a6-82c4-dcb089a884ed', '3b10d64d-e88c-4477-93aa-cdaed49f10b1', 'cff52201-b5d5-4c4c-b668-2286fd304443', '993f4cd0-ab6f-4cc8-a8b2-2db9049e0046'] {{(pid=134148) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 18 21:09:08.490638 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-4df732ff-ddd3-4b09-8d32-fc5980e4117c tempest-VolumesSnapshotListTestJSON-1056661803 None] Delete snapshot completed successfully. Dec 18 21:09:08.500618 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.coordination [None req-4df732ff-ddd3-4b09-8d32-fc5980e4117c tempest-VolumesSnapshotListTestJSON-1056661803 None] Lock "b'cinder-d2a7cff6-6f48-471a-81ae-d1db377424bb-delete_snapshot'" released by "delete_snapshot" :: held 2.145s {{(pid=134148) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 18 21:09:08.532202 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.coordination [None req-c6af1c2a-ff08-4c55-ae2e-966bedbb59cd tempest-VolumesSnapshotListTestJSON-1056661803 None] Lock "b'cinder-9226f66c-9c4e-43bc-a801-463c19a6ad9c-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.019s {{(pid=134148) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 18 21:09:08.534321 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-c6af1c2a-ff08-4c55-ae2e-966bedbb59cd tempest-VolumesSnapshotListTestJSON-1056661803 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:09:08.851217 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.flows.manager.create_volume [None req-edbc91a3-2a22-4bd8-9c33-816d23ea5f20 tempest-TestVolumeBootPattern-1320248540 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134148) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Dec 18 21:09:08.855763 ncdv-master-1 cinder-volume[134148]: WARNING stevedore.named [None req-edbc91a3-2a22-4bd8-9c33-816d23ea5f20 tempest-TestVolumeBootPattern-1320248540 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Dec 18 21:09:08.856238 ncdv-master-1 cinder-volume[134148]: WARNING castellan.key_manager [None req-edbc91a3-2a22-4bd8-9c33-816d23ea5f20 tempest-TestVolumeBootPattern-1320248540 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Dec 18 21:09:08.873425 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-edbc91a3-2a22-4bd8-9c33-816d23ea5f20 tempest-TestVolumeBootPattern-1320248540 None] Flow 'volume_create_manager' (2a4bb5b5-a987-495f-9db9-71fd11679af3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 18 21:09:08.877265 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-edbc91a3-2a22-4bd8-9c33-816d23ea5f20 tempest-TestVolumeBootPattern-1320248540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1cade936-7a18-4b9c-8890-84426efbf737) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:09:08.892799 ncdv-master-1 cinder-volume[134148]: DEBUG oslo_db.sqlalchemy.engines [None req-edbc91a3-2a22-4bd8-9c33-816d23ea5f20 tempest-TestVolumeBootPattern-1320248540 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134148) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 18 21:09:08.930623 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-edbc91a3-2a22-4bd8-9c33-816d23ea5f20 tempest-TestVolumeBootPattern-1320248540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1cade936-7a18-4b9c-8890-84426efbf737) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-12-18T21:09:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeBootPattern-volume-origin-655690545',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=02e23047-aecc-4a47-abf5-3b74dfa2dc23,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de79cd87d023436a80d3cc5428586e21',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-12-18T21:09:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-12-18T21:09:09Z,use_quota=True,user_id='d32598482c834073b8fe24c84cb57d2f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f2e1fe1-9fd6-411e-9ed9-368f463ccb6f),volume_type_id=1f2e1fe1-9fd6-411e-9ed9-368f463ccb6f)' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:09:08.936205 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-edbc91a3-2a22-4bd8-9c33-816d23ea5f20 tempest-TestVolumeBootPattern-1320248540 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c7bc6c6-2827-4104-8876-7656920ebad9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:09:08.939464 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-edbc91a3-2a22-4bd8-9c33-816d23ea5f20 tempest-TestVolumeBootPattern-1320248540 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c7bc6c6-2827-4104-8876-7656920ebad9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:09:08.943001 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-edbc91a3-2a22-4bd8-9c33-816d23ea5f20 tempest-TestVolumeBootPattern-1320248540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ebb6f31-1ad9-4a6b-954e-a68ad17b8f99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:09:09.050300 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-edbc91a3-2a22-4bd8-9c33-816d23ea5f20 tempest-TestVolumeBootPattern-1320248540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ebb6f31-1ad9-4a6b-954e-a68ad17b8f99) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '02e23047-aecc-4a47-abf5-3b74dfa2dc23', 'volume_name': 'volume-02e23047-aecc-4a47-abf5-3b74dfa2dc23', 'volume_size': 1, 'image_id': '394b3891-80f2-44c9-a9aa-56fe23a5acb3', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b04c3d19c79d4c208395e97f9d293618', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '394b3891-80f2-44c9-a9aa-56fe23a5acb3', 'created_at': datetime.datetime(2021, 12, 18, 20, 38, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 12, 18, 20, 38, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/394b3891-80f2-44c9-a9aa-56fe23a5acb3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:09:09.053055 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-edbc91a3-2a22-4bd8-9c33-816d23ea5f20 tempest-TestVolumeBootPattern-1320248540 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df2eb283-2b37-49a4-b9e4-d7867a5346e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:09:09.055535 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-edbc91a3-2a22-4bd8-9c33-816d23ea5f20 tempest-TestVolumeBootPattern-1320248540 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df2eb283-2b37-49a4-b9e4-d7867a5346e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:09:09.058264 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-edbc91a3-2a22-4bd8-9c33-816d23ea5f20 tempest-TestVolumeBootPattern-1320248540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87b810f2-fdc1-44c8-a005-6736de47a465) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:09:09.059297 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.flows.manager.create_volume [None req-edbc91a3-2a22-4bd8-9c33-816d23ea5f20 tempest-TestVolumeBootPattern-1320248540 None] Volume 02e23047-aecc-4a47-abf5-3b74dfa2dc23: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-02e23047-aecc-4a47-abf5-3b74dfa2dc23', 'volume_size': 1, 'image_id': '394b3891-80f2-44c9-a9aa-56fe23a5acb3', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b04c3d19c79d4c208395e97f9d293618', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '394b3891-80f2-44c9-a9aa-56fe23a5acb3', 'created_at': datetime.datetime(2021, 12, 18, 20, 38, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 12, 18, 20, 38, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/394b3891-80f2-44c9-a9aa-56fe23a5acb3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Dec 18 21:09:09.060050 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.flows.manager.create_volume [None req-edbc91a3-2a22-4bd8-9c33-816d23ea5f20 tempest-TestVolumeBootPattern-1320248540 None] Cloning 02e23047-aecc-4a47-abf5-3b74dfa2dc23 from image 394b3891-80f2-44c9-a9aa-56fe23a5acb3 at location (None, None). {{(pid=134148) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1047}} Dec 18 21:09:09.072884 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.coordination [None req-edbc91a3-2a22-4bd8-9c33-816d23ea5f20 tempest-TestVolumeBootPattern-1320248540 None] Lock "b'cinder-394b3891-80f2-44c9-a9aa-56fe23a5acb3'" acquired by "_prepare_image_cache_entry" :: waited 0.012s {{(pid=134148) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 18 21:09:09.084169 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.image.cache [None req-edbc91a3-2a22-4bd8-9c33-816d23ea5f20 tempest-TestVolumeBootPattern-1320248540 None] Found image-volume cache entry: {'id': 1, 'image_id': '394b3891-80f2-44c9-a9aa-56fe23a5acb3', 'volume_id': 'e6411a45-48fa-4beb-a5a0-eb6a6ca3f525', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2021, 12, 18, 20, 38, 21), 'last_used': datetime.datetime(2021, 12, 18, 21, 9, 9, 78895)}. {{(pid=134148) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Dec 18 21:09:09.084635 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.image.cache [None req-edbc91a3-2a22-4bd8-9c33-816d23ea5f20 tempest-TestVolumeBootPattern-1320248540 None] Image-volume cache entry image_update_at = 2021-12-18 20:38:21+00:00, requested image updated_at = 2021-12-18 20:38:21+00:00. {{(pid=134148) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Dec 18 21:09:09.084999 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.flows.manager.create_volume [None req-edbc91a3-2a22-4bd8-9c33-816d23ea5f20 tempest-TestVolumeBootPattern-1320248540 None] Found cache entry for image = 394b3891-80f2-44c9-a9aa-56fe23a5acb3 on host ncdv-master-1@ceph#ceph. {{(pid=134148) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:870}} Dec 18 21:09:09.090576 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.coordination [None req-edbc91a3-2a22-4bd8-9c33-816d23ea5f20 tempest-TestVolumeBootPattern-1320248540 None] Lock "b'cinder-394b3891-80f2-44c9-a9aa-56fe23a5acb3'" released by "_prepare_image_cache_entry" :: held 0.018s {{(pid=134148) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 18 21:09:09.091532 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.flows.manager.create_volume [None req-edbc91a3-2a22-4bd8-9c33-816d23ea5f20 tempest-TestVolumeBootPattern-1320248540 None] Attempting to retrieve cache entry for image = 394b3891-80f2-44c9-a9aa-56fe23a5acb3 on host ncdv-master-1@ceph#ceph. {{(pid=134148) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:811}} Dec 18 21:09:09.097595 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.image.cache [None req-edbc91a3-2a22-4bd8-9c33-816d23ea5f20 tempest-TestVolumeBootPattern-1320248540 None] Found image-volume cache entry: {'id': 1, 'image_id': '394b3891-80f2-44c9-a9aa-56fe23a5acb3', 'volume_id': 'e6411a45-48fa-4beb-a5a0-eb6a6ca3f525', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2021, 12, 18, 20, 38, 21), 'last_used': datetime.datetime(2021, 12, 18, 21, 9, 9, 95035)}. {{(pid=134148) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Dec 18 21:09:09.098216 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.image.cache [None req-edbc91a3-2a22-4bd8-9c33-816d23ea5f20 tempest-TestVolumeBootPattern-1320248540 None] Image-volume cache entry image_update_at = 2021-12-18 20:38:21+00:00, requested image updated_at = 2021-12-18 20:38:21+00:00. {{(pid=134148) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Dec 18 21:09:09.098783 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.flows.manager.create_volume [None req-edbc91a3-2a22-4bd8-9c33-816d23ea5f20 tempest-TestVolumeBootPattern-1320248540 None] Creating from source image-volume e6411a45-48fa-4beb-a5a0-eb6a6ca3f525 {{(pid=134148) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:825}} Dec 18 21:09:09.119412 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-edbc91a3-2a22-4bd8-9c33-816d23ea5f20 tempest-TestVolumeBootPattern-1320248540 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:09:09.193392 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-edbc91a3-2a22-4bd8-9c33-816d23ea5f20 tempest-TestVolumeBootPattern-1320248540 None] creating snapshot='volume-02e23047-aecc-4a47-abf5-3b74dfa2dc23.clone_snap' {{(pid=134148) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:725}} Dec 18 21:09:10.142380 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-edbc91a3-2a22-4bd8-9c33-816d23ea5f20 tempest-TestVolumeBootPattern-1320248540 None] cloning 'volume-e6411a45-48fa-4beb-a5a0-eb6a6ca3f525@volume-02e23047-aecc-4a47-abf5-3b74dfa2dc23.clone_snap' to 'volume-02e23047-aecc-4a47-abf5-3b74dfa2dc23' {{(pid=134148) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:731}} Dec 18 21:09:10.274791 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.quota [None req-c6af1c2a-ff08-4c55-ae2e-966bedbb59cd tempest-VolumesSnapshotListTestJSON-1056661803 None] Created reservations ['8f4ac08a-bbbf-4945-9193-0270a3290fdf', '114675fe-71e4-4633-8bdb-4180fa2ac90c', 'c07c84a1-2fb7-4e35-955f-4a76d5c534aa', 'dc7865f5-42da-4201-80a2-b99ea9f844fc'] {{(pid=134148) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 18 21:09:10.373164 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-edbc91a3-2a22-4bd8-9c33-816d23ea5f20 tempest-TestVolumeBootPattern-1320248540 None] Volume volume-9f5f7417-3abc-4462-988f-ef519750d753.deleted is not a clone. {{(pid=134148) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Dec 18 21:09:10.383414 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-edbc91a3-2a22-4bd8-9c33-816d23ea5f20 tempest-TestVolumeBootPattern-1320248540 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134148) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 18 21:09:10.384201 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-edbc91a3-2a22-4bd8-9c33-816d23ea5f20 tempest-TestVolumeBootPattern-1320248540 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134148) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 18 21:09:10.426744 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-edbc91a3-2a22-4bd8-9c33-816d23ea5f20 tempest-TestVolumeBootPattern-1320248540 None] clone created successfully {{(pid=134148) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:803}} Dec 18 21:09:10.427465 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.volume_utils [None req-edbc91a3-2a22-4bd8-9c33-816d23ea5f20 tempest-TestVolumeBootPattern-1320248540 None] Marking volume 02e23047-aecc-4a47-abf5-3b74dfa2dc23 as bootable. {{(pid=134148) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1178}} Dec 18 21:09:10.450570 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.flows.manager.create_volume [None req-edbc91a3-2a22-4bd8-9c33-816d23ea5f20 tempest-TestVolumeBootPattern-1320248540 None] Copying metadata from image 394b3891-80f2-44c9-a9aa-56fe23a5acb3 to 02e23047-aecc-4a47-abf5-3b74dfa2dc23. {{(pid=134148) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:444}} Dec 18 21:09:10.451053 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.flows.manager.create_volume [None req-edbc91a3-2a22-4bd8-9c33-816d23ea5f20 tempest-TestVolumeBootPattern-1320248540 None] Creating volume glance metadata for volume 02e23047-aecc-4a47-abf5-3b74dfa2dc23 backed by image 394b3891-80f2-44c9-a9aa-56fe23a5acb3 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '394b3891-80f2-44c9-a9aa-56fe23a5acb3', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=134148) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:667}} Dec 18 21:09:10.508742 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-c88ca725-cd71-4d1e-a84e-2bf6e868e2ab tempest-VolumesBackupsV39Test-1873090783 None] Terminate volume connection completed successfully. Dec 18 21:09:10.537197 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-c88ca725-cd71-4d1e-a84e-2bf6e868e2ab tempest-VolumesBackupsV39Test-1873090783 None] Remove volume export completed successfully. Dec 18 21:09:10.540001 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-c6af1c2a-ff08-4c55-ae2e-966bedbb59cd tempest-VolumesSnapshotListTestJSON-1056661803 None] Delete snapshot completed successfully. Dec 18 21:09:10.550607 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.coordination [None req-c6af1c2a-ff08-4c55-ae2e-966bedbb59cd tempest-VolumesSnapshotListTestJSON-1056661803 None] Lock "b'cinder-9226f66c-9c4e-43bc-a801-463c19a6ad9c-delete_snapshot'" released by "delete_snapshot" :: held 2.017s {{(pid=134148) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 18 21:09:10.582520 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-edbc91a3-2a22-4bd8-9c33-816d23ea5f20 tempest-TestVolumeBootPattern-1320248540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87b810f2-fdc1-44c8-a005-6736de47a465) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-02e23047-aecc-4a47-abf5-3b74dfa2dc23', 'volume_size': 1, 'image_id': '394b3891-80f2-44c9-a9aa-56fe23a5acb3', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b04c3d19c79d4c208395e97f9d293618', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '394b3891-80f2-44c9-a9aa-56fe23a5acb3', 'created_at': datetime.datetime(2021, 12, 18, 20, 38, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 12, 18, 20, 38, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/394b3891-80f2-44c9-a9aa-56fe23a5acb3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:09:10.585108 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-edbc91a3-2a22-4bd8-9c33-816d23ea5f20 tempest-TestVolumeBootPattern-1320248540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be2f0237-d65b-4cfc-9699-8e017df31b00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:09:10.596082 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.flows.manager.create_volume [None req-edbc91a3-2a22-4bd8-9c33-816d23ea5f20 tempest-TestVolumeBootPattern-1320248540 None] Volume volume-02e23047-aecc-4a47-abf5-3b74dfa2dc23 (02e23047-aecc-4a47-abf5-3b74dfa2dc23): created successfully Dec 18 21:09:10.598736 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-edbc91a3-2a22-4bd8-9c33-816d23ea5f20 tempest-TestVolumeBootPattern-1320248540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be2f0237-d65b-4cfc-9699-8e017df31b00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:09:10.602451 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-edbc91a3-2a22-4bd8-9c33-816d23ea5f20 tempest-TestVolumeBootPattern-1320248540 None] Flow 'volume_create_manager' (2a4bb5b5-a987-495f-9db9-71fd11679af3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134148) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 18 21:09:10.613220 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-edbc91a3-2a22-4bd8-9c33-816d23ea5f20 tempest-TestVolumeBootPattern-1320248540 None] Created volume successfully. Dec 18 21:09:10.687511 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.coordination [None req-98fad6ef-73fa-4fe6-98c7-03151e62555b tempest-VolumesSnapshotListTestJSON-1056661803 None] Lock "b'cinder-8df08399-b7c8-4648-9519-690d568ebfa6-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.010s {{(pid=134148) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 18 21:09:10.689258 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-98fad6ef-73fa-4fe6-98c7-03151e62555b tempest-VolumesSnapshotListTestJSON-1056661803 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:09:11.424711 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.quota [None req-98fad6ef-73fa-4fe6-98c7-03151e62555b tempest-VolumesSnapshotListTestJSON-1056661803 None] Created reservations ['726ff53b-e0a3-4308-b5f7-23c13ad1bfa2', '0dbfc3b1-500f-4121-b47f-a035b46b7ac1', '6d4b8772-8d9d-450b-a103-0e6761920807', '367e2f05-8553-4838-b548-a1e0ba9cb650'] {{(pid=134148) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 18 21:09:11.491192 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-98fad6ef-73fa-4fe6-98c7-03151e62555b tempest-VolumesSnapshotListTestJSON-1056661803 None] Delete snapshot completed successfully. Dec 18 21:09:11.498555 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.coordination [None req-98fad6ef-73fa-4fe6-98c7-03151e62555b tempest-VolumesSnapshotListTestJSON-1056661803 None] Lock "b'cinder-8df08399-b7c8-4648-9519-690d568ebfa6-delete_snapshot'" released by "delete_snapshot" :: held 0.811s {{(pid=134148) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 18 21:09:11.896709 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.coordination [None req-490b6c1d-787a-4f31-9185-a247967558cb tempest-VolumesSnapshotListTestJSON-1056661803 None] Lock "b'cinder-53711a34-766b-44a2-9485-93a03eda3474-delete_volume'" acquired by "delete_volume" :: waited 0.035s {{(pid=134148) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 18 21:09:11.979180 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-490b6c1d-787a-4f31-9185-a247967558cb tempest-VolumesSnapshotListTestJSON-1056661803 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:09:12.077185 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-490b6c1d-787a-4f31-9185-a247967558cb tempest-VolumesSnapshotListTestJSON-1056661803 None] volume has no backup snaps {{(pid=134148) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Dec 18 21:09:12.077613 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-490b6c1d-787a-4f31-9185-a247967558cb tempest-VolumesSnapshotListTestJSON-1056661803 None] Volume volume-53711a34-766b-44a2-9485-93a03eda3474 is not a clone. {{(pid=134148) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Dec 18 21:09:12.096404 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-490b6c1d-787a-4f31-9185-a247967558cb tempest-VolumesSnapshotListTestJSON-1056661803 None] deleting rbd volume volume-53711a34-766b-44a2-9485-93a03eda3474 {{(pid=134148) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Dec 18 21:09:12.855211 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.quota [None req-490b6c1d-787a-4f31-9185-a247967558cb tempest-VolumesSnapshotListTestJSON-1056661803 None] Created reservations ['3d92b177-3575-48a9-bb73-6684cddd1b2d', '4880e408-20f5-47eb-876f-44d2f6dcdf89', 'd5184601-3981-4404-ab71-e875241ab83b', '489eb9e5-3bbf-4bc2-97eb-1db5c2367379'] {{(pid=134148) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 18 21:09:12.961697 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-490b6c1d-787a-4f31-9185-a247967558cb tempest-VolumesSnapshotListTestJSON-1056661803 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:09:13.041229 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-490b6c1d-787a-4f31-9185-a247967558cb tempest-VolumesSnapshotListTestJSON-1056661803 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:09:13.156689 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.manager [None req-490b6c1d-787a-4f31-9185-a247967558cb tempest-VolumesSnapshotListTestJSON-1056661803 None] Notifying Schedulers of capabilities ... {{(pid=134148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 18 21:09:13.171780 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-490b6c1d-787a-4f31-9185-a247967558cb tempest-VolumesSnapshotListTestJSON-1056661803 None] Deleted volume successfully. Dec 18 21:09:13.247359 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.coordination [None req-490b6c1d-787a-4f31-9185-a247967558cb tempest-VolumesSnapshotListTestJSON-1056661803 None] Lock "b'cinder-53711a34-766b-44a2-9485-93a03eda3474-delete_volume'" released by "delete_volume" :: held 1.348s {{(pid=134148) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 18 21:09:13.929017 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.coordination [None req-5714ba67-b0e2-4fdd-81cd-6a3a8246089f tempest-VolumesBackupsV39Test-1873090783 None] Lock "b'cinder-deaf7c96-01b6-479a-946e-c92f2d37075d-delete_volume'" acquired by "delete_volume" :: waited 0.011s {{(pid=134148) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 18 21:09:13.992759 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-5714ba67-b0e2-4fdd-81cd-6a3a8246089f tempest-VolumesBackupsV39Test-1873090783 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:09:14.404906 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-5714ba67-b0e2-4fdd-81cd-6a3a8246089f tempest-VolumesBackupsV39Test-1873090783 None] Volume volume-deaf7c96-01b6-479a-946e-c92f2d37075d is not a clone. {{(pid=134148) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Dec 18 21:09:14.452836 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-5714ba67-b0e2-4fdd-81cd-6a3a8246089f tempest-VolumesBackupsV39Test-1873090783 None] deleting rbd volume volume-deaf7c96-01b6-479a-946e-c92f2d37075d {{(pid=134148) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Dec 18 21:09:14.880443 ncdv-master-1 cinder-volume[134148]: DEBUG oslo_concurrency.processutils [req-8741b8d3-adaf-428b-a71a-1791db4a3a0e req-2e81665c-7c12-4006-84c2-6499245ea19a tempest-TestVolumeBootPattern-1320248540 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=134148) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Dec 18 21:09:15.105839 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.quota [None req-5714ba67-b0e2-4fdd-81cd-6a3a8246089f tempest-VolumesBackupsV39Test-1873090783 None] Created reservations ['7d4f2ef8-7f1d-43ee-ad41-d25511a92e87', '6b71b0a8-38e7-4e61-8d9c-b3933862c3c0', '8a57814d-812f-48ea-afb4-27a62c279313', '3b74c704-5e65-47fa-a6c8-3d710f79e998'] {{(pid=134148) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 18 21:09:15.275396 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-5714ba67-b0e2-4fdd-81cd-6a3a8246089f tempest-VolumesBackupsV39Test-1873090783 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:09:15.365509 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-5714ba67-b0e2-4fdd-81cd-6a3a8246089f tempest-VolumesBackupsV39Test-1873090783 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:09:15.455602 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.manager [None req-5714ba67-b0e2-4fdd-81cd-6a3a8246089f tempest-VolumesBackupsV39Test-1873090783 None] Notifying Schedulers of capabilities ... {{(pid=134148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 18 21:09:15.462147 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-5714ba67-b0e2-4fdd-81cd-6a3a8246089f tempest-VolumesBackupsV39Test-1873090783 None] Deleted volume successfully. Dec 18 21:09:15.490594 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.coordination [None req-5714ba67-b0e2-4fdd-81cd-6a3a8246089f tempest-VolumesBackupsV39Test-1873090783 None] Lock "b'cinder-deaf7c96-01b6-479a-946e-c92f2d37075d-delete_volume'" released by "delete_volume" :: held 1.562s {{(pid=134148) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 18 21:09:16.345986 ncdv-master-1 cinder-volume[134148]: DEBUG oslo_concurrency.processutils [req-8741b8d3-adaf-428b-a71a-1791db4a3a0e req-2e81665c-7c12-4006-84c2-6499245ea19a tempest-TestVolumeBootPattern-1320248540 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.466s {{(pid=134148) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Dec 18 21:09:16.348116 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [req-8741b8d3-adaf-428b-a71a-1791db4a3a0e req-2e81665c-7c12-4006-84c2-6499245ea19a tempest-TestVolumeBootPattern-1320248540 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-02e23047-aecc-4a47-abf5-3b74dfa2dc23', 'hosts': ['10.222.0.13'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '946d1715-d12c-4dbf-8a79-181222df6e2e', 'volume_id': '02e23047-aecc-4a47-abf5-3b74dfa2dc23', 'discard': True}} {{(pid=134148) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Dec 18 21:09:16.401000 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [req-8741b8d3-adaf-428b-a71a-1791db4a3a0e req-2e81665c-7c12-4006-84c2-6499245ea19a tempest-TestVolumeBootPattern-1320248540 None] Connection info returned from driver {'name': 'volumes/volume-02e23047-aecc-4a47-abf5-3b74dfa2dc23', 'hosts': ['10.222.0.13'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '02e23047-aecc-4a47-abf5-3b74dfa2dc23', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'c060c776-fd9f-4186-9e34-830cb914db8b'} {{(pid=134148) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4812}} Dec 18 21:09:16.487055 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [req-8741b8d3-adaf-428b-a71a-1791db4a3a0e req-2e81665c-7c12-4006-84c2-6499245ea19a tempest-TestVolumeBootPattern-1320248540 None] attachment_update completed successfully. Dec 18 21:09:20.032245 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.flows.manager.create_volume [None req-e4435967-e921-4888-9250-b2c81a52d7b2 tempest-VolumesCloneTest-303739508 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134148) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Dec 18 21:09:20.042358 ncdv-master-1 cinder-volume[134148]: WARNING stevedore.named [None req-e4435967-e921-4888-9250-b2c81a52d7b2 tempest-VolumesCloneTest-303739508 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Dec 18 21:09:20.043782 ncdv-master-1 cinder-volume[134148]: WARNING castellan.key_manager [None req-e4435967-e921-4888-9250-b2c81a52d7b2 tempest-VolumesCloneTest-303739508 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Dec 18 21:09:20.073992 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-e4435967-e921-4888-9250-b2c81a52d7b2 tempest-VolumesCloneTest-303739508 None] Flow 'volume_create_manager' (38eca7e2-825f-4378-9e8f-c7893d0aa29b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 18 21:09:20.080704 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-e4435967-e921-4888-9250-b2c81a52d7b2 tempest-VolumesCloneTest-303739508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d882a15d-9028-4e99-b980-d0d968cf3144) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:09:20.088949 ncdv-master-1 cinder-volume[134148]: DEBUG oslo_db.sqlalchemy.engines [None req-e4435967-e921-4888-9250-b2c81a52d7b2 tempest-VolumesCloneTest-303739508 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134148) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 18 21:09:20.108822 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-e4435967-e921-4888-9250-b2c81a52d7b2 tempest-VolumesCloneTest-303739508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d882a15d-9028-4e99-b980-d0d968cf3144) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-12-18T21:09:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-539366061',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=88fbadc8-a4e6-4480-a5fb-9ee75fb51da3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5673f3a012384b3d82feb722bb93a642',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-12-18T21:09:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-12-18T21:09:20Z,use_quota=True,user_id='94da636659af412bac820f5ef326ce8d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f2e1fe1-9fd6-411e-9ed9-368f463ccb6f),volume_type_id=1f2e1fe1-9fd6-411e-9ed9-368f463ccb6f)' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:09:20.112506 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-e4435967-e921-4888-9250-b2c81a52d7b2 tempest-VolumesCloneTest-303739508 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (819f6c8e-d2a0-402a-b621-957d3aef22d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:09:20.116178 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-e4435967-e921-4888-9250-b2c81a52d7b2 tempest-VolumesCloneTest-303739508 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (819f6c8e-d2a0-402a-b621-957d3aef22d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:09:20.120449 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-e4435967-e921-4888-9250-b2c81a52d7b2 tempest-VolumesCloneTest-303739508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (788b620f-5a8a-464b-8842-6ed93b2485d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:09:20.277852 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-e4435967-e921-4888-9250-b2c81a52d7b2 tempest-VolumesCloneTest-303739508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (788b620f-5a8a-464b-8842-6ed93b2485d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '88fbadc8-a4e6-4480-a5fb-9ee75fb51da3', 'volume_name': 'volume-88fbadc8-a4e6-4480-a5fb-9ee75fb51da3', 'volume_size': 1, 'image_id': '394b3891-80f2-44c9-a9aa-56fe23a5acb3', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b04c3d19c79d4c208395e97f9d293618', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '394b3891-80f2-44c9-a9aa-56fe23a5acb3', 'created_at': datetime.datetime(2021, 12, 18, 20, 38, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 12, 18, 20, 38, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/394b3891-80f2-44c9-a9aa-56fe23a5acb3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:09:20.280665 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-e4435967-e921-4888-9250-b2c81a52d7b2 tempest-VolumesCloneTest-303739508 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58c951bc-6174-4646-b8af-a665805c28db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:09:20.287929 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-e4435967-e921-4888-9250-b2c81a52d7b2 tempest-VolumesCloneTest-303739508 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58c951bc-6174-4646-b8af-a665805c28db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:09:20.290229 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-e4435967-e921-4888-9250-b2c81a52d7b2 tempest-VolumesCloneTest-303739508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cec6e168-7aef-4009-811c-49d14bbb5012) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:09:20.291113 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.flows.manager.create_volume [None req-e4435967-e921-4888-9250-b2c81a52d7b2 tempest-VolumesCloneTest-303739508 None] Volume 88fbadc8-a4e6-4480-a5fb-9ee75fb51da3: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-88fbadc8-a4e6-4480-a5fb-9ee75fb51da3', 'volume_size': 1, 'image_id': '394b3891-80f2-44c9-a9aa-56fe23a5acb3', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b04c3d19c79d4c208395e97f9d293618', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '394b3891-80f2-44c9-a9aa-56fe23a5acb3', 'created_at': datetime.datetime(2021, 12, 18, 20, 38, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 12, 18, 20, 38, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/394b3891-80f2-44c9-a9aa-56fe23a5acb3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Dec 18 21:09:20.292238 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.flows.manager.create_volume [None req-e4435967-e921-4888-9250-b2c81a52d7b2 tempest-VolumesCloneTest-303739508 None] Cloning 88fbadc8-a4e6-4480-a5fb-9ee75fb51da3 from image 394b3891-80f2-44c9-a9aa-56fe23a5acb3 at location (None, None). {{(pid=134148) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1047}} Dec 18 21:09:20.308559 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.coordination [None req-e4435967-e921-4888-9250-b2c81a52d7b2 tempest-VolumesCloneTest-303739508 None] Lock "b'cinder-394b3891-80f2-44c9-a9aa-56fe23a5acb3'" acquired by "_prepare_image_cache_entry" :: waited 0.014s {{(pid=134148) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 18 21:09:20.340679 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.image.cache [None req-e4435967-e921-4888-9250-b2c81a52d7b2 tempest-VolumesCloneTest-303739508 None] Found image-volume cache entry: {'id': 1, 'image_id': '394b3891-80f2-44c9-a9aa-56fe23a5acb3', 'volume_id': 'e6411a45-48fa-4beb-a5a0-eb6a6ca3f525', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2021, 12, 18, 20, 38, 21), 'last_used': datetime.datetime(2021, 12, 18, 21, 9, 20, 315056)}. {{(pid=134148) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Dec 18 21:09:20.341352 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.image.cache [None req-e4435967-e921-4888-9250-b2c81a52d7b2 tempest-VolumesCloneTest-303739508 None] Image-volume cache entry image_update_at = 2021-12-18 20:38:21+00:00, requested image updated_at = 2021-12-18 20:38:21+00:00. {{(pid=134148) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Dec 18 21:09:20.342093 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.flows.manager.create_volume [None req-e4435967-e921-4888-9250-b2c81a52d7b2 tempest-VolumesCloneTest-303739508 None] Found cache entry for image = 394b3891-80f2-44c9-a9aa-56fe23a5acb3 on host ncdv-master-1@ceph#ceph. {{(pid=134148) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:870}} Dec 18 21:09:20.348822 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.coordination [None req-e4435967-e921-4888-9250-b2c81a52d7b2 tempest-VolumesCloneTest-303739508 None] Lock "b'cinder-394b3891-80f2-44c9-a9aa-56fe23a5acb3'" released by "_prepare_image_cache_entry" :: held 0.042s {{(pid=134148) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 18 21:09:20.349976 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.flows.manager.create_volume [None req-e4435967-e921-4888-9250-b2c81a52d7b2 tempest-VolumesCloneTest-303739508 None] Attempting to retrieve cache entry for image = 394b3891-80f2-44c9-a9aa-56fe23a5acb3 on host ncdv-master-1@ceph#ceph. {{(pid=134148) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:811}} Dec 18 21:09:20.357798 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.image.cache [None req-e4435967-e921-4888-9250-b2c81a52d7b2 tempest-VolumesCloneTest-303739508 None] Found image-volume cache entry: {'id': 1, 'image_id': '394b3891-80f2-44c9-a9aa-56fe23a5acb3', 'volume_id': 'e6411a45-48fa-4beb-a5a0-eb6a6ca3f525', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2021, 12, 18, 20, 38, 21), 'last_used': datetime.datetime(2021, 12, 18, 21, 9, 20, 355320)}. {{(pid=134148) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Dec 18 21:09:20.359043 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.image.cache [None req-e4435967-e921-4888-9250-b2c81a52d7b2 tempest-VolumesCloneTest-303739508 None] Image-volume cache entry image_update_at = 2021-12-18 20:38:21+00:00, requested image updated_at = 2021-12-18 20:38:21+00:00. {{(pid=134148) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Dec 18 21:09:20.359597 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.flows.manager.create_volume [None req-e4435967-e921-4888-9250-b2c81a52d7b2 tempest-VolumesCloneTest-303739508 None] Creating from source image-volume e6411a45-48fa-4beb-a5a0-eb6a6ca3f525 {{(pid=134148) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:825}} Dec 18 21:09:20.385958 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-e4435967-e921-4888-9250-b2c81a52d7b2 tempest-VolumesCloneTest-303739508 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:09:20.511585 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-e4435967-e921-4888-9250-b2c81a52d7b2 tempest-VolumesCloneTest-303739508 None] creating snapshot='volume-88fbadc8-a4e6-4480-a5fb-9ee75fb51da3.clone_snap' {{(pid=134148) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:725}} Dec 18 21:09:21.235732 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-e4435967-e921-4888-9250-b2c81a52d7b2 tempest-VolumesCloneTest-303739508 None] cloning 'volume-e6411a45-48fa-4beb-a5a0-eb6a6ca3f525@volume-88fbadc8-a4e6-4480-a5fb-9ee75fb51da3.clone_snap' to 'volume-88fbadc8-a4e6-4480-a5fb-9ee75fb51da3' {{(pid=134148) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:731}} Dec 18 21:09:21.459602 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-e4435967-e921-4888-9250-b2c81a52d7b2 tempest-VolumesCloneTest-303739508 None] Volume volume-9f5f7417-3abc-4462-988f-ef519750d753.deleted is not a clone. {{(pid=134148) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Dec 18 21:09:21.461434 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-e4435967-e921-4888-9250-b2c81a52d7b2 tempest-VolumesCloneTest-303739508 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134148) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 18 21:09:21.461877 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-e4435967-e921-4888-9250-b2c81a52d7b2 tempest-VolumesCloneTest-303739508 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134148) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 18 21:09:21.520773 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-e4435967-e921-4888-9250-b2c81a52d7b2 tempest-VolumesCloneTest-303739508 None] clone created successfully {{(pid=134148) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:803}} Dec 18 21:09:21.521683 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.volume_utils [None req-e4435967-e921-4888-9250-b2c81a52d7b2 tempest-VolumesCloneTest-303739508 None] Marking volume 88fbadc8-a4e6-4480-a5fb-9ee75fb51da3 as bootable. {{(pid=134148) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1178}} Dec 18 21:09:21.536910 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.flows.manager.create_volume [None req-e4435967-e921-4888-9250-b2c81a52d7b2 tempest-VolumesCloneTest-303739508 None] Copying metadata from image 394b3891-80f2-44c9-a9aa-56fe23a5acb3 to 88fbadc8-a4e6-4480-a5fb-9ee75fb51da3. {{(pid=134148) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:444}} Dec 18 21:09:21.537325 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.flows.manager.create_volume [None req-e4435967-e921-4888-9250-b2c81a52d7b2 tempest-VolumesCloneTest-303739508 None] Creating volume glance metadata for volume 88fbadc8-a4e6-4480-a5fb-9ee75fb51da3 backed by image 394b3891-80f2-44c9-a9aa-56fe23a5acb3 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '394b3891-80f2-44c9-a9aa-56fe23a5acb3', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=134148) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:667}} Dec 18 21:09:21.656921 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-e4435967-e921-4888-9250-b2c81a52d7b2 tempest-VolumesCloneTest-303739508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cec6e168-7aef-4009-811c-49d14bbb5012) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-88fbadc8-a4e6-4480-a5fb-9ee75fb51da3', 'volume_size': 1, 'image_id': '394b3891-80f2-44c9-a9aa-56fe23a5acb3', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b04c3d19c79d4c208395e97f9d293618', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '394b3891-80f2-44c9-a9aa-56fe23a5acb3', 'created_at': datetime.datetime(2021, 12, 18, 20, 38, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 12, 18, 20, 38, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/394b3891-80f2-44c9-a9aa-56fe23a5acb3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:09:21.665930 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-e4435967-e921-4888-9250-b2c81a52d7b2 tempest-VolumesCloneTest-303739508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7780e961-6cd3-4bb0-8c95-2860413dfaf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:09:21.685668 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.flows.manager.create_volume [None req-e4435967-e921-4888-9250-b2c81a52d7b2 tempest-VolumesCloneTest-303739508 None] Volume volume-88fbadc8-a4e6-4480-a5fb-9ee75fb51da3 (88fbadc8-a4e6-4480-a5fb-9ee75fb51da3): created successfully Dec 18 21:09:21.689777 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-e4435967-e921-4888-9250-b2c81a52d7b2 tempest-VolumesCloneTest-303739508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7780e961-6cd3-4bb0-8c95-2860413dfaf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:09:21.693900 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-e4435967-e921-4888-9250-b2c81a52d7b2 tempest-VolumesCloneTest-303739508 None] Flow 'volume_create_manager' (38eca7e2-825f-4378-9e8f-c7893d0aa29b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134148) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 18 21:09:21.708971 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-e4435967-e921-4888-9250-b2c81a52d7b2 tempest-VolumesCloneTest-303739508 None] Created volume successfully. Dec 18 21:09:23.003158 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.flows.manager.create_volume [None req-a61578ce-c8bb-409d-b621-a713eaab38ed tempest-VolumesCloneTest-303739508 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134148) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Dec 18 21:09:23.015431 ncdv-master-1 cinder-volume[134148]: WARNING stevedore.named [None req-a61578ce-c8bb-409d-b621-a713eaab38ed tempest-VolumesCloneTest-303739508 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Dec 18 21:09:23.016274 ncdv-master-1 cinder-volume[134148]: WARNING castellan.key_manager [None req-a61578ce-c8bb-409d-b621-a713eaab38ed tempest-VolumesCloneTest-303739508 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Dec 18 21:09:23.064039 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-a61578ce-c8bb-409d-b621-a713eaab38ed tempest-VolumesCloneTest-303739508 None] Flow 'volume_create_manager' (c66ef8d4-e94b-4873-994d-52ceca186a02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 18 21:09:23.072050 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-a61578ce-c8bb-409d-b621-a713eaab38ed tempest-VolumesCloneTest-303739508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (732434ad-04e6-4dfb-84c3-b34f0697f25c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:09:23.083309 ncdv-master-1 cinder-volume[134148]: DEBUG oslo_db.sqlalchemy.engines [None req-a61578ce-c8bb-409d-b621-a713eaab38ed tempest-VolumesCloneTest-303739508 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134148) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 18 21:09:23.105905 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-a61578ce-c8bb-409d-b621-a713eaab38ed tempest-VolumesCloneTest-303739508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (732434ad-04e6-4dfb-84c3-b34f0697f25c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=True,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-12-18T21:09:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1246744479',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=042e8614-e4bf-4329-a734-748c62be6100,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5673f3a012384b3d82feb722bb93a642',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-12-18T21:09:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=88fbadc8-a4e6-4480-a5fb-9ee75fb51da3,status='creating',terminated_at=None,updated_at=2021-12-18T21:09:23Z,use_quota=True,user_id='94da636659af412bac820f5ef326ce8d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f2e1fe1-9fd6-411e-9ed9-368f463ccb6f),volume_type_id=1f2e1fe1-9fd6-411e-9ed9-368f463ccb6f)' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:09:23.120106 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-a61578ce-c8bb-409d-b621-a713eaab38ed tempest-VolumesCloneTest-303739508 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b9c6705-6db1-4544-9750-22b212ab2482) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:09:23.122719 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-a61578ce-c8bb-409d-b621-a713eaab38ed tempest-VolumesCloneTest-303739508 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b9c6705-6db1-4544-9750-22b212ab2482) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:09:23.125596 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-a61578ce-c8bb-409d-b621-a713eaab38ed tempest-VolumesCloneTest-303739508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e14ebacb-e2f7-4cd7-8c7f-8aa743ddf53b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:09:23.147204 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-a61578ce-c8bb-409d-b621-a713eaab38ed tempest-VolumesCloneTest-303739508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e14ebacb-e2f7-4cd7-8c7f-8aa743ddf53b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '042e8614-e4bf-4329-a734-748c62be6100', 'volume_name': 'volume-042e8614-e4bf-4329-a734-748c62be6100', 'volume_size': 1, 'source_volid': '88fbadc8-a4e6-4480-a5fb-9ee75fb51da3', 'source_volstatus': 'available'}' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:09:23.150411 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-a61578ce-c8bb-409d-b621-a713eaab38ed tempest-VolumesCloneTest-303739508 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81b13abe-86fc-4391-bf28-a64a87b9e4a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:09:23.153584 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-a61578ce-c8bb-409d-b621-a713eaab38ed tempest-VolumesCloneTest-303739508 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81b13abe-86fc-4391-bf28-a64a87b9e4a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:09:23.156484 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-a61578ce-c8bb-409d-b621-a713eaab38ed tempest-VolumesCloneTest-303739508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59422998-9d54-47c3-ab9a-fdfd4c713fbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:09:23.157525 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.flows.manager.create_volume [None req-a61578ce-c8bb-409d-b621-a713eaab38ed tempest-VolumesCloneTest-303739508 None] Volume 042e8614-e4bf-4329-a734-748c62be6100: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-042e8614-e4bf-4329-a734-748c62be6100', 'volume_size': 1, 'source_volid': '88fbadc8-a4e6-4480-a5fb-9ee75fb51da3', 'source_volstatus': 'available'} Dec 18 21:09:23.173289 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-a61578ce-c8bb-409d-b621-a713eaab38ed tempest-VolumesCloneTest-303739508 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:09:23.312294 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-a61578ce-c8bb-409d-b621-a713eaab38ed tempest-VolumesCloneTest-303739508 None] creating snapshot='volume-042e8614-e4bf-4329-a734-748c62be6100.clone_snap' {{(pid=134148) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:725}} Dec 18 21:09:24.235909 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-a61578ce-c8bb-409d-b621-a713eaab38ed tempest-VolumesCloneTest-303739508 None] cloning 'volume-88fbadc8-a4e6-4480-a5fb-9ee75fb51da3@volume-042e8614-e4bf-4329-a734-748c62be6100.clone_snap' to 'volume-042e8614-e4bf-4329-a734-748c62be6100' {{(pid=134148) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:731}} Dec 18 21:09:24.566214 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-a61578ce-c8bb-409d-b621-a713eaab38ed tempest-VolumesCloneTest-303739508 None] Volume volume-9f5f7417-3abc-4462-988f-ef519750d753.deleted is not a clone. {{(pid=134148) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Dec 18 21:09:24.569131 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-a61578ce-c8bb-409d-b621-a713eaab38ed tempest-VolumesCloneTest-303739508 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134148) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 18 21:09:24.569738 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-a61578ce-c8bb-409d-b621-a713eaab38ed tempest-VolumesCloneTest-303739508 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134148) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 18 21:09:24.606554 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-a61578ce-c8bb-409d-b621-a713eaab38ed tempest-VolumesCloneTest-303739508 None] clone created successfully {{(pid=134148) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:803}} Dec 18 21:09:24.607169 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.volume_utils [None req-a61578ce-c8bb-409d-b621-a713eaab38ed tempest-VolumesCloneTest-303739508 None] Marking volume 042e8614-e4bf-4329-a734-748c62be6100 as bootable. {{(pid=134148) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1178}} Dec 18 21:09:24.627540 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.flows.manager.create_volume [None req-a61578ce-c8bb-409d-b621-a713eaab38ed tempest-VolumesCloneTest-303739508 None] Copying metadata from source volume 88fbadc8-a4e6-4480-a5fb-9ee75fb51da3 to 042e8614-e4bf-4329-a734-748c62be6100. {{(pid=134148) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:432}} Dec 18 21:09:24.671881 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-a61578ce-c8bb-409d-b621-a713eaab38ed tempest-VolumesCloneTest-303739508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59422998-9d54-47c3-ab9a-fdfd4c713fbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-042e8614-e4bf-4329-a734-748c62be6100', 'volume_size': 1, 'source_volid': '88fbadc8-a4e6-4480-a5fb-9ee75fb51da3', 'source_volstatus': 'available'}' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:09:24.675582 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-a61578ce-c8bb-409d-b621-a713eaab38ed tempest-VolumesCloneTest-303739508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef4bdf95-3260-4b32-917b-44a50bd38faa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:09:24.692954 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.flows.manager.create_volume [None req-a61578ce-c8bb-409d-b621-a713eaab38ed tempest-VolumesCloneTest-303739508 None] Volume volume-042e8614-e4bf-4329-a734-748c62be6100 (042e8614-e4bf-4329-a734-748c62be6100): created successfully Dec 18 21:09:24.697352 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-a61578ce-c8bb-409d-b621-a713eaab38ed tempest-VolumesCloneTest-303739508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef4bdf95-3260-4b32-917b-44a50bd38faa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:09:24.708113 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-a61578ce-c8bb-409d-b621-a713eaab38ed tempest-VolumesCloneTest-303739508 None] Flow 'volume_create_manager' (c66ef8d4-e94b-4873-994d-52ceca186a02) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134148) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 18 21:09:24.749286 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-a61578ce-c8bb-409d-b621-a713eaab38ed tempest-VolumesCloneTest-303739508 None] Created volume successfully. Dec 18 21:09:25.873365 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.flows.manager.create_volume [None req-58cf67e7-f127-43cb-950a-3c68a98a0358 tempest-VolumesCloneTest-303739508 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134148) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Dec 18 21:09:25.879254 ncdv-master-1 cinder-volume[134148]: WARNING stevedore.named [None req-58cf67e7-f127-43cb-950a-3c68a98a0358 tempest-VolumesCloneTest-303739508 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Dec 18 21:09:25.880581 ncdv-master-1 cinder-volume[134148]: WARNING castellan.key_manager [None req-58cf67e7-f127-43cb-950a-3c68a98a0358 tempest-VolumesCloneTest-303739508 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Dec 18 21:09:25.908477 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-58cf67e7-f127-43cb-950a-3c68a98a0358 tempest-VolumesCloneTest-303739508 None] Flow 'volume_create_manager' (5752043c-4cc0-48fa-adbf-f564df452037) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 18 21:09:25.914840 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-58cf67e7-f127-43cb-950a-3c68a98a0358 tempest-VolumesCloneTest-303739508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (250da834-e65e-465c-943d-54be85eccc0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:09:25.928100 ncdv-master-1 cinder-volume[134148]: DEBUG oslo_db.sqlalchemy.engines [None req-58cf67e7-f127-43cb-950a-3c68a98a0358 tempest-VolumesCloneTest-303739508 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134148) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 18 21:09:25.950956 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-58cf67e7-f127-43cb-950a-3c68a98a0358 tempest-VolumesCloneTest-303739508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (250da834-e65e-465c-943d-54be85eccc0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-12-18T21:09:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1144278608',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=b0557879-1f47-4760-a05a-e2af7f78a4e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5673f3a012384b3d82feb722bb93a642',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-12-18T21:09:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-12-18T21:09:26Z,use_quota=True,user_id='94da636659af412bac820f5ef326ce8d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f2e1fe1-9fd6-411e-9ed9-368f463ccb6f),volume_type_id=1f2e1fe1-9fd6-411e-9ed9-368f463ccb6f)' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:09:25.955695 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-58cf67e7-f127-43cb-950a-3c68a98a0358 tempest-VolumesCloneTest-303739508 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf88e86a-9549-4a85-a1eb-5f381cddf026) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:09:25.959389 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-58cf67e7-f127-43cb-950a-3c68a98a0358 tempest-VolumesCloneTest-303739508 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf88e86a-9549-4a85-a1eb-5f381cddf026) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:09:25.962538 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-58cf67e7-f127-43cb-950a-3c68a98a0358 tempest-VolumesCloneTest-303739508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f1621f4-172f-4d83-9baf-66d1fa17214a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:09:25.969841 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-58cf67e7-f127-43cb-950a-3c68a98a0358 tempest-VolumesCloneTest-303739508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f1621f4-172f-4d83-9baf-66d1fa17214a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b0557879-1f47-4760-a05a-e2af7f78a4e2', 'volume_name': 'volume-b0557879-1f47-4760-a05a-e2af7f78a4e2', 'volume_size': 1}' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:09:25.973739 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-58cf67e7-f127-43cb-950a-3c68a98a0358 tempest-VolumesCloneTest-303739508 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (caf31cd3-e0f2-4bbb-bf97-3a76985a4c09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:09:25.982838 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-58cf67e7-f127-43cb-950a-3c68a98a0358 tempest-VolumesCloneTest-303739508 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (caf31cd3-e0f2-4bbb-bf97-3a76985a4c09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:09:25.988025 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-58cf67e7-f127-43cb-950a-3c68a98a0358 tempest-VolumesCloneTest-303739508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff6ab2a6-2106-4212-aa7e-8d7abb376d11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:09:25.989208 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.flows.manager.create_volume [None req-58cf67e7-f127-43cb-950a-3c68a98a0358 tempest-VolumesCloneTest-303739508 None] Volume b0557879-1f47-4760-a05a-e2af7f78a4e2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b0557879-1f47-4760-a05a-e2af7f78a4e2', 'volume_size': 1} Dec 18 21:09:25.990362 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-58cf67e7-f127-43cb-950a-3c68a98a0358 tempest-VolumesCloneTest-303739508 None] creating volume 'volume-b0557879-1f47-4760-a05a-e2af7f78a4e2' {{(pid=134148) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Dec 18 21:09:25.991665 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-58cf67e7-f127-43cb-950a-3c68a98a0358 tempest-VolumesCloneTest-303739508 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:09:26.159884 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-58cf67e7-f127-43cb-950a-3c68a98a0358 tempest-VolumesCloneTest-303739508 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134148) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 18 21:09:26.160942 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-58cf67e7-f127-43cb-950a-3c68a98a0358 tempest-VolumesCloneTest-303739508 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134148) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 18 21:09:26.163069 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-58cf67e7-f127-43cb-950a-3c68a98a0358 tempest-VolumesCloneTest-303739508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff6ab2a6-2106-4212-aa7e-8d7abb376d11) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b0557879-1f47-4760-a05a-e2af7f78a4e2', 'volume_size': 1}' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:09:26.166061 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-58cf67e7-f127-43cb-950a-3c68a98a0358 tempest-VolumesCloneTest-303739508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91c6def5-87bd-4d79-9f16-509ec6c51c5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:09:26.188383 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.flows.manager.create_volume [None req-58cf67e7-f127-43cb-950a-3c68a98a0358 tempest-VolumesCloneTest-303739508 None] Volume volume-b0557879-1f47-4760-a05a-e2af7f78a4e2 (b0557879-1f47-4760-a05a-e2af7f78a4e2): created successfully Dec 18 21:09:26.190401 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-58cf67e7-f127-43cb-950a-3c68a98a0358 tempest-VolumesCloneTest-303739508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91c6def5-87bd-4d79-9f16-509ec6c51c5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:09:26.193655 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-58cf67e7-f127-43cb-950a-3c68a98a0358 tempest-VolumesCloneTest-303739508 None] Flow 'volume_create_manager' (5752043c-4cc0-48fa-adbf-f564df452037) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134148) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 18 21:09:26.216027 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-58cf67e7-f127-43cb-950a-3c68a98a0358 tempest-VolumesCloneTest-303739508 None] Created volume successfully. Dec 18 21:09:27.841296 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.flows.manager.create_volume [None req-31d3f143-ca42-451c-acfa-8e46cbe8b728 tempest-VolumesCloneTest-303739508 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134148) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Dec 18 21:09:27.875853 ncdv-master-1 cinder-volume[134148]: WARNING stevedore.named [None req-31d3f143-ca42-451c-acfa-8e46cbe8b728 tempest-VolumesCloneTest-303739508 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Dec 18 21:09:27.876311 ncdv-master-1 cinder-volume[134148]: WARNING castellan.key_manager [None req-31d3f143-ca42-451c-acfa-8e46cbe8b728 tempest-VolumesCloneTest-303739508 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Dec 18 21:09:27.957083 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-31d3f143-ca42-451c-acfa-8e46cbe8b728 tempest-VolumesCloneTest-303739508 None] Flow 'volume_create_manager' (eb632929-c5d1-4865-9be7-cf04a2ad0ed6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 18 21:09:27.963476 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-31d3f143-ca42-451c-acfa-8e46cbe8b728 tempest-VolumesCloneTest-303739508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1c0f730-8a7b-4ad5-9521-67344fdae19e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:09:27.975968 ncdv-master-1 cinder-volume[134148]: DEBUG oslo_db.sqlalchemy.engines [None req-31d3f143-ca42-451c-acfa-8e46cbe8b728 tempest-VolumesCloneTest-303739508 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134148) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 18 21:09:27.992595 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-31d3f143-ca42-451c-acfa-8e46cbe8b728 tempest-VolumesCloneTest-303739508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1c0f730-8a7b-4ad5-9521-67344fdae19e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-12-18T21:09:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-692091077',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=22926410-4af7-493f-a061-6468379b27d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5673f3a012384b3d82feb722bb93a642',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-12-18T21:09:28Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=b0557879-1f47-4760-a05a-e2af7f78a4e2,status='creating',terminated_at=None,updated_at=2021-12-18T21:09:28Z,use_quota=True,user_id='94da636659af412bac820f5ef326ce8d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f2e1fe1-9fd6-411e-9ed9-368f463ccb6f),volume_type_id=1f2e1fe1-9fd6-411e-9ed9-368f463ccb6f)' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:09:27.996358 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-31d3f143-ca42-451c-acfa-8e46cbe8b728 tempest-VolumesCloneTest-303739508 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8b1f306-5a0c-4b86-b239-837c7461f1dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:09:27.998819 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-31d3f143-ca42-451c-acfa-8e46cbe8b728 tempest-VolumesCloneTest-303739508 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8b1f306-5a0c-4b86-b239-837c7461f1dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:09:28.001272 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-31d3f143-ca42-451c-acfa-8e46cbe8b728 tempest-VolumesCloneTest-303739508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (feed2d36-8e36-4daa-890e-1ba3e590a97a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:09:28.018743 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-31d3f143-ca42-451c-acfa-8e46cbe8b728 tempest-VolumesCloneTest-303739508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (feed2d36-8e36-4daa-890e-1ba3e590a97a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '22926410-4af7-493f-a061-6468379b27d7', 'volume_name': 'volume-22926410-4af7-493f-a061-6468379b27d7', 'volume_size': 2, 'source_volid': 'b0557879-1f47-4760-a05a-e2af7f78a4e2', 'source_volstatus': 'available'}' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:09:28.022506 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-31d3f143-ca42-451c-acfa-8e46cbe8b728 tempest-VolumesCloneTest-303739508 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38d670a8-666b-484a-aa45-73acc7802d60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:09:28.024744 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-31d3f143-ca42-451c-acfa-8e46cbe8b728 tempest-VolumesCloneTest-303739508 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38d670a8-666b-484a-aa45-73acc7802d60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:09:28.039933 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-31d3f143-ca42-451c-acfa-8e46cbe8b728 tempest-VolumesCloneTest-303739508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0658bb79-4a5e-42e6-ba2e-0548319de618) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:09:28.040796 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.flows.manager.create_volume [None req-31d3f143-ca42-451c-acfa-8e46cbe8b728 tempest-VolumesCloneTest-303739508 None] Volume 22926410-4af7-493f-a061-6468379b27d7: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-22926410-4af7-493f-a061-6468379b27d7', 'volume_size': 2, 'source_volid': 'b0557879-1f47-4760-a05a-e2af7f78a4e2', 'source_volstatus': 'available'} Dec 18 21:09:28.060859 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-31d3f143-ca42-451c-acfa-8e46cbe8b728 tempest-VolumesCloneTest-303739508 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:09:28.172230 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-31d3f143-ca42-451c-acfa-8e46cbe8b728 tempest-VolumesCloneTest-303739508 None] creating snapshot='volume-22926410-4af7-493f-a061-6468379b27d7.clone_snap' {{(pid=134148) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:725}} Dec 18 21:09:28.672138 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-31d3f143-ca42-451c-acfa-8e46cbe8b728 tempest-VolumesCloneTest-303739508 None] cloning 'volume-b0557879-1f47-4760-a05a-e2af7f78a4e2@volume-22926410-4af7-493f-a061-6468379b27d7.clone_snap' to 'volume-22926410-4af7-493f-a061-6468379b27d7' {{(pid=134148) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:731}} Dec 18 21:09:28.853297 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-31d3f143-ca42-451c-acfa-8e46cbe8b728 tempest-VolumesCloneTest-303739508 None] Volume volume-b0557879-1f47-4760-a05a-e2af7f78a4e2 is not a clone. {{(pid=134148) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Dec 18 21:09:28.854712 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-31d3f143-ca42-451c-acfa-8e46cbe8b728 tempest-VolumesCloneTest-303739508 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134148) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 18 21:09:28.855355 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-31d3f143-ca42-451c-acfa-8e46cbe8b728 tempest-VolumesCloneTest-303739508 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134148) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 18 21:09:28.883353 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-31d3f143-ca42-451c-acfa-8e46cbe8b728 tempest-VolumesCloneTest-303739508 None] resize volume 'volume-22926410-4af7-493f-a061-6468379b27d7' from 1 to 2 {{(pid=134148) _extend_if_required /opt/stack/cinder/cinder/volume/drivers/rbd.py:694}} Dec 18 21:09:28.885709 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-31d3f143-ca42-451c-acfa-8e46cbe8b728 tempest-VolumesCloneTest-303739508 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:09:29.082697 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-31d3f143-ca42-451c-acfa-8e46cbe8b728 tempest-VolumesCloneTest-303739508 None] clone created successfully {{(pid=134148) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:803}} Dec 18 21:09:29.085275 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-31d3f143-ca42-451c-acfa-8e46cbe8b728 tempest-VolumesCloneTest-303739508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0658bb79-4a5e-42e6-ba2e-0548319de618) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-22926410-4af7-493f-a061-6468379b27d7', 'volume_size': 2, 'source_volid': 'b0557879-1f47-4760-a05a-e2af7f78a4e2', 'source_volstatus': 'available'}' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:09:29.088539 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-31d3f143-ca42-451c-acfa-8e46cbe8b728 tempest-VolumesCloneTest-303739508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5023977-199d-4fa3-b27c-6337a007b691) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:09:29.108009 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.flows.manager.create_volume [None req-31d3f143-ca42-451c-acfa-8e46cbe8b728 tempest-VolumesCloneTest-303739508 None] Volume volume-22926410-4af7-493f-a061-6468379b27d7 (22926410-4af7-493f-a061-6468379b27d7): created successfully Dec 18 21:09:29.117419 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-31d3f143-ca42-451c-acfa-8e46cbe8b728 tempest-VolumesCloneTest-303739508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5023977-199d-4fa3-b27c-6337a007b691) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:09:29.124213 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-31d3f143-ca42-451c-acfa-8e46cbe8b728 tempest-VolumesCloneTest-303739508 None] Flow 'volume_create_manager' (eb632929-c5d1-4865-9be7-cf04a2ad0ed6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134148) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 18 21:09:29.171509 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-31d3f143-ca42-451c-acfa-8e46cbe8b728 tempest-VolumesCloneTest-303739508 None] Created volume successfully. Dec 18 21:09:30.083343 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.coordination [None req-4f8e0ee1-1988-4f68-aab1-7494c18bba97 tempest-VolumesCloneTest-303739508 None] Lock "b'cinder-22926410-4af7-493f-a061-6468379b27d7-delete_volume'" acquired by "delete_volume" :: waited 0.030s {{(pid=134148) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 18 21:09:30.190672 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-4f8e0ee1-1988-4f68-aab1-7494c18bba97 tempest-VolumesCloneTest-303739508 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:09:30.334244 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-4f8e0ee1-1988-4f68-aab1-7494c18bba97 tempest-VolumesCloneTest-303739508 None] volume has no backup snaps {{(pid=134148) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Dec 18 21:09:30.342767 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-4f8e0ee1-1988-4f68-aab1-7494c18bba97 tempest-VolumesCloneTest-303739508 None] deleting rbd volume volume-22926410-4af7-493f-a061-6468379b27d7 {{(pid=134148) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Dec 18 21:09:30.698232 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-4f8e0ee1-1988-4f68-aab1-7494c18bba97 tempest-VolumesCloneTest-303739508 None] volume is a clone so cleaning references {{(pid=134148) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1266}} Dec 18 21:09:30.762826 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-4f8e0ee1-1988-4f68-aab1-7494c18bba97 tempest-VolumesCloneTest-303739508 None] Volume volume-b0557879-1f47-4760-a05a-e2af7f78a4e2 is not a clone. {{(pid=134148) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Dec 18 21:09:30.764187 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-4f8e0ee1-1988-4f68-aab1-7494c18bba97 tempest-VolumesCloneTest-303739508 None] deleting parent snapshot volume-22926410-4af7-493f-a061-6468379b27d7.clone_snap {{(pid=134148) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1158}} Dec 18 21:09:31.218861 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.quota [None req-4f8e0ee1-1988-4f68-aab1-7494c18bba97 tempest-VolumesCloneTest-303739508 None] Created reservations ['9308c20d-1910-41fb-b8fe-d785a0ffaa15', '6d723bcb-3d3d-4941-8c2d-309ee29ab463', 'f8a33153-b494-4b01-a628-e24aab7c6e61', '593eb6c5-4a3b-400d-be76-888cae45e39d'] {{(pid=134148) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 18 21:09:31.364439 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-4f8e0ee1-1988-4f68-aab1-7494c18bba97 tempest-VolumesCloneTest-303739508 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:09:31.455686 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-4f8e0ee1-1988-4f68-aab1-7494c18bba97 tempest-VolumesCloneTest-303739508 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:09:31.555164 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.manager [None req-4f8e0ee1-1988-4f68-aab1-7494c18bba97 tempest-VolumesCloneTest-303739508 None] Notifying Schedulers of capabilities ... {{(pid=134148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 18 21:09:31.563938 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-4f8e0ee1-1988-4f68-aab1-7494c18bba97 tempest-VolumesCloneTest-303739508 None] Deleted volume successfully. Dec 18 21:09:31.604550 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.coordination [None req-4f8e0ee1-1988-4f68-aab1-7494c18bba97 tempest-VolumesCloneTest-303739508 None] Lock "b'cinder-22926410-4af7-493f-a061-6468379b27d7-delete_volume'" released by "delete_volume" :: held 1.514s {{(pid=134148) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 18 21:09:32.488042 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.coordination [None req-67468927-4d4a-4ac7-aa2c-3830c2b6e363 tempest-VolumesCloneTest-303739508 None] Lock "b'cinder-b0557879-1f47-4760-a05a-e2af7f78a4e2-delete_volume'" acquired by "delete_volume" :: waited 0.042s {{(pid=134148) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 18 21:09:32.593900 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-67468927-4d4a-4ac7-aa2c-3830c2b6e363 tempest-VolumesCloneTest-303739508 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:09:32.721590 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-67468927-4d4a-4ac7-aa2c-3830c2b6e363 tempest-VolumesCloneTest-303739508 None] volume has no backup snaps {{(pid=134148) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Dec 18 21:09:32.723165 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-67468927-4d4a-4ac7-aa2c-3830c2b6e363 tempest-VolumesCloneTest-303739508 None] Volume volume-b0557879-1f47-4760-a05a-e2af7f78a4e2 is not a clone. {{(pid=134148) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Dec 18 21:09:32.746878 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-67468927-4d4a-4ac7-aa2c-3830c2b6e363 tempest-VolumesCloneTest-303739508 None] deleting rbd volume volume-b0557879-1f47-4760-a05a-e2af7f78a4e2 {{(pid=134148) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Dec 18 21:09:33.326641 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.quota [None req-67468927-4d4a-4ac7-aa2c-3830c2b6e363 tempest-VolumesCloneTest-303739508 None] Created reservations ['3ec2438e-fff3-4d78-9abd-21f355d3fb3b', '52b12bd2-4ef1-4e48-9a7c-36c24c512983', '0494b1be-07e7-43f5-8d7e-3724df231e32', '38510742-b0d7-404d-8011-3faec186d31f'] {{(pid=134148) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 18 21:09:33.399370 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-67468927-4d4a-4ac7-aa2c-3830c2b6e363 tempest-VolumesCloneTest-303739508 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:09:33.468925 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-67468927-4d4a-4ac7-aa2c-3830c2b6e363 tempest-VolumesCloneTest-303739508 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:09:33.538103 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.manager [None req-67468927-4d4a-4ac7-aa2c-3830c2b6e363 tempest-VolumesCloneTest-303739508 None] Notifying Schedulers of capabilities ... {{(pid=134148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 18 21:09:33.551174 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-67468927-4d4a-4ac7-aa2c-3830c2b6e363 tempest-VolumesCloneTest-303739508 None] Deleted volume successfully. Dec 18 21:09:33.577278 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.coordination [None req-67468927-4d4a-4ac7-aa2c-3830c2b6e363 tempest-VolumesCloneTest-303739508 None] Lock "b'cinder-b0557879-1f47-4760-a05a-e2af7f78a4e2-delete_volume'" released by "delete_volume" :: held 1.090s {{(pid=134148) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 18 21:09:33.762669 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.coordination [None req-6ded228b-3e42-429e-bcf7-4587b675fd49 tempest-VolumesCloneTest-303739508 None] Lock "b'cinder-042e8614-e4bf-4329-a734-748c62be6100-delete_volume'" acquired by "delete_volume" :: waited 0.015s {{(pid=134148) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 18 21:09:33.844169 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-6ded228b-3e42-429e-bcf7-4587b675fd49 tempest-VolumesCloneTest-303739508 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:09:34.023641 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-6ded228b-3e42-429e-bcf7-4587b675fd49 tempest-VolumesCloneTest-303739508 None] volume has no backup snaps {{(pid=134148) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Dec 18 21:09:34.045064 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-6ded228b-3e42-429e-bcf7-4587b675fd49 tempest-VolumesCloneTest-303739508 None] deleting rbd volume volume-042e8614-e4bf-4329-a734-748c62be6100 {{(pid=134148) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Dec 18 21:09:34.346382 ncdv-master-1 cinder-volume[134148]: DEBUG oslo_service.periodic_task [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134148) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Dec 18 21:09:34.348465 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:09:34.464131 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:09:34.583347 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.manager [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] Notifying Schedulers of capabilities ... {{(pid=134148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 18 21:09:34.588796 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-6ded228b-3e42-429e-bcf7-4587b675fd49 tempest-VolumesCloneTest-303739508 None] volume is a clone so cleaning references {{(pid=134148) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1266}} Dec 18 21:09:34.656361 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-6ded228b-3e42-429e-bcf7-4587b675fd49 tempest-VolumesCloneTest-303739508 None] deleting parent snapshot volume-042e8614-e4bf-4329-a734-748c62be6100.clone_snap {{(pid=134148) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1158}} Dec 18 21:09:35.350925 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.quota [None req-6ded228b-3e42-429e-bcf7-4587b675fd49 tempest-VolumesCloneTest-303739508 None] Created reservations ['9d28d3bd-51d7-4a35-b312-584451386050', 'aa38340a-7490-42b3-a2ad-edc51d486297', 'aa894f1d-0e70-4067-8896-3e4e9f664f2c', '2c879de5-dc70-4034-93e6-1d9dc013150a'] {{(pid=134148) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 18 21:09:35.415662 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-6ded228b-3e42-429e-bcf7-4587b675fd49 tempest-VolumesCloneTest-303739508 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:09:35.491991 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-6ded228b-3e42-429e-bcf7-4587b675fd49 tempest-VolumesCloneTest-303739508 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:09:35.545359 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.manager [None req-6ded228b-3e42-429e-bcf7-4587b675fd49 tempest-VolumesCloneTest-303739508 None] Notifying Schedulers of capabilities ... {{(pid=134148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 18 21:09:35.550689 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-6ded228b-3e42-429e-bcf7-4587b675fd49 tempest-VolumesCloneTest-303739508 None] Deleted volume successfully. Dec 18 21:09:35.574353 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.coordination [None req-6ded228b-3e42-429e-bcf7-4587b675fd49 tempest-VolumesCloneTest-303739508 None] Lock "b'cinder-042e8614-e4bf-4329-a734-748c62be6100-delete_volume'" released by "delete_volume" :: held 1.812s {{(pid=134148) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 18 21:09:35.945895 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [req-a658db90-1e35-44cc-95e8-eb25874854fb req-96de0782-312b-4cfd-892c-7a0bc82af215 tempest-TestVolumeBootPattern-1320248540 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:09:36.127568 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.coordination [None req-cf6844ae-53f7-4df1-8bd0-8923dfb70345 tempest-VolumesCloneTest-303739508 None] Lock "b'cinder-88fbadc8-a4e6-4480-a5fb-9ee75fb51da3-delete_volume'" acquired by "delete_volume" :: waited 0.012s {{(pid=134148) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 18 21:09:36.239667 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-cf6844ae-53f7-4df1-8bd0-8923dfb70345 tempest-VolumesCloneTest-303739508 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:09:36.359565 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-cf6844ae-53f7-4df1-8bd0-8923dfb70345 tempest-VolumesCloneTest-303739508 None] volume has no backup snaps {{(pid=134148) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Dec 18 21:09:36.373737 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-cf6844ae-53f7-4df1-8bd0-8923dfb70345 tempest-VolumesCloneTest-303739508 None] deleting rbd volume volume-88fbadc8-a4e6-4480-a5fb-9ee75fb51da3 {{(pid=134148) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Dec 18 21:09:36.620217 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [req-a658db90-1e35-44cc-95e8-eb25874854fb req-96de0782-312b-4cfd-892c-7a0bc82af215 tempest-TestVolumeBootPattern-1320248540 None] Create snapshot completed successfully Dec 18 21:09:36.856956 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-cf6844ae-53f7-4df1-8bd0-8923dfb70345 tempest-VolumesCloneTest-303739508 None] volume is a clone so cleaning references {{(pid=134148) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1266}} Dec 18 21:09:36.907313 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-cf6844ae-53f7-4df1-8bd0-8923dfb70345 tempest-VolumesCloneTest-303739508 None] deleting parent snapshot volume-88fbadc8-a4e6-4480-a5fb-9ee75fb51da3.clone_snap {{(pid=134148) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1158}} Dec 18 21:09:37.515145 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.quota [None req-cf6844ae-53f7-4df1-8bd0-8923dfb70345 tempest-VolumesCloneTest-303739508 None] Created reservations ['54a43847-7222-4e0e-a843-13cc7411d3d8', 'dceb0120-6400-4c8d-a867-4d22bcfcea68', 'abf5af6e-c1e3-45bf-b5c7-744699959552', '49644070-94cb-4f08-b204-1856b5185131'] {{(pid=134148) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 18 21:09:37.610184 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-cf6844ae-53f7-4df1-8bd0-8923dfb70345 tempest-VolumesCloneTest-303739508 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:09:37.717406 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-cf6844ae-53f7-4df1-8bd0-8923dfb70345 tempest-VolumesCloneTest-303739508 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:09:37.829125 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.manager [None req-cf6844ae-53f7-4df1-8bd0-8923dfb70345 tempest-VolumesCloneTest-303739508 None] Notifying Schedulers of capabilities ... {{(pid=134148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 18 21:09:37.834765 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-cf6844ae-53f7-4df1-8bd0-8923dfb70345 tempest-VolumesCloneTest-303739508 None] Deleted volume successfully. Dec 18 21:09:37.851149 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.coordination [None req-cf6844ae-53f7-4df1-8bd0-8923dfb70345 tempest-VolumesCloneTest-303739508 None] Lock "b'cinder-88fbadc8-a4e6-4480-a5fb-9ee75fb51da3-delete_volume'" released by "delete_volume" :: held 1.724s {{(pid=134148) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 18 21:09:43.410677 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.flows.manager.create_volume [req-abe2cea8-95db-4600-a635-a707d0f69e64 req-8237a41d-922d-47bb-93a3-9ec81fc73cc9 tempest-TestVolumeBootPattern-1320248540 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134148) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Dec 18 21:09:43.417902 ncdv-master-1 cinder-volume[134148]: WARNING stevedore.named [req-abe2cea8-95db-4600-a635-a707d0f69e64 req-8237a41d-922d-47bb-93a3-9ec81fc73cc9 tempest-TestVolumeBootPattern-1320248540 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Dec 18 21:09:43.418594 ncdv-master-1 cinder-volume[134148]: WARNING castellan.key_manager [req-abe2cea8-95db-4600-a635-a707d0f69e64 req-8237a41d-922d-47bb-93a3-9ec81fc73cc9 tempest-TestVolumeBootPattern-1320248540 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Dec 18 21:09:43.448697 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [req-abe2cea8-95db-4600-a635-a707d0f69e64 req-8237a41d-922d-47bb-93a3-9ec81fc73cc9 tempest-TestVolumeBootPattern-1320248540 None] Flow 'volume_create_manager' (c89076b1-6831-435c-a97e-e3173ce81330) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 18 21:09:43.453575 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [req-abe2cea8-95db-4600-a635-a707d0f69e64 req-8237a41d-922d-47bb-93a3-9ec81fc73cc9 tempest-TestVolumeBootPattern-1320248540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (254eebd3-0989-4e0f-87e4-83372922c26e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:09:43.462482 ncdv-master-1 cinder-volume[134148]: DEBUG oslo_db.sqlalchemy.engines [req-abe2cea8-95db-4600-a635-a707d0f69e64 req-8237a41d-922d-47bb-93a3-9ec81fc73cc9 tempest-TestVolumeBootPattern-1320248540 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134148) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 18 21:09:43.483390 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [req-abe2cea8-95db-4600-a635-a707d0f69e64 req-8237a41d-922d-47bb-93a3-9ec81fc73cc9 tempest-TestVolumeBootPattern-1320248540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (254eebd3-0989-4e0f-87e4-83372922c26e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=True,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-12-18T21:09:43Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=89492b70-b22f-4bc4-b598-70e4e70d931a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de79cd87d023436a80d3cc5428586e21',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-12-18T21:09:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=5d1fb417-1893-4a31-ae5f-e0033d4ffdbf,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-12-18T21:09:43Z,use_quota=True,user_id='d32598482c834073b8fe24c84cb57d2f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f2e1fe1-9fd6-411e-9ed9-368f463ccb6f),volume_type_id=1f2e1fe1-9fd6-411e-9ed9-368f463ccb6f)' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:09:43.486672 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [req-abe2cea8-95db-4600-a635-a707d0f69e64 req-8237a41d-922d-47bb-93a3-9ec81fc73cc9 tempest-TestVolumeBootPattern-1320248540 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae5dc31c-f289-4045-ae39-50d7acbe2a77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:09:43.490363 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [req-abe2cea8-95db-4600-a635-a707d0f69e64 req-8237a41d-922d-47bb-93a3-9ec81fc73cc9 tempest-TestVolumeBootPattern-1320248540 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae5dc31c-f289-4045-ae39-50d7acbe2a77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:09:43.494091 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [req-abe2cea8-95db-4600-a635-a707d0f69e64 req-8237a41d-922d-47bb-93a3-9ec81fc73cc9 tempest-TestVolumeBootPattern-1320248540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57f98ea1-0e3d-4d1d-8c9d-2bb8a8cacae3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:09:43.496768 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [req-abe2cea8-95db-4600-a635-a707d0f69e64 req-8237a41d-922d-47bb-93a3-9ec81fc73cc9 tempest-TestVolumeBootPattern-1320248540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57f98ea1-0e3d-4d1d-8c9d-2bb8a8cacae3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '89492b70-b22f-4bc4-b598-70e4e70d931a', 'volume_name': 'volume-89492b70-b22f-4bc4-b598-70e4e70d931a', 'volume_size': 1, 'snapshot_id': '5d1fb417-1893-4a31-ae5f-e0033d4ffdbf'}' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:09:43.499953 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [req-abe2cea8-95db-4600-a635-a707d0f69e64 req-8237a41d-922d-47bb-93a3-9ec81fc73cc9 tempest-TestVolumeBootPattern-1320248540 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (742b9835-31ad-4aa8-bb81-22759331b5fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:09:43.503223 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [req-abe2cea8-95db-4600-a635-a707d0f69e64 req-8237a41d-922d-47bb-93a3-9ec81fc73cc9 tempest-TestVolumeBootPattern-1320248540 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (742b9835-31ad-4aa8-bb81-22759331b5fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:09:43.506356 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [req-abe2cea8-95db-4600-a635-a707d0f69e64 req-8237a41d-922d-47bb-93a3-9ec81fc73cc9 tempest-TestVolumeBootPattern-1320248540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a21916e-7e86-4c8e-b50e-8f481c9b484e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:09:43.507625 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.flows.manager.create_volume [req-abe2cea8-95db-4600-a635-a707d0f69e64 req-8237a41d-922d-47bb-93a3-9ec81fc73cc9 tempest-TestVolumeBootPattern-1320248540 None] Volume 89492b70-b22f-4bc4-b598-70e4e70d931a: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-89492b70-b22f-4bc4-b598-70e4e70d931a', 'volume_size': 1, 'snapshot_id': '5d1fb417-1893-4a31-ae5f-e0033d4ffdbf'} Dec 18 21:09:43.537936 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [req-abe2cea8-95db-4600-a635-a707d0f69e64 req-8237a41d-922d-47bb-93a3-9ec81fc73cc9 tempest-TestVolumeBootPattern-1320248540 None] cloning volumes/volume-02e23047-aecc-4a47-abf5-3b74dfa2dc23@snapshot-5d1fb417-1893-4a31-ae5f-e0033d4ffdbf to volume-89492b70-b22f-4bc4-b598-70e4e70d931a {{(pid=134148) _clone /opt/stack/cinder/cinder/volume/drivers/rbd.py:1028}} Dec 18 21:09:43.539173 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [req-abe2cea8-95db-4600-a635-a707d0f69e64 req-8237a41d-922d-47bb-93a3-9ec81fc73cc9 tempest-TestVolumeBootPattern-1320248540 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:09:43.680092 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [req-abe2cea8-95db-4600-a635-a707d0f69e64 req-8237a41d-922d-47bb-93a3-9ec81fc73cc9 tempest-TestVolumeBootPattern-1320248540 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:09:43.909963 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [req-abe2cea8-95db-4600-a635-a707d0f69e64 req-8237a41d-922d-47bb-93a3-9ec81fc73cc9 tempest-TestVolumeBootPattern-1320248540 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134148) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 18 21:09:43.911043 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [req-abe2cea8-95db-4600-a635-a707d0f69e64 req-8237a41d-922d-47bb-93a3-9ec81fc73cc9 tempest-TestVolumeBootPattern-1320248540 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134148) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 18 21:09:43.950487 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.volume_utils [req-abe2cea8-95db-4600-a635-a707d0f69e64 req-8237a41d-922d-47bb-93a3-9ec81fc73cc9 tempest-TestVolumeBootPattern-1320248540 None] Marking volume 89492b70-b22f-4bc4-b598-70e4e70d931a as bootable. {{(pid=134148) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1178}} Dec 18 21:09:43.971496 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.flows.manager.create_volume [req-abe2cea8-95db-4600-a635-a707d0f69e64 req-8237a41d-922d-47bb-93a3-9ec81fc73cc9 tempest-TestVolumeBootPattern-1320248540 None] Copying metadata from snapshot 5d1fb417-1893-4a31-ae5f-e0033d4ffdbf to 89492b70-b22f-4bc4-b598-70e4e70d931a. {{(pid=134148) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:423}} Dec 18 21:09:44.028095 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [req-abe2cea8-95db-4600-a635-a707d0f69e64 req-8237a41d-922d-47bb-93a3-9ec81fc73cc9 tempest-TestVolumeBootPattern-1320248540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a21916e-7e86-4c8e-b50e-8f481c9b484e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-89492b70-b22f-4bc4-b598-70e4e70d931a', 'volume_size': 1, 'snapshot_id': '5d1fb417-1893-4a31-ae5f-e0033d4ffdbf'}' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:09:44.031729 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [req-abe2cea8-95db-4600-a635-a707d0f69e64 req-8237a41d-922d-47bb-93a3-9ec81fc73cc9 tempest-TestVolumeBootPattern-1320248540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de957481-706a-4395-9b37-94c00d4ced0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:09:44.045621 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.flows.manager.create_volume [req-abe2cea8-95db-4600-a635-a707d0f69e64 req-8237a41d-922d-47bb-93a3-9ec81fc73cc9 tempest-TestVolumeBootPattern-1320248540 None] Volume volume-89492b70-b22f-4bc4-b598-70e4e70d931a (89492b70-b22f-4bc4-b598-70e4e70d931a): created successfully Dec 18 21:09:44.053636 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [req-abe2cea8-95db-4600-a635-a707d0f69e64 req-8237a41d-922d-47bb-93a3-9ec81fc73cc9 tempest-TestVolumeBootPattern-1320248540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de957481-706a-4395-9b37-94c00d4ced0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:09:44.058821 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [req-abe2cea8-95db-4600-a635-a707d0f69e64 req-8237a41d-922d-47bb-93a3-9ec81fc73cc9 tempest-TestVolumeBootPattern-1320248540 None] Flow 'volume_create_manager' (c89076b1-6831-435c-a97e-e3173ce81330) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134148) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 18 21:09:44.087183 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [req-abe2cea8-95db-4600-a635-a707d0f69e64 req-8237a41d-922d-47bb-93a3-9ec81fc73cc9 tempest-TestVolumeBootPattern-1320248540 None] Created volume successfully. Dec 18 21:09:46.763398 ncdv-master-1 cinder-volume[134148]: DEBUG oslo_concurrency.processutils [req-abe2cea8-95db-4600-a635-a707d0f69e64 req-ef1235f5-b6d3-4456-9da1-4f8efa8ca94f tempest-TestVolumeBootPattern-1320248540 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=134148) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Dec 18 21:09:47.894526 ncdv-master-1 cinder-volume[134148]: DEBUG oslo_concurrency.processutils [req-abe2cea8-95db-4600-a635-a707d0f69e64 req-ef1235f5-b6d3-4456-9da1-4f8efa8ca94f tempest-TestVolumeBootPattern-1320248540 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.131s {{(pid=134148) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Dec 18 21:09:47.896287 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [req-abe2cea8-95db-4600-a635-a707d0f69e64 req-ef1235f5-b6d3-4456-9da1-4f8efa8ca94f tempest-TestVolumeBootPattern-1320248540 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-89492b70-b22f-4bc4-b598-70e4e70d931a', 'hosts': ['10.222.0.13'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '946d1715-d12c-4dbf-8a79-181222df6e2e', 'volume_id': '89492b70-b22f-4bc4-b598-70e4e70d931a', 'discard': True}} {{(pid=134148) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Dec 18 21:09:47.967370 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [req-abe2cea8-95db-4600-a635-a707d0f69e64 req-ef1235f5-b6d3-4456-9da1-4f8efa8ca94f tempest-TestVolumeBootPattern-1320248540 None] Connection info returned from driver {'name': 'volumes/volume-89492b70-b22f-4bc4-b598-70e4e70d931a', 'hosts': ['10.222.0.13'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '89492b70-b22f-4bc4-b598-70e4e70d931a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'ea5bed9e-ab69-4611-8ea8-db04cd924f48'} {{(pid=134148) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4812}} Dec 18 21:09:48.053840 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [req-abe2cea8-95db-4600-a635-a707d0f69e64 req-ef1235f5-b6d3-4456-9da1-4f8efa8ca94f tempest-TestVolumeBootPattern-1320248540 None] attachment_update completed successfully. Dec 18 21:10:02.238619 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [req-af41f371-6ee2-4dcd-8c7c-2a87f773d4c3 req-95826eaf-a5d1-447a-a771-356c8aa570fe tempest-TestVolumeBootPattern-1320248540 None] Terminate volume connection completed successfully. Dec 18 21:10:02.240008 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [req-af41f371-6ee2-4dcd-8c7c-2a87f773d4c3 req-95826eaf-a5d1-447a-a771-356c8aa570fe tempest-TestVolumeBootPattern-1320248540 None] Deleting attachment ea5bed9e-ab69-4611-8ea8-db04cd924f48. {{(pid=134148) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4948}} Dec 18 21:10:02.489870 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.coordination [req-af41f371-6ee2-4dcd-8c7c-2a87f773d4c3 req-4564a4a6-ed6e-47f1-90ff-86b6886b0f2a tempest-TestVolumeBootPattern-1320248540 None] Lock "b'cinder-89492b70-b22f-4bc4-b598-70e4e70d931a-delete_volume'" acquired by "delete_volume" :: waited 0.039s {{(pid=134148) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 18 21:10:02.594548 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [req-af41f371-6ee2-4dcd-8c7c-2a87f773d4c3 req-4564a4a6-ed6e-47f1-90ff-86b6886b0f2a tempest-TestVolumeBootPattern-1320248540 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:10:02.756758 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [req-af41f371-6ee2-4dcd-8c7c-2a87f773d4c3 req-4564a4a6-ed6e-47f1-90ff-86b6886b0f2a tempest-TestVolumeBootPattern-1320248540 None] volume has no backup snaps {{(pid=134148) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Dec 18 21:10:02.769199 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [req-af41f371-6ee2-4dcd-8c7c-2a87f773d4c3 req-4564a4a6-ed6e-47f1-90ff-86b6886b0f2a tempest-TestVolumeBootPattern-1320248540 None] deleting rbd volume volume-89492b70-b22f-4bc4-b598-70e4e70d931a {{(pid=134148) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Dec 18 21:10:03.279435 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.quota [req-af41f371-6ee2-4dcd-8c7c-2a87f773d4c3 req-4564a4a6-ed6e-47f1-90ff-86b6886b0f2a tempest-TestVolumeBootPattern-1320248540 None] Created reservations ['9986bc29-f052-4194-887b-1442c56754ed', '6a573439-bf6c-4620-bd04-bd7eba4eb69a', 'db6d11d2-ba93-4a7f-b92b-c0c43b77b7ee', '1b5cf09e-53f0-419e-9908-d77a19fef639'] {{(pid=134148) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 18 21:10:03.344427 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [req-af41f371-6ee2-4dcd-8c7c-2a87f773d4c3 req-4564a4a6-ed6e-47f1-90ff-86b6886b0f2a tempest-TestVolumeBootPattern-1320248540 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:10:03.387953 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [req-af41f371-6ee2-4dcd-8c7c-2a87f773d4c3 req-4564a4a6-ed6e-47f1-90ff-86b6886b0f2a tempest-TestVolumeBootPattern-1320248540 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:10:03.454093 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.manager [req-af41f371-6ee2-4dcd-8c7c-2a87f773d4c3 req-4564a4a6-ed6e-47f1-90ff-86b6886b0f2a tempest-TestVolumeBootPattern-1320248540 None] Notifying Schedulers of capabilities ... {{(pid=134148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 18 21:10:03.475263 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [req-af41f371-6ee2-4dcd-8c7c-2a87f773d4c3 req-4564a4a6-ed6e-47f1-90ff-86b6886b0f2a tempest-TestVolumeBootPattern-1320248540 None] Deleted volume successfully. Dec 18 21:10:03.501029 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.coordination [None req-86fd64db-5183-479f-a2e2-81674a55a294 tempest-TestVolumeBootPattern-1320248540 None] Lock "b'cinder-5d1fb417-1893-4a31-ae5f-e0033d4ffdbf-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.031s {{(pid=134148) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 18 21:10:03.504990 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-86fd64db-5183-479f-a2e2-81674a55a294 tempest-TestVolumeBootPattern-1320248540 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:10:03.655844 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.coordination [req-af41f371-6ee2-4dcd-8c7c-2a87f773d4c3 req-4564a4a6-ed6e-47f1-90ff-86b6886b0f2a tempest-TestVolumeBootPattern-1320248540 None] Lock "b'cinder-89492b70-b22f-4bc4-b598-70e4e70d931a-delete_volume'" released by "delete_volume" :: held 1.168s {{(pid=134148) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 18 21:10:11.491918 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [req-6ae61526-ed3f-40a8-9bb9-00c43a48abcb req-26bf3b87-df06-4e5e-b93c-4a1bde84ab02 tempest-TaggedBootDevicesTest_v242-1367484865 None] Terminate volume connection completed successfully. Dec 18 21:10:11.493692 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [req-6ae61526-ed3f-40a8-9bb9-00c43a48abcb req-26bf3b87-df06-4e5e-b93c-4a1bde84ab02 tempest-TaggedBootDevicesTest_v242-1367484865 None] Deleting attachment c3e22986-07b0-4fe3-a93d-560839571b22. {{(pid=134148) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4948}} Dec 18 21:10:11.644229 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [req-6ae61526-ed3f-40a8-9bb9-00c43a48abcb req-ac807d3a-dddf-49ad-aa18-453089c01474 tempest-TaggedBootDevicesTest_v242-1367484865 None] Terminate volume connection completed successfully. Dec 18 21:10:11.644881 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [req-6ae61526-ed3f-40a8-9bb9-00c43a48abcb req-ac807d3a-dddf-49ad-aa18-453089c01474 tempest-TaggedBootDevicesTest_v242-1367484865 None] Deleting attachment 3cc31b6d-15fd-4d7c-a391-8c601e56e4a8. {{(pid=134148) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4948}} Dec 18 21:10:11.822086 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [req-6ae61526-ed3f-40a8-9bb9-00c43a48abcb req-c376847a-306e-48f3-b434-05f3010c8743 tempest-TaggedBootDevicesTest_v242-1367484865 None] Terminate volume connection completed successfully. Dec 18 21:10:11.822086 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [req-6ae61526-ed3f-40a8-9bb9-00c43a48abcb req-c376847a-306e-48f3-b434-05f3010c8743 tempest-TaggedBootDevicesTest_v242-1367484865 None] Deleting attachment 8a141446-e1a8-4dc4-b8b5-26bfcd8eb51a. {{(pid=134148) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4948}} Dec 18 21:10:20.613868 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.flows.manager.create_volume [None req-01e3cf6a-a686-44a0-83a7-4f6430476074 tempest-TestVolumeBackupRestore-2104047399 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134148) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Dec 18 21:10:20.627434 ncdv-master-1 cinder-volume[134148]: WARNING stevedore.named [None req-01e3cf6a-a686-44a0-83a7-4f6430476074 tempest-TestVolumeBackupRestore-2104047399 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Dec 18 21:10:20.630344 ncdv-master-1 cinder-volume[134148]: WARNING castellan.key_manager [None req-01e3cf6a-a686-44a0-83a7-4f6430476074 tempest-TestVolumeBackupRestore-2104047399 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Dec 18 21:10:20.662161 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-01e3cf6a-a686-44a0-83a7-4f6430476074 tempest-TestVolumeBackupRestore-2104047399 None] Flow 'volume_create_manager' (004e37ec-9f8a-4b9f-aa7b-edc59a6b1f61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 18 21:10:20.666755 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-01e3cf6a-a686-44a0-83a7-4f6430476074 tempest-TestVolumeBackupRestore-2104047399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c84fc5bd-2956-40f0-bf92-7fd518f4f6da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:10:20.675410 ncdv-master-1 cinder-volume[134148]: DEBUG oslo_db.sqlalchemy.engines [None req-01e3cf6a-a686-44a0-83a7-4f6430476074 tempest-TestVolumeBackupRestore-2104047399 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134148) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 18 21:10:20.710793 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-01e3cf6a-a686-44a0-83a7-4f6430476074 tempest-TestVolumeBackupRestore-2104047399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c84fc5bd-2956-40f0-bf92-7fd518f4f6da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-12-18T21:10:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeBackupRestore-volume-427904944',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=cd3e50ad-c2c4-48eb-9560-8a0740a6943e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62fd960aee2d408d8c9977b60fcabd61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-12-18T21:10:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-12-18T21:10:21Z,use_quota=True,user_id='0a9b1c58215046afb6974d9a4b654326',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f2e1fe1-9fd6-411e-9ed9-368f463ccb6f),volume_type_id=1f2e1fe1-9fd6-411e-9ed9-368f463ccb6f)' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:10:20.714161 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-01e3cf6a-a686-44a0-83a7-4f6430476074 tempest-TestVolumeBackupRestore-2104047399 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0087e7e-a473-44eb-9479-de5b0a5ec55f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:10:20.719118 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-01e3cf6a-a686-44a0-83a7-4f6430476074 tempest-TestVolumeBackupRestore-2104047399 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0087e7e-a473-44eb-9479-de5b0a5ec55f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:10:20.722659 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-01e3cf6a-a686-44a0-83a7-4f6430476074 tempest-TestVolumeBackupRestore-2104047399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a28b8c13-5f7a-4fef-96bc-e404a71aab63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:10:20.747554 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.coordination [None req-8e78f25f-0c0f-4d04-9fc1-96390839ea90 tempest-TaggedBootDevicesTest_v242-1367484865 None] Lock "b'cinder-ef3e7ab0-e225-41eb-80c8-31e494531508-delete_volume'" acquired by "delete_volume" :: waited 0.014s {{(pid=134148) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 18 21:10:20.854188 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-8e78f25f-0c0f-4d04-9fc1-96390839ea90 tempest-TaggedBootDevicesTest_v242-1367484865 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:10:20.959307 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-8e78f25f-0c0f-4d04-9fc1-96390839ea90 tempest-TaggedBootDevicesTest_v242-1367484865 None] volume has no backup snaps {{(pid=134148) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Dec 18 21:10:20.960533 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-8e78f25f-0c0f-4d04-9fc1-96390839ea90 tempest-TaggedBootDevicesTest_v242-1367484865 None] Volume volume-ef3e7ab0-e225-41eb-80c8-31e494531508 is not a clone. {{(pid=134148) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Dec 18 21:10:20.970120 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-8e78f25f-0c0f-4d04-9fc1-96390839ea90 tempest-TaggedBootDevicesTest_v242-1367484865 None] deleting rbd volume volume-ef3e7ab0-e225-41eb-80c8-31e494531508 {{(pid=134148) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Dec 18 21:10:20.975969 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-01e3cf6a-a686-44a0-83a7-4f6430476074 tempest-TestVolumeBackupRestore-2104047399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a28b8c13-5f7a-4fef-96bc-e404a71aab63) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'cd3e50ad-c2c4-48eb-9560-8a0740a6943e', 'volume_name': 'volume-cd3e50ad-c2c4-48eb-9560-8a0740a6943e', 'volume_size': 1, 'image_id': '394b3891-80f2-44c9-a9aa-56fe23a5acb3', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b04c3d19c79d4c208395e97f9d293618', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '394b3891-80f2-44c9-a9aa-56fe23a5acb3', 'created_at': datetime.datetime(2021, 12, 18, 20, 38, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 12, 18, 20, 38, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/394b3891-80f2-44c9-a9aa-56fe23a5acb3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:10:20.979248 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-01e3cf6a-a686-44a0-83a7-4f6430476074 tempest-TestVolumeBackupRestore-2104047399 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (acb946c9-87e2-421c-b12f-202901dcba41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:10:20.983879 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-01e3cf6a-a686-44a0-83a7-4f6430476074 tempest-TestVolumeBackupRestore-2104047399 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (acb946c9-87e2-421c-b12f-202901dcba41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:10:20.986491 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-01e3cf6a-a686-44a0-83a7-4f6430476074 tempest-TestVolumeBackupRestore-2104047399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03b4b8e7-3b58-456b-903e-d762bcb2944f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:10:20.987793 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.flows.manager.create_volume [None req-01e3cf6a-a686-44a0-83a7-4f6430476074 tempest-TestVolumeBackupRestore-2104047399 None] Volume cd3e50ad-c2c4-48eb-9560-8a0740a6943e: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-cd3e50ad-c2c4-48eb-9560-8a0740a6943e', 'volume_size': 1, 'image_id': '394b3891-80f2-44c9-a9aa-56fe23a5acb3', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b04c3d19c79d4c208395e97f9d293618', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '394b3891-80f2-44c9-a9aa-56fe23a5acb3', 'created_at': datetime.datetime(2021, 12, 18, 20, 38, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 12, 18, 20, 38, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/394b3891-80f2-44c9-a9aa-56fe23a5acb3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Dec 18 21:10:20.988890 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.flows.manager.create_volume [None req-01e3cf6a-a686-44a0-83a7-4f6430476074 tempest-TestVolumeBackupRestore-2104047399 None] Cloning cd3e50ad-c2c4-48eb-9560-8a0740a6943e from image 394b3891-80f2-44c9-a9aa-56fe23a5acb3 at location (None, None). {{(pid=134148) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1047}} Dec 18 21:10:21.000890 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.coordination [None req-01e3cf6a-a686-44a0-83a7-4f6430476074 tempest-TestVolumeBackupRestore-2104047399 None] Lock "b'cinder-394b3891-80f2-44c9-a9aa-56fe23a5acb3'" acquired by "_prepare_image_cache_entry" :: waited 0.011s {{(pid=134148) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 18 21:10:21.014551 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.image.cache [None req-01e3cf6a-a686-44a0-83a7-4f6430476074 tempest-TestVolumeBackupRestore-2104047399 None] Found image-volume cache entry: {'id': 1, 'image_id': '394b3891-80f2-44c9-a9aa-56fe23a5acb3', 'volume_id': 'e6411a45-48fa-4beb-a5a0-eb6a6ca3f525', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2021, 12, 18, 20, 38, 21), 'last_used': datetime.datetime(2021, 12, 18, 21, 10, 21, 7350)}. {{(pid=134148) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Dec 18 21:10:21.015690 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.image.cache [None req-01e3cf6a-a686-44a0-83a7-4f6430476074 tempest-TestVolumeBackupRestore-2104047399 None] Image-volume cache entry image_update_at = 2021-12-18 20:38:21+00:00, requested image updated_at = 2021-12-18 20:38:21+00:00. {{(pid=134148) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Dec 18 21:10:21.016375 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.flows.manager.create_volume [None req-01e3cf6a-a686-44a0-83a7-4f6430476074 tempest-TestVolumeBackupRestore-2104047399 None] Found cache entry for image = 394b3891-80f2-44c9-a9aa-56fe23a5acb3 on host ncdv-master-1@ceph#ceph. {{(pid=134148) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:870}} Dec 18 21:10:21.023882 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.coordination [None req-01e3cf6a-a686-44a0-83a7-4f6430476074 tempest-TestVolumeBackupRestore-2104047399 None] Lock "b'cinder-394b3891-80f2-44c9-a9aa-56fe23a5acb3'" released by "_prepare_image_cache_entry" :: held 0.021s {{(pid=134148) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 18 21:10:21.025235 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.flows.manager.create_volume [None req-01e3cf6a-a686-44a0-83a7-4f6430476074 tempest-TestVolumeBackupRestore-2104047399 None] Attempting to retrieve cache entry for image = 394b3891-80f2-44c9-a9aa-56fe23a5acb3 on host ncdv-master-1@ceph#ceph. {{(pid=134148) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:811}} Dec 18 21:10:21.033907 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.image.cache [None req-01e3cf6a-a686-44a0-83a7-4f6430476074 tempest-TestVolumeBackupRestore-2104047399 None] Found image-volume cache entry: {'id': 1, 'image_id': '394b3891-80f2-44c9-a9aa-56fe23a5acb3', 'volume_id': 'e6411a45-48fa-4beb-a5a0-eb6a6ca3f525', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2021, 12, 18, 20, 38, 21), 'last_used': datetime.datetime(2021, 12, 18, 21, 10, 21, 30917)}. {{(pid=134148) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Dec 18 21:10:21.035558 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.image.cache [None req-01e3cf6a-a686-44a0-83a7-4f6430476074 tempest-TestVolumeBackupRestore-2104047399 None] Image-volume cache entry image_update_at = 2021-12-18 20:38:21+00:00, requested image updated_at = 2021-12-18 20:38:21+00:00. {{(pid=134148) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Dec 18 21:10:21.036678 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.flows.manager.create_volume [None req-01e3cf6a-a686-44a0-83a7-4f6430476074 tempest-TestVolumeBackupRestore-2104047399 None] Creating from source image-volume e6411a45-48fa-4beb-a5a0-eb6a6ca3f525 {{(pid=134148) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:825}} Dec 18 21:10:21.059066 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-01e3cf6a-a686-44a0-83a7-4f6430476074 tempest-TestVolumeBackupRestore-2104047399 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:10:21.167274 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-01e3cf6a-a686-44a0-83a7-4f6430476074 tempest-TestVolumeBackupRestore-2104047399 None] creating snapshot='volume-cd3e50ad-c2c4-48eb-9560-8a0740a6943e.clone_snap' {{(pid=134148) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:725}} Dec 18 21:10:22.306051 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-01e3cf6a-a686-44a0-83a7-4f6430476074 tempest-TestVolumeBackupRestore-2104047399 None] cloning 'volume-e6411a45-48fa-4beb-a5a0-eb6a6ca3f525@volume-cd3e50ad-c2c4-48eb-9560-8a0740a6943e.clone_snap' to 'volume-cd3e50ad-c2c4-48eb-9560-8a0740a6943e' {{(pid=134148) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:731}} Dec 18 21:10:22.427211 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.quota [None req-8e78f25f-0c0f-4d04-9fc1-96390839ea90 tempest-TaggedBootDevicesTest_v242-1367484865 None] Created reservations ['6887f9bb-be99-4c7c-9dde-43042af0d9fe', '6fa69ac1-15ed-456a-ae42-ca59f691a26f', '2bddbef5-817d-4582-84fa-ffd910a664f9', '6858bef5-8e5c-4eec-9fd4-cc05a08b1f38'] {{(pid=134148) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 18 21:10:22.513661 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-8e78f25f-0c0f-4d04-9fc1-96390839ea90 tempest-TaggedBootDevicesTest_v242-1367484865 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:10:22.592069 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-8e78f25f-0c0f-4d04-9fc1-96390839ea90 tempest-TaggedBootDevicesTest_v242-1367484865 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:10:22.644262 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.manager [None req-8e78f25f-0c0f-4d04-9fc1-96390839ea90 tempest-TaggedBootDevicesTest_v242-1367484865 None] Notifying Schedulers of capabilities ... {{(pid=134148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 18 21:10:22.652216 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-8e78f25f-0c0f-4d04-9fc1-96390839ea90 tempest-TaggedBootDevicesTest_v242-1367484865 None] Deleted volume successfully. Dec 18 21:10:22.734464 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-01e3cf6a-a686-44a0-83a7-4f6430476074 tempest-TestVolumeBackupRestore-2104047399 None] Volume volume-9f5f7417-3abc-4462-988f-ef519750d753.deleted is not a clone. {{(pid=134148) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Dec 18 21:10:22.736078 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-01e3cf6a-a686-44a0-83a7-4f6430476074 tempest-TestVolumeBackupRestore-2104047399 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134148) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 18 21:10:22.736718 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-01e3cf6a-a686-44a0-83a7-4f6430476074 tempest-TestVolumeBackupRestore-2104047399 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134148) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 18 21:10:22.783382 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-01e3cf6a-a686-44a0-83a7-4f6430476074 tempest-TestVolumeBackupRestore-2104047399 None] clone created successfully {{(pid=134148) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:803}} Dec 18 21:10:22.784438 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.volume_utils [None req-01e3cf6a-a686-44a0-83a7-4f6430476074 tempest-TestVolumeBackupRestore-2104047399 None] Marking volume cd3e50ad-c2c4-48eb-9560-8a0740a6943e as bootable. {{(pid=134148) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1178}} Dec 18 21:10:22.809710 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.coordination [None req-8e78f25f-0c0f-4d04-9fc1-96390839ea90 tempest-TaggedBootDevicesTest_v242-1367484865 None] Lock "b'cinder-ef3e7ab0-e225-41eb-80c8-31e494531508-delete_volume'" released by "delete_volume" :: held 2.062s {{(pid=134148) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 18 21:10:22.815437 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.flows.manager.create_volume [None req-01e3cf6a-a686-44a0-83a7-4f6430476074 tempest-TestVolumeBackupRestore-2104047399 None] Copying metadata from image 394b3891-80f2-44c9-a9aa-56fe23a5acb3 to cd3e50ad-c2c4-48eb-9560-8a0740a6943e. {{(pid=134148) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:444}} Dec 18 21:10:22.815894 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.flows.manager.create_volume [None req-01e3cf6a-a686-44a0-83a7-4f6430476074 tempest-TestVolumeBackupRestore-2104047399 None] Creating volume glance metadata for volume cd3e50ad-c2c4-48eb-9560-8a0740a6943e backed by image 394b3891-80f2-44c9-a9aa-56fe23a5acb3 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '394b3891-80f2-44c9-a9aa-56fe23a5acb3', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=134148) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:667}} Dec 18 21:10:22.875767 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-01e3cf6a-a686-44a0-83a7-4f6430476074 tempest-TestVolumeBackupRestore-2104047399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03b4b8e7-3b58-456b-903e-d762bcb2944f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cd3e50ad-c2c4-48eb-9560-8a0740a6943e', 'volume_size': 1, 'image_id': '394b3891-80f2-44c9-a9aa-56fe23a5acb3', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b04c3d19c79d4c208395e97f9d293618', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '394b3891-80f2-44c9-a9aa-56fe23a5acb3', 'created_at': datetime.datetime(2021, 12, 18, 20, 38, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 12, 18, 20, 38, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/394b3891-80f2-44c9-a9aa-56fe23a5acb3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:10:22.877892 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-01e3cf6a-a686-44a0-83a7-4f6430476074 tempest-TestVolumeBackupRestore-2104047399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75b0eada-a863-4645-aeb9-178abcc0bcaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:10:22.895666 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.flows.manager.create_volume [None req-01e3cf6a-a686-44a0-83a7-4f6430476074 tempest-TestVolumeBackupRestore-2104047399 None] Volume volume-cd3e50ad-c2c4-48eb-9560-8a0740a6943e (cd3e50ad-c2c4-48eb-9560-8a0740a6943e): created successfully Dec 18 21:10:22.900293 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-01e3cf6a-a686-44a0-83a7-4f6430476074 tempest-TestVolumeBackupRestore-2104047399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75b0eada-a863-4645-aeb9-178abcc0bcaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:10:22.904737 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-01e3cf6a-a686-44a0-83a7-4f6430476074 tempest-TestVolumeBackupRestore-2104047399 None] Flow 'volume_create_manager' (004e37ec-9f8a-4b9f-aa7b-edc59a6b1f61) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134148) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 18 21:10:22.915578 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-01e3cf6a-a686-44a0-83a7-4f6430476074 tempest-TestVolumeBackupRestore-2104047399 None] Created volume successfully. Dec 18 21:10:22.983034 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.coordination [None req-31f78652-1ebb-4e54-9ef9-391a3a56cf29 tempest-TaggedBootDevicesTest_v242-1367484865 None] Lock "b'cinder-1ea7630c-e820-4aaa-bc7b-d24a0a7e0bab-delete_volume'" acquired by "delete_volume" :: waited 0.011s {{(pid=134148) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 18 21:10:23.024256 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-31f78652-1ebb-4e54-9ef9-391a3a56cf29 tempest-TaggedBootDevicesTest_v242-1367484865 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:10:23.069634 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-31f78652-1ebb-4e54-9ef9-391a3a56cf29 tempest-TaggedBootDevicesTest_v242-1367484865 None] volume has no backup snaps {{(pid=134148) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Dec 18 21:10:23.069965 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-31f78652-1ebb-4e54-9ef9-391a3a56cf29 tempest-TaggedBootDevicesTest_v242-1367484865 None] Volume volume-1ea7630c-e820-4aaa-bc7b-d24a0a7e0bab is not a clone. {{(pid=134148) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Dec 18 21:10:23.077113 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-31f78652-1ebb-4e54-9ef9-391a3a56cf29 tempest-TaggedBootDevicesTest_v242-1367484865 None] deleting rbd volume volume-1ea7630c-e820-4aaa-bc7b-d24a0a7e0bab {{(pid=134148) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Dec 18 21:10:23.406660 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.quota [None req-31f78652-1ebb-4e54-9ef9-391a3a56cf29 tempest-TaggedBootDevicesTest_v242-1367484865 None] Created reservations ['8622052a-469b-4d4b-9d7a-7bbd492670d0', '0cd81c20-a7f7-43fa-a62f-075684b45713', '3e177385-0e53-42bc-9e64-f00105abb80f', '71aeab61-33d4-4bba-ba6c-2cef76158997'] {{(pid=134148) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 18 21:10:23.457902 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-31f78652-1ebb-4e54-9ef9-391a3a56cf29 tempest-TaggedBootDevicesTest_v242-1367484865 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:10:23.488252 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-31f78652-1ebb-4e54-9ef9-391a3a56cf29 tempest-TaggedBootDevicesTest_v242-1367484865 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:10:23.530646 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.manager [None req-31f78652-1ebb-4e54-9ef9-391a3a56cf29 tempest-TaggedBootDevicesTest_v242-1367484865 None] Notifying Schedulers of capabilities ... {{(pid=134148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 18 21:10:23.535353 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-31f78652-1ebb-4e54-9ef9-391a3a56cf29 tempest-TaggedBootDevicesTest_v242-1367484865 None] Deleted volume successfully. Dec 18 21:10:23.549244 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.coordination [None req-31f78652-1ebb-4e54-9ef9-391a3a56cf29 tempest-TaggedBootDevicesTest_v242-1367484865 None] Lock "b'cinder-1ea7630c-e820-4aaa-bc7b-d24a0a7e0bab-delete_volume'" released by "delete_volume" :: held 0.566s {{(pid=134148) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 18 21:10:24.148467 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.coordination [None req-9c74f894-2d52-4421-8562-db5457b41909 tempest-TaggedBootDevicesTest_v242-1367484865 None] Lock "b'cinder-8f6e05d6-463a-4bb2-82e3-f0b21a816f31-delete_volume'" acquired by "delete_volume" :: waited 0.015s {{(pid=134148) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 18 21:10:24.197756 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-9c74f894-2d52-4421-8562-db5457b41909 tempest-TaggedBootDevicesTest_v242-1367484865 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:10:24.283225 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-9c74f894-2d52-4421-8562-db5457b41909 tempest-TaggedBootDevicesTest_v242-1367484865 None] volume has no backup snaps {{(pid=134148) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Dec 18 21:10:24.295037 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-9c74f894-2d52-4421-8562-db5457b41909 tempest-TaggedBootDevicesTest_v242-1367484865 None] deleting rbd volume volume-8f6e05d6-463a-4bb2-82e3-f0b21a816f31 {{(pid=134148) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Dec 18 21:10:24.323688 ncdv-master-1 cinder-volume[134148]: DEBUG oslo_concurrency.processutils [None req-ad7315d4-d074-4b41-95b5-5736f112a752 tempest-TestVolumeBackupRestore-2104047399 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=134148) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Dec 18 21:10:24.685902 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-9c74f894-2d52-4421-8562-db5457b41909 tempest-TaggedBootDevicesTest_v242-1367484865 None] volume is a clone so cleaning references {{(pid=134148) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1266}} Dec 18 21:10:24.730672 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-9c74f894-2d52-4421-8562-db5457b41909 tempest-TaggedBootDevicesTest_v242-1367484865 None] deleting parent snapshot volume-8f6e05d6-463a-4bb2-82e3-f0b21a816f31.clone_snap {{(pid=134148) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1158}} Dec 18 21:10:25.319446 ncdv-master-1 cinder-volume[134148]: DEBUG oslo_concurrency.processutils [None req-ad7315d4-d074-4b41-95b5-5736f112a752 tempest-TestVolumeBackupRestore-2104047399 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.996s {{(pid=134148) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Dec 18 21:10:25.320148 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-ad7315d4-d074-4b41-95b5-5736f112a752 tempest-TestVolumeBackupRestore-2104047399 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-cd3e50ad-c2c4-48eb-9560-8a0740a6943e', 'hosts': ['10.222.0.13'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '946d1715-d12c-4dbf-8a79-181222df6e2e', 'volume_id': 'cd3e50ad-c2c4-48eb-9560-8a0740a6943e', 'discard': True}} {{(pid=134148) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Dec 18 21:10:25.344768 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-ad7315d4-d074-4b41-95b5-5736f112a752 tempest-TestVolumeBackupRestore-2104047399 None] Initialize volume connection completed successfully. Dec 18 21:10:25.370237 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.quota [None req-9c74f894-2d52-4421-8562-db5457b41909 tempest-TaggedBootDevicesTest_v242-1367484865 None] Created reservations ['aa2caabb-2778-42fe-bc12-14d938f6f80e', 'ecb031e6-c251-47d4-a7ef-2ba3f1e69089', '7df89442-93ff-42dd-9c49-8448fc1f5b64', '6518706d-393d-4852-91c4-d5ff232ce76c'] {{(pid=134148) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 18 21:10:25.421771 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-9c74f894-2d52-4421-8562-db5457b41909 tempest-TaggedBootDevicesTest_v242-1367484865 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:10:25.461532 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-9c74f894-2d52-4421-8562-db5457b41909 tempest-TaggedBootDevicesTest_v242-1367484865 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:10:25.490689 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.manager [None req-9c74f894-2d52-4421-8562-db5457b41909 tempest-TaggedBootDevicesTest_v242-1367484865 None] Notifying Schedulers of capabilities ... {{(pid=134148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 18 21:10:25.496744 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-9c74f894-2d52-4421-8562-db5457b41909 tempest-TaggedBootDevicesTest_v242-1367484865 None] Deleted volume successfully. Dec 18 21:10:25.512518 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.coordination [None req-9c74f894-2d52-4421-8562-db5457b41909 tempest-TaggedBootDevicesTest_v242-1367484865 None] Lock "b'cinder-8f6e05d6-463a-4bb2-82e3-f0b21a816f31-delete_volume'" released by "delete_volume" :: held 1.364s {{(pid=134148) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 18 21:10:33.809176 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.quota [None req-86fd64db-5183-479f-a2e2-81674a55a294 tempest-TestVolumeBootPattern-1320248540 None] Created reservations ['0070afff-07d0-47ea-af16-a89e43f28988', '16b91ab7-f01e-4783-b65b-a3d62180db3f', 'a59f8ffd-b2fe-4067-8d4c-f5108ae291ab', '0eb307c4-b0be-43cd-ac8c-dfc78827a750'] {{(pid=134148) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 18 21:10:33.835427 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-ad7315d4-d074-4b41-95b5-5736f112a752 tempest-TestVolumeBackupRestore-2104047399 None] Terminate volume connection completed successfully. Dec 18 21:10:33.856294 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-ad7315d4-d074-4b41-95b5-5736f112a752 tempest-TestVolumeBackupRestore-2104047399 None] Remove volume export completed successfully. Dec 18 21:10:33.895554 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-86fd64db-5183-479f-a2e2-81674a55a294 tempest-TestVolumeBootPattern-1320248540 None] Delete snapshot completed successfully. Dec 18 21:10:33.902130 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.coordination [None req-86fd64db-5183-479f-a2e2-81674a55a294 tempest-TestVolumeBootPattern-1320248540 None] Lock "b'cinder-5d1fb417-1893-4a31-ae5f-e0033d4ffdbf-delete_snapshot'" released by "delete_snapshot" :: held 30.401s {{(pid=134148) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 18 21:10:34.344102 ncdv-master-1 cinder-volume[134148]: DEBUG oslo_service.periodic_task [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134148) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Dec 18 21:10:34.345204 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:10:34.422691 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:10:34.483336 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.manager [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] Notifying Schedulers of capabilities ... {{(pid=134148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 18 21:10:34.822621 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.flows.manager.create_volume [None req-8511de16-14d3-4188-879c-a69f4bc96b8c tempest-TestVolumeBackupRestore-2104047399 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134148) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Dec 18 21:10:34.828354 ncdv-master-1 cinder-volume[134148]: WARNING stevedore.named [None req-8511de16-14d3-4188-879c-a69f4bc96b8c tempest-TestVolumeBackupRestore-2104047399 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Dec 18 21:10:34.829120 ncdv-master-1 cinder-volume[134148]: WARNING castellan.key_manager [None req-8511de16-14d3-4188-879c-a69f4bc96b8c tempest-TestVolumeBackupRestore-2104047399 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Dec 18 21:10:34.844831 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-8511de16-14d3-4188-879c-a69f4bc96b8c tempest-TestVolumeBackupRestore-2104047399 None] Flow 'volume_create_manager' (e3e3e244-1774-4412-b1ca-428de794eeec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 18 21:10:34.848702 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-8511de16-14d3-4188-879c-a69f4bc96b8c tempest-TestVolumeBackupRestore-2104047399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8607497-2ac4-438e-8bc9-425589f051cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:10:34.856069 ncdv-master-1 cinder-volume[134148]: DEBUG oslo_db.sqlalchemy.engines [None req-8511de16-14d3-4188-879c-a69f4bc96b8c tempest-TestVolumeBackupRestore-2104047399 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134148) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 18 21:10:34.871089 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-8511de16-14d3-4188-879c-a69f4bc96b8c tempest-TestVolumeBackupRestore-2104047399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8607497-2ac4-438e-8bc9-425589f051cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-12-18T21:10:35Z,deleted=False,deleted_at=None,display_description='auto-created_from_restore_from_backup',display_name='restore_backup_017a133b-0b87-4753-be0e-99e8ef4fe027',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=4d1a0629-0c83-4586-abdd-6a090066b332,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62fd960aee2d408d8c9977b60fcabd61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-12-18T21:10:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-12-18T21:10:35Z,use_quota=True,user_id='0a9b1c58215046afb6974d9a4b654326',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f2e1fe1-9fd6-411e-9ed9-368f463ccb6f),volume_type_id=1f2e1fe1-9fd6-411e-9ed9-368f463ccb6f)' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:10:34.874211 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-8511de16-14d3-4188-879c-a69f4bc96b8c tempest-TestVolumeBackupRestore-2104047399 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43cd2051-d396-4d2c-9115-09b04e2faa98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:10:34.876936 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-8511de16-14d3-4188-879c-a69f4bc96b8c tempest-TestVolumeBackupRestore-2104047399 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43cd2051-d396-4d2c-9115-09b04e2faa98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:10:34.879976 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-8511de16-14d3-4188-879c-a69f4bc96b8c tempest-TestVolumeBackupRestore-2104047399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (456bec32-5373-4b60-8af1-dd1e86516423) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:10:34.883087 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-8511de16-14d3-4188-879c-a69f4bc96b8c tempest-TestVolumeBackupRestore-2104047399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (456bec32-5373-4b60-8af1-dd1e86516423) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4d1a0629-0c83-4586-abdd-6a090066b332', 'volume_name': 'volume-4d1a0629-0c83-4586-abdd-6a090066b332', 'volume_size': 1}' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:10:34.885511 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-8511de16-14d3-4188-879c-a69f4bc96b8c tempest-TestVolumeBackupRestore-2104047399 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7d3e74f-b904-4bae-89d2-5bd8dae716c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:10:34.887958 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-8511de16-14d3-4188-879c-a69f4bc96b8c tempest-TestVolumeBackupRestore-2104047399 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7d3e74f-b904-4bae-89d2-5bd8dae716c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:10:34.890722 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-8511de16-14d3-4188-879c-a69f4bc96b8c tempest-TestVolumeBackupRestore-2104047399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e762c8b-91b8-4c33-8181-a4a94f97fa51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:10:34.891850 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.flows.manager.create_volume [None req-8511de16-14d3-4188-879c-a69f4bc96b8c tempest-TestVolumeBackupRestore-2104047399 None] Volume 4d1a0629-0c83-4586-abdd-6a090066b332: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4d1a0629-0c83-4586-abdd-6a090066b332', 'volume_size': 1} Dec 18 21:10:34.892388 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-8511de16-14d3-4188-879c-a69f4bc96b8c tempest-TestVolumeBackupRestore-2104047399 None] creating volume 'volume-4d1a0629-0c83-4586-abdd-6a090066b332' {{(pid=134148) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Dec 18 21:10:34.893591 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-8511de16-14d3-4188-879c-a69f4bc96b8c tempest-TestVolumeBackupRestore-2104047399 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:10:34.975118 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-8511de16-14d3-4188-879c-a69f4bc96b8c tempest-TestVolumeBackupRestore-2104047399 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134148) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 18 21:10:34.975512 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-8511de16-14d3-4188-879c-a69f4bc96b8c tempest-TestVolumeBackupRestore-2104047399 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134148) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 18 21:10:34.977676 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-8511de16-14d3-4188-879c-a69f4bc96b8c tempest-TestVolumeBackupRestore-2104047399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e762c8b-91b8-4c33-8181-a4a94f97fa51) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4d1a0629-0c83-4586-abdd-6a090066b332', 'volume_size': 1}' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:10:34.980570 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-8511de16-14d3-4188-879c-a69f4bc96b8c tempest-TestVolumeBackupRestore-2104047399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc3e1b78-b2b1-48f2-8d5f-48535a868a4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:10:34.989472 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.flows.manager.create_volume [None req-8511de16-14d3-4188-879c-a69f4bc96b8c tempest-TestVolumeBackupRestore-2104047399 None] Volume volume-4d1a0629-0c83-4586-abdd-6a090066b332 (4d1a0629-0c83-4586-abdd-6a090066b332): created successfully Dec 18 21:10:34.992536 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-8511de16-14d3-4188-879c-a69f4bc96b8c tempest-TestVolumeBackupRestore-2104047399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc3e1b78-b2b1-48f2-8d5f-48535a868a4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:10:34.995880 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-8511de16-14d3-4188-879c-a69f4bc96b8c tempest-TestVolumeBackupRestore-2104047399 None] Flow 'volume_create_manager' (e3e3e244-1774-4412-b1ca-428de794eeec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134148) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 18 21:10:35.004387 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-8511de16-14d3-4188-879c-a69f4bc96b8c tempest-TestVolumeBackupRestore-2104047399 None] Created volume successfully. Dec 18 21:10:35.890694 ncdv-master-1 cinder-volume[134148]: DEBUG oslo_concurrency.processutils [None req-8511de16-14d3-4188-879c-a69f4bc96b8c tempest-TestVolumeBackupRestore-2104047399 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=134148) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Dec 18 21:10:36.640081 ncdv-master-1 cinder-volume[134148]: DEBUG oslo_concurrency.processutils [None req-8511de16-14d3-4188-879c-a69f4bc96b8c tempest-TestVolumeBackupRestore-2104047399 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.749s {{(pid=134148) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Dec 18 21:10:36.640879 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-8511de16-14d3-4188-879c-a69f4bc96b8c tempest-TestVolumeBackupRestore-2104047399 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-4d1a0629-0c83-4586-abdd-6a090066b332', 'hosts': ['10.222.0.13'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '946d1715-d12c-4dbf-8a79-181222df6e2e', 'volume_id': '4d1a0629-0c83-4586-abdd-6a090066b332', 'discard': True}} {{(pid=134148) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Dec 18 21:10:36.656336 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-8511de16-14d3-4188-879c-a69f4bc96b8c tempest-TestVolumeBackupRestore-2104047399 None] Initialize volume connection completed successfully. Dec 18 21:10:37.895610 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [req-f2d5e601-9552-4568-bf69-5e27bad59f47 req-b492240f-32ac-4183-ba8f-d8f4036044d6 tempest-TestVolumeBootPattern-1320248540 None] Terminate volume connection completed successfully. Dec 18 21:10:37.904331 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [req-f2d5e601-9552-4568-bf69-5e27bad59f47 req-b492240f-32ac-4183-ba8f-d8f4036044d6 tempest-TestVolumeBootPattern-1320248540 None] Deleting attachment c060c776-fd9f-4186-9e34-830cb914db8b. {{(pid=134148) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4948}} Dec 18 21:10:38.139992 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.coordination [req-f2d5e601-9552-4568-bf69-5e27bad59f47 req-99633b38-6b23-4ace-84ec-ada814b3af48 tempest-TestVolumeBootPattern-1320248540 None] Lock "b'cinder-02e23047-aecc-4a47-abf5-3b74dfa2dc23-delete_volume'" acquired by "delete_volume" :: waited 0.017s {{(pid=134148) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 18 21:10:38.229324 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [req-f2d5e601-9552-4568-bf69-5e27bad59f47 req-99633b38-6b23-4ace-84ec-ada814b3af48 tempest-TestVolumeBootPattern-1320248540 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:10:38.419208 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [req-f2d5e601-9552-4568-bf69-5e27bad59f47 req-99633b38-6b23-4ace-84ec-ada814b3af48 tempest-TestVolumeBootPattern-1320248540 None] volume has no backup snaps {{(pid=134148) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Dec 18 21:10:38.448991 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [req-f2d5e601-9552-4568-bf69-5e27bad59f47 req-99633b38-6b23-4ace-84ec-ada814b3af48 tempest-TestVolumeBootPattern-1320248540 None] deleting rbd volume volume-02e23047-aecc-4a47-abf5-3b74dfa2dc23 {{(pid=134148) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Dec 18 21:10:39.739340 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [req-f2d5e601-9552-4568-bf69-5e27bad59f47 req-99633b38-6b23-4ace-84ec-ada814b3af48 tempest-TestVolumeBootPattern-1320248540 None] volume is a clone so cleaning references {{(pid=134148) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1266}} Dec 18 21:10:39.821699 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [req-f2d5e601-9552-4568-bf69-5e27bad59f47 req-99633b38-6b23-4ace-84ec-ada814b3af48 tempest-TestVolumeBootPattern-1320248540 None] deleting parent snapshot volume-02e23047-aecc-4a47-abf5-3b74dfa2dc23.clone_snap {{(pid=134148) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1158}} Dec 18 21:10:40.846448 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.quota [req-f2d5e601-9552-4568-bf69-5e27bad59f47 req-99633b38-6b23-4ace-84ec-ada814b3af48 tempest-TestVolumeBootPattern-1320248540 None] Created reservations ['bf59c518-55ce-424e-8902-05c71fa6f7cc', '5664cc71-cc72-4659-a663-9194babdb769', '4f317dbb-b5d3-4019-bbb2-8941a3234b12', '869d952c-3c79-4023-adbd-fe05dc1f7d08'] {{(pid=134148) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 18 21:10:40.889973 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [req-f2d5e601-9552-4568-bf69-5e27bad59f47 req-99633b38-6b23-4ace-84ec-ada814b3af48 tempest-TestVolumeBootPattern-1320248540 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:10:40.914160 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [req-f2d5e601-9552-4568-bf69-5e27bad59f47 req-99633b38-6b23-4ace-84ec-ada814b3af48 tempest-TestVolumeBootPattern-1320248540 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:10:40.940607 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.manager [req-f2d5e601-9552-4568-bf69-5e27bad59f47 req-99633b38-6b23-4ace-84ec-ada814b3af48 tempest-TestVolumeBootPattern-1320248540 None] Notifying Schedulers of capabilities ... {{(pid=134148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 18 21:10:40.946855 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [req-f2d5e601-9552-4568-bf69-5e27bad59f47 req-99633b38-6b23-4ace-84ec-ada814b3af48 tempest-TestVolumeBootPattern-1320248540 None] Deleted volume successfully. Dec 18 21:10:40.958968 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.coordination [req-f2d5e601-9552-4568-bf69-5e27bad59f47 req-99633b38-6b23-4ace-84ec-ada814b3af48 tempest-TestVolumeBootPattern-1320248540 None] Lock "b'cinder-02e23047-aecc-4a47-abf5-3b74dfa2dc23-delete_volume'" released by "delete_volume" :: held 2.819s {{(pid=134148) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 18 21:10:42.266165 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-8511de16-14d3-4188-879c-a69f4bc96b8c tempest-TestVolumeBackupRestore-2104047399 None] Terminate volume connection completed successfully. Dec 18 21:10:42.294121 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-8511de16-14d3-4188-879c-a69f4bc96b8c tempest-TestVolumeBackupRestore-2104047399 None] Remove volume export completed successfully. Dec 18 21:10:43.787363 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.flows.manager.create_volume [None req-da169123-958f-4cf0-9d0b-687aee5d24e7 tempest-TestVolumeBootPattern-1320248540 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134148) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Dec 18 21:10:43.792114 ncdv-master-1 cinder-volume[134148]: WARNING stevedore.named [None req-da169123-958f-4cf0-9d0b-687aee5d24e7 tempest-TestVolumeBootPattern-1320248540 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Dec 18 21:10:43.792723 ncdv-master-1 cinder-volume[134148]: WARNING castellan.key_manager [None req-da169123-958f-4cf0-9d0b-687aee5d24e7 tempest-TestVolumeBootPattern-1320248540 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Dec 18 21:10:43.807493 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-da169123-958f-4cf0-9d0b-687aee5d24e7 tempest-TestVolumeBootPattern-1320248540 None] Flow 'volume_create_manager' (327b5111-265c-44f9-ac72-e7b8ce18c868) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 18 21:10:43.810857 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-da169123-958f-4cf0-9d0b-687aee5d24e7 tempest-TestVolumeBootPattern-1320248540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45f9582c-3d97-4444-8930-855aa67e6627) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:10:43.817394 ncdv-master-1 cinder-volume[134148]: DEBUG oslo_db.sqlalchemy.engines [None req-da169123-958f-4cf0-9d0b-687aee5d24e7 tempest-TestVolumeBootPattern-1320248540 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134148) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 18 21:10:43.838436 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-da169123-958f-4cf0-9d0b-687aee5d24e7 tempest-TestVolumeBootPattern-1320248540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45f9582c-3d97-4444-8930-855aa67e6627) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-12-18T21:10:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeBootPattern-volume-origin-724483562',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=13376864-8f52-4c3a-8fb8-d44948ce92e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de79cd87d023436a80d3cc5428586e21',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-12-18T21:10:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-12-18T21:10:44Z,use_quota=True,user_id='d32598482c834073b8fe24c84cb57d2f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f2e1fe1-9fd6-411e-9ed9-368f463ccb6f),volume_type_id=1f2e1fe1-9fd6-411e-9ed9-368f463ccb6f)' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:10:43.841036 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-da169123-958f-4cf0-9d0b-687aee5d24e7 tempest-TestVolumeBootPattern-1320248540 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85194b95-9f1e-4610-917b-37ec0cf00d02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:10:43.843963 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-da169123-958f-4cf0-9d0b-687aee5d24e7 tempest-TestVolumeBootPattern-1320248540 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85194b95-9f1e-4610-917b-37ec0cf00d02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:10:43.846822 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-da169123-958f-4cf0-9d0b-687aee5d24e7 tempest-TestVolumeBootPattern-1320248540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b859f0fd-3a92-48b6-ad06-e4744692f93d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:10:43.937141 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-da169123-958f-4cf0-9d0b-687aee5d24e7 tempest-TestVolumeBootPattern-1320248540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b859f0fd-3a92-48b6-ad06-e4744692f93d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '13376864-8f52-4c3a-8fb8-d44948ce92e4', 'volume_name': 'volume-13376864-8f52-4c3a-8fb8-d44948ce92e4', 'volume_size': 1, 'image_id': '394b3891-80f2-44c9-a9aa-56fe23a5acb3', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b04c3d19c79d4c208395e97f9d293618', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '394b3891-80f2-44c9-a9aa-56fe23a5acb3', 'created_at': datetime.datetime(2021, 12, 18, 20, 38, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 12, 18, 20, 38, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/394b3891-80f2-44c9-a9aa-56fe23a5acb3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:10:43.942591 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-da169123-958f-4cf0-9d0b-687aee5d24e7 tempest-TestVolumeBootPattern-1320248540 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24ea340e-2b94-4acc-a1b0-092eb85e9d68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:10:43.947025 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-da169123-958f-4cf0-9d0b-687aee5d24e7 tempest-TestVolumeBootPattern-1320248540 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24ea340e-2b94-4acc-a1b0-092eb85e9d68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:10:43.950611 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-da169123-958f-4cf0-9d0b-687aee5d24e7 tempest-TestVolumeBootPattern-1320248540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c690b177-10c9-46f6-b529-a91299837efb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:10:43.951884 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.flows.manager.create_volume [None req-da169123-958f-4cf0-9d0b-687aee5d24e7 tempest-TestVolumeBootPattern-1320248540 None] Volume 13376864-8f52-4c3a-8fb8-d44948ce92e4: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-13376864-8f52-4c3a-8fb8-d44948ce92e4', 'volume_size': 1, 'image_id': '394b3891-80f2-44c9-a9aa-56fe23a5acb3', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b04c3d19c79d4c208395e97f9d293618', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '394b3891-80f2-44c9-a9aa-56fe23a5acb3', 'created_at': datetime.datetime(2021, 12, 18, 20, 38, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 12, 18, 20, 38, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/394b3891-80f2-44c9-a9aa-56fe23a5acb3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Dec 18 21:10:43.952719 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.flows.manager.create_volume [None req-da169123-958f-4cf0-9d0b-687aee5d24e7 tempest-TestVolumeBootPattern-1320248540 None] Cloning 13376864-8f52-4c3a-8fb8-d44948ce92e4 from image 394b3891-80f2-44c9-a9aa-56fe23a5acb3 at location (None, None). {{(pid=134148) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1047}} Dec 18 21:10:43.966051 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.coordination [None req-da169123-958f-4cf0-9d0b-687aee5d24e7 tempest-TestVolumeBootPattern-1320248540 None] Lock "b'cinder-394b3891-80f2-44c9-a9aa-56fe23a5acb3'" acquired by "_prepare_image_cache_entry" :: waited 0.012s {{(pid=134148) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 18 21:10:43.979263 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.image.cache [None req-da169123-958f-4cf0-9d0b-687aee5d24e7 tempest-TestVolumeBootPattern-1320248540 None] Found image-volume cache entry: {'id': 1, 'image_id': '394b3891-80f2-44c9-a9aa-56fe23a5acb3', 'volume_id': 'e6411a45-48fa-4beb-a5a0-eb6a6ca3f525', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2021, 12, 18, 20, 38, 21), 'last_used': datetime.datetime(2021, 12, 18, 21, 10, 43, 971565)}. {{(pid=134148) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Dec 18 21:10:43.979849 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.image.cache [None req-da169123-958f-4cf0-9d0b-687aee5d24e7 tempest-TestVolumeBootPattern-1320248540 None] Image-volume cache entry image_update_at = 2021-12-18 20:38:21+00:00, requested image updated_at = 2021-12-18 20:38:21+00:00. {{(pid=134148) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Dec 18 21:10:43.980640 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.flows.manager.create_volume [None req-da169123-958f-4cf0-9d0b-687aee5d24e7 tempest-TestVolumeBootPattern-1320248540 None] Found cache entry for image = 394b3891-80f2-44c9-a9aa-56fe23a5acb3 on host ncdv-master-1@ceph#ceph. {{(pid=134148) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:870}} Dec 18 21:10:43.985780 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.coordination [None req-da169123-958f-4cf0-9d0b-687aee5d24e7 tempest-TestVolumeBootPattern-1320248540 None] Lock "b'cinder-394b3891-80f2-44c9-a9aa-56fe23a5acb3'" released by "_prepare_image_cache_entry" :: held 0.020s {{(pid=134148) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 18 21:10:43.986799 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.flows.manager.create_volume [None req-da169123-958f-4cf0-9d0b-687aee5d24e7 tempest-TestVolumeBootPattern-1320248540 None] Attempting to retrieve cache entry for image = 394b3891-80f2-44c9-a9aa-56fe23a5acb3 on host ncdv-master-1@ceph#ceph. {{(pid=134148) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:811}} Dec 18 21:10:43.998802 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.image.cache [None req-da169123-958f-4cf0-9d0b-687aee5d24e7 tempest-TestVolumeBootPattern-1320248540 None] Found image-volume cache entry: {'id': 1, 'image_id': '394b3891-80f2-44c9-a9aa-56fe23a5acb3', 'volume_id': 'e6411a45-48fa-4beb-a5a0-eb6a6ca3f525', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2021, 12, 18, 20, 38, 21), 'last_used': datetime.datetime(2021, 12, 18, 21, 10, 43, 990399)}. {{(pid=134148) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Dec 18 21:10:44.000469 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.image.cache [None req-da169123-958f-4cf0-9d0b-687aee5d24e7 tempest-TestVolumeBootPattern-1320248540 None] Image-volume cache entry image_update_at = 2021-12-18 20:38:21+00:00, requested image updated_at = 2021-12-18 20:38:21+00:00. {{(pid=134148) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Dec 18 21:10:44.001142 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.flows.manager.create_volume [None req-da169123-958f-4cf0-9d0b-687aee5d24e7 tempest-TestVolumeBootPattern-1320248540 None] Creating from source image-volume e6411a45-48fa-4beb-a5a0-eb6a6ca3f525 {{(pid=134148) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:825}} Dec 18 21:10:44.014334 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-da169123-958f-4cf0-9d0b-687aee5d24e7 tempest-TestVolumeBootPattern-1320248540 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:10:44.079628 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-da169123-958f-4cf0-9d0b-687aee5d24e7 tempest-TestVolumeBootPattern-1320248540 None] creating snapshot='volume-13376864-8f52-4c3a-8fb8-d44948ce92e4.clone_snap' {{(pid=134148) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:725}} Dec 18 21:10:44.873572 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-da169123-958f-4cf0-9d0b-687aee5d24e7 tempest-TestVolumeBootPattern-1320248540 None] cloning 'volume-e6411a45-48fa-4beb-a5a0-eb6a6ca3f525@volume-13376864-8f52-4c3a-8fb8-d44948ce92e4.clone_snap' to 'volume-13376864-8f52-4c3a-8fb8-d44948ce92e4' {{(pid=134148) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:731}} Dec 18 21:10:45.012128 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-da169123-958f-4cf0-9d0b-687aee5d24e7 tempest-TestVolumeBootPattern-1320248540 None] Volume volume-9f5f7417-3abc-4462-988f-ef519750d753.deleted is not a clone. {{(pid=134148) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Dec 18 21:10:45.012989 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-da169123-958f-4cf0-9d0b-687aee5d24e7 tempest-TestVolumeBootPattern-1320248540 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134148) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 18 21:10:45.013427 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-da169123-958f-4cf0-9d0b-687aee5d24e7 tempest-TestVolumeBootPattern-1320248540 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134148) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 18 21:10:45.033961 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-da169123-958f-4cf0-9d0b-687aee5d24e7 tempest-TestVolumeBootPattern-1320248540 None] clone created successfully {{(pid=134148) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:803}} Dec 18 21:10:45.034599 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.volume_utils [None req-da169123-958f-4cf0-9d0b-687aee5d24e7 tempest-TestVolumeBootPattern-1320248540 None] Marking volume 13376864-8f52-4c3a-8fb8-d44948ce92e4 as bootable. {{(pid=134148) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1178}} Dec 18 21:10:45.042810 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.flows.manager.create_volume [None req-da169123-958f-4cf0-9d0b-687aee5d24e7 tempest-TestVolumeBootPattern-1320248540 None] Copying metadata from image 394b3891-80f2-44c9-a9aa-56fe23a5acb3 to 13376864-8f52-4c3a-8fb8-d44948ce92e4. {{(pid=134148) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:444}} Dec 18 21:10:45.043232 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.flows.manager.create_volume [None req-da169123-958f-4cf0-9d0b-687aee5d24e7 tempest-TestVolumeBootPattern-1320248540 None] Creating volume glance metadata for volume 13376864-8f52-4c3a-8fb8-d44948ce92e4 backed by image 394b3891-80f2-44c9-a9aa-56fe23a5acb3 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '394b3891-80f2-44c9-a9aa-56fe23a5acb3', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=134148) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:667}} Dec 18 21:10:45.090763 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-da169123-958f-4cf0-9d0b-687aee5d24e7 tempest-TestVolumeBootPattern-1320248540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c690b177-10c9-46f6-b529-a91299837efb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-13376864-8f52-4c3a-8fb8-d44948ce92e4', 'volume_size': 1, 'image_id': '394b3891-80f2-44c9-a9aa-56fe23a5acb3', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b04c3d19c79d4c208395e97f9d293618', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '394b3891-80f2-44c9-a9aa-56fe23a5acb3', 'created_at': datetime.datetime(2021, 12, 18, 20, 38, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 12, 18, 20, 38, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/394b3891-80f2-44c9-a9aa-56fe23a5acb3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:10:45.092968 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-da169123-958f-4cf0-9d0b-687aee5d24e7 tempest-TestVolumeBootPattern-1320248540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6449f73a-41d3-4c20-b35e-de872e218959) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:10:45.099811 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.flows.manager.create_volume [None req-da169123-958f-4cf0-9d0b-687aee5d24e7 tempest-TestVolumeBootPattern-1320248540 None] Volume volume-13376864-8f52-4c3a-8fb8-d44948ce92e4 (13376864-8f52-4c3a-8fb8-d44948ce92e4): created successfully Dec 18 21:10:45.102267 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-da169123-958f-4cf0-9d0b-687aee5d24e7 tempest-TestVolumeBootPattern-1320248540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6449f73a-41d3-4c20-b35e-de872e218959) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:10:45.105696 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-da169123-958f-4cf0-9d0b-687aee5d24e7 tempest-TestVolumeBootPattern-1320248540 None] Flow 'volume_create_manager' (327b5111-265c-44f9-ac72-e7b8ce18c868) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134148) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 18 21:10:45.114733 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-da169123-958f-4cf0-9d0b-687aee5d24e7 tempest-TestVolumeBootPattern-1320248540 None] Created volume successfully. Dec 18 21:10:46.665495 ncdv-master-1 cinder-volume[134148]: DEBUG oslo_concurrency.processutils [req-3c5f4283-de5d-4536-aaa8-2538d758dda2 req-6fae4edb-ccff-4879-8d16-0b9da93bd747 tempest-TestVolumeBackupRestore-2104047399 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=134148) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Dec 18 21:10:47.356346 ncdv-master-1 cinder-volume[134148]: DEBUG oslo_concurrency.processutils [req-3c5f4283-de5d-4536-aaa8-2538d758dda2 req-6fae4edb-ccff-4879-8d16-0b9da93bd747 tempest-TestVolumeBackupRestore-2104047399 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.690s {{(pid=134148) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Dec 18 21:10:47.357288 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [req-3c5f4283-de5d-4536-aaa8-2538d758dda2 req-6fae4edb-ccff-4879-8d16-0b9da93bd747 tempest-TestVolumeBackupRestore-2104047399 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-4d1a0629-0c83-4586-abdd-6a090066b332', 'hosts': ['10.222.0.13'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '946d1715-d12c-4dbf-8a79-181222df6e2e', 'volume_id': '4d1a0629-0c83-4586-abdd-6a090066b332', 'discard': True}} {{(pid=134148) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Dec 18 21:10:47.381563 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [req-3c5f4283-de5d-4536-aaa8-2538d758dda2 req-6fae4edb-ccff-4879-8d16-0b9da93bd747 tempest-TestVolumeBackupRestore-2104047399 None] Connection info returned from driver {'name': 'volumes/volume-4d1a0629-0c83-4586-abdd-6a090066b332', 'hosts': ['10.222.0.13'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '4d1a0629-0c83-4586-abdd-6a090066b332', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '4342b7a8-2d47-4a0a-bd0a-5f0e99a85a3c'} {{(pid=134148) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4812}} Dec 18 21:10:47.451432 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [req-3c5f4283-de5d-4536-aaa8-2538d758dda2 req-6fae4edb-ccff-4879-8d16-0b9da93bd747 tempest-TestVolumeBackupRestore-2104047399 None] attachment_update completed successfully. Dec 18 21:10:48.424783 ncdv-master-1 cinder-volume[134148]: DEBUG oslo_concurrency.processutils [req-b2341d65-88e8-4eb8-933b-add96e3a47a7 req-c0bcd1ed-d0a7-4c48-8a04-e886934710db tempest-TestVolumeBootPattern-1320248540 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=134148) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Dec 18 21:10:49.112545 ncdv-master-1 cinder-volume[134148]: DEBUG oslo_concurrency.processutils [req-b2341d65-88e8-4eb8-933b-add96e3a47a7 req-c0bcd1ed-d0a7-4c48-8a04-e886934710db tempest-TestVolumeBootPattern-1320248540 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.688s {{(pid=134148) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Dec 18 21:10:49.113366 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [req-b2341d65-88e8-4eb8-933b-add96e3a47a7 req-c0bcd1ed-d0a7-4c48-8a04-e886934710db tempest-TestVolumeBootPattern-1320248540 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-13376864-8f52-4c3a-8fb8-d44948ce92e4', 'hosts': ['10.222.0.13'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '946d1715-d12c-4dbf-8a79-181222df6e2e', 'volume_id': '13376864-8f52-4c3a-8fb8-d44948ce92e4', 'discard': True}} {{(pid=134148) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Dec 18 21:10:49.138037 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [req-b2341d65-88e8-4eb8-933b-add96e3a47a7 req-c0bcd1ed-d0a7-4c48-8a04-e886934710db tempest-TestVolumeBootPattern-1320248540 None] Connection info returned from driver {'name': 'volumes/volume-13376864-8f52-4c3a-8fb8-d44948ce92e4', 'hosts': ['10.222.0.13'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '13376864-8f52-4c3a-8fb8-d44948ce92e4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '42560e02-1df1-4686-87c7-d5bee809f122'} {{(pid=134148) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4812}} Dec 18 21:10:49.192923 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [req-b2341d65-88e8-4eb8-933b-add96e3a47a7 req-c0bcd1ed-d0a7-4c48-8a04-e886934710db tempest-TestVolumeBootPattern-1320248540 None] attachment_update completed successfully. Dec 18 21:11:24.433111 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.flows.manager.create_volume [None req-1b92e856-fb47-4e66-ad34-9283af3791cb tempest-AttachVolumeTestJSON-466975463 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134148) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Dec 18 21:11:24.438069 ncdv-master-1 cinder-volume[134148]: WARNING stevedore.named [None req-1b92e856-fb47-4e66-ad34-9283af3791cb tempest-AttachVolumeTestJSON-466975463 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Dec 18 21:11:24.438651 ncdv-master-1 cinder-volume[134148]: WARNING castellan.key_manager [None req-1b92e856-fb47-4e66-ad34-9283af3791cb tempest-AttachVolumeTestJSON-466975463 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Dec 18 21:11:24.454038 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-1b92e856-fb47-4e66-ad34-9283af3791cb tempest-AttachVolumeTestJSON-466975463 None] Flow 'volume_create_manager' (053f6dee-0b03-4aab-9f21-e6ff3737f63b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 18 21:11:24.458104 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-1b92e856-fb47-4e66-ad34-9283af3791cb tempest-AttachVolumeTestJSON-466975463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2bade35b-ecbe-4984-9547-5406d6676819) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:11:24.465556 ncdv-master-1 cinder-volume[134148]: DEBUG oslo_db.sqlalchemy.engines [None req-1b92e856-fb47-4e66-ad34-9283af3791cb tempest-AttachVolumeTestJSON-466975463 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134148) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 18 21:11:24.481090 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-1b92e856-fb47-4e66-ad34-9283af3791cb tempest-AttachVolumeTestJSON-466975463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2bade35b-ecbe-4984-9547-5406d6676819) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-12-18T21:11:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-2052376242',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=2bd5b569-0c9f-4252-ba7f-6fa3ddb1c046,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0115052ed7dd4b60b9c729f1daa095c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-12-18T21:11:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-12-18T21:11:24Z,use_quota=True,user_id='a3e6bef41b9948099215b02cdca829bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f2e1fe1-9fd6-411e-9ed9-368f463ccb6f),volume_type_id=1f2e1fe1-9fd6-411e-9ed9-368f463ccb6f)' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:11:24.483881 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-1b92e856-fb47-4e66-ad34-9283af3791cb tempest-AttachVolumeTestJSON-466975463 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d5095b2-3d1d-44a6-9171-b35d50f0f24a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:11:24.486304 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-1b92e856-fb47-4e66-ad34-9283af3791cb tempest-AttachVolumeTestJSON-466975463 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d5095b2-3d1d-44a6-9171-b35d50f0f24a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:11:24.489607 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-1b92e856-fb47-4e66-ad34-9283af3791cb tempest-AttachVolumeTestJSON-466975463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d8deafb-8609-47bc-9eec-7e9c52caff69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:11:24.492282 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-1b92e856-fb47-4e66-ad34-9283af3791cb tempest-AttachVolumeTestJSON-466975463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d8deafb-8609-47bc-9eec-7e9c52caff69) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2bd5b569-0c9f-4252-ba7f-6fa3ddb1c046', 'volume_name': 'volume-2bd5b569-0c9f-4252-ba7f-6fa3ddb1c046', 'volume_size': 1}' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:11:24.495078 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-1b92e856-fb47-4e66-ad34-9283af3791cb tempest-AttachVolumeTestJSON-466975463 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87e56f2f-0937-4c85-8007-ab883c148aef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:11:24.497375 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-1b92e856-fb47-4e66-ad34-9283af3791cb tempest-AttachVolumeTestJSON-466975463 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87e56f2f-0937-4c85-8007-ab883c148aef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:11:24.500048 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-1b92e856-fb47-4e66-ad34-9283af3791cb tempest-AttachVolumeTestJSON-466975463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5cbeab5a-2e73-45ed-80c8-1ed08b173b8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:11:24.500946 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.flows.manager.create_volume [None req-1b92e856-fb47-4e66-ad34-9283af3791cb tempest-AttachVolumeTestJSON-466975463 None] Volume 2bd5b569-0c9f-4252-ba7f-6fa3ddb1c046: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2bd5b569-0c9f-4252-ba7f-6fa3ddb1c046', 'volume_size': 1} Dec 18 21:11:24.501464 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-1b92e856-fb47-4e66-ad34-9283af3791cb tempest-AttachVolumeTestJSON-466975463 None] creating volume 'volume-2bd5b569-0c9f-4252-ba7f-6fa3ddb1c046' {{(pid=134148) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Dec 18 21:11:24.502782 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-1b92e856-fb47-4e66-ad34-9283af3791cb tempest-AttachVolumeTestJSON-466975463 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:11:24.594515 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-1b92e856-fb47-4e66-ad34-9283af3791cb tempest-AttachVolumeTestJSON-466975463 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134148) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 18 21:11:24.595156 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-1b92e856-fb47-4e66-ad34-9283af3791cb tempest-AttachVolumeTestJSON-466975463 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134148) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 18 21:11:24.597710 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-1b92e856-fb47-4e66-ad34-9283af3791cb tempest-AttachVolumeTestJSON-466975463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5cbeab5a-2e73-45ed-80c8-1ed08b173b8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2bd5b569-0c9f-4252-ba7f-6fa3ddb1c046', 'volume_size': 1}' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:11:24.600754 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-1b92e856-fb47-4e66-ad34-9283af3791cb tempest-AttachVolumeTestJSON-466975463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84ffcd9a-613b-449a-a855-8afcf70b2413) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:11:24.611255 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.flows.manager.create_volume [None req-1b92e856-fb47-4e66-ad34-9283af3791cb tempest-AttachVolumeTestJSON-466975463 None] Volume volume-2bd5b569-0c9f-4252-ba7f-6fa3ddb1c046 (2bd5b569-0c9f-4252-ba7f-6fa3ddb1c046): created successfully Dec 18 21:11:24.613918 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-1b92e856-fb47-4e66-ad34-9283af3791cb tempest-AttachVolumeTestJSON-466975463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84ffcd9a-613b-449a-a855-8afcf70b2413) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:11:24.617996 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-1b92e856-fb47-4e66-ad34-9283af3791cb tempest-AttachVolumeTestJSON-466975463 None] Flow 'volume_create_manager' (053f6dee-0b03-4aab-9f21-e6ff3737f63b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134148) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 18 21:11:24.628966 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-1b92e856-fb47-4e66-ad34-9283af3791cb tempest-AttachVolumeTestJSON-466975463 None] Created volume successfully. Dec 18 21:11:26.078916 ncdv-master-1 cinder-volume[134148]: DEBUG oslo_concurrency.processutils [req-5478ba5b-5307-4543-9b4b-f9c206f808d4 req-4abb85aa-25d9-4c2e-b822-99ed6b9d3484 tempest-AttachVolumeTestJSON-466975463 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=134148) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Dec 18 21:11:26.809084 ncdv-master-1 cinder-volume[134148]: DEBUG oslo_concurrency.processutils [req-5478ba5b-5307-4543-9b4b-f9c206f808d4 req-4abb85aa-25d9-4c2e-b822-99ed6b9d3484 tempest-AttachVolumeTestJSON-466975463 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.730s {{(pid=134148) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Dec 18 21:11:26.809988 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [req-5478ba5b-5307-4543-9b4b-f9c206f808d4 req-4abb85aa-25d9-4c2e-b822-99ed6b9d3484 tempest-AttachVolumeTestJSON-466975463 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-2bd5b569-0c9f-4252-ba7f-6fa3ddb1c046', 'hosts': ['10.222.0.13'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '946d1715-d12c-4dbf-8a79-181222df6e2e', 'volume_id': '2bd5b569-0c9f-4252-ba7f-6fa3ddb1c046', 'discard': True}} {{(pid=134148) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Dec 18 21:11:26.836368 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [req-5478ba5b-5307-4543-9b4b-f9c206f808d4 req-4abb85aa-25d9-4c2e-b822-99ed6b9d3484 tempest-AttachVolumeTestJSON-466975463 None] Connection info returned from driver {'name': 'volumes/volume-2bd5b569-0c9f-4252-ba7f-6fa3ddb1c046', 'hosts': ['10.222.0.13'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '2bd5b569-0c9f-4252-ba7f-6fa3ddb1c046', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '42b40d6c-4260-452d-a505-654653fe33ee'} {{(pid=134148) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4812}} Dec 18 21:11:26.911170 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [req-5478ba5b-5307-4543-9b4b-f9c206f808d4 req-4abb85aa-25d9-4c2e-b822-99ed6b9d3484 tempest-AttachVolumeTestJSON-466975463 None] attachment_update completed successfully. Dec 18 21:11:31.676407 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.flows.manager.create_volume [None req-3f20da6e-f137-49fc-8c63-66f3564dd09e tempest-AttachVolumeShelveTestJSON-764429992 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134148) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Dec 18 21:11:31.681652 ncdv-master-1 cinder-volume[134148]: WARNING stevedore.named [None req-3f20da6e-f137-49fc-8c63-66f3564dd09e tempest-AttachVolumeShelveTestJSON-764429992 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Dec 18 21:11:31.682201 ncdv-master-1 cinder-volume[134148]: WARNING castellan.key_manager [None req-3f20da6e-f137-49fc-8c63-66f3564dd09e tempest-AttachVolumeShelveTestJSON-764429992 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Dec 18 21:11:31.704874 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-3f20da6e-f137-49fc-8c63-66f3564dd09e tempest-AttachVolumeShelveTestJSON-764429992 None] Flow 'volume_create_manager' (64587af1-4335-4f69-92cf-7bcc0bfcf578) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 18 21:11:31.708645 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-3f20da6e-f137-49fc-8c63-66f3564dd09e tempest-AttachVolumeShelveTestJSON-764429992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99ceee8b-fb41-4e88-9de9-1c2f641b3171) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:11:31.716898 ncdv-master-1 cinder-volume[134148]: DEBUG oslo_db.sqlalchemy.engines [None req-3f20da6e-f137-49fc-8c63-66f3564dd09e tempest-AttachVolumeShelveTestJSON-764429992 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134148) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 18 21:11:31.747906 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-3f20da6e-f137-49fc-8c63-66f3564dd09e tempest-AttachVolumeShelveTestJSON-764429992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99ceee8b-fb41-4e88-9de9-1c2f641b3171) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-12-18T21:11:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1160783350',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=87b40d06-8666-40c6-a69a-c359ce3aa4fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='64ef041cd6724458b053cde5c1afe4fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-12-18T21:11:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-12-18T21:11:32Z,use_quota=True,user_id='bdd05da990fb4f7290fb926a258de4eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f2e1fe1-9fd6-411e-9ed9-368f463ccb6f),volume_type_id=1f2e1fe1-9fd6-411e-9ed9-368f463ccb6f)' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:11:31.750719 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-3f20da6e-f137-49fc-8c63-66f3564dd09e tempest-AttachVolumeShelveTestJSON-764429992 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3929bee-9555-491c-b810-19591469c343) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:11:31.753294 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-3f20da6e-f137-49fc-8c63-66f3564dd09e tempest-AttachVolumeShelveTestJSON-764429992 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3929bee-9555-491c-b810-19591469c343) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:11:31.756004 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-3f20da6e-f137-49fc-8c63-66f3564dd09e tempest-AttachVolumeShelveTestJSON-764429992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74f5359e-fb5c-4389-a4c1-e14f00836560) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:11:31.759216 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-3f20da6e-f137-49fc-8c63-66f3564dd09e tempest-AttachVolumeShelveTestJSON-764429992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74f5359e-fb5c-4389-a4c1-e14f00836560) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '87b40d06-8666-40c6-a69a-c359ce3aa4fc', 'volume_name': 'volume-87b40d06-8666-40c6-a69a-c359ce3aa4fc', 'volume_size': 1}' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:11:31.761729 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-3f20da6e-f137-49fc-8c63-66f3564dd09e tempest-AttachVolumeShelveTestJSON-764429992 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5fd9b2b-a0ab-47aa-b826-8fa941fb454f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:11:31.764287 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-3f20da6e-f137-49fc-8c63-66f3564dd09e tempest-AttachVolumeShelveTestJSON-764429992 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5fd9b2b-a0ab-47aa-b826-8fa941fb454f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:11:31.766642 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-3f20da6e-f137-49fc-8c63-66f3564dd09e tempest-AttachVolumeShelveTestJSON-764429992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f66feef1-3309-43be-a2f2-414c8770667b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:11:31.767606 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.flows.manager.create_volume [None req-3f20da6e-f137-49fc-8c63-66f3564dd09e tempest-AttachVolumeShelveTestJSON-764429992 None] Volume 87b40d06-8666-40c6-a69a-c359ce3aa4fc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-87b40d06-8666-40c6-a69a-c359ce3aa4fc', 'volume_size': 1} Dec 18 21:11:31.768217 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-3f20da6e-f137-49fc-8c63-66f3564dd09e tempest-AttachVolumeShelveTestJSON-764429992 None] creating volume 'volume-87b40d06-8666-40c6-a69a-c359ce3aa4fc' {{(pid=134148) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Dec 18 21:11:31.769395 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-3f20da6e-f137-49fc-8c63-66f3564dd09e tempest-AttachVolumeShelveTestJSON-764429992 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:11:31.871579 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-3f20da6e-f137-49fc-8c63-66f3564dd09e tempest-AttachVolumeShelveTestJSON-764429992 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134148) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 18 21:11:31.872265 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-3f20da6e-f137-49fc-8c63-66f3564dd09e tempest-AttachVolumeShelveTestJSON-764429992 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134148) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 18 21:11:31.874864 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-3f20da6e-f137-49fc-8c63-66f3564dd09e tempest-AttachVolumeShelveTestJSON-764429992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f66feef1-3309-43be-a2f2-414c8770667b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-87b40d06-8666-40c6-a69a-c359ce3aa4fc', 'volume_size': 1}' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:11:31.877719 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-3f20da6e-f137-49fc-8c63-66f3564dd09e tempest-AttachVolumeShelveTestJSON-764429992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9686402a-8f46-4ead-9718-0bd656f2b59d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:11:31.895198 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.flows.manager.create_volume [None req-3f20da6e-f137-49fc-8c63-66f3564dd09e tempest-AttachVolumeShelveTestJSON-764429992 None] Volume volume-87b40d06-8666-40c6-a69a-c359ce3aa4fc (87b40d06-8666-40c6-a69a-c359ce3aa4fc): created successfully Dec 18 21:11:31.897471 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-3f20da6e-f137-49fc-8c63-66f3564dd09e tempest-AttachVolumeShelveTestJSON-764429992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9686402a-8f46-4ead-9718-0bd656f2b59d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:11:31.900804 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-3f20da6e-f137-49fc-8c63-66f3564dd09e tempest-AttachVolumeShelveTestJSON-764429992 None] Flow 'volume_create_manager' (64587af1-4335-4f69-92cf-7bcc0bfcf578) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134148) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 18 21:11:31.917054 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-3f20da6e-f137-49fc-8c63-66f3564dd09e tempest-AttachVolumeShelveTestJSON-764429992 None] Created volume successfully. Dec 18 21:11:34.340271 ncdv-master-1 cinder-volume[134148]: DEBUG oslo_service.periodic_task [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134148) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Dec 18 21:11:34.341440 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:11:34.372265 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:11:34.415547 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.manager [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] Notifying Schedulers of capabilities ... {{(pid=134148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 18 21:11:58.204587 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [req-59aa39ad-76aa-4589-b75c-e8a91c25463e req-4a8e6d0f-59a6-4857-933f-b294e2f8c701 tempest-TestVolumeBackupRestore-2104047399 None] Terminate volume connection completed successfully. Dec 18 21:11:58.205413 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [req-59aa39ad-76aa-4589-b75c-e8a91c25463e req-4a8e6d0f-59a6-4857-933f-b294e2f8c701 tempest-TestVolumeBackupRestore-2104047399 None] Deleting attachment 4342b7a8-2d47-4a0a-bd0a-5f0e99a85a3c. {{(pid=134148) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4948}} Dec 18 21:11:59.835181 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.coordination [None req-515f6f11-4928-4f54-bada-2053c8f9b424 tempest-TestVolumeBackupRestore-2104047399 None] Lock "b'cinder-4d1a0629-0c83-4586-abdd-6a090066b332-delete_volume'" acquired by "delete_volume" :: waited 0.014s {{(pid=134148) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 18 21:11:59.891267 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-515f6f11-4928-4f54-bada-2053c8f9b424 tempest-TestVolumeBackupRestore-2104047399 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:12:00.751084 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-515f6f11-4928-4f54-bada-2053c8f9b424 tempest-TestVolumeBackupRestore-2104047399 None] Volume volume-4d1a0629-0c83-4586-abdd-6a090066b332 is not a clone. {{(pid=134148) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Dec 18 21:12:00.808429 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-515f6f11-4928-4f54-bada-2053c8f9b424 tempest-TestVolumeBackupRestore-2104047399 None] deleting rbd volume volume-4d1a0629-0c83-4586-abdd-6a090066b332 {{(pid=134148) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Dec 18 21:12:00.843210 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.coordination [None req-13dd29a7-ae67-4498-9b08-cce4c75c62f8 tempest-TestVolumeBackupRestore-2104047399 None] Lock "b'cinder-cd3e50ad-c2c4-48eb-9560-8a0740a6943e-delete_volume'" acquired by "delete_volume" :: waited 0.028s {{(pid=134148) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 18 21:12:00.890233 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-13dd29a7-ae67-4498-9b08-cce4c75c62f8 tempest-TestVolumeBackupRestore-2104047399 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:12:01.787167 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-13dd29a7-ae67-4498-9b08-cce4c75c62f8 tempest-TestVolumeBackupRestore-2104047399 None] deleting rbd volume volume-cd3e50ad-c2c4-48eb-9560-8a0740a6943e {{(pid=134148) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Dec 18 21:12:01.850520 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.quota [None req-515f6f11-4928-4f54-bada-2053c8f9b424 tempest-TestVolumeBackupRestore-2104047399 None] Created reservations ['ee7fa23b-6e3e-44c2-bb4a-b3e9d6c6152c', '1077ca82-b285-41fa-bddb-5c42670de2d0', 'e239376c-b5b6-45b8-bb33-6ad9b5639b0a', '86fd5b30-9efb-44a3-9df9-b5f1aff1b302'] {{(pid=134148) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 18 21:12:01.915454 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-515f6f11-4928-4f54-bada-2053c8f9b424 tempest-TestVolumeBackupRestore-2104047399 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:12:01.987963 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-515f6f11-4928-4f54-bada-2053c8f9b424 tempest-TestVolumeBackupRestore-2104047399 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:12:02.047099 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.manager [None req-515f6f11-4928-4f54-bada-2053c8f9b424 tempest-TestVolumeBackupRestore-2104047399 None] Notifying Schedulers of capabilities ... {{(pid=134148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 18 21:12:02.053994 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-515f6f11-4928-4f54-bada-2053c8f9b424 tempest-TestVolumeBackupRestore-2104047399 None] Deleted volume successfully. Dec 18 21:12:02.079578 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.coordination [None req-515f6f11-4928-4f54-bada-2053c8f9b424 tempest-TestVolumeBackupRestore-2104047399 None] Lock "b'cinder-4d1a0629-0c83-4586-abdd-6a090066b332-delete_volume'" released by "delete_volume" :: held 2.244s {{(pid=134148) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 18 21:12:02.273524 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-13dd29a7-ae67-4498-9b08-cce4c75c62f8 tempest-TestVolumeBackupRestore-2104047399 None] volume is a clone so cleaning references {{(pid=134148) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1266}} Dec 18 21:12:02.312573 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-13dd29a7-ae67-4498-9b08-cce4c75c62f8 tempest-TestVolumeBackupRestore-2104047399 None] deleting parent snapshot volume-cd3e50ad-c2c4-48eb-9560-8a0740a6943e.clone_snap {{(pid=134148) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1158}} Dec 18 21:12:02.929205 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.quota [None req-13dd29a7-ae67-4498-9b08-cce4c75c62f8 tempest-TestVolumeBackupRestore-2104047399 None] Created reservations ['a0ce4b73-f927-4d63-8d01-a5a14dbfe352', '5da7f597-f862-4eb4-b7ac-58dc5b7b8f11', 'bddc6830-7ef2-4981-8afa-3b053c2a5f8c', 'ae74ad3d-aaed-48dd-9f84-4a6b4e466687'] {{(pid=134148) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 18 21:12:03.028568 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-13dd29a7-ae67-4498-9b08-cce4c75c62f8 tempest-TestVolumeBackupRestore-2104047399 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:12:03.112778 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-13dd29a7-ae67-4498-9b08-cce4c75c62f8 tempest-TestVolumeBackupRestore-2104047399 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:12:03.195192 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.manager [None req-13dd29a7-ae67-4498-9b08-cce4c75c62f8 tempest-TestVolumeBackupRestore-2104047399 None] Notifying Schedulers of capabilities ... {{(pid=134148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 18 21:12:03.208104 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-13dd29a7-ae67-4498-9b08-cce4c75c62f8 tempest-TestVolumeBackupRestore-2104047399 None] Deleted volume successfully. Dec 18 21:12:03.225238 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.coordination [None req-13dd29a7-ae67-4498-9b08-cce4c75c62f8 tempest-TestVolumeBackupRestore-2104047399 None] Lock "b'cinder-cd3e50ad-c2c4-48eb-9560-8a0740a6943e-delete_volume'" released by "delete_volume" :: held 2.382s {{(pid=134148) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 18 21:12:05.081049 ncdv-master-1 cinder-volume[134148]: DEBUG oslo_concurrency.processutils [req-e89bbcf4-477a-470f-ba44-5cb9701c200c req-e7c04d40-1268-4044-b547-01296174aaaf tempest-AttachVolumeShelveTestJSON-764429992 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=134148) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Dec 18 21:12:06.125294 ncdv-master-1 cinder-volume[134148]: DEBUG oslo_concurrency.processutils [req-e89bbcf4-477a-470f-ba44-5cb9701c200c req-e7c04d40-1268-4044-b547-01296174aaaf tempest-AttachVolumeShelveTestJSON-764429992 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.044s {{(pid=134148) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Dec 18 21:12:06.126885 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [req-e89bbcf4-477a-470f-ba44-5cb9701c200c req-e7c04d40-1268-4044-b547-01296174aaaf tempest-AttachVolumeShelveTestJSON-764429992 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-87b40d06-8666-40c6-a69a-c359ce3aa4fc', 'hosts': ['10.222.0.13'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '946d1715-d12c-4dbf-8a79-181222df6e2e', 'volume_id': '87b40d06-8666-40c6-a69a-c359ce3aa4fc', 'discard': True}} {{(pid=134148) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Dec 18 21:12:06.153838 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [req-e89bbcf4-477a-470f-ba44-5cb9701c200c req-e7c04d40-1268-4044-b547-01296174aaaf tempest-AttachVolumeShelveTestJSON-764429992 None] Connection info returned from driver {'name': 'volumes/volume-87b40d06-8666-40c6-a69a-c359ce3aa4fc', 'hosts': ['10.222.0.13'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '87b40d06-8666-40c6-a69a-c359ce3aa4fc', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'e93a9cf3-6515-48f5-86b9-3f0d175156c2'} {{(pid=134148) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4812}} Dec 18 21:12:06.232188 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [req-e89bbcf4-477a-470f-ba44-5cb9701c200c req-e7c04d40-1268-4044-b547-01296174aaaf tempest-AttachVolumeShelveTestJSON-764429992 None] attachment_update completed successfully. Dec 18 21:12:23.320735 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [req-84a0ea34-ce81-47ac-a535-d248b06527e0 req-4f80dbf3-3074-48bc-a780-b3e4dac14872 tempest-AttachVolumeTestJSON-466975463 None] Terminate volume connection completed successfully. Dec 18 21:12:23.321544 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [req-84a0ea34-ce81-47ac-a535-d248b06527e0 req-4f80dbf3-3074-48bc-a780-b3e4dac14872 tempest-AttachVolumeTestJSON-466975463 None] Deleting attachment 42b40d6c-4260-452d-a505-654653fe33ee. {{(pid=134148) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4948}} Dec 18 21:12:34.341852 ncdv-master-1 cinder-volume[134148]: DEBUG oslo_service.periodic_task [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134148) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Dec 18 21:12:34.342705 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:12:34.366414 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:12:34.388031 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.manager [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] Notifying Schedulers of capabilities ... {{(pid=134148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 18 21:13:04.504088 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [req-2fbcca58-8070-484a-a6d6-c3199dbed29c req-cef539b8-20de-4e03-9a2e-2c526fcd3cfa tempest-AttachVolumeShelveTestJSON-764429992 None] Terminate volume connection completed successfully. Dec 18 21:13:04.504718 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [req-2fbcca58-8070-484a-a6d6-c3199dbed29c req-cef539b8-20de-4e03-9a2e-2c526fcd3cfa tempest-AttachVolumeShelveTestJSON-764429992 None] Deleting attachment e93a9cf3-6515-48f5-86b9-3f0d175156c2. {{(pid=134148) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4948}} Dec 18 21:13:24.584181 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [req-e7a1ee70-953c-4312-acc7-cd29903f1ac3 req-dbe32734-1bab-4940-9c2b-8f18a2361192 tempest-TestVolumeBootPattern-1320248540 None] Terminate volume connection completed successfully. Dec 18 21:13:24.584797 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [req-e7a1ee70-953c-4312-acc7-cd29903f1ac3 req-dbe32734-1bab-4940-9c2b-8f18a2361192 tempest-TestVolumeBootPattern-1320248540 None] Deleting attachment 42560e02-1df1-4686-87c7-d5bee809f122. {{(pid=134148) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4948}} Dec 18 21:13:28.352859 ncdv-master-1 cinder-volume[134148]: DEBUG oslo_concurrency.processutils [req-ab71e39f-2f39-4410-b48e-26bf990d6153 req-ebdb126b-ba64-4a6c-990d-caba91bd4586 tempest-TestVolumeBootPattern-1320248540 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=134148) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Dec 18 21:13:29.244820 ncdv-master-1 cinder-volume[134148]: DEBUG oslo_concurrency.processutils [req-ab71e39f-2f39-4410-b48e-26bf990d6153 req-ebdb126b-ba64-4a6c-990d-caba91bd4586 tempest-TestVolumeBootPattern-1320248540 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.892s {{(pid=134148) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Dec 18 21:13:29.246163 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [req-ab71e39f-2f39-4410-b48e-26bf990d6153 req-ebdb126b-ba64-4a6c-990d-caba91bd4586 tempest-TestVolumeBootPattern-1320248540 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-13376864-8f52-4c3a-8fb8-d44948ce92e4', 'hosts': ['10.222.0.13'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '946d1715-d12c-4dbf-8a79-181222df6e2e', 'volume_id': '13376864-8f52-4c3a-8fb8-d44948ce92e4', 'discard': True}} {{(pid=134148) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Dec 18 21:13:29.293094 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [req-ab71e39f-2f39-4410-b48e-26bf990d6153 req-ebdb126b-ba64-4a6c-990d-caba91bd4586 tempest-TestVolumeBootPattern-1320248540 None] Connection info returned from driver {'name': 'volumes/volume-13376864-8f52-4c3a-8fb8-d44948ce92e4', 'hosts': ['10.222.0.13'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '13376864-8f52-4c3a-8fb8-d44948ce92e4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'b8d0f2d6-9f7e-485e-b873-fb067093bcba'} {{(pid=134148) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4812}} Dec 18 21:13:29.402246 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [req-ab71e39f-2f39-4410-b48e-26bf990d6153 req-ebdb126b-ba64-4a6c-990d-caba91bd4586 tempest-TestVolumeBootPattern-1320248540 None] attachment_update completed successfully. Dec 18 21:13:34.343351 ncdv-master-1 cinder-volume[134148]: DEBUG oslo_service.periodic_task [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134148) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Dec 18 21:13:34.344512 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:13:34.412508 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:13:34.484969 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.manager [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] Notifying Schedulers of capabilities ... {{(pid=134148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 18 21:14:34.342154 ncdv-master-1 cinder-volume[134148]: DEBUG oslo_service.periodic_task [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134148) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Dec 18 21:14:34.343836 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:14:34.418154 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:14:34.484723 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.manager [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] Notifying Schedulers of capabilities ... {{(pid=134148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 18 21:15:05.283939 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.flows.manager.create_volume [None req-41ebdfba-326c-48f6-b1aa-2fea5f629dfd tempest-AttachVolumeShelveTestJSON-764429992 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134148) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Dec 18 21:15:05.289518 ncdv-master-1 cinder-volume[134148]: WARNING stevedore.named [None req-41ebdfba-326c-48f6-b1aa-2fea5f629dfd tempest-AttachVolumeShelveTestJSON-764429992 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Dec 18 21:15:05.290112 ncdv-master-1 cinder-volume[134148]: WARNING castellan.key_manager [None req-41ebdfba-326c-48f6-b1aa-2fea5f629dfd tempest-AttachVolumeShelveTestJSON-764429992 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Dec 18 21:15:05.304426 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-41ebdfba-326c-48f6-b1aa-2fea5f629dfd tempest-AttachVolumeShelveTestJSON-764429992 None] Flow 'volume_create_manager' (87871a2f-083b-45d5-a1d0-58edeb39d387) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 18 21:15:05.308170 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-41ebdfba-326c-48f6-b1aa-2fea5f629dfd tempest-AttachVolumeShelveTestJSON-764429992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0d311cf-3355-4bf2-b521-921f2076627d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:15:05.317099 ncdv-master-1 cinder-volume[134148]: DEBUG oslo_db.sqlalchemy.engines [None req-41ebdfba-326c-48f6-b1aa-2fea5f629dfd tempest-AttachVolumeShelveTestJSON-764429992 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134148) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 18 21:15:05.335728 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-41ebdfba-326c-48f6-b1aa-2fea5f629dfd tempest-AttachVolumeShelveTestJSON-764429992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0d311cf-3355-4bf2-b521-921f2076627d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-12-18T21:15:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-395393627',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=ead49322-abed-4471-af58-9f89b29a5107,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='64ef041cd6724458b053cde5c1afe4fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-12-18T21:15:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-12-18T21:15:05Z,use_quota=True,user_id='bdd05da990fb4f7290fb926a258de4eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f2e1fe1-9fd6-411e-9ed9-368f463ccb6f),volume_type_id=1f2e1fe1-9fd6-411e-9ed9-368f463ccb6f)' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:15:05.339974 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-41ebdfba-326c-48f6-b1aa-2fea5f629dfd tempest-AttachVolumeShelveTestJSON-764429992 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19cede3f-f038-47d6-9fe8-187394b05902) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:15:05.342153 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-41ebdfba-326c-48f6-b1aa-2fea5f629dfd tempest-AttachVolumeShelveTestJSON-764429992 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19cede3f-f038-47d6-9fe8-187394b05902) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:15:05.347206 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-41ebdfba-326c-48f6-b1aa-2fea5f629dfd tempest-AttachVolumeShelveTestJSON-764429992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (909a2d6d-d5f0-4281-a554-6bed39f342b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:15:05.351962 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-41ebdfba-326c-48f6-b1aa-2fea5f629dfd tempest-AttachVolumeShelveTestJSON-764429992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (909a2d6d-d5f0-4281-a554-6bed39f342b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ead49322-abed-4471-af58-9f89b29a5107', 'volume_name': 'volume-ead49322-abed-4471-af58-9f89b29a5107', 'volume_size': 1}' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:15:05.354928 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-41ebdfba-326c-48f6-b1aa-2fea5f629dfd tempest-AttachVolumeShelveTestJSON-764429992 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c428e52-f6de-4ee5-b073-3c809a1ef9e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:15:05.358343 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-41ebdfba-326c-48f6-b1aa-2fea5f629dfd tempest-AttachVolumeShelveTestJSON-764429992 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c428e52-f6de-4ee5-b073-3c809a1ef9e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:15:05.361498 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-41ebdfba-326c-48f6-b1aa-2fea5f629dfd tempest-AttachVolumeShelveTestJSON-764429992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9426fd39-1c31-436f-a716-ee32b642dd91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:15:05.362341 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.flows.manager.create_volume [None req-41ebdfba-326c-48f6-b1aa-2fea5f629dfd tempest-AttachVolumeShelveTestJSON-764429992 None] Volume ead49322-abed-4471-af58-9f89b29a5107: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ead49322-abed-4471-af58-9f89b29a5107', 'volume_size': 1} Dec 18 21:15:05.362752 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-41ebdfba-326c-48f6-b1aa-2fea5f629dfd tempest-AttachVolumeShelveTestJSON-764429992 None] creating volume 'volume-ead49322-abed-4471-af58-9f89b29a5107' {{(pid=134148) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Dec 18 21:15:05.364350 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-41ebdfba-326c-48f6-b1aa-2fea5f629dfd tempest-AttachVolumeShelveTestJSON-764429992 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:15:05.439944 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-41ebdfba-326c-48f6-b1aa-2fea5f629dfd tempest-AttachVolumeShelveTestJSON-764429992 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134148) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 18 21:15:05.441158 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-41ebdfba-326c-48f6-b1aa-2fea5f629dfd tempest-AttachVolumeShelveTestJSON-764429992 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134148) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 18 21:15:05.445575 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-41ebdfba-326c-48f6-b1aa-2fea5f629dfd tempest-AttachVolumeShelveTestJSON-764429992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9426fd39-1c31-436f-a716-ee32b642dd91) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ead49322-abed-4471-af58-9f89b29a5107', 'volume_size': 1}' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:15:05.450204 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-41ebdfba-326c-48f6-b1aa-2fea5f629dfd tempest-AttachVolumeShelveTestJSON-764429992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e92f9a9f-524b-48ab-9fb3-6281a8004570) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:15:05.466522 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.flows.manager.create_volume [None req-41ebdfba-326c-48f6-b1aa-2fea5f629dfd tempest-AttachVolumeShelveTestJSON-764429992 None] Volume volume-ead49322-abed-4471-af58-9f89b29a5107 (ead49322-abed-4471-af58-9f89b29a5107): created successfully Dec 18 21:15:05.469949 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-41ebdfba-326c-48f6-b1aa-2fea5f629dfd tempest-AttachVolumeShelveTestJSON-764429992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e92f9a9f-524b-48ab-9fb3-6281a8004570) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:15:05.474110 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-41ebdfba-326c-48f6-b1aa-2fea5f629dfd tempest-AttachVolumeShelveTestJSON-764429992 None] Flow 'volume_create_manager' (87871a2f-083b-45d5-a1d0-58edeb39d387) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134148) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 18 21:15:05.484526 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-41ebdfba-326c-48f6-b1aa-2fea5f629dfd tempest-AttachVolumeShelveTestJSON-764429992 None] Created volume successfully. Dec 18 21:15:14.610717 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.flows.manager.create_volume [None req-2dd15ce1-f308-432e-b2f2-a189fe2c9e2a tempest-VolumesImageMetadata-1686268488 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134148) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Dec 18 21:15:14.615336 ncdv-master-1 cinder-volume[134148]: WARNING stevedore.named [None req-2dd15ce1-f308-432e-b2f2-a189fe2c9e2a tempest-VolumesImageMetadata-1686268488 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Dec 18 21:15:14.615872 ncdv-master-1 cinder-volume[134148]: WARNING castellan.key_manager [None req-2dd15ce1-f308-432e-b2f2-a189fe2c9e2a tempest-VolumesImageMetadata-1686268488 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Dec 18 21:15:14.627673 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-2dd15ce1-f308-432e-b2f2-a189fe2c9e2a tempest-VolumesImageMetadata-1686268488 None] Flow 'volume_create_manager' (e00b4a1b-039c-4ed6-a26e-1941ed8a21bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 18 21:15:14.631456 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-2dd15ce1-f308-432e-b2f2-a189fe2c9e2a tempest-VolumesImageMetadata-1686268488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38bbc30f-6301-4be0-9933-29b6f82ca2c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:15:14.637900 ncdv-master-1 cinder-volume[134148]: DEBUG oslo_db.sqlalchemy.engines [None req-2dd15ce1-f308-432e-b2f2-a189fe2c9e2a tempest-VolumesImageMetadata-1686268488 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134148) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 18 21:15:14.652510 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-2dd15ce1-f308-432e-b2f2-a189fe2c9e2a tempest-VolumesImageMetadata-1686268488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38bbc30f-6301-4be0-9933-29b6f82ca2c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-12-18T21:15:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1175210348',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=5e8ec622-9796-45d2-a367-3c4954f92a39,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9189fc5b4594c02bd9ad50c5c5358ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-12-18T21:15:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-12-18T21:15:15Z,use_quota=True,user_id='81dd7c2da3bd4ef2b639119c62f6bd8a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f2e1fe1-9fd6-411e-9ed9-368f463ccb6f),volume_type_id=1f2e1fe1-9fd6-411e-9ed9-368f463ccb6f)' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:15:14.655834 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-2dd15ce1-f308-432e-b2f2-a189fe2c9e2a tempest-VolumesImageMetadata-1686268488 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7cc08310-bd45-49a6-a9a2-3ea2b8bcf120) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:15:14.658112 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-2dd15ce1-f308-432e-b2f2-a189fe2c9e2a tempest-VolumesImageMetadata-1686268488 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7cc08310-bd45-49a6-a9a2-3ea2b8bcf120) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:15:14.660691 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-2dd15ce1-f308-432e-b2f2-a189fe2c9e2a tempest-VolumesImageMetadata-1686268488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76f006f3-6923-41e2-b314-5a387611fcb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:15:14.741557 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-2dd15ce1-f308-432e-b2f2-a189fe2c9e2a tempest-VolumesImageMetadata-1686268488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76f006f3-6923-41e2-b314-5a387611fcb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '5e8ec622-9796-45d2-a367-3c4954f92a39', 'volume_name': 'volume-5e8ec622-9796-45d2-a367-3c4954f92a39', 'volume_size': 1, 'image_id': '394b3891-80f2-44c9-a9aa-56fe23a5acb3', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b04c3d19c79d4c208395e97f9d293618', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '394b3891-80f2-44c9-a9aa-56fe23a5acb3', 'created_at': datetime.datetime(2021, 12, 18, 20, 38, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 12, 18, 20, 38, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/394b3891-80f2-44c9-a9aa-56fe23a5acb3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:15:14.743922 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-2dd15ce1-f308-432e-b2f2-a189fe2c9e2a tempest-VolumesImageMetadata-1686268488 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (078bbb8a-26f9-4add-a957-0a04688d3a6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:15:14.746067 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-2dd15ce1-f308-432e-b2f2-a189fe2c9e2a tempest-VolumesImageMetadata-1686268488 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (078bbb8a-26f9-4add-a957-0a04688d3a6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:15:14.748274 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-2dd15ce1-f308-432e-b2f2-a189fe2c9e2a tempest-VolumesImageMetadata-1686268488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73af4365-0369-4a12-ad02-afaf4584cb2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:15:14.749078 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.flows.manager.create_volume [None req-2dd15ce1-f308-432e-b2f2-a189fe2c9e2a tempest-VolumesImageMetadata-1686268488 None] Volume 5e8ec622-9796-45d2-a367-3c4954f92a39: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-5e8ec622-9796-45d2-a367-3c4954f92a39', 'volume_size': 1, 'image_id': '394b3891-80f2-44c9-a9aa-56fe23a5acb3', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b04c3d19c79d4c208395e97f9d293618', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '394b3891-80f2-44c9-a9aa-56fe23a5acb3', 'created_at': datetime.datetime(2021, 12, 18, 20, 38, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 12, 18, 20, 38, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/394b3891-80f2-44c9-a9aa-56fe23a5acb3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Dec 18 21:15:14.749635 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.flows.manager.create_volume [None req-2dd15ce1-f308-432e-b2f2-a189fe2c9e2a tempest-VolumesImageMetadata-1686268488 None] Cloning 5e8ec622-9796-45d2-a367-3c4954f92a39 from image 394b3891-80f2-44c9-a9aa-56fe23a5acb3 at location (None, None). {{(pid=134148) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1047}} Dec 18 21:15:14.758222 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.coordination [None req-2dd15ce1-f308-432e-b2f2-a189fe2c9e2a tempest-VolumesImageMetadata-1686268488 None] Lock "b'cinder-394b3891-80f2-44c9-a9aa-56fe23a5acb3'" acquired by "_prepare_image_cache_entry" :: waited 0.008s {{(pid=134148) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 18 21:15:14.767417 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.image.cache [None req-2dd15ce1-f308-432e-b2f2-a189fe2c9e2a tempest-VolumesImageMetadata-1686268488 None] Found image-volume cache entry: {'id': 1, 'image_id': '394b3891-80f2-44c9-a9aa-56fe23a5acb3', 'volume_id': 'e6411a45-48fa-4beb-a5a0-eb6a6ca3f525', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2021, 12, 18, 20, 38, 21), 'last_used': datetime.datetime(2021, 12, 18, 21, 15, 14, 762337)}. {{(pid=134148) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Dec 18 21:15:14.767919 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.image.cache [None req-2dd15ce1-f308-432e-b2f2-a189fe2c9e2a tempest-VolumesImageMetadata-1686268488 None] Image-volume cache entry image_update_at = 2021-12-18 20:38:21+00:00, requested image updated_at = 2021-12-18 20:38:21+00:00. {{(pid=134148) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Dec 18 21:15:14.768352 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.flows.manager.create_volume [None req-2dd15ce1-f308-432e-b2f2-a189fe2c9e2a tempest-VolumesImageMetadata-1686268488 None] Found cache entry for image = 394b3891-80f2-44c9-a9aa-56fe23a5acb3 on host ncdv-master-1@ceph#ceph. {{(pid=134148) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:870}} Dec 18 21:15:14.772436 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.coordination [None req-2dd15ce1-f308-432e-b2f2-a189fe2c9e2a tempest-VolumesImageMetadata-1686268488 None] Lock "b'cinder-394b3891-80f2-44c9-a9aa-56fe23a5acb3'" released by "_prepare_image_cache_entry" :: held 0.014s {{(pid=134148) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 18 21:15:14.773311 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.flows.manager.create_volume [None req-2dd15ce1-f308-432e-b2f2-a189fe2c9e2a tempest-VolumesImageMetadata-1686268488 None] Attempting to retrieve cache entry for image = 394b3891-80f2-44c9-a9aa-56fe23a5acb3 on host ncdv-master-1@ceph#ceph. {{(pid=134148) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:811}} Dec 18 21:15:14.800238 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.image.cache [None req-2dd15ce1-f308-432e-b2f2-a189fe2c9e2a tempest-VolumesImageMetadata-1686268488 None] Found image-volume cache entry: {'id': 1, 'image_id': '394b3891-80f2-44c9-a9aa-56fe23a5acb3', 'volume_id': 'e6411a45-48fa-4beb-a5a0-eb6a6ca3f525', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2021, 12, 18, 20, 38, 21), 'last_used': datetime.datetime(2021, 12, 18, 21, 15, 14, 797557)}. {{(pid=134148) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Dec 18 21:15:14.800700 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.image.cache [None req-2dd15ce1-f308-432e-b2f2-a189fe2c9e2a tempest-VolumesImageMetadata-1686268488 None] Image-volume cache entry image_update_at = 2021-12-18 20:38:21+00:00, requested image updated_at = 2021-12-18 20:38:21+00:00. {{(pid=134148) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Dec 18 21:15:14.801093 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.flows.manager.create_volume [None req-2dd15ce1-f308-432e-b2f2-a189fe2c9e2a tempest-VolumesImageMetadata-1686268488 None] Creating from source image-volume e6411a45-48fa-4beb-a5a0-eb6a6ca3f525 {{(pid=134148) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:825}} Dec 18 21:15:14.812746 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-2dd15ce1-f308-432e-b2f2-a189fe2c9e2a tempest-VolumesImageMetadata-1686268488 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:15:14.860892 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-2dd15ce1-f308-432e-b2f2-a189fe2c9e2a tempest-VolumesImageMetadata-1686268488 None] creating snapshot='volume-5e8ec622-9796-45d2-a367-3c4954f92a39.clone_snap' {{(pid=134148) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:725}} Dec 18 21:15:15.710829 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-2dd15ce1-f308-432e-b2f2-a189fe2c9e2a tempest-VolumesImageMetadata-1686268488 None] cloning 'volume-e6411a45-48fa-4beb-a5a0-eb6a6ca3f525@volume-5e8ec622-9796-45d2-a367-3c4954f92a39.clone_snap' to 'volume-5e8ec622-9796-45d2-a367-3c4954f92a39' {{(pid=134148) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:731}} Dec 18 21:15:15.840440 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-2dd15ce1-f308-432e-b2f2-a189fe2c9e2a tempest-VolumesImageMetadata-1686268488 None] Volume volume-9f5f7417-3abc-4462-988f-ef519750d753.deleted is not a clone. {{(pid=134148) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Dec 18 21:15:15.841620 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-2dd15ce1-f308-432e-b2f2-a189fe2c9e2a tempest-VolumesImageMetadata-1686268488 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134148) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 18 21:15:15.841997 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-2dd15ce1-f308-432e-b2f2-a189fe2c9e2a tempest-VolumesImageMetadata-1686268488 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134148) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 18 21:15:15.856875 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-2dd15ce1-f308-432e-b2f2-a189fe2c9e2a tempest-VolumesImageMetadata-1686268488 None] clone created successfully {{(pid=134148) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:803}} Dec 18 21:15:15.857549 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.volume_utils [None req-2dd15ce1-f308-432e-b2f2-a189fe2c9e2a tempest-VolumesImageMetadata-1686268488 None] Marking volume 5e8ec622-9796-45d2-a367-3c4954f92a39 as bootable. {{(pid=134148) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1178}} Dec 18 21:15:15.865453 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.flows.manager.create_volume [None req-2dd15ce1-f308-432e-b2f2-a189fe2c9e2a tempest-VolumesImageMetadata-1686268488 None] Copying metadata from image 394b3891-80f2-44c9-a9aa-56fe23a5acb3 to 5e8ec622-9796-45d2-a367-3c4954f92a39. {{(pid=134148) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:444}} Dec 18 21:15:15.865913 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.flows.manager.create_volume [None req-2dd15ce1-f308-432e-b2f2-a189fe2c9e2a tempest-VolumesImageMetadata-1686268488 None] Creating volume glance metadata for volume 5e8ec622-9796-45d2-a367-3c4954f92a39 backed by image 394b3891-80f2-44c9-a9aa-56fe23a5acb3 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '394b3891-80f2-44c9-a9aa-56fe23a5acb3', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=134148) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:667}} Dec 18 21:15:15.912678 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-2dd15ce1-f308-432e-b2f2-a189fe2c9e2a tempest-VolumesImageMetadata-1686268488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73af4365-0369-4a12-ad02-afaf4584cb2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5e8ec622-9796-45d2-a367-3c4954f92a39', 'volume_size': 1, 'image_id': '394b3891-80f2-44c9-a9aa-56fe23a5acb3', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b04c3d19c79d4c208395e97f9d293618', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '394b3891-80f2-44c9-a9aa-56fe23a5acb3', 'created_at': datetime.datetime(2021, 12, 18, 20, 38, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 12, 18, 20, 38, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/394b3891-80f2-44c9-a9aa-56fe23a5acb3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:15:15.914937 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-2dd15ce1-f308-432e-b2f2-a189fe2c9e2a tempest-VolumesImageMetadata-1686268488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07a85cd1-194a-448e-b006-d5653583d07d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:15:15.922176 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.flows.manager.create_volume [None req-2dd15ce1-f308-432e-b2f2-a189fe2c9e2a tempest-VolumesImageMetadata-1686268488 None] Volume volume-5e8ec622-9796-45d2-a367-3c4954f92a39 (5e8ec622-9796-45d2-a367-3c4954f92a39): created successfully Dec 18 21:15:15.924025 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-2dd15ce1-f308-432e-b2f2-a189fe2c9e2a tempest-VolumesImageMetadata-1686268488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07a85cd1-194a-448e-b006-d5653583d07d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:15:15.927507 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-2dd15ce1-f308-432e-b2f2-a189fe2c9e2a tempest-VolumesImageMetadata-1686268488 None] Flow 'volume_create_manager' (e00b4a1b-039c-4ed6-a26e-1941ed8a21bf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134148) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 18 21:15:15.934083 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-2dd15ce1-f308-432e-b2f2-a189fe2c9e2a tempest-VolumesImageMetadata-1686268488 None] Created volume successfully. Dec 18 21:15:16.966613 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.coordination [None req-a4f4eb96-795d-4ee3-8f98-b5ac64094c60 tempest-VolumesImageMetadata-1686268488 None] Lock "b'cinder-5e8ec622-9796-45d2-a367-3c4954f92a39-delete_volume'" acquired by "delete_volume" :: waited 0.018s {{(pid=134148) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 18 21:15:17.013201 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-a4f4eb96-795d-4ee3-8f98-b5ac64094c60 tempest-VolumesImageMetadata-1686268488 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:15:17.079294 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-a4f4eb96-795d-4ee3-8f98-b5ac64094c60 tempest-VolumesImageMetadata-1686268488 None] volume has no backup snaps {{(pid=134148) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Dec 18 21:15:17.086704 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-a4f4eb96-795d-4ee3-8f98-b5ac64094c60 tempest-VolumesImageMetadata-1686268488 None] deleting rbd volume volume-5e8ec622-9796-45d2-a367-3c4954f92a39 {{(pid=134148) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Dec 18 21:15:17.106866 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.flows.manager.create_volume [None req-c4a7f60e-f8c5-4467-aa71-54b1b8f29bb9 tempest-AttachVolumeTestJSON-466975463 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134148) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Dec 18 21:15:17.110873 ncdv-master-1 cinder-volume[134148]: WARNING stevedore.named [None req-c4a7f60e-f8c5-4467-aa71-54b1b8f29bb9 tempest-AttachVolumeTestJSON-466975463 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Dec 18 21:15:17.111322 ncdv-master-1 cinder-volume[134148]: WARNING castellan.key_manager [None req-c4a7f60e-f8c5-4467-aa71-54b1b8f29bb9 tempest-AttachVolumeTestJSON-466975463 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Dec 18 21:15:17.124017 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-c4a7f60e-f8c5-4467-aa71-54b1b8f29bb9 tempest-AttachVolumeTestJSON-466975463 None] Flow 'volume_create_manager' (c04e9683-3cbb-4654-b573-5a3f573d47c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 18 21:15:17.127395 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-c4a7f60e-f8c5-4467-aa71-54b1b8f29bb9 tempest-AttachVolumeTestJSON-466975463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5368c49d-6df5-434e-a998-b9573277de7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:15:17.134665 ncdv-master-1 cinder-volume[134148]: DEBUG oslo_db.sqlalchemy.engines [None req-c4a7f60e-f8c5-4467-aa71-54b1b8f29bb9 tempest-AttachVolumeTestJSON-466975463 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134148) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 18 21:15:17.148019 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-c4a7f60e-f8c5-4467-aa71-54b1b8f29bb9 tempest-AttachVolumeTestJSON-466975463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5368c49d-6df5-434e-a998-b9573277de7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-12-18T21:15:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1179561308',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=a2805e9a-f450-4ca2-921c-1bba86b6b1e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0115052ed7dd4b60b9c729f1daa095c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-12-18T21:15:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-12-18T21:15:17Z,use_quota=True,user_id='a3e6bef41b9948099215b02cdca829bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f2e1fe1-9fd6-411e-9ed9-368f463ccb6f),volume_type_id=1f2e1fe1-9fd6-411e-9ed9-368f463ccb6f)' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:15:17.150723 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-c4a7f60e-f8c5-4467-aa71-54b1b8f29bb9 tempest-AttachVolumeTestJSON-466975463 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f523aaae-cace-4939-824c-1f4570124a11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:15:17.153028 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-c4a7f60e-f8c5-4467-aa71-54b1b8f29bb9 tempest-AttachVolumeTestJSON-466975463 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f523aaae-cace-4939-824c-1f4570124a11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:15:17.155661 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-c4a7f60e-f8c5-4467-aa71-54b1b8f29bb9 tempest-AttachVolumeTestJSON-466975463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e10dcd9b-bde0-40b2-830d-53e1aad14600) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:15:17.158303 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-c4a7f60e-f8c5-4467-aa71-54b1b8f29bb9 tempest-AttachVolumeTestJSON-466975463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e10dcd9b-bde0-40b2-830d-53e1aad14600) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a2805e9a-f450-4ca2-921c-1bba86b6b1e1', 'volume_name': 'volume-a2805e9a-f450-4ca2-921c-1bba86b6b1e1', 'volume_size': 1}' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:15:17.160658 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-c4a7f60e-f8c5-4467-aa71-54b1b8f29bb9 tempest-AttachVolumeTestJSON-466975463 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5cbd33a8-9bf6-470e-99b7-c7033ef6a992) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:15:17.162917 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-c4a7f60e-f8c5-4467-aa71-54b1b8f29bb9 tempest-AttachVolumeTestJSON-466975463 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5cbd33a8-9bf6-470e-99b7-c7033ef6a992) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:15:17.165443 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-c4a7f60e-f8c5-4467-aa71-54b1b8f29bb9 tempest-AttachVolumeTestJSON-466975463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3a59359-2035-4668-a40d-d2a71b19f0df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:15:17.166276 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.flows.manager.create_volume [None req-c4a7f60e-f8c5-4467-aa71-54b1b8f29bb9 tempest-AttachVolumeTestJSON-466975463 None] Volume a2805e9a-f450-4ca2-921c-1bba86b6b1e1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a2805e9a-f450-4ca2-921c-1bba86b6b1e1', 'volume_size': 1} Dec 18 21:15:17.166699 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-c4a7f60e-f8c5-4467-aa71-54b1b8f29bb9 tempest-AttachVolumeTestJSON-466975463 None] creating volume 'volume-a2805e9a-f450-4ca2-921c-1bba86b6b1e1' {{(pid=134148) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Dec 18 21:15:17.167638 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-c4a7f60e-f8c5-4467-aa71-54b1b8f29bb9 tempest-AttachVolumeTestJSON-466975463 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:15:17.222577 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-c4a7f60e-f8c5-4467-aa71-54b1b8f29bb9 tempest-AttachVolumeTestJSON-466975463 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134148) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 18 21:15:17.222955 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-c4a7f60e-f8c5-4467-aa71-54b1b8f29bb9 tempest-AttachVolumeTestJSON-466975463 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134148) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 18 21:15:17.225678 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-c4a7f60e-f8c5-4467-aa71-54b1b8f29bb9 tempest-AttachVolumeTestJSON-466975463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3a59359-2035-4668-a40d-d2a71b19f0df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a2805e9a-f450-4ca2-921c-1bba86b6b1e1', 'volume_size': 1}' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:15:17.227925 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-c4a7f60e-f8c5-4467-aa71-54b1b8f29bb9 tempest-AttachVolumeTestJSON-466975463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e3b0a4d-60cd-40e4-aafb-b4bb07c89593) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:15:17.236784 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.flows.manager.create_volume [None req-c4a7f60e-f8c5-4467-aa71-54b1b8f29bb9 tempest-AttachVolumeTestJSON-466975463 None] Volume volume-a2805e9a-f450-4ca2-921c-1bba86b6b1e1 (a2805e9a-f450-4ca2-921c-1bba86b6b1e1): created successfully Dec 18 21:15:17.239073 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-c4a7f60e-f8c5-4467-aa71-54b1b8f29bb9 tempest-AttachVolumeTestJSON-466975463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e3b0a4d-60cd-40e4-aafb-b4bb07c89593) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:15:17.243467 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-c4a7f60e-f8c5-4467-aa71-54b1b8f29bb9 tempest-AttachVolumeTestJSON-466975463 None] Flow 'volume_create_manager' (c04e9683-3cbb-4654-b573-5a3f573d47c4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134148) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 18 21:15:17.251726 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-c4a7f60e-f8c5-4467-aa71-54b1b8f29bb9 tempest-AttachVolumeTestJSON-466975463 None] Created volume successfully. Dec 18 21:15:17.274348 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-a4f4eb96-795d-4ee3-8f98-b5ac64094c60 tempest-VolumesImageMetadata-1686268488 None] volume is a clone so cleaning references {{(pid=134148) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1266}} Dec 18 21:15:17.304732 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-a4f4eb96-795d-4ee3-8f98-b5ac64094c60 tempest-VolumesImageMetadata-1686268488 None] deleting parent snapshot volume-5e8ec622-9796-45d2-a367-3c4954f92a39.clone_snap {{(pid=134148) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1158}} Dec 18 21:15:17.787742 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.quota [None req-a4f4eb96-795d-4ee3-8f98-b5ac64094c60 tempest-VolumesImageMetadata-1686268488 None] Created reservations ['9351d9c3-a21b-47b9-84a5-9beece17a8f9', '1ca64dde-d713-4c6a-9494-a4dafe26e72e', '7bc04b42-672e-4e4d-82cc-9e406e7253a4', 'a2372abd-8db8-495d-be20-ea48620c1929'] {{(pid=134148) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 18 21:15:17.828616 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-a4f4eb96-795d-4ee3-8f98-b5ac64094c60 tempest-VolumesImageMetadata-1686268488 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:15:17.852225 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-a4f4eb96-795d-4ee3-8f98-b5ac64094c60 tempest-VolumesImageMetadata-1686268488 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:15:17.874200 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.manager [None req-a4f4eb96-795d-4ee3-8f98-b5ac64094c60 tempest-VolumesImageMetadata-1686268488 None] Notifying Schedulers of capabilities ... {{(pid=134148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 18 21:15:17.878373 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-a4f4eb96-795d-4ee3-8f98-b5ac64094c60 tempest-VolumesImageMetadata-1686268488 None] Deleted volume successfully. Dec 18 21:15:17.890064 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.coordination [None req-a4f4eb96-795d-4ee3-8f98-b5ac64094c60 tempest-VolumesImageMetadata-1686268488 None] Lock "b'cinder-5e8ec622-9796-45d2-a367-3c4954f92a39-delete_volume'" released by "delete_volume" :: held 0.924s {{(pid=134148) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 18 21:15:18.519362 ncdv-master-1 cinder-volume[134148]: DEBUG oslo_concurrency.processutils [req-09e6de78-44a3-49d5-8c6e-fc333653c44a req-f113e70a-e60b-4f3c-ad14-4ee026659742 tempest-AttachVolumeTestJSON-466975463 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=134148) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Dec 18 21:15:19.267703 ncdv-master-1 cinder-volume[134148]: DEBUG oslo_concurrency.processutils [req-09e6de78-44a3-49d5-8c6e-fc333653c44a req-f113e70a-e60b-4f3c-ad14-4ee026659742 tempest-AttachVolumeTestJSON-466975463 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.748s {{(pid=134148) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Dec 18 21:15:19.268492 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [req-09e6de78-44a3-49d5-8c6e-fc333653c44a req-f113e70a-e60b-4f3c-ad14-4ee026659742 tempest-AttachVolumeTestJSON-466975463 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-a2805e9a-f450-4ca2-921c-1bba86b6b1e1', 'hosts': ['10.222.0.13'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '946d1715-d12c-4dbf-8a79-181222df6e2e', 'volume_id': 'a2805e9a-f450-4ca2-921c-1bba86b6b1e1', 'discard': True}} {{(pid=134148) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Dec 18 21:15:19.291439 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [req-09e6de78-44a3-49d5-8c6e-fc333653c44a req-f113e70a-e60b-4f3c-ad14-4ee026659742 tempest-AttachVolumeTestJSON-466975463 None] Connection info returned from driver {'name': 'volumes/volume-a2805e9a-f450-4ca2-921c-1bba86b6b1e1', 'hosts': ['10.222.0.13'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'a2805e9a-f450-4ca2-921c-1bba86b6b1e1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'b957629c-ed0f-45b8-bdfe-c7dcf6c95e08'} {{(pid=134148) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4812}} Dec 18 21:15:19.340082 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [req-09e6de78-44a3-49d5-8c6e-fc333653c44a req-f113e70a-e60b-4f3c-ad14-4ee026659742 tempest-AttachVolumeTestJSON-466975463 None] attachment_update completed successfully. Dec 18 21:15:19.866188 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.flows.manager.create_volume [None req-3c26578b-159f-4ae6-a086-7d8229278212 tempest-VolumesBackupsTest-1696781328 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134148) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Dec 18 21:15:19.869889 ncdv-master-1 cinder-volume[134148]: WARNING stevedore.named [None req-3c26578b-159f-4ae6-a086-7d8229278212 tempest-VolumesBackupsTest-1696781328 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Dec 18 21:15:19.870417 ncdv-master-1 cinder-volume[134148]: WARNING castellan.key_manager [None req-3c26578b-159f-4ae6-a086-7d8229278212 tempest-VolumesBackupsTest-1696781328 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Dec 18 21:15:19.883375 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-3c26578b-159f-4ae6-a086-7d8229278212 tempest-VolumesBackupsTest-1696781328 None] Flow 'volume_create_manager' (4469a058-8913-4d3b-b77a-6d7300fc54e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 18 21:15:19.886698 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-3c26578b-159f-4ae6-a086-7d8229278212 tempest-VolumesBackupsTest-1696781328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d49b4d44-f49b-4adf-89a7-bd61a8df7894) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:15:19.893300 ncdv-master-1 cinder-volume[134148]: DEBUG oslo_db.sqlalchemy.engines [None req-3c26578b-159f-4ae6-a086-7d8229278212 tempest-VolumesBackupsTest-1696781328 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134148) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 18 21:15:19.908951 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-3c26578b-159f-4ae6-a086-7d8229278212 tempest-VolumesBackupsTest-1696781328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d49b4d44-f49b-4adf-89a7-bd61a8df7894) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-12-18T21:15:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsTest-Volume-419685420',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=711fd27e-147d-4084-8318-a72e449932b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3ff294c24f54faf9ba1592e4dd3ebaa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-12-18T21:15:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-12-18T21:15:20Z,use_quota=True,user_id='480f527dbe434218a49acb6095d4d66f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f2e1fe1-9fd6-411e-9ed9-368f463ccb6f),volume_type_id=1f2e1fe1-9fd6-411e-9ed9-368f463ccb6f)' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:15:19.912235 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-3c26578b-159f-4ae6-a086-7d8229278212 tempest-VolumesBackupsTest-1696781328 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (562f17f7-4aab-4142-9dce-c5acad1ef0ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:15:19.914468 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-3c26578b-159f-4ae6-a086-7d8229278212 tempest-VolumesBackupsTest-1696781328 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (562f17f7-4aab-4142-9dce-c5acad1ef0ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:15:19.916850 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-3c26578b-159f-4ae6-a086-7d8229278212 tempest-VolumesBackupsTest-1696781328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e87e2d5c-72b8-4353-99c8-07a2823bfdb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:15:19.919134 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-3c26578b-159f-4ae6-a086-7d8229278212 tempest-VolumesBackupsTest-1696781328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e87e2d5c-72b8-4353-99c8-07a2823bfdb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '711fd27e-147d-4084-8318-a72e449932b9', 'volume_name': 'volume-711fd27e-147d-4084-8318-a72e449932b9', 'volume_size': 1}' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:15:19.921597 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-3c26578b-159f-4ae6-a086-7d8229278212 tempest-VolumesBackupsTest-1696781328 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8041de76-6199-486c-a76a-6cfaf76049ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:15:19.923749 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-3c26578b-159f-4ae6-a086-7d8229278212 tempest-VolumesBackupsTest-1696781328 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8041de76-6199-486c-a76a-6cfaf76049ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:15:19.926278 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-3c26578b-159f-4ae6-a086-7d8229278212 tempest-VolumesBackupsTest-1696781328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb0a1cd0-e3b5-4348-91b4-c144c0737d97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:15:19.927183 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.flows.manager.create_volume [None req-3c26578b-159f-4ae6-a086-7d8229278212 tempest-VolumesBackupsTest-1696781328 None] Volume 711fd27e-147d-4084-8318-a72e449932b9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-711fd27e-147d-4084-8318-a72e449932b9', 'volume_size': 1} Dec 18 21:15:19.927586 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-3c26578b-159f-4ae6-a086-7d8229278212 tempest-VolumesBackupsTest-1696781328 None] creating volume 'volume-711fd27e-147d-4084-8318-a72e449932b9' {{(pid=134148) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Dec 18 21:15:19.928675 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-3c26578b-159f-4ae6-a086-7d8229278212 tempest-VolumesBackupsTest-1696781328 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:15:19.986346 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-3c26578b-159f-4ae6-a086-7d8229278212 tempest-VolumesBackupsTest-1696781328 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134148) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 18 21:15:19.986838 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-3c26578b-159f-4ae6-a086-7d8229278212 tempest-VolumesBackupsTest-1696781328 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134148) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 18 21:15:19.988868 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-3c26578b-159f-4ae6-a086-7d8229278212 tempest-VolumesBackupsTest-1696781328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb0a1cd0-e3b5-4348-91b4-c144c0737d97) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-711fd27e-147d-4084-8318-a72e449932b9', 'volume_size': 1}' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:15:19.991091 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-3c26578b-159f-4ae6-a086-7d8229278212 tempest-VolumesBackupsTest-1696781328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0095ccfb-0b53-4dbd-937f-3bd522bdb0b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:15:20.000317 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.flows.manager.create_volume [None req-3c26578b-159f-4ae6-a086-7d8229278212 tempest-VolumesBackupsTest-1696781328 None] Volume volume-711fd27e-147d-4084-8318-a72e449932b9 (711fd27e-147d-4084-8318-a72e449932b9): created successfully Dec 18 21:15:20.002503 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-3c26578b-159f-4ae6-a086-7d8229278212 tempest-VolumesBackupsTest-1696781328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0095ccfb-0b53-4dbd-937f-3bd522bdb0b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:15:20.006228 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-3c26578b-159f-4ae6-a086-7d8229278212 tempest-VolumesBackupsTest-1696781328 None] Flow 'volume_create_manager' (4469a058-8913-4d3b-b77a-6d7300fc54e8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134148) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 18 21:15:20.014445 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-3c26578b-159f-4ae6-a086-7d8229278212 tempest-VolumesBackupsTest-1696781328 None] Created volume successfully. Dec 18 21:15:22.272487 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.flows.manager.create_volume [None req-905cc6e5-96f9-4139-b112-9995f4afbabf tempest-AttachVolumeTestJSON-466975463 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134148) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Dec 18 21:15:22.278548 ncdv-master-1 cinder-volume[134148]: WARNING stevedore.named [None req-905cc6e5-96f9-4139-b112-9995f4afbabf tempest-AttachVolumeTestJSON-466975463 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Dec 18 21:15:22.279439 ncdv-master-1 cinder-volume[134148]: WARNING castellan.key_manager [None req-905cc6e5-96f9-4139-b112-9995f4afbabf tempest-AttachVolumeTestJSON-466975463 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Dec 18 21:15:22.298860 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-905cc6e5-96f9-4139-b112-9995f4afbabf tempest-AttachVolumeTestJSON-466975463 None] Flow 'volume_create_manager' (2d320e79-98a1-4606-a446-d658b4d9a13c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 18 21:15:22.303306 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-905cc6e5-96f9-4139-b112-9995f4afbabf tempest-AttachVolumeTestJSON-466975463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (264ec747-a692-4f2c-86a6-ce7d69f5590a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:15:22.313398 ncdv-master-1 cinder-volume[134148]: DEBUG oslo_db.sqlalchemy.engines [None req-905cc6e5-96f9-4139-b112-9995f4afbabf tempest-AttachVolumeTestJSON-466975463 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134148) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 18 21:15:22.330570 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-905cc6e5-96f9-4139-b112-9995f4afbabf tempest-AttachVolumeTestJSON-466975463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (264ec747-a692-4f2c-86a6-ce7d69f5590a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-12-18T21:15:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-16627764',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=e3f4d09b-7e17-403a-90d2-33cb5c4f21dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0115052ed7dd4b60b9c729f1daa095c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-12-18T21:15:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-12-18T21:15:22Z,use_quota=True,user_id='a3e6bef41b9948099215b02cdca829bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f2e1fe1-9fd6-411e-9ed9-368f463ccb6f),volume_type_id=1f2e1fe1-9fd6-411e-9ed9-368f463ccb6f)' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:15:22.334104 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-905cc6e5-96f9-4139-b112-9995f4afbabf tempest-AttachVolumeTestJSON-466975463 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54c4110a-94c0-4af0-b4db-533685ca0cc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:15:22.336529 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-905cc6e5-96f9-4139-b112-9995f4afbabf tempest-AttachVolumeTestJSON-466975463 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54c4110a-94c0-4af0-b4db-533685ca0cc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:15:22.339067 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-905cc6e5-96f9-4139-b112-9995f4afbabf tempest-AttachVolumeTestJSON-466975463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d270ba66-eaf8-4bf7-b12a-8685602043e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:15:22.341505 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-905cc6e5-96f9-4139-b112-9995f4afbabf tempest-AttachVolumeTestJSON-466975463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d270ba66-eaf8-4bf7-b12a-8685602043e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e3f4d09b-7e17-403a-90d2-33cb5c4f21dd', 'volume_name': 'volume-e3f4d09b-7e17-403a-90d2-33cb5c4f21dd', 'volume_size': 1}' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:15:22.343902 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-905cc6e5-96f9-4139-b112-9995f4afbabf tempest-AttachVolumeTestJSON-466975463 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f2697b9-0e35-4106-9552-14f06f01df9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:15:22.346047 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-905cc6e5-96f9-4139-b112-9995f4afbabf tempest-AttachVolumeTestJSON-466975463 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f2697b9-0e35-4106-9552-14f06f01df9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:15:22.348315 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-905cc6e5-96f9-4139-b112-9995f4afbabf tempest-AttachVolumeTestJSON-466975463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb777184-95fe-4469-a6c8-aeb35ffe9104) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:15:22.349677 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.flows.manager.create_volume [None req-905cc6e5-96f9-4139-b112-9995f4afbabf tempest-AttachVolumeTestJSON-466975463 None] Volume e3f4d09b-7e17-403a-90d2-33cb5c4f21dd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e3f4d09b-7e17-403a-90d2-33cb5c4f21dd', 'volume_size': 1} Dec 18 21:15:22.350281 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-905cc6e5-96f9-4139-b112-9995f4afbabf tempest-AttachVolumeTestJSON-466975463 None] creating volume 'volume-e3f4d09b-7e17-403a-90d2-33cb5c4f21dd' {{(pid=134148) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Dec 18 21:15:22.351464 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-905cc6e5-96f9-4139-b112-9995f4afbabf tempest-AttachVolumeTestJSON-466975463 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:15:22.420896 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-905cc6e5-96f9-4139-b112-9995f4afbabf tempest-AttachVolumeTestJSON-466975463 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134148) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 18 21:15:22.421588 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-905cc6e5-96f9-4139-b112-9995f4afbabf tempest-AttachVolumeTestJSON-466975463 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134148) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 18 21:15:22.423799 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-905cc6e5-96f9-4139-b112-9995f4afbabf tempest-AttachVolumeTestJSON-466975463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb777184-95fe-4469-a6c8-aeb35ffe9104) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e3f4d09b-7e17-403a-90d2-33cb5c4f21dd', 'volume_size': 1}' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:15:22.426206 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-905cc6e5-96f9-4139-b112-9995f4afbabf tempest-AttachVolumeTestJSON-466975463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (819635d2-79b5-4fe4-8986-a4b99e195228) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:15:22.437407 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.flows.manager.create_volume [None req-905cc6e5-96f9-4139-b112-9995f4afbabf tempest-AttachVolumeTestJSON-466975463 None] Volume volume-e3f4d09b-7e17-403a-90d2-33cb5c4f21dd (e3f4d09b-7e17-403a-90d2-33cb5c4f21dd): created successfully Dec 18 21:15:22.439808 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-905cc6e5-96f9-4139-b112-9995f4afbabf tempest-AttachVolumeTestJSON-466975463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (819635d2-79b5-4fe4-8986-a4b99e195228) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:15:22.443143 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-905cc6e5-96f9-4139-b112-9995f4afbabf tempest-AttachVolumeTestJSON-466975463 None] Flow 'volume_create_manager' (2d320e79-98a1-4606-a446-d658b4d9a13c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134148) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 18 21:15:22.451610 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-905cc6e5-96f9-4139-b112-9995f4afbabf tempest-AttachVolumeTestJSON-466975463 None] Created volume successfully. Dec 18 21:15:23.894327 ncdv-master-1 cinder-volume[134148]: DEBUG oslo_concurrency.processutils [req-af8c204d-46ca-4574-ab8b-8b4fa27a645d req-c5a0ccc1-4d97-4b6d-aadc-a93f95591d17 tempest-AttachVolumeTestJSON-466975463 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=134148) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Dec 18 21:15:24.768497 ncdv-master-1 cinder-volume[134148]: DEBUG oslo_concurrency.processutils [req-af8c204d-46ca-4574-ab8b-8b4fa27a645d req-c5a0ccc1-4d97-4b6d-aadc-a93f95591d17 tempest-AttachVolumeTestJSON-466975463 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.873s {{(pid=134148) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Dec 18 21:15:24.769209 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [req-af8c204d-46ca-4574-ab8b-8b4fa27a645d req-c5a0ccc1-4d97-4b6d-aadc-a93f95591d17 tempest-AttachVolumeTestJSON-466975463 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-e3f4d09b-7e17-403a-90d2-33cb5c4f21dd', 'hosts': ['10.222.0.13'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '946d1715-d12c-4dbf-8a79-181222df6e2e', 'volume_id': 'e3f4d09b-7e17-403a-90d2-33cb5c4f21dd', 'discard': True}} {{(pid=134148) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Dec 18 21:15:24.826964 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [req-af8c204d-46ca-4574-ab8b-8b4fa27a645d req-c5a0ccc1-4d97-4b6d-aadc-a93f95591d17 tempest-AttachVolumeTestJSON-466975463 None] Connection info returned from driver {'name': 'volumes/volume-e3f4d09b-7e17-403a-90d2-33cb5c4f21dd', 'hosts': ['10.222.0.13'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'e3f4d09b-7e17-403a-90d2-33cb5c4f21dd', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '7ba8dcab-451f-4c4b-ab96-09fc6886fd89'} {{(pid=134148) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4812}} Dec 18 21:15:24.927734 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [req-af8c204d-46ca-4574-ab8b-8b4fa27a645d req-c5a0ccc1-4d97-4b6d-aadc-a93f95591d17 tempest-AttachVolumeTestJSON-466975463 None] attachment_update completed successfully. Dec 18 21:15:28.219083 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [req-207f0400-bb29-4423-a644-ce008dfd1e9c req-250b0a30-2b9e-4c09-93c6-2a705091d6b2 tempest-AttachVolumeTestJSON-466975463 None] Terminate volume connection completed successfully. Dec 18 21:15:28.220747 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [req-207f0400-bb29-4423-a644-ce008dfd1e9c req-250b0a30-2b9e-4c09-93c6-2a705091d6b2 tempest-AttachVolumeTestJSON-466975463 None] Deleting attachment b957629c-ed0f-45b8-bdfe-c7dcf6c95e08. {{(pid=134148) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4948}} Dec 18 21:15:29.733945 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [req-72076bd2-eb1e-4f5a-8af7-fdf8e73b1a5b req-25d363e1-1726-4bf4-8dd9-b38e9d3019ea tempest-AttachVolumeTestJSON-466975463 None] Terminate volume connection completed successfully. Dec 18 21:15:29.733945 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [req-72076bd2-eb1e-4f5a-8af7-fdf8e73b1a5b req-25d363e1-1726-4bf4-8dd9-b38e9d3019ea tempest-AttachVolumeTestJSON-466975463 None] Deleting attachment 7ba8dcab-451f-4c4b-ab96-09fc6886fd89. {{(pid=134148) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4948}} Dec 18 21:15:33.018727 ncdv-master-1 cinder-volume[134148]: DEBUG oslo_concurrency.processutils [req-b40e18b9-3f65-4115-8a9a-145b1907967a req-f6f32af1-5169-44e6-bab6-09fc75f9684f tempest-VolumesBackupsTest-1696781328 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=134148) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Dec 18 21:15:33.769030 ncdv-master-1 cinder-volume[134148]: DEBUG oslo_concurrency.processutils [req-b40e18b9-3f65-4115-8a9a-145b1907967a req-f6f32af1-5169-44e6-bab6-09fc75f9684f tempest-VolumesBackupsTest-1696781328 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.749s {{(pid=134148) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Dec 18 21:15:33.769278 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [req-b40e18b9-3f65-4115-8a9a-145b1907967a req-f6f32af1-5169-44e6-bab6-09fc75f9684f tempest-VolumesBackupsTest-1696781328 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-711fd27e-147d-4084-8318-a72e449932b9', 'hosts': ['10.222.0.13'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '946d1715-d12c-4dbf-8a79-181222df6e2e', 'volume_id': '711fd27e-147d-4084-8318-a72e449932b9', 'discard': True}} {{(pid=134148) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Dec 18 21:15:33.802312 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [req-b40e18b9-3f65-4115-8a9a-145b1907967a req-f6f32af1-5169-44e6-bab6-09fc75f9684f tempest-VolumesBackupsTest-1696781328 None] Connection info returned from driver {'name': 'volumes/volume-711fd27e-147d-4084-8318-a72e449932b9', 'hosts': ['10.222.0.13'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '711fd27e-147d-4084-8318-a72e449932b9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'fb605022-ea80-4d30-ac52-df5926a5e2a0'} {{(pid=134148) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4812}} Dec 18 21:15:33.920107 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [req-b40e18b9-3f65-4115-8a9a-145b1907967a req-f6f32af1-5169-44e6-bab6-09fc75f9684f tempest-VolumesBackupsTest-1696781328 None] attachment_update completed successfully. Dec 18 21:15:34.344873 ncdv-master-1 cinder-volume[134148]: DEBUG oslo_service.periodic_task [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134148) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Dec 18 21:15:34.347222 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:15:34.417092 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:15:34.498548 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.manager [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] Notifying Schedulers of capabilities ... {{(pid=134148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 18 21:15:35.117734 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [req-161a96de-5e86-4725-bbfc-c3823386d7b4 req-f2ed8e04-d6a5-4dc6-8603-c8d139583ce8 tempest-AttachVolumeShelveTestJSON-764429992 None] No connector for attachment 11494de4-2bcf-4da0-9e12-2c264a76a908; skipping storage backend terminate_connection call. {{(pid=134148) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:4903}} Dec 18 21:15:35.118607 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [req-161a96de-5e86-4725-bbfc-c3823386d7b4 req-f2ed8e04-d6a5-4dc6-8603-c8d139583ce8 tempest-AttachVolumeShelveTestJSON-764429992 None] Deleting attachment 11494de4-2bcf-4da0-9e12-2c264a76a908. {{(pid=134148) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4948}} Dec 18 21:15:35.482052 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-8287b369-4c64-4ae6-9808-5707b60eae18 tempest-TestVolumeBootPattern-1320248540 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:15:36.635879 ncdv-master-1 cinder-volume[134148]: DEBUG oslo_concurrency.processutils [None req-e68add05-a95d-497b-b345-88cde8b4712c tempest-VolumesBackupsTest-1696781328 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=134148) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Dec 18 21:15:36.723869 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-8287b369-4c64-4ae6-9808-5707b60eae18 tempest-TestVolumeBootPattern-1320248540 None] Create snapshot completed successfully Dec 18 21:15:37.416475 ncdv-master-1 cinder-volume[134148]: DEBUG oslo_concurrency.processutils [None req-e68add05-a95d-497b-b345-88cde8b4712c tempest-VolumesBackupsTest-1696781328 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.778s {{(pid=134148) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Dec 18 21:15:37.417495 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-e68add05-a95d-497b-b345-88cde8b4712c tempest-VolumesBackupsTest-1696781328 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-711fd27e-147d-4084-8318-a72e449932b9', 'hosts': ['10.222.0.13'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '946d1715-d12c-4dbf-8a79-181222df6e2e', 'volume_id': '711fd27e-147d-4084-8318-a72e449932b9', 'discard': True}} {{(pid=134148) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Dec 18 21:15:37.435595 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-e68add05-a95d-497b-b345-88cde8b4712c tempest-VolumesBackupsTest-1696781328 None] Initialize volume connection completed successfully. Dec 18 21:15:37.497412 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.coordination [None req-4880e8f9-0822-49bc-a6eb-7bd4b745486d tempest-AttachVolumeTestJSON-466975463 None] Lock "b'cinder-e3f4d09b-7e17-403a-90d2-33cb5c4f21dd-delete_volume'" acquired by "delete_volume" :: waited 0.017s {{(pid=134148) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 18 21:15:37.579267 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-4880e8f9-0822-49bc-a6eb-7bd4b745486d tempest-AttachVolumeTestJSON-466975463 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:15:37.661001 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-4880e8f9-0822-49bc-a6eb-7bd4b745486d tempest-AttachVolumeTestJSON-466975463 None] volume has no backup snaps {{(pid=134148) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Dec 18 21:15:37.661001 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-4880e8f9-0822-49bc-a6eb-7bd4b745486d tempest-AttachVolumeTestJSON-466975463 None] Volume volume-e3f4d09b-7e17-403a-90d2-33cb5c4f21dd is not a clone. {{(pid=134148) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Dec 18 21:15:37.669747 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-4880e8f9-0822-49bc-a6eb-7bd4b745486d tempest-AttachVolumeTestJSON-466975463 None] deleting rbd volume volume-e3f4d09b-7e17-403a-90d2-33cb5c4f21dd {{(pid=134148) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Dec 18 21:15:38.011666 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.quota [None req-4880e8f9-0822-49bc-a6eb-7bd4b745486d tempest-AttachVolumeTestJSON-466975463 None] Created reservations ['bd28a9d2-74e6-49a7-8326-be51652dcb28', '1a9a8e71-bd86-4677-9fd2-149e8b7eef80', '9b5be944-3ab5-4d0b-b0c1-92c4ebd95967', '6468578a-bc53-4f81-afd5-fdead1613c02'] {{(pid=134148) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 18 21:15:38.073099 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-4880e8f9-0822-49bc-a6eb-7bd4b745486d tempest-AttachVolumeTestJSON-466975463 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:15:38.144060 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-4880e8f9-0822-49bc-a6eb-7bd4b745486d tempest-AttachVolumeTestJSON-466975463 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:15:38.244409 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.manager [None req-4880e8f9-0822-49bc-a6eb-7bd4b745486d tempest-AttachVolumeTestJSON-466975463 None] Notifying Schedulers of capabilities ... {{(pid=134148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 18 21:15:38.264460 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-4880e8f9-0822-49bc-a6eb-7bd4b745486d tempest-AttachVolumeTestJSON-466975463 None] Deleted volume successfully. Dec 18 21:15:38.295130 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.flows.manager.create_volume [None req-29e94963-62be-433f-b309-70714431e3b0 tempest-TestVolumeBootPattern-1320248540 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134148) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Dec 18 21:15:38.299297 ncdv-master-1 cinder-volume[134148]: WARNING stevedore.named [None req-29e94963-62be-433f-b309-70714431e3b0 tempest-TestVolumeBootPattern-1320248540 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Dec 18 21:15:38.299951 ncdv-master-1 cinder-volume[134148]: WARNING castellan.key_manager [None req-29e94963-62be-433f-b309-70714431e3b0 tempest-TestVolumeBootPattern-1320248540 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Dec 18 21:15:38.310538 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.coordination [None req-4880e8f9-0822-49bc-a6eb-7bd4b745486d tempest-AttachVolumeTestJSON-466975463 None] Lock "b'cinder-e3f4d09b-7e17-403a-90d2-33cb5c4f21dd-delete_volume'" released by "delete_volume" :: held 0.813s {{(pid=134148) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 18 21:15:38.324692 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-29e94963-62be-433f-b309-70714431e3b0 tempest-TestVolumeBootPattern-1320248540 None] Flow 'volume_create_manager' (35880dca-5090-4b6f-b88c-5e863ab81597) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 18 21:15:38.328062 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-29e94963-62be-433f-b309-70714431e3b0 tempest-TestVolumeBootPattern-1320248540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f891ab5-8fad-490f-8119-f16664402f46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:15:38.334581 ncdv-master-1 cinder-volume[134148]: DEBUG oslo_db.sqlalchemy.engines [None req-29e94963-62be-433f-b309-70714431e3b0 tempest-TestVolumeBootPattern-1320248540 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134148) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 18 21:15:38.351338 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-29e94963-62be-433f-b309-70714431e3b0 tempest-TestVolumeBootPattern-1320248540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f891ab5-8fad-490f-8119-f16664402f46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=True,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-12-18T21:15:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeBootPattern-volume-926448835',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=41536881-3ff9-4059-a3bb-d571589e7a54,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de79cd87d023436a80d3cc5428586e21',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-12-18T21:15:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=38d8249f-a253-43e2-b429-d8a7c1a23757,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-12-18T21:15:38Z,use_quota=True,user_id='d32598482c834073b8fe24c84cb57d2f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f2e1fe1-9fd6-411e-9ed9-368f463ccb6f),volume_type_id=1f2e1fe1-9fd6-411e-9ed9-368f463ccb6f)' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:15:38.354590 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-29e94963-62be-433f-b309-70714431e3b0 tempest-TestVolumeBootPattern-1320248540 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5717b99-a122-4621-b881-e9b8b1519055) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:15:38.357804 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-29e94963-62be-433f-b309-70714431e3b0 tempest-TestVolumeBootPattern-1320248540 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5717b99-a122-4621-b881-e9b8b1519055) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:15:38.361124 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-29e94963-62be-433f-b309-70714431e3b0 tempest-TestVolumeBootPattern-1320248540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (603319d3-bbac-4280-be17-b5d998c1ad5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:15:38.364367 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-29e94963-62be-433f-b309-70714431e3b0 tempest-TestVolumeBootPattern-1320248540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (603319d3-bbac-4280-be17-b5d998c1ad5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '41536881-3ff9-4059-a3bb-d571589e7a54', 'volume_name': 'volume-41536881-3ff9-4059-a3bb-d571589e7a54', 'volume_size': 1, 'snapshot_id': '38d8249f-a253-43e2-b429-d8a7c1a23757'}' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:15:38.366772 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-29e94963-62be-433f-b309-70714431e3b0 tempest-TestVolumeBootPattern-1320248540 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5fd205b9-9968-47b6-af1e-ec048fe46743) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:15:38.369079 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-29e94963-62be-433f-b309-70714431e3b0 tempest-TestVolumeBootPattern-1320248540 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5fd205b9-9968-47b6-af1e-ec048fe46743) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:15:38.371433 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-29e94963-62be-433f-b309-70714431e3b0 tempest-TestVolumeBootPattern-1320248540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c92f3ca1-9d01-48a7-9460-c265f0c03406) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:15:38.372378 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.flows.manager.create_volume [None req-29e94963-62be-433f-b309-70714431e3b0 tempest-TestVolumeBootPattern-1320248540 None] Volume 41536881-3ff9-4059-a3bb-d571589e7a54: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-41536881-3ff9-4059-a3bb-d571589e7a54', 'volume_size': 1, 'snapshot_id': '38d8249f-a253-43e2-b429-d8a7c1a23757'} Dec 18 21:15:38.395216 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-29e94963-62be-433f-b309-70714431e3b0 tempest-TestVolumeBootPattern-1320248540 None] cloning volumes/volume-13376864-8f52-4c3a-8fb8-d44948ce92e4@snapshot-38d8249f-a253-43e2-b429-d8a7c1a23757 to volume-41536881-3ff9-4059-a3bb-d571589e7a54 {{(pid=134148) _clone /opt/stack/cinder/cinder/volume/drivers/rbd.py:1028}} Dec 18 21:15:38.396128 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-29e94963-62be-433f-b309-70714431e3b0 tempest-TestVolumeBootPattern-1320248540 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:15:38.483872 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-29e94963-62be-433f-b309-70714431e3b0 tempest-TestVolumeBootPattern-1320248540 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:15:38.660940 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-29e94963-62be-433f-b309-70714431e3b0 tempest-TestVolumeBootPattern-1320248540 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134148) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 18 21:15:38.661832 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-29e94963-62be-433f-b309-70714431e3b0 tempest-TestVolumeBootPattern-1320248540 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134148) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 18 21:15:38.705535 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.volume_utils [None req-29e94963-62be-433f-b309-70714431e3b0 tempest-TestVolumeBootPattern-1320248540 None] Marking volume 41536881-3ff9-4059-a3bb-d571589e7a54 as bootable. {{(pid=134148) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1178}} Dec 18 21:15:38.710735 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.coordination [None req-7c7ee99f-b319-4c80-bfa1-4dafb27fdf33 tempest-AttachVolumeTestJSON-466975463 None] Lock "b'cinder-a2805e9a-f450-4ca2-921c-1bba86b6b1e1-delete_volume'" acquired by "delete_volume" :: waited 0.028s {{(pid=134148) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 18 21:15:38.724212 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.flows.manager.create_volume [None req-29e94963-62be-433f-b309-70714431e3b0 tempest-TestVolumeBootPattern-1320248540 None] Copying metadata from snapshot 38d8249f-a253-43e2-b429-d8a7c1a23757 to 41536881-3ff9-4059-a3bb-d571589e7a54. {{(pid=134148) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:423}} Dec 18 21:15:38.768211 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-7c7ee99f-b319-4c80-bfa1-4dafb27fdf33 tempest-AttachVolumeTestJSON-466975463 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:15:38.842647 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-7c7ee99f-b319-4c80-bfa1-4dafb27fdf33 tempest-AttachVolumeTestJSON-466975463 None] volume has no backup snaps {{(pid=134148) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Dec 18 21:15:38.843393 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-7c7ee99f-b319-4c80-bfa1-4dafb27fdf33 tempest-AttachVolumeTestJSON-466975463 None] Volume volume-a2805e9a-f450-4ca2-921c-1bba86b6b1e1 is not a clone. {{(pid=134148) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Dec 18 21:15:38.854176 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-7c7ee99f-b319-4c80-bfa1-4dafb27fdf33 tempest-AttachVolumeTestJSON-466975463 None] deleting rbd volume volume-a2805e9a-f450-4ca2-921c-1bba86b6b1e1 {{(pid=134148) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Dec 18 21:15:38.885356 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-29e94963-62be-433f-b309-70714431e3b0 tempest-TestVolumeBootPattern-1320248540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c92f3ca1-9d01-48a7-9460-c265f0c03406) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-41536881-3ff9-4059-a3bb-d571589e7a54', 'volume_size': 1, 'snapshot_id': '38d8249f-a253-43e2-b429-d8a7c1a23757'}' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:15:38.887766 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-29e94963-62be-433f-b309-70714431e3b0 tempest-TestVolumeBootPattern-1320248540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f05ae635-2ab5-41cc-8b5b-c6a0626730f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:15:38.900165 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.flows.manager.create_volume [None req-29e94963-62be-433f-b309-70714431e3b0 tempest-TestVolumeBootPattern-1320248540 None] Volume volume-41536881-3ff9-4059-a3bb-d571589e7a54 (41536881-3ff9-4059-a3bb-d571589e7a54): created successfully Dec 18 21:15:38.902866 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-29e94963-62be-433f-b309-70714431e3b0 tempest-TestVolumeBootPattern-1320248540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f05ae635-2ab5-41cc-8b5b-c6a0626730f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:15:38.906703 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-29e94963-62be-433f-b309-70714431e3b0 tempest-TestVolumeBootPattern-1320248540 None] Flow 'volume_create_manager' (35880dca-5090-4b6f-b88c-5e863ab81597) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134148) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 18 21:15:38.924136 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-29e94963-62be-433f-b309-70714431e3b0 tempest-TestVolumeBootPattern-1320248540 None] Created volume successfully. Dec 18 21:15:39.244663 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.quota [None req-7c7ee99f-b319-4c80-bfa1-4dafb27fdf33 tempest-AttachVolumeTestJSON-466975463 None] Created reservations ['11928126-a7c0-432c-b0f4-f6018037185c', '2a9a6e78-fca9-407d-b8f6-fe513b6a7d50', '24089050-9f82-41df-8867-230e0a6c3da3', '6437d47b-4b6f-4cd9-b6f3-8b8425ba00e1'] {{(pid=134148) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 18 21:15:39.297047 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-7c7ee99f-b319-4c80-bfa1-4dafb27fdf33 tempest-AttachVolumeTestJSON-466975463 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:15:39.357380 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-7c7ee99f-b319-4c80-bfa1-4dafb27fdf33 tempest-AttachVolumeTestJSON-466975463 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:15:39.418061 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.manager [None req-7c7ee99f-b319-4c80-bfa1-4dafb27fdf33 tempest-AttachVolumeTestJSON-466975463 None] Notifying Schedulers of capabilities ... {{(pid=134148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 18 21:15:39.445521 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-7c7ee99f-b319-4c80-bfa1-4dafb27fdf33 tempest-AttachVolumeTestJSON-466975463 None] Deleted volume successfully. Dec 18 21:15:39.470862 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.coordination [None req-7c7ee99f-b319-4c80-bfa1-4dafb27fdf33 tempest-AttachVolumeTestJSON-466975463 None] Lock "b'cinder-a2805e9a-f450-4ca2-921c-1bba86b6b1e1-delete_volume'" released by "delete_volume" :: held 0.759s {{(pid=134148) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 18 21:15:39.840252 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-e68add05-a95d-497b-b345-88cde8b4712c tempest-VolumesBackupsTest-1696781328 None] Terminate volume connection completed successfully. Dec 18 21:15:39.860472 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-e68add05-a95d-497b-b345-88cde8b4712c tempest-VolumesBackupsTest-1696781328 None] Remove volume export completed successfully. Dec 18 21:15:40.094577 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.coordination [None req-458c1155-7bd7-49ca-a9d0-1f1cea9f29e3 tempest-AttachVolumeTestJSON-466975463 None] Lock "b'cinder-2bd5b569-0c9f-4252-ba7f-6fa3ddb1c046-delete_volume'" acquired by "delete_volume" :: waited 0.011s {{(pid=134148) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 18 21:15:40.142952 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-458c1155-7bd7-49ca-a9d0-1f1cea9f29e3 tempest-AttachVolumeTestJSON-466975463 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:15:40.207505 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-458c1155-7bd7-49ca-a9d0-1f1cea9f29e3 tempest-AttachVolumeTestJSON-466975463 None] volume has no backup snaps {{(pid=134148) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Dec 18 21:15:40.207914 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-458c1155-7bd7-49ca-a9d0-1f1cea9f29e3 tempest-AttachVolumeTestJSON-466975463 None] Volume volume-2bd5b569-0c9f-4252-ba7f-6fa3ddb1c046 is not a clone. {{(pid=134148) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Dec 18 21:15:40.213448 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-458c1155-7bd7-49ca-a9d0-1f1cea9f29e3 tempest-AttachVolumeTestJSON-466975463 None] deleting rbd volume volume-2bd5b569-0c9f-4252-ba7f-6fa3ddb1c046 {{(pid=134148) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Dec 18 21:15:40.547530 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.quota [None req-458c1155-7bd7-49ca-a9d0-1f1cea9f29e3 tempest-AttachVolumeTestJSON-466975463 None] Created reservations ['886e1e1d-9d2a-440b-a2f5-d9db49924b09', '634c610d-56bc-4b1c-84b6-e461515f957a', '7da9495f-03f2-4a00-bb57-417715ed4305', '05aec358-5921-4e1c-9021-75c67e6c49de'] {{(pid=134148) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 18 21:15:40.628007 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-458c1155-7bd7-49ca-a9d0-1f1cea9f29e3 tempest-AttachVolumeTestJSON-466975463 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:15:40.695276 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-458c1155-7bd7-49ca-a9d0-1f1cea9f29e3 tempest-AttachVolumeTestJSON-466975463 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:15:40.750766 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.manager [None req-458c1155-7bd7-49ca-a9d0-1f1cea9f29e3 tempest-AttachVolumeTestJSON-466975463 None] Notifying Schedulers of capabilities ... {{(pid=134148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 18 21:15:40.755670 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-458c1155-7bd7-49ca-a9d0-1f1cea9f29e3 tempest-AttachVolumeTestJSON-466975463 None] Deleted volume successfully. Dec 18 21:15:40.776426 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.coordination [None req-458c1155-7bd7-49ca-a9d0-1f1cea9f29e3 tempest-AttachVolumeTestJSON-466975463 None] Lock "b'cinder-2bd5b569-0c9f-4252-ba7f-6fa3ddb1c046-delete_volume'" released by "delete_volume" :: held 0.682s {{(pid=134148) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 18 21:15:43.812803 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [req-4b7fdc30-4fc2-437e-aa19-761faac10e74 req-43be2f0f-c374-4dfa-a994-dca2071b48ff tempest-VolumesBackupsTest-1696781328 None] Terminate volume connection completed successfully. Dec 18 21:15:43.813588 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [req-4b7fdc30-4fc2-437e-aa19-761faac10e74 req-43be2f0f-c374-4dfa-a994-dca2071b48ff tempest-VolumesBackupsTest-1696781328 None] Deleting attachment fb605022-ea80-4d30-ac52-df5926a5e2a0. {{(pid=134148) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4948}} Dec 18 21:15:48.499658 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.coordination [None req-ea892256-7b72-467d-a29b-9cc19b2952b0 tempest-VolumesBackupsTest-1696781328 None] Lock "b'cinder-711fd27e-147d-4084-8318-a72e449932b9-delete_volume'" acquired by "delete_volume" :: waited 0.014s {{(pid=134148) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 18 21:15:48.565046 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-ea892256-7b72-467d-a29b-9cc19b2952b0 tempest-VolumesBackupsTest-1696781328 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:15:48.785892 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-ea892256-7b72-467d-a29b-9cc19b2952b0 tempest-VolumesBackupsTest-1696781328 None] Volume volume-711fd27e-147d-4084-8318-a72e449932b9 is not a clone. {{(pid=134148) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Dec 18 21:15:48.842505 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-ea892256-7b72-467d-a29b-9cc19b2952b0 tempest-VolumesBackupsTest-1696781328 None] deleting rbd volume volume-711fd27e-147d-4084-8318-a72e449932b9 {{(pid=134148) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Dec 18 21:15:48.870900 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.flows.manager.create_volume [req-a113db31-1100-4878-8795-d37a218f0a98 req-ee4a4bb5-8259-4182-87a9-626ad908167e tempest-VolumesGetTestJSON-2060073084 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134148) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Dec 18 21:15:48.876201 ncdv-master-1 cinder-volume[134148]: WARNING stevedore.named [req-a113db31-1100-4878-8795-d37a218f0a98 req-ee4a4bb5-8259-4182-87a9-626ad908167e tempest-VolumesGetTestJSON-2060073084 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Dec 18 21:15:48.876934 ncdv-master-1 cinder-volume[134148]: WARNING castellan.key_manager [req-a113db31-1100-4878-8795-d37a218f0a98 req-ee4a4bb5-8259-4182-87a9-626ad908167e tempest-VolumesGetTestJSON-2060073084 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Dec 18 21:15:48.892765 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [req-a113db31-1100-4878-8795-d37a218f0a98 req-ee4a4bb5-8259-4182-87a9-626ad908167e tempest-VolumesGetTestJSON-2060073084 None] Flow 'volume_create_manager' (1536aa7c-1227-44eb-8128-e6d646dbd6d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 18 21:15:48.898106 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [req-a113db31-1100-4878-8795-d37a218f0a98 req-ee4a4bb5-8259-4182-87a9-626ad908167e tempest-VolumesGetTestJSON-2060073084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22befd4e-8396-4475-9e21-a00e15c19e58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:15:48.910710 ncdv-master-1 cinder-volume[134148]: DEBUG oslo_db.sqlalchemy.engines [req-a113db31-1100-4878-8795-d37a218f0a98 req-ee4a4bb5-8259-4182-87a9-626ad908167e tempest-VolumesGetTestJSON-2060073084 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134148) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 18 21:15:48.930392 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [req-a113db31-1100-4878-8795-d37a218f0a98 req-ee4a4bb5-8259-4182-87a9-626ad908167e tempest-VolumesGetTestJSON-2060073084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22befd4e-8396-4475-9e21-a00e15c19e58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-12-18T21:15:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-84950342',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=449a875b-1e8f-4b1a-8919-c5108df657c7,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='f7c5cb1d08af40f7acd449ffa5c623c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-12-18T21:15:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-12-18T21:15:49Z,use_quota=True,user_id='5fa3714fd30e44eabb89aee09b7d4f11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f2e1fe1-9fd6-411e-9ed9-368f463ccb6f),volume_type_id=1f2e1fe1-9fd6-411e-9ed9-368f463ccb6f)' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:15:48.935284 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [req-a113db31-1100-4878-8795-d37a218f0a98 req-ee4a4bb5-8259-4182-87a9-626ad908167e tempest-VolumesGetTestJSON-2060073084 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c8dcdab-f584-40a9-8b54-43f5704c6140) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:15:48.938524 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [req-a113db31-1100-4878-8795-d37a218f0a98 req-ee4a4bb5-8259-4182-87a9-626ad908167e tempest-VolumesGetTestJSON-2060073084 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c8dcdab-f584-40a9-8b54-43f5704c6140) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:15:48.941490 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [req-a113db31-1100-4878-8795-d37a218f0a98 req-ee4a4bb5-8259-4182-87a9-626ad908167e tempest-VolumesGetTestJSON-2060073084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e15be4d9-6b84-4a36-a358-f716e05bdfa9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:15:48.944278 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [req-a113db31-1100-4878-8795-d37a218f0a98 req-ee4a4bb5-8259-4182-87a9-626ad908167e tempest-VolumesGetTestJSON-2060073084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e15be4d9-6b84-4a36-a358-f716e05bdfa9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '449a875b-1e8f-4b1a-8919-c5108df657c7', 'volume_name': 'volume-449a875b-1e8f-4b1a-8919-c5108df657c7', 'volume_size': 1}' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:15:48.947370 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [req-a113db31-1100-4878-8795-d37a218f0a98 req-ee4a4bb5-8259-4182-87a9-626ad908167e tempest-VolumesGetTestJSON-2060073084 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (367258e4-2b9a-45cd-83dd-bbdbc899d65b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:15:48.949498 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [req-a113db31-1100-4878-8795-d37a218f0a98 req-ee4a4bb5-8259-4182-87a9-626ad908167e tempest-VolumesGetTestJSON-2060073084 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (367258e4-2b9a-45cd-83dd-bbdbc899d65b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:15:48.951958 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [req-a113db31-1100-4878-8795-d37a218f0a98 req-ee4a4bb5-8259-4182-87a9-626ad908167e tempest-VolumesGetTestJSON-2060073084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef4cb0f8-2dd5-40f0-b233-faf305136405) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:15:48.952936 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.flows.manager.create_volume [req-a113db31-1100-4878-8795-d37a218f0a98 req-ee4a4bb5-8259-4182-87a9-626ad908167e tempest-VolumesGetTestJSON-2060073084 None] Volume 449a875b-1e8f-4b1a-8919-c5108df657c7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-449a875b-1e8f-4b1a-8919-c5108df657c7', 'volume_size': 1} Dec 18 21:15:48.953497 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [req-a113db31-1100-4878-8795-d37a218f0a98 req-ee4a4bb5-8259-4182-87a9-626ad908167e tempest-VolumesGetTestJSON-2060073084 None] creating volume 'volume-449a875b-1e8f-4b1a-8919-c5108df657c7' {{(pid=134148) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Dec 18 21:15:48.954674 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [req-a113db31-1100-4878-8795-d37a218f0a98 req-ee4a4bb5-8259-4182-87a9-626ad908167e tempest-VolumesGetTestJSON-2060073084 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:15:49.083761 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [req-a113db31-1100-4878-8795-d37a218f0a98 req-ee4a4bb5-8259-4182-87a9-626ad908167e tempest-VolumesGetTestJSON-2060073084 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134148) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 18 21:15:49.084219 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [req-a113db31-1100-4878-8795-d37a218f0a98 req-ee4a4bb5-8259-4182-87a9-626ad908167e tempest-VolumesGetTestJSON-2060073084 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134148) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 18 21:15:49.086403 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [req-a113db31-1100-4878-8795-d37a218f0a98 req-ee4a4bb5-8259-4182-87a9-626ad908167e tempest-VolumesGetTestJSON-2060073084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef4cb0f8-2dd5-40f0-b233-faf305136405) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-449a875b-1e8f-4b1a-8919-c5108df657c7', 'volume_size': 1}' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:15:49.088931 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [req-a113db31-1100-4878-8795-d37a218f0a98 req-ee4a4bb5-8259-4182-87a9-626ad908167e tempest-VolumesGetTestJSON-2060073084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53d9f78a-f7b1-4440-b9d0-a65f8bf0377b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:15:49.100028 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.flows.manager.create_volume [req-a113db31-1100-4878-8795-d37a218f0a98 req-ee4a4bb5-8259-4182-87a9-626ad908167e tempest-VolumesGetTestJSON-2060073084 None] Volume volume-449a875b-1e8f-4b1a-8919-c5108df657c7 (449a875b-1e8f-4b1a-8919-c5108df657c7): created successfully Dec 18 21:15:49.102187 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [req-a113db31-1100-4878-8795-d37a218f0a98 req-ee4a4bb5-8259-4182-87a9-626ad908167e tempest-VolumesGetTestJSON-2060073084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53d9f78a-f7b1-4440-b9d0-a65f8bf0377b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:15:49.106104 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [req-a113db31-1100-4878-8795-d37a218f0a98 req-ee4a4bb5-8259-4182-87a9-626ad908167e tempest-VolumesGetTestJSON-2060073084 None] Flow 'volume_create_manager' (1536aa7c-1227-44eb-8128-e6d646dbd6d3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134148) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 18 21:15:49.117913 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [req-a113db31-1100-4878-8795-d37a218f0a98 req-ee4a4bb5-8259-4182-87a9-626ad908167e tempest-VolumesGetTestJSON-2060073084 None] Created volume successfully. Dec 18 21:15:49.219301 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.quota [None req-ea892256-7b72-467d-a29b-9cc19b2952b0 tempest-VolumesBackupsTest-1696781328 None] Created reservations ['00daf8e6-6588-49f0-9c60-f8c467b370b4', '2da35ebe-6b1f-4592-837d-cdfd2b8b68f0', 'f2d3db46-79b9-4892-a7a4-26710c4c7e4a', '49f37531-b654-4bae-ab09-026c124f3b21'] {{(pid=134148) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 18 21:15:49.259862 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-ea892256-7b72-467d-a29b-9cc19b2952b0 tempest-VolumesBackupsTest-1696781328 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:15:49.282923 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-ea892256-7b72-467d-a29b-9cc19b2952b0 tempest-VolumesBackupsTest-1696781328 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:15:49.306548 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.manager [None req-ea892256-7b72-467d-a29b-9cc19b2952b0 tempest-VolumesBackupsTest-1696781328 None] Notifying Schedulers of capabilities ... {{(pid=134148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 18 21:15:49.310738 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-ea892256-7b72-467d-a29b-9cc19b2952b0 tempest-VolumesBackupsTest-1696781328 None] Deleted volume successfully. Dec 18 21:15:49.322504 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.coordination [None req-ea892256-7b72-467d-a29b-9cc19b2952b0 tempest-VolumesBackupsTest-1696781328 None] Lock "b'cinder-711fd27e-147d-4084-8318-a72e449932b9-delete_volume'" released by "delete_volume" :: held 0.823s {{(pid=134148) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 18 21:15:50.028998 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.flows.manager.create_volume [None req-cc8bdd67-a69e-475f-847d-69126b0db4d9 tempest-VolumesBackupsTest-1696781328 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134148) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Dec 18 21:15:50.032496 ncdv-master-1 cinder-volume[134148]: WARNING stevedore.named [None req-cc8bdd67-a69e-475f-847d-69126b0db4d9 tempest-VolumesBackupsTest-1696781328 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Dec 18 21:15:50.033005 ncdv-master-1 cinder-volume[134148]: WARNING castellan.key_manager [None req-cc8bdd67-a69e-475f-847d-69126b0db4d9 tempest-VolumesBackupsTest-1696781328 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Dec 18 21:15:50.051689 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-cc8bdd67-a69e-475f-847d-69126b0db4d9 tempest-VolumesBackupsTest-1696781328 None] Flow 'volume_create_manager' (356c12c9-bf4e-49b7-bf4b-e264bf31ee3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 18 21:15:50.055580 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-cc8bdd67-a69e-475f-847d-69126b0db4d9 tempest-VolumesBackupsTest-1696781328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1fd7d221-12ca-4bcd-a051-d94b6e4c1606) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:15:50.065554 ncdv-master-1 cinder-volume[134148]: DEBUG oslo_db.sqlalchemy.engines [None req-cc8bdd67-a69e-475f-847d-69126b0db4d9 tempest-VolumesBackupsTest-1696781328 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134148) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 18 21:15:50.105790 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-cc8bdd67-a69e-475f-847d-69126b0db4d9 tempest-VolumesBackupsTest-1696781328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1fd7d221-12ca-4bcd-a051-d94b6e4c1606) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-12-18T21:15:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsTest-Volume-786019593',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=115c0e6c-fd0b-4fa6-af13-338519528865,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3ff294c24f54faf9ba1592e4dd3ebaa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-12-18T21:15:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-12-18T21:15:50Z,use_quota=True,user_id='480f527dbe434218a49acb6095d4d66f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f2e1fe1-9fd6-411e-9ed9-368f463ccb6f),volume_type_id=1f2e1fe1-9fd6-411e-9ed9-368f463ccb6f)' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:15:50.109318 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-cc8bdd67-a69e-475f-847d-69126b0db4d9 tempest-VolumesBackupsTest-1696781328 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3027f38e-5895-4dcb-86d7-6f9769e4b41a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:15:50.111801 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-cc8bdd67-a69e-475f-847d-69126b0db4d9 tempest-VolumesBackupsTest-1696781328 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3027f38e-5895-4dcb-86d7-6f9769e4b41a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:15:50.115294 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-cc8bdd67-a69e-475f-847d-69126b0db4d9 tempest-VolumesBackupsTest-1696781328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6e50343-85c5-453a-b6d4-2018bb94360d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:15:50.132693 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.coordination [req-0ed245fa-802d-4d74-b28e-66be0d468443 req-4dd38cf8-3556-448b-b6f3-73184c8ed675 tempest-VolumesGetTestJSON-2060073084 None] Lock "b'cinder-449a875b-1e8f-4b1a-8919-c5108df657c7-delete_volume'" acquired by "delete_volume" :: waited 0.033s {{(pid=134148) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 18 21:15:50.228990 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [req-0ed245fa-802d-4d74-b28e-66be0d468443 req-4dd38cf8-3556-448b-b6f3-73184c8ed675 tempest-VolumesGetTestJSON-2060073084 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:15:50.302400 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [req-0ed245fa-802d-4d74-b28e-66be0d468443 req-4dd38cf8-3556-448b-b6f3-73184c8ed675 tempest-VolumesGetTestJSON-2060073084 None] volume has no backup snaps {{(pid=134148) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Dec 18 21:15:50.302959 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [req-0ed245fa-802d-4d74-b28e-66be0d468443 req-4dd38cf8-3556-448b-b6f3-73184c8ed675 tempest-VolumesGetTestJSON-2060073084 None] Volume volume-449a875b-1e8f-4b1a-8919-c5108df657c7 is not a clone. {{(pid=134148) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Dec 18 21:15:50.312180 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [req-0ed245fa-802d-4d74-b28e-66be0d468443 req-4dd38cf8-3556-448b-b6f3-73184c8ed675 tempest-VolumesGetTestJSON-2060073084 None] deleting rbd volume volume-449a875b-1e8f-4b1a-8919-c5108df657c7 {{(pid=134148) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Dec 18 21:15:50.338030 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-cc8bdd67-a69e-475f-847d-69126b0db4d9 tempest-VolumesBackupsTest-1696781328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6e50343-85c5-453a-b6d4-2018bb94360d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '115c0e6c-fd0b-4fa6-af13-338519528865', 'volume_name': 'volume-115c0e6c-fd0b-4fa6-af13-338519528865', 'volume_size': 1, 'image_id': '394b3891-80f2-44c9-a9aa-56fe23a5acb3', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b04c3d19c79d4c208395e97f9d293618', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '394b3891-80f2-44c9-a9aa-56fe23a5acb3', 'created_at': datetime.datetime(2021, 12, 18, 20, 38, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 12, 18, 20, 38, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/394b3891-80f2-44c9-a9aa-56fe23a5acb3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:15:50.340949 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-cc8bdd67-a69e-475f-847d-69126b0db4d9 tempest-VolumesBackupsTest-1696781328 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9cc58c13-7610-4942-b191-07b452a7769e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:15:50.343750 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-cc8bdd67-a69e-475f-847d-69126b0db4d9 tempest-VolumesBackupsTest-1696781328 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9cc58c13-7610-4942-b191-07b452a7769e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:15:50.346801 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-cc8bdd67-a69e-475f-847d-69126b0db4d9 tempest-VolumesBackupsTest-1696781328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9cb454c-678c-489b-aa1d-7a046fba7d6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:15:50.348693 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.flows.manager.create_volume [None req-cc8bdd67-a69e-475f-847d-69126b0db4d9 tempest-VolumesBackupsTest-1696781328 None] Volume 115c0e6c-fd0b-4fa6-af13-338519528865: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-115c0e6c-fd0b-4fa6-af13-338519528865', 'volume_size': 1, 'image_id': '394b3891-80f2-44c9-a9aa-56fe23a5acb3', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b04c3d19c79d4c208395e97f9d293618', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '394b3891-80f2-44c9-a9aa-56fe23a5acb3', 'created_at': datetime.datetime(2021, 12, 18, 20, 38, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 12, 18, 20, 38, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/394b3891-80f2-44c9-a9aa-56fe23a5acb3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Dec 18 21:15:50.349586 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.flows.manager.create_volume [None req-cc8bdd67-a69e-475f-847d-69126b0db4d9 tempest-VolumesBackupsTest-1696781328 None] Cloning 115c0e6c-fd0b-4fa6-af13-338519528865 from image 394b3891-80f2-44c9-a9aa-56fe23a5acb3 at location (None, None). {{(pid=134148) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1047}} Dec 18 21:15:50.360980 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.coordination [None req-cc8bdd67-a69e-475f-847d-69126b0db4d9 tempest-VolumesBackupsTest-1696781328 None] Lock "b'cinder-394b3891-80f2-44c9-a9aa-56fe23a5acb3'" acquired by "_prepare_image_cache_entry" :: waited 0.010s {{(pid=134148) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 18 21:15:50.372807 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.image.cache [None req-cc8bdd67-a69e-475f-847d-69126b0db4d9 tempest-VolumesBackupsTest-1696781328 None] Found image-volume cache entry: {'id': 1, 'image_id': '394b3891-80f2-44c9-a9aa-56fe23a5acb3', 'volume_id': 'e6411a45-48fa-4beb-a5a0-eb6a6ca3f525', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2021, 12, 18, 20, 38, 21), 'last_used': datetime.datetime(2021, 12, 18, 21, 15, 50, 366533)}. {{(pid=134148) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Dec 18 21:15:50.373468 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.image.cache [None req-cc8bdd67-a69e-475f-847d-69126b0db4d9 tempest-VolumesBackupsTest-1696781328 None] Image-volume cache entry image_update_at = 2021-12-18 20:38:21+00:00, requested image updated_at = 2021-12-18 20:38:21+00:00. {{(pid=134148) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Dec 18 21:15:50.374167 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.flows.manager.create_volume [None req-cc8bdd67-a69e-475f-847d-69126b0db4d9 tempest-VolumesBackupsTest-1696781328 None] Found cache entry for image = 394b3891-80f2-44c9-a9aa-56fe23a5acb3 on host ncdv-master-1@ceph#ceph. {{(pid=134148) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:870}} Dec 18 21:15:50.382817 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.coordination [None req-cc8bdd67-a69e-475f-847d-69126b0db4d9 tempest-VolumesBackupsTest-1696781328 None] Lock "b'cinder-394b3891-80f2-44c9-a9aa-56fe23a5acb3'" released by "_prepare_image_cache_entry" :: held 0.022s {{(pid=134148) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 18 21:15:50.384948 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.flows.manager.create_volume [None req-cc8bdd67-a69e-475f-847d-69126b0db4d9 tempest-VolumesBackupsTest-1696781328 None] Attempting to retrieve cache entry for image = 394b3891-80f2-44c9-a9aa-56fe23a5acb3 on host ncdv-master-1@ceph#ceph. {{(pid=134148) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:811}} Dec 18 21:15:50.392762 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.image.cache [None req-cc8bdd67-a69e-475f-847d-69126b0db4d9 tempest-VolumesBackupsTest-1696781328 None] Found image-volume cache entry: {'id': 1, 'image_id': '394b3891-80f2-44c9-a9aa-56fe23a5acb3', 'volume_id': 'e6411a45-48fa-4beb-a5a0-eb6a6ca3f525', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2021, 12, 18, 20, 38, 21), 'last_used': datetime.datetime(2021, 12, 18, 21, 15, 50, 390241)}. {{(pid=134148) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Dec 18 21:15:50.393802 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.image.cache [None req-cc8bdd67-a69e-475f-847d-69126b0db4d9 tempest-VolumesBackupsTest-1696781328 None] Image-volume cache entry image_update_at = 2021-12-18 20:38:21+00:00, requested image updated_at = 2021-12-18 20:38:21+00:00. {{(pid=134148) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Dec 18 21:15:50.395229 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.flows.manager.create_volume [None req-cc8bdd67-a69e-475f-847d-69126b0db4d9 tempest-VolumesBackupsTest-1696781328 None] Creating from source image-volume e6411a45-48fa-4beb-a5a0-eb6a6ca3f525 {{(pid=134148) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:825}} Dec 18 21:15:50.412660 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-cc8bdd67-a69e-475f-847d-69126b0db4d9 tempest-VolumesBackupsTest-1696781328 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:15:50.499927 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-cc8bdd67-a69e-475f-847d-69126b0db4d9 tempest-VolumesBackupsTest-1696781328 None] creating snapshot='volume-115c0e6c-fd0b-4fa6-af13-338519528865.clone_snap' {{(pid=134148) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:725}} Dec 18 21:15:51.585519 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-cc8bdd67-a69e-475f-847d-69126b0db4d9 tempest-VolumesBackupsTest-1696781328 None] cloning 'volume-e6411a45-48fa-4beb-a5a0-eb6a6ca3f525@volume-115c0e6c-fd0b-4fa6-af13-338519528865.clone_snap' to 'volume-115c0e6c-fd0b-4fa6-af13-338519528865' {{(pid=134148) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:731}} Dec 18 21:15:51.732354 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.quota [req-0ed245fa-802d-4d74-b28e-66be0d468443 req-4dd38cf8-3556-448b-b6f3-73184c8ed675 tempest-VolumesGetTestJSON-2060073084 None] Created reservations ['570f6a48-8194-4787-adee-a97ff96a73f6', '182d45f6-aa2a-4914-a26e-c5c05f1d332f', '94b428cb-f8c5-4fc2-b20c-2e689b494172', 'c6ce8a77-7cbe-48c3-b25d-f175750ac9a5'] {{(pid=134148) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 18 21:15:51.738244 ncdv-master-1 cinder-volume[134148]: DEBUG oslo_concurrency.processutils [req-8d5132f0-9b0d-4d5f-9ea2-98fb9b552403 req-1b763327-e4ee-45fd-9726-0e64e50ab472 tempest-TestVolumeBootPattern-1320248540 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=134148) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Dec 18 21:15:51.842182 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-cc8bdd67-a69e-475f-847d-69126b0db4d9 tempest-VolumesBackupsTest-1696781328 None] Volume volume-9f5f7417-3abc-4462-988f-ef519750d753.deleted is not a clone. {{(pid=134148) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Dec 18 21:15:51.844297 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-cc8bdd67-a69e-475f-847d-69126b0db4d9 tempest-VolumesBackupsTest-1696781328 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134148) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 18 21:15:51.844684 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-cc8bdd67-a69e-475f-847d-69126b0db4d9 tempest-VolumesBackupsTest-1696781328 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134148) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 18 21:15:51.888922 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-cc8bdd67-a69e-475f-847d-69126b0db4d9 tempest-VolumesBackupsTest-1696781328 None] clone created successfully {{(pid=134148) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:803}} Dec 18 21:15:51.890854 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.volume_utils [None req-cc8bdd67-a69e-475f-847d-69126b0db4d9 tempest-VolumesBackupsTest-1696781328 None] Marking volume 115c0e6c-fd0b-4fa6-af13-338519528865 as bootable. {{(pid=134148) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1178}} Dec 18 21:15:51.913435 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.flows.manager.create_volume [None req-cc8bdd67-a69e-475f-847d-69126b0db4d9 tempest-VolumesBackupsTest-1696781328 None] Copying metadata from image 394b3891-80f2-44c9-a9aa-56fe23a5acb3 to 115c0e6c-fd0b-4fa6-af13-338519528865. {{(pid=134148) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:444}} Dec 18 21:15:51.913845 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.flows.manager.create_volume [None req-cc8bdd67-a69e-475f-847d-69126b0db4d9 tempest-VolumesBackupsTest-1696781328 None] Creating volume glance metadata for volume 115c0e6c-fd0b-4fa6-af13-338519528865 backed by image 394b3891-80f2-44c9-a9aa-56fe23a5acb3 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '394b3891-80f2-44c9-a9aa-56fe23a5acb3', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=134148) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:667}} Dec 18 21:15:51.967474 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [req-0ed245fa-802d-4d74-b28e-66be0d468443 req-4dd38cf8-3556-448b-b6f3-73184c8ed675 tempest-VolumesGetTestJSON-2060073084 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:15:51.999792 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [req-0ed245fa-802d-4d74-b28e-66be0d468443 req-4dd38cf8-3556-448b-b6f3-73184c8ed675 tempest-VolumesGetTestJSON-2060073084 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:15:52.058341 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.manager [req-0ed245fa-802d-4d74-b28e-66be0d468443 req-4dd38cf8-3556-448b-b6f3-73184c8ed675 tempest-VolumesGetTestJSON-2060073084 None] Notifying Schedulers of capabilities ... {{(pid=134148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 18 21:15:52.071176 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [req-0ed245fa-802d-4d74-b28e-66be0d468443 req-4dd38cf8-3556-448b-b6f3-73184c8ed675 tempest-VolumesGetTestJSON-2060073084 None] Deleted volume successfully. Dec 18 21:15:52.140441 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.coordination [req-0ed245fa-802d-4d74-b28e-66be0d468443 req-4dd38cf8-3556-448b-b6f3-73184c8ed675 tempest-VolumesGetTestJSON-2060073084 None] Lock "b'cinder-449a875b-1e8f-4b1a-8919-c5108df657c7-delete_volume'" released by "delete_volume" :: held 2.008s {{(pid=134148) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 18 21:15:52.152072 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-cc8bdd67-a69e-475f-847d-69126b0db4d9 tempest-VolumesBackupsTest-1696781328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9cb454c-678c-489b-aa1d-7a046fba7d6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-115c0e6c-fd0b-4fa6-af13-338519528865', 'volume_size': 1, 'image_id': '394b3891-80f2-44c9-a9aa-56fe23a5acb3', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b04c3d19c79d4c208395e97f9d293618', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '394b3891-80f2-44c9-a9aa-56fe23a5acb3', 'created_at': datetime.datetime(2021, 12, 18, 20, 38, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 12, 18, 20, 38, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/394b3891-80f2-44c9-a9aa-56fe23a5acb3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:15:52.154857 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-cc8bdd67-a69e-475f-847d-69126b0db4d9 tempest-VolumesBackupsTest-1696781328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a0e13bb-db61-4724-a4c2-31c086059b7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:15:52.165719 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.flows.manager.create_volume [None req-cc8bdd67-a69e-475f-847d-69126b0db4d9 tempest-VolumesBackupsTest-1696781328 None] Volume volume-115c0e6c-fd0b-4fa6-af13-338519528865 (115c0e6c-fd0b-4fa6-af13-338519528865): created successfully Dec 18 21:15:52.170679 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-cc8bdd67-a69e-475f-847d-69126b0db4d9 tempest-VolumesBackupsTest-1696781328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a0e13bb-db61-4724-a4c2-31c086059b7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:15:52.174788 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-cc8bdd67-a69e-475f-847d-69126b0db4d9 tempest-VolumesBackupsTest-1696781328 None] Flow 'volume_create_manager' (356c12c9-bf4e-49b7-bf4b-e264bf31ee3d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134148) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 18 21:15:52.187702 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-cc8bdd67-a69e-475f-847d-69126b0db4d9 tempest-VolumesBackupsTest-1696781328 None] Created volume successfully. Dec 18 21:15:52.646468 ncdv-master-1 cinder-volume[134148]: DEBUG oslo_concurrency.processutils [req-8d5132f0-9b0d-4d5f-9ea2-98fb9b552403 req-1b763327-e4ee-45fd-9726-0e64e50ab472 tempest-TestVolumeBootPattern-1320248540 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.908s {{(pid=134148) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Dec 18 21:15:52.647729 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [req-8d5132f0-9b0d-4d5f-9ea2-98fb9b552403 req-1b763327-e4ee-45fd-9726-0e64e50ab472 tempest-TestVolumeBootPattern-1320248540 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-41536881-3ff9-4059-a3bb-d571589e7a54', 'hosts': ['10.222.0.13'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '946d1715-d12c-4dbf-8a79-181222df6e2e', 'volume_id': '41536881-3ff9-4059-a3bb-d571589e7a54', 'discard': True}} {{(pid=134148) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Dec 18 21:15:52.668533 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [req-8d5132f0-9b0d-4d5f-9ea2-98fb9b552403 req-1b763327-e4ee-45fd-9726-0e64e50ab472 tempest-TestVolumeBootPattern-1320248540 None] Connection info returned from driver {'name': 'volumes/volume-41536881-3ff9-4059-a3bb-d571589e7a54', 'hosts': ['10.222.0.13'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '41536881-3ff9-4059-a3bb-d571589e7a54', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '29c6279d-48b9-4ad0-a6f2-58314b434166'} {{(pid=134148) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4812}} Dec 18 21:15:52.723951 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [req-8d5132f0-9b0d-4d5f-9ea2-98fb9b552403 req-1b763327-e4ee-45fd-9726-0e64e50ab472 tempest-TestVolumeBootPattern-1320248540 None] attachment_update completed successfully. Dec 18 21:15:53.860121 ncdv-master-1 cinder-volume[134148]: DEBUG oslo_concurrency.processutils [None req-b88cb73f-7564-47f0-a03f-74ccc9b4565a tempest-VolumesBackupsTest-1696781328 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=134148) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Dec 18 21:15:54.648760 ncdv-master-1 cinder-volume[134148]: DEBUG oslo_concurrency.processutils [None req-b88cb73f-7564-47f0-a03f-74ccc9b4565a tempest-VolumesBackupsTest-1696781328 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.788s {{(pid=134148) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Dec 18 21:15:54.649540 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-b88cb73f-7564-47f0-a03f-74ccc9b4565a tempest-VolumesBackupsTest-1696781328 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-115c0e6c-fd0b-4fa6-af13-338519528865', 'hosts': ['10.222.0.13'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '946d1715-d12c-4dbf-8a79-181222df6e2e', 'volume_id': '115c0e6c-fd0b-4fa6-af13-338519528865', 'discard': True}} {{(pid=134148) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Dec 18 21:15:54.686701 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-b88cb73f-7564-47f0-a03f-74ccc9b4565a tempest-VolumesBackupsTest-1696781328 None] Initialize volume connection completed successfully. Dec 18 21:16:02.986653 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-b88cb73f-7564-47f0-a03f-74ccc9b4565a tempest-VolumesBackupsTest-1696781328 None] Terminate volume connection completed successfully. Dec 18 21:16:03.013180 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-b88cb73f-7564-47f0-a03f-74ccc9b4565a tempest-VolumesBackupsTest-1696781328 None] Remove volume export completed successfully. Dec 18 21:16:04.601330 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.flows.manager.create_volume [None req-a1e00301-e328-4a0e-b6a4-55d78c141743 tempest-VolumesBackupsTest-1696781328 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134148) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Dec 18 21:16:04.608093 ncdv-master-1 cinder-volume[134148]: WARNING stevedore.named [None req-a1e00301-e328-4a0e-b6a4-55d78c141743 tempest-VolumesBackupsTest-1696781328 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Dec 18 21:16:04.609256 ncdv-master-1 cinder-volume[134148]: WARNING castellan.key_manager [None req-a1e00301-e328-4a0e-b6a4-55d78c141743 tempest-VolumesBackupsTest-1696781328 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Dec 18 21:16:04.625605 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-a1e00301-e328-4a0e-b6a4-55d78c141743 tempest-VolumesBackupsTest-1696781328 None] Flow 'volume_create_manager' (cd49c44d-ac95-4ef7-9431-debfb74d00e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 18 21:16:04.631793 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-a1e00301-e328-4a0e-b6a4-55d78c141743 tempest-VolumesBackupsTest-1696781328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a16b9a07-a314-4b14-b6bc-d2210bfffbd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:16:04.642166 ncdv-master-1 cinder-volume[134148]: DEBUG oslo_db.sqlalchemy.engines [None req-a1e00301-e328-4a0e-b6a4-55d78c141743 tempest-VolumesBackupsTest-1696781328 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134148) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 18 21:16:04.661977 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-a1e00301-e328-4a0e-b6a4-55d78c141743 tempest-VolumesBackupsTest-1696781328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a16b9a07-a314-4b14-b6bc-d2210bfffbd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-12-18T21:16:04Z,deleted=False,deleted_at=None,display_description='auto-created_from_restore_from_backup',display_name='restore_backup_a36d0633-f6c2-46c3-99db-31abf7e74b6d',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=252e16fa-3cfe-4246-a51b-ba1b118c4103,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3ff294c24f54faf9ba1592e4dd3ebaa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-12-18T21:16:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-12-18T21:16:05Z,use_quota=True,user_id='480f527dbe434218a49acb6095d4d66f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f2e1fe1-9fd6-411e-9ed9-368f463ccb6f),volume_type_id=1f2e1fe1-9fd6-411e-9ed9-368f463ccb6f)' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:16:04.666369 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-a1e00301-e328-4a0e-b6a4-55d78c141743 tempest-VolumesBackupsTest-1696781328 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48a08298-d7af-4c37-b2ab-b45df9cbd36d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:16:04.669153 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-a1e00301-e328-4a0e-b6a4-55d78c141743 tempest-VolumesBackupsTest-1696781328 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48a08298-d7af-4c37-b2ab-b45df9cbd36d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:16:04.672973 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-a1e00301-e328-4a0e-b6a4-55d78c141743 tempest-VolumesBackupsTest-1696781328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a09e3c93-4bb2-4802-a28f-0a8722dbdf4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:16:04.676984 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-a1e00301-e328-4a0e-b6a4-55d78c141743 tempest-VolumesBackupsTest-1696781328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a09e3c93-4bb2-4802-a28f-0a8722dbdf4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '252e16fa-3cfe-4246-a51b-ba1b118c4103', 'volume_name': 'volume-252e16fa-3cfe-4246-a51b-ba1b118c4103', 'volume_size': 1}' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:16:04.680630 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-a1e00301-e328-4a0e-b6a4-55d78c141743 tempest-VolumesBackupsTest-1696781328 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83951103-6b07-48a6-9b83-f80f51400930) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:16:04.683725 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-a1e00301-e328-4a0e-b6a4-55d78c141743 tempest-VolumesBackupsTest-1696781328 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83951103-6b07-48a6-9b83-f80f51400930) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:16:04.687335 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-a1e00301-e328-4a0e-b6a4-55d78c141743 tempest-VolumesBackupsTest-1696781328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55d8628c-33ed-48b2-b86e-03c34395c99e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:16:04.688527 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.flows.manager.create_volume [None req-a1e00301-e328-4a0e-b6a4-55d78c141743 tempest-VolumesBackupsTest-1696781328 None] Volume 252e16fa-3cfe-4246-a51b-ba1b118c4103: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-252e16fa-3cfe-4246-a51b-ba1b118c4103', 'volume_size': 1} Dec 18 21:16:04.689236 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-a1e00301-e328-4a0e-b6a4-55d78c141743 tempest-VolumesBackupsTest-1696781328 None] creating volume 'volume-252e16fa-3cfe-4246-a51b-ba1b118c4103' {{(pid=134148) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Dec 18 21:16:04.693235 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-a1e00301-e328-4a0e-b6a4-55d78c141743 tempest-VolumesBackupsTest-1696781328 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:16:04.815802 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-a1e00301-e328-4a0e-b6a4-55d78c141743 tempest-VolumesBackupsTest-1696781328 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134148) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 18 21:16:04.817067 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-a1e00301-e328-4a0e-b6a4-55d78c141743 tempest-VolumesBackupsTest-1696781328 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134148) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 18 21:16:04.820356 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-a1e00301-e328-4a0e-b6a4-55d78c141743 tempest-VolumesBackupsTest-1696781328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55d8628c-33ed-48b2-b86e-03c34395c99e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-252e16fa-3cfe-4246-a51b-ba1b118c4103', 'volume_size': 1}' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:16:04.823484 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-a1e00301-e328-4a0e-b6a4-55d78c141743 tempest-VolumesBackupsTest-1696781328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c336d7d1-1807-425a-a81d-fcf3f2a2ead5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:16:04.839020 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.flows.manager.create_volume [None req-a1e00301-e328-4a0e-b6a4-55d78c141743 tempest-VolumesBackupsTest-1696781328 None] Volume volume-252e16fa-3cfe-4246-a51b-ba1b118c4103 (252e16fa-3cfe-4246-a51b-ba1b118c4103): created successfully Dec 18 21:16:04.841700 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-a1e00301-e328-4a0e-b6a4-55d78c141743 tempest-VolumesBackupsTest-1696781328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c336d7d1-1807-425a-a81d-fcf3f2a2ead5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:16:04.848318 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-a1e00301-e328-4a0e-b6a4-55d78c141743 tempest-VolumesBackupsTest-1696781328 None] Flow 'volume_create_manager' (cd49c44d-ac95-4ef7-9431-debfb74d00e6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134148) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 18 21:16:04.862093 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-a1e00301-e328-4a0e-b6a4-55d78c141743 tempest-VolumesBackupsTest-1696781328 None] Created volume successfully. Dec 18 21:16:05.702333 ncdv-master-1 cinder-volume[134148]: DEBUG oslo_concurrency.processutils [None req-a1e00301-e328-4a0e-b6a4-55d78c141743 tempest-VolumesBackupsTest-1696781328 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=134148) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Dec 18 21:16:06.646012 ncdv-master-1 cinder-volume[134148]: DEBUG oslo_concurrency.processutils [None req-a1e00301-e328-4a0e-b6a4-55d78c141743 tempest-VolumesBackupsTest-1696781328 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.943s {{(pid=134148) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Dec 18 21:16:06.647434 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-a1e00301-e328-4a0e-b6a4-55d78c141743 tempest-VolumesBackupsTest-1696781328 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-252e16fa-3cfe-4246-a51b-ba1b118c4103', 'hosts': ['10.222.0.13'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '946d1715-d12c-4dbf-8a79-181222df6e2e', 'volume_id': '252e16fa-3cfe-4246-a51b-ba1b118c4103', 'discard': True}} {{(pid=134148) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Dec 18 21:16:06.671371 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-a1e00301-e328-4a0e-b6a4-55d78c141743 tempest-VolumesBackupsTest-1696781328 None] Initialize volume connection completed successfully. Dec 18 21:16:13.146745 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-a1e00301-e328-4a0e-b6a4-55d78c141743 tempest-VolumesBackupsTest-1696781328 None] Terminate volume connection completed successfully. Dec 18 21:16:13.168883 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-a1e00301-e328-4a0e-b6a4-55d78c141743 tempest-VolumesBackupsTest-1696781328 None] Remove volume export completed successfully. Dec 18 21:16:14.121108 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.coordination [None req-55c0345f-3698-497a-9bef-2aea2abf1d6f tempest-VolumesBackupsTest-1696781328 None] Lock "b'cinder-252e16fa-3cfe-4246-a51b-ba1b118c4103-delete_volume'" acquired by "delete_volume" :: waited 0.017s {{(pid=134148) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 18 21:16:14.167886 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-55c0345f-3698-497a-9bef-2aea2abf1d6f tempest-VolumesBackupsTest-1696781328 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:16:14.731722 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-55c0345f-3698-497a-9bef-2aea2abf1d6f tempest-VolumesBackupsTest-1696781328 None] Volume volume-252e16fa-3cfe-4246-a51b-ba1b118c4103 is not a clone. {{(pid=134148) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Dec 18 21:16:14.771857 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-55c0345f-3698-497a-9bef-2aea2abf1d6f tempest-VolumesBackupsTest-1696781328 None] deleting rbd volume volume-252e16fa-3cfe-4246-a51b-ba1b118c4103 {{(pid=134148) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Dec 18 21:16:15.531365 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.quota [None req-55c0345f-3698-497a-9bef-2aea2abf1d6f tempest-VolumesBackupsTest-1696781328 None] Created reservations ['4cd747a7-cac8-4de4-ac16-195271af0c6f', '75e5461c-b061-4de4-8151-aee5e32b620c', '9e003c54-69da-4b45-b8fd-5e614cbf2022', '67e9670b-be32-45fa-971b-0953ec20b839'] {{(pid=134148) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 18 21:16:15.611766 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-55c0345f-3698-497a-9bef-2aea2abf1d6f tempest-VolumesBackupsTest-1696781328 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:16:15.654823 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-55c0345f-3698-497a-9bef-2aea2abf1d6f tempest-VolumesBackupsTest-1696781328 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:16:15.726526 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.manager [None req-55c0345f-3698-497a-9bef-2aea2abf1d6f tempest-VolumesBackupsTest-1696781328 None] Notifying Schedulers of capabilities ... {{(pid=134148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 18 21:16:15.747710 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-55c0345f-3698-497a-9bef-2aea2abf1d6f tempest-VolumesBackupsTest-1696781328 None] Deleted volume successfully. Dec 18 21:16:15.771347 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.coordination [None req-55c0345f-3698-497a-9bef-2aea2abf1d6f tempest-VolumesBackupsTest-1696781328 None] Lock "b'cinder-252e16fa-3cfe-4246-a51b-ba1b118c4103-delete_volume'" released by "delete_volume" :: held 1.651s {{(pid=134148) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 18 21:16:18.579534 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.coordination [None req-0698876d-57c9-4f81-862b-62a6ff02e7b8 tempest-VolumesBackupsTest-1696781328 None] Lock "b'cinder-115c0e6c-fd0b-4fa6-af13-338519528865-delete_volume'" acquired by "delete_volume" :: waited 0.020s {{(pid=134148) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 18 21:16:18.622659 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-0698876d-57c9-4f81-862b-62a6ff02e7b8 tempest-VolumesBackupsTest-1696781328 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:16:19.849178 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-0698876d-57c9-4f81-862b-62a6ff02e7b8 tempest-VolumesBackupsTest-1696781328 None] deleting rbd volume volume-115c0e6c-fd0b-4fa6-af13-338519528865 {{(pid=134148) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Dec 18 21:16:20.150905 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-0698876d-57c9-4f81-862b-62a6ff02e7b8 tempest-VolumesBackupsTest-1696781328 None] volume is a clone so cleaning references {{(pid=134148) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1266}} Dec 18 21:16:20.185559 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-0698876d-57c9-4f81-862b-62a6ff02e7b8 tempest-VolumesBackupsTest-1696781328 None] deleting parent snapshot volume-115c0e6c-fd0b-4fa6-af13-338519528865.clone_snap {{(pid=134148) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1158}} Dec 18 21:16:20.764011 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.quota [None req-0698876d-57c9-4f81-862b-62a6ff02e7b8 tempest-VolumesBackupsTest-1696781328 None] Created reservations ['1bf5e53f-d228-48e1-a780-badf2759620f', 'ddcd5c80-b18c-4063-998d-f7a210c741bf', 'd3eafb37-062e-4466-868c-25a3bbbd7c06', '6a114fe6-a876-4648-bd20-d3944a4437e8'] {{(pid=134148) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 18 21:16:20.816023 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-0698876d-57c9-4f81-862b-62a6ff02e7b8 tempest-VolumesBackupsTest-1696781328 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:16:20.869604 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-0698876d-57c9-4f81-862b-62a6ff02e7b8 tempest-VolumesBackupsTest-1696781328 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:16:20.929778 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.manager [None req-0698876d-57c9-4f81-862b-62a6ff02e7b8 tempest-VolumesBackupsTest-1696781328 None] Notifying Schedulers of capabilities ... {{(pid=134148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 18 21:16:20.935101 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-0698876d-57c9-4f81-862b-62a6ff02e7b8 tempest-VolumesBackupsTest-1696781328 None] Deleted volume successfully. Dec 18 21:16:20.952183 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.coordination [None req-0698876d-57c9-4f81-862b-62a6ff02e7b8 tempest-VolumesBackupsTest-1696781328 None] Lock "b'cinder-115c0e6c-fd0b-4fa6-af13-338519528865-delete_volume'" released by "delete_volume" :: held 2.372s {{(pid=134148) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 18 21:16:24.097154 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.flows.manager.create_volume [None req-395192b4-bdb8-4af0-8393-7911c02df39a tempest-VolumesExtendTest-1596427776 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134148) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Dec 18 21:16:24.101258 ncdv-master-1 cinder-volume[134148]: WARNING stevedore.named [None req-395192b4-bdb8-4af0-8393-7911c02df39a tempest-VolumesExtendTest-1596427776 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Dec 18 21:16:24.101817 ncdv-master-1 cinder-volume[134148]: WARNING castellan.key_manager [None req-395192b4-bdb8-4af0-8393-7911c02df39a tempest-VolumesExtendTest-1596427776 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Dec 18 21:16:24.116468 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-395192b4-bdb8-4af0-8393-7911c02df39a tempest-VolumesExtendTest-1596427776 None] Flow 'volume_create_manager' (24cfa8b9-f6fc-4b7a-bfe7-e18471919c58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 18 21:16:24.120080 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-395192b4-bdb8-4af0-8393-7911c02df39a tempest-VolumesExtendTest-1596427776 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69dac0d5-cd6a-4930-b3f4-195bfc084cdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:16:24.127192 ncdv-master-1 cinder-volume[134148]: DEBUG oslo_db.sqlalchemy.engines [None req-395192b4-bdb8-4af0-8393-7911c02df39a tempest-VolumesExtendTest-1596427776 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134148) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 18 21:16:24.144158 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-395192b4-bdb8-4af0-8393-7911c02df39a tempest-VolumesExtendTest-1596427776 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69dac0d5-cd6a-4930-b3f4-195bfc084cdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-12-18T21:16:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-688040392',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=875afc35-fd86-43f3-a1cc-f2586b97d7e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99059ecc40914ada8844eb4371203cac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-12-18T21:16:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-12-18T21:16:24Z,use_quota=True,user_id='0259ba697b5240bcbf4ab8f023c18cdc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f2e1fe1-9fd6-411e-9ed9-368f463ccb6f),volume_type_id=1f2e1fe1-9fd6-411e-9ed9-368f463ccb6f)' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:16:24.147185 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-395192b4-bdb8-4af0-8393-7911c02df39a tempest-VolumesExtendTest-1596427776 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed620367-d45f-4c04-9d5d-47231e99334a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:16:24.150207 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-395192b4-bdb8-4af0-8393-7911c02df39a tempest-VolumesExtendTest-1596427776 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed620367-d45f-4c04-9d5d-47231e99334a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:16:24.153195 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-395192b4-bdb8-4af0-8393-7911c02df39a tempest-VolumesExtendTest-1596427776 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92e9d20d-fac3-4217-9598-f22fe9838372) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:16:24.261740 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-395192b4-bdb8-4af0-8393-7911c02df39a tempest-VolumesExtendTest-1596427776 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92e9d20d-fac3-4217-9598-f22fe9838372) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '875afc35-fd86-43f3-a1cc-f2586b97d7e6', 'volume_name': 'volume-875afc35-fd86-43f3-a1cc-f2586b97d7e6', 'volume_size': 1, 'image_id': '394b3891-80f2-44c9-a9aa-56fe23a5acb3', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b04c3d19c79d4c208395e97f9d293618', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '394b3891-80f2-44c9-a9aa-56fe23a5acb3', 'created_at': datetime.datetime(2021, 12, 18, 20, 38, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 12, 18, 20, 38, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/394b3891-80f2-44c9-a9aa-56fe23a5acb3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:16:24.264174 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-395192b4-bdb8-4af0-8393-7911c02df39a tempest-VolumesExtendTest-1596427776 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (311e7f4f-19c2-4169-8d78-7133b86becf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:16:24.266449 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-395192b4-bdb8-4af0-8393-7911c02df39a tempest-VolumesExtendTest-1596427776 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (311e7f4f-19c2-4169-8d78-7133b86becf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:16:24.268766 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-395192b4-bdb8-4af0-8393-7911c02df39a tempest-VolumesExtendTest-1596427776 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93b50e76-8cb5-464e-b86d-3a1597c9d840) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:16:24.269610 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.flows.manager.create_volume [None req-395192b4-bdb8-4af0-8393-7911c02df39a tempest-VolumesExtendTest-1596427776 None] Volume 875afc35-fd86-43f3-a1cc-f2586b97d7e6: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-875afc35-fd86-43f3-a1cc-f2586b97d7e6', 'volume_size': 1, 'image_id': '394b3891-80f2-44c9-a9aa-56fe23a5acb3', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b04c3d19c79d4c208395e97f9d293618', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '394b3891-80f2-44c9-a9aa-56fe23a5acb3', 'created_at': datetime.datetime(2021, 12, 18, 20, 38, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 12, 18, 20, 38, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/394b3891-80f2-44c9-a9aa-56fe23a5acb3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Dec 18 21:16:24.270187 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.flows.manager.create_volume [None req-395192b4-bdb8-4af0-8393-7911c02df39a tempest-VolumesExtendTest-1596427776 None] Cloning 875afc35-fd86-43f3-a1cc-f2586b97d7e6 from image 394b3891-80f2-44c9-a9aa-56fe23a5acb3 at location (None, None). {{(pid=134148) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1047}} Dec 18 21:16:24.278625 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.coordination [None req-395192b4-bdb8-4af0-8393-7911c02df39a tempest-VolumesExtendTest-1596427776 None] Lock "b'cinder-394b3891-80f2-44c9-a9aa-56fe23a5acb3'" acquired by "_prepare_image_cache_entry" :: waited 0.008s {{(pid=134148) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 18 21:16:24.287947 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.image.cache [None req-395192b4-bdb8-4af0-8393-7911c02df39a tempest-VolumesExtendTest-1596427776 None] Found image-volume cache entry: {'id': 1, 'image_id': '394b3891-80f2-44c9-a9aa-56fe23a5acb3', 'volume_id': 'e6411a45-48fa-4beb-a5a0-eb6a6ca3f525', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2021, 12, 18, 20, 38, 21), 'last_used': datetime.datetime(2021, 12, 18, 21, 16, 24, 282687)}. {{(pid=134148) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Dec 18 21:16:24.288388 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.image.cache [None req-395192b4-bdb8-4af0-8393-7911c02df39a tempest-VolumesExtendTest-1596427776 None] Image-volume cache entry image_update_at = 2021-12-18 20:38:21+00:00, requested image updated_at = 2021-12-18 20:38:21+00:00. {{(pid=134148) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Dec 18 21:16:24.288797 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.flows.manager.create_volume [None req-395192b4-bdb8-4af0-8393-7911c02df39a tempest-VolumesExtendTest-1596427776 None] Found cache entry for image = 394b3891-80f2-44c9-a9aa-56fe23a5acb3 on host ncdv-master-1@ceph#ceph. {{(pid=134148) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:870}} Dec 18 21:16:24.293193 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.coordination [None req-395192b4-bdb8-4af0-8393-7911c02df39a tempest-VolumesExtendTest-1596427776 None] Lock "b'cinder-394b3891-80f2-44c9-a9aa-56fe23a5acb3'" released by "_prepare_image_cache_entry" :: held 0.015s {{(pid=134148) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 18 21:16:24.294192 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.flows.manager.create_volume [None req-395192b4-bdb8-4af0-8393-7911c02df39a tempest-VolumesExtendTest-1596427776 None] Attempting to retrieve cache entry for image = 394b3891-80f2-44c9-a9aa-56fe23a5acb3 on host ncdv-master-1@ceph#ceph. {{(pid=134148) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:811}} Dec 18 21:16:24.300568 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.image.cache [None req-395192b4-bdb8-4af0-8393-7911c02df39a tempest-VolumesExtendTest-1596427776 None] Found image-volume cache entry: {'id': 1, 'image_id': '394b3891-80f2-44c9-a9aa-56fe23a5acb3', 'volume_id': 'e6411a45-48fa-4beb-a5a0-eb6a6ca3f525', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2021, 12, 18, 20, 38, 21), 'last_used': datetime.datetime(2021, 12, 18, 21, 16, 24, 297461)}. {{(pid=134148) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Dec 18 21:16:24.301299 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.image.cache [None req-395192b4-bdb8-4af0-8393-7911c02df39a tempest-VolumesExtendTest-1596427776 None] Image-volume cache entry image_update_at = 2021-12-18 20:38:21+00:00, requested image updated_at = 2021-12-18 20:38:21+00:00. {{(pid=134148) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Dec 18 21:16:24.302157 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.flows.manager.create_volume [None req-395192b4-bdb8-4af0-8393-7911c02df39a tempest-VolumesExtendTest-1596427776 None] Creating from source image-volume e6411a45-48fa-4beb-a5a0-eb6a6ca3f525 {{(pid=134148) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:825}} Dec 18 21:16:24.316767 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-395192b4-bdb8-4af0-8393-7911c02df39a tempest-VolumesExtendTest-1596427776 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:16:24.386524 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-395192b4-bdb8-4af0-8393-7911c02df39a tempest-VolumesExtendTest-1596427776 None] creating snapshot='volume-875afc35-fd86-43f3-a1cc-f2586b97d7e6.clone_snap' {{(pid=134148) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:725}} Dec 18 21:16:24.862213 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-395192b4-bdb8-4af0-8393-7911c02df39a tempest-VolumesExtendTest-1596427776 None] cloning 'volume-e6411a45-48fa-4beb-a5a0-eb6a6ca3f525@volume-875afc35-fd86-43f3-a1cc-f2586b97d7e6.clone_snap' to 'volume-875afc35-fd86-43f3-a1cc-f2586b97d7e6' {{(pid=134148) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:731}} Dec 18 21:16:25.057458 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-395192b4-bdb8-4af0-8393-7911c02df39a tempest-VolumesExtendTest-1596427776 None] Volume volume-9f5f7417-3abc-4462-988f-ef519750d753.deleted is not a clone. {{(pid=134148) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Dec 18 21:16:25.059041 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-395192b4-bdb8-4af0-8393-7911c02df39a tempest-VolumesExtendTest-1596427776 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134148) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 18 21:16:25.059579 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-395192b4-bdb8-4af0-8393-7911c02df39a tempest-VolumesExtendTest-1596427776 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134148) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 18 21:16:25.099973 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-395192b4-bdb8-4af0-8393-7911c02df39a tempest-VolumesExtendTest-1596427776 None] clone created successfully {{(pid=134148) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:803}} Dec 18 21:16:25.103915 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.volume_utils [None req-395192b4-bdb8-4af0-8393-7911c02df39a tempest-VolumesExtendTest-1596427776 None] Marking volume 875afc35-fd86-43f3-a1cc-f2586b97d7e6 as bootable. {{(pid=134148) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1178}} Dec 18 21:16:25.122196 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.flows.manager.create_volume [None req-395192b4-bdb8-4af0-8393-7911c02df39a tempest-VolumesExtendTest-1596427776 None] Copying metadata from image 394b3891-80f2-44c9-a9aa-56fe23a5acb3 to 875afc35-fd86-43f3-a1cc-f2586b97d7e6. {{(pid=134148) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:444}} Dec 18 21:16:25.122988 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.flows.manager.create_volume [None req-395192b4-bdb8-4af0-8393-7911c02df39a tempest-VolumesExtendTest-1596427776 None] Creating volume glance metadata for volume 875afc35-fd86-43f3-a1cc-f2586b97d7e6 backed by image 394b3891-80f2-44c9-a9aa-56fe23a5acb3 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '394b3891-80f2-44c9-a9aa-56fe23a5acb3', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=134148) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:667}} Dec 18 21:16:25.193983 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-395192b4-bdb8-4af0-8393-7911c02df39a tempest-VolumesExtendTest-1596427776 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93b50e76-8cb5-464e-b86d-3a1597c9d840) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-875afc35-fd86-43f3-a1cc-f2586b97d7e6', 'volume_size': 1, 'image_id': '394b3891-80f2-44c9-a9aa-56fe23a5acb3', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b04c3d19c79d4c208395e97f9d293618', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '394b3891-80f2-44c9-a9aa-56fe23a5acb3', 'created_at': datetime.datetime(2021, 12, 18, 20, 38, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 12, 18, 20, 38, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/394b3891-80f2-44c9-a9aa-56fe23a5acb3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:16:25.196927 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-395192b4-bdb8-4af0-8393-7911c02df39a tempest-VolumesExtendTest-1596427776 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b01853a-97bc-43fe-a45c-481db4148b20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:16:25.206076 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.flows.manager.create_volume [None req-395192b4-bdb8-4af0-8393-7911c02df39a tempest-VolumesExtendTest-1596427776 None] Volume volume-875afc35-fd86-43f3-a1cc-f2586b97d7e6 (875afc35-fd86-43f3-a1cc-f2586b97d7e6): created successfully Dec 18 21:16:25.208473 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-395192b4-bdb8-4af0-8393-7911c02df39a tempest-VolumesExtendTest-1596427776 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b01853a-97bc-43fe-a45c-481db4148b20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:16:25.211944 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-395192b4-bdb8-4af0-8393-7911c02df39a tempest-VolumesExtendTest-1596427776 None] Flow 'volume_create_manager' (24cfa8b9-f6fc-4b7a-bfe7-e18471919c58) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134148) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 18 21:16:25.224296 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-395192b4-bdb8-4af0-8393-7911c02df39a tempest-VolumesExtendTest-1596427776 None] Created volume successfully. Dec 18 21:16:26.272026 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-414050ae-2652-49d1-a892-07b72b316329 tempest-VolumesExtendTest-1596427776 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:16:26.389138 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-414050ae-2652-49d1-a892-07b72b316329 tempest-VolumesExtendTest-1596427776 None] Extend volume from 1 GB to 2 GB. {{(pid=134148) extend_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1732}} Dec 18 21:16:26.418295 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-414050ae-2652-49d1-a892-07b72b316329 tempest-VolumesExtendTest-1596427776 None] Extend volume completed successfully. Dec 18 21:16:27.781161 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.flows.manager.create_volume [None req-fa58b896-bee9-4d3a-a17f-57ce806682f7 tempest-VolumesExtendTest-1596427776 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134148) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Dec 18 21:16:27.785260 ncdv-master-1 cinder-volume[134148]: WARNING stevedore.named [None req-fa58b896-bee9-4d3a-a17f-57ce806682f7 tempest-VolumesExtendTest-1596427776 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Dec 18 21:16:27.785701 ncdv-master-1 cinder-volume[134148]: WARNING castellan.key_manager [None req-fa58b896-bee9-4d3a-a17f-57ce806682f7 tempest-VolumesExtendTest-1596427776 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Dec 18 21:16:27.798392 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-fa58b896-bee9-4d3a-a17f-57ce806682f7 tempest-VolumesExtendTest-1596427776 None] Flow 'volume_create_manager' (b5974adb-afe5-43e7-aaab-2f95b6edc04c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 18 21:16:27.802219 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-fa58b896-bee9-4d3a-a17f-57ce806682f7 tempest-VolumesExtendTest-1596427776 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad9cfc0f-e5e6-4274-a0bf-7ef2bcbe2c55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:16:27.808689 ncdv-master-1 cinder-volume[134148]: DEBUG oslo_db.sqlalchemy.engines [None req-fa58b896-bee9-4d3a-a17f-57ce806682f7 tempest-VolumesExtendTest-1596427776 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134148) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 18 21:16:27.825262 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-fa58b896-bee9-4d3a-a17f-57ce806682f7 tempest-VolumesExtendTest-1596427776 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad9cfc0f-e5e6-4274-a0bf-7ef2bcbe2c55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-12-18T21:16:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1056581987',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=c495ab3f-5c45-4906-a81c-4b9611f0229d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99059ecc40914ada8844eb4371203cac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-12-18T21:16:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-12-18T21:16:28Z,use_quota=True,user_id='0259ba697b5240bcbf4ab8f023c18cdc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f2e1fe1-9fd6-411e-9ed9-368f463ccb6f),volume_type_id=1f2e1fe1-9fd6-411e-9ed9-368f463ccb6f)' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:16:27.827889 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-fa58b896-bee9-4d3a-a17f-57ce806682f7 tempest-VolumesExtendTest-1596427776 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (619e32fb-be65-4180-9b11-df03e230a421) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:16:27.830037 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-fa58b896-bee9-4d3a-a17f-57ce806682f7 tempest-VolumesExtendTest-1596427776 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (619e32fb-be65-4180-9b11-df03e230a421) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:16:27.835316 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-fa58b896-bee9-4d3a-a17f-57ce806682f7 tempest-VolumesExtendTest-1596427776 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1441a111-13c7-4b2e-b617-289dda3df417) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:16:27.840882 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-fa58b896-bee9-4d3a-a17f-57ce806682f7 tempest-VolumesExtendTest-1596427776 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1441a111-13c7-4b2e-b617-289dda3df417) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c495ab3f-5c45-4906-a81c-4b9611f0229d', 'volume_name': 'volume-c495ab3f-5c45-4906-a81c-4b9611f0229d', 'volume_size': 1}' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:16:27.844407 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-fa58b896-bee9-4d3a-a17f-57ce806682f7 tempest-VolumesExtendTest-1596427776 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3378b41-c483-45ec-b134-0da326407699) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:16:27.847187 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-fa58b896-bee9-4d3a-a17f-57ce806682f7 tempest-VolumesExtendTest-1596427776 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3378b41-c483-45ec-b134-0da326407699) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:16:27.849402 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-fa58b896-bee9-4d3a-a17f-57ce806682f7 tempest-VolumesExtendTest-1596427776 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5b0f65f-ef5d-4c62-b03e-0e5dc7d99107) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:16:27.850194 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.flows.manager.create_volume [None req-fa58b896-bee9-4d3a-a17f-57ce806682f7 tempest-VolumesExtendTest-1596427776 None] Volume c495ab3f-5c45-4906-a81c-4b9611f0229d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c495ab3f-5c45-4906-a81c-4b9611f0229d', 'volume_size': 1} Dec 18 21:16:27.850608 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-fa58b896-bee9-4d3a-a17f-57ce806682f7 tempest-VolumesExtendTest-1596427776 None] creating volume 'volume-c495ab3f-5c45-4906-a81c-4b9611f0229d' {{(pid=134148) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Dec 18 21:16:27.851788 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-fa58b896-bee9-4d3a-a17f-57ce806682f7 tempest-VolumesExtendTest-1596427776 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:16:27.911358 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-fa58b896-bee9-4d3a-a17f-57ce806682f7 tempest-VolumesExtendTest-1596427776 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134148) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 18 21:16:27.911749 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-fa58b896-bee9-4d3a-a17f-57ce806682f7 tempest-VolumesExtendTest-1596427776 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134148) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 18 21:16:27.913809 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-fa58b896-bee9-4d3a-a17f-57ce806682f7 tempest-VolumesExtendTest-1596427776 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5b0f65f-ef5d-4c62-b03e-0e5dc7d99107) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c495ab3f-5c45-4906-a81c-4b9611f0229d', 'volume_size': 1}' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:16:27.915994 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-fa58b896-bee9-4d3a-a17f-57ce806682f7 tempest-VolumesExtendTest-1596427776 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8019aa5c-3b42-46df-8250-b9eb022734e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:16:27.924523 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.flows.manager.create_volume [None req-fa58b896-bee9-4d3a-a17f-57ce806682f7 tempest-VolumesExtendTest-1596427776 None] Volume volume-c495ab3f-5c45-4906-a81c-4b9611f0229d (c495ab3f-5c45-4906-a81c-4b9611f0229d): created successfully Dec 18 21:16:27.926580 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-fa58b896-bee9-4d3a-a17f-57ce806682f7 tempest-VolumesExtendTest-1596427776 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8019aa5c-3b42-46df-8250-b9eb022734e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:16:27.929473 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-fa58b896-bee9-4d3a-a17f-57ce806682f7 tempest-VolumesExtendTest-1596427776 None] Flow 'volume_create_manager' (b5974adb-afe5-43e7-aaab-2f95b6edc04c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134148) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 18 21:16:27.936932 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-fa58b896-bee9-4d3a-a17f-57ce806682f7 tempest-VolumesExtendTest-1596427776 None] Created volume successfully. Dec 18 21:16:29.055212 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-459d0e85-0781-47b6-a44d-2712224d2bde tempest-VolumesExtendTest-1596427776 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:16:29.947378 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-459d0e85-0781-47b6-a44d-2712224d2bde tempest-VolumesExtendTest-1596427776 None] Create snapshot completed successfully Dec 18 21:16:30.331795 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-10558798-ea76-446a-95d5-aea7db4a0e85 tempest-VolumesExtendTest-1596427776 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:16:30.455672 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-10558798-ea76-446a-95d5-aea7db4a0e85 tempest-VolumesExtendTest-1596427776 None] Extend volume from 1 GB to 2 GB. {{(pid=134148) extend_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1732}} Dec 18 21:16:30.521747 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-10558798-ea76-446a-95d5-aea7db4a0e85 tempest-VolumesExtendTest-1596427776 None] Extend volume completed successfully. Dec 18 21:16:31.586688 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.coordination [None req-056993ff-4813-4f2b-9095-253316148aa8 tempest-VolumesExtendTest-1596427776 None] Lock "b'cinder-b3df70fe-0745-4d78-b8f9-4a775781de6f-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.017s {{(pid=134148) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 18 21:16:31.590362 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-056993ff-4813-4f2b-9095-253316148aa8 tempest-VolumesExtendTest-1596427776 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:16:32.737107 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.quota [None req-056993ff-4813-4f2b-9095-253316148aa8 tempest-VolumesExtendTest-1596427776 None] Created reservations ['a778f078-4d5b-43fe-8120-5f4c05db18a3', '0b25037c-dcec-4a4b-ba53-ed0fa328f2ab', '18bb285f-11fc-436b-ba7a-4738baf56d12', '2daa3bad-280f-4ad8-b242-033bc289e06e'] {{(pid=134148) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 18 21:16:32.784165 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-056993ff-4813-4f2b-9095-253316148aa8 tempest-VolumesExtendTest-1596427776 None] Delete snapshot completed successfully. Dec 18 21:16:32.790398 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.coordination [None req-056993ff-4813-4f2b-9095-253316148aa8 tempest-VolumesExtendTest-1596427776 None] Lock "b'cinder-b3df70fe-0745-4d78-b8f9-4a775781de6f-delete_snapshot'" released by "delete_snapshot" :: held 1.204s {{(pid=134148) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 18 21:16:33.763724 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.coordination [None req-5f69fd60-6f38-409e-a3dc-53ef50b01d7d tempest-VolumesExtendTest-1596427776 None] Lock "b'cinder-c495ab3f-5c45-4906-a81c-4b9611f0229d-delete_volume'" acquired by "delete_volume" :: waited 0.016s {{(pid=134148) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 18 21:16:33.827498 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-5f69fd60-6f38-409e-a3dc-53ef50b01d7d tempest-VolumesExtendTest-1596427776 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:16:33.905389 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-5f69fd60-6f38-409e-a3dc-53ef50b01d7d tempest-VolumesExtendTest-1596427776 None] volume has no backup snaps {{(pid=134148) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Dec 18 21:16:33.905777 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-5f69fd60-6f38-409e-a3dc-53ef50b01d7d tempest-VolumesExtendTest-1596427776 None] Volume volume-c495ab3f-5c45-4906-a81c-4b9611f0229d is not a clone. {{(pid=134148) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Dec 18 21:16:33.917168 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-5f69fd60-6f38-409e-a3dc-53ef50b01d7d tempest-VolumesExtendTest-1596427776 None] deleting rbd volume volume-c495ab3f-5c45-4906-a81c-4b9611f0229d {{(pid=134148) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Dec 18 21:16:34.349905 ncdv-master-1 cinder-volume[134148]: DEBUG oslo_service.periodic_task [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134148) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Dec 18 21:16:34.351415 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:16:34.398094 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:16:34.479521 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.manager [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] Notifying Schedulers of capabilities ... {{(pid=134148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 18 21:16:34.496804 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.quota [None req-5f69fd60-6f38-409e-a3dc-53ef50b01d7d tempest-VolumesExtendTest-1596427776 None] Created reservations ['b80941ab-e6f6-4cfb-a904-fdc9b4a6329a', 'ae850028-9420-47c2-8f00-2bbe8737ae51', '4f908d59-6749-4790-bbbd-3475913ef989', 'dba18c24-efba-4787-a717-71eac4e1fa6b'] {{(pid=134148) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 18 21:16:34.565060 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-5f69fd60-6f38-409e-a3dc-53ef50b01d7d tempest-VolumesExtendTest-1596427776 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:16:34.636342 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-5f69fd60-6f38-409e-a3dc-53ef50b01d7d tempest-VolumesExtendTest-1596427776 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:16:34.685937 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.manager [None req-5f69fd60-6f38-409e-a3dc-53ef50b01d7d tempest-VolumesExtendTest-1596427776 None] Notifying Schedulers of capabilities ... {{(pid=134148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 18 21:16:34.690531 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-5f69fd60-6f38-409e-a3dc-53ef50b01d7d tempest-VolumesExtendTest-1596427776 None] Deleted volume successfully. Dec 18 21:16:34.707098 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.coordination [None req-5f69fd60-6f38-409e-a3dc-53ef50b01d7d tempest-VolumesExtendTest-1596427776 None] Lock "b'cinder-c495ab3f-5c45-4906-a81c-4b9611f0229d-delete_volume'" released by "delete_volume" :: held 0.943s {{(pid=134148) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 18 21:16:35.003607 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.coordination [None req-68b560ef-9b82-4aa3-aa6f-b1ad555cee98 tempest-VolumesExtendTest-1596427776 None] Lock "b'cinder-875afc35-fd86-43f3-a1cc-f2586b97d7e6-delete_volume'" acquired by "delete_volume" :: waited 0.049s {{(pid=134148) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 18 21:16:35.083761 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-68b560ef-9b82-4aa3-aa6f-b1ad555cee98 tempest-VolumesExtendTest-1596427776 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:16:35.190591 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-68b560ef-9b82-4aa3-aa6f-b1ad555cee98 tempest-VolumesExtendTest-1596427776 None] volume has no backup snaps {{(pid=134148) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Dec 18 21:16:35.204165 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-68b560ef-9b82-4aa3-aa6f-b1ad555cee98 tempest-VolumesExtendTest-1596427776 None] deleting rbd volume volume-875afc35-fd86-43f3-a1cc-f2586b97d7e6 {{(pid=134148) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Dec 18 21:16:35.586432 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-68b560ef-9b82-4aa3-aa6f-b1ad555cee98 tempest-VolumesExtendTest-1596427776 None] volume is a clone so cleaning references {{(pid=134148) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1266}} Dec 18 21:16:35.657859 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-68b560ef-9b82-4aa3-aa6f-b1ad555cee98 tempest-VolumesExtendTest-1596427776 None] deleting parent snapshot volume-875afc35-fd86-43f3-a1cc-f2586b97d7e6.clone_snap {{(pid=134148) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1158}} Dec 18 21:16:36.791346 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.coordination [None req-1fb25d30-e774-4bf7-ad1a-dc52e69b66f4 tempest-AttachVolumeShelveTestJSON-764429992 None] Lock "b'cinder-ead49322-abed-4471-af58-9f89b29a5107-delete_volume'" acquired by "delete_volume" :: waited 0.019s {{(pid=134148) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 18 21:16:36.856907 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.quota [None req-68b560ef-9b82-4aa3-aa6f-b1ad555cee98 tempest-VolumesExtendTest-1596427776 None] Created reservations ['8dfcadcf-d55d-4480-b377-a88e9925d3c4', 'cc40a620-8074-404e-97de-e711d1d618f1', '198ca017-c9b3-40fc-b5b3-36b156394755', '5838fd9d-7c96-403f-926d-ba3cca22fbaa'] {{(pid=134148) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 18 21:16:36.868281 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-1fb25d30-e774-4bf7-ad1a-dc52e69b66f4 tempest-AttachVolumeShelveTestJSON-764429992 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:16:36.929828 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-1fb25d30-e774-4bf7-ad1a-dc52e69b66f4 tempest-AttachVolumeShelveTestJSON-764429992 None] volume has no backup snaps {{(pid=134148) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Dec 18 21:16:36.930234 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-1fb25d30-e774-4bf7-ad1a-dc52e69b66f4 tempest-AttachVolumeShelveTestJSON-764429992 None] Volume volume-ead49322-abed-4471-af58-9f89b29a5107 is not a clone. {{(pid=134148) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Dec 18 21:16:36.944356 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-1fb25d30-e774-4bf7-ad1a-dc52e69b66f4 tempest-AttachVolumeShelveTestJSON-764429992 None] deleting rbd volume volume-ead49322-abed-4471-af58-9f89b29a5107 {{(pid=134148) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Dec 18 21:16:36.999736 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-68b560ef-9b82-4aa3-aa6f-b1ad555cee98 tempest-VolumesExtendTest-1596427776 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:16:37.043865 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-68b560ef-9b82-4aa3-aa6f-b1ad555cee98 tempest-VolumesExtendTest-1596427776 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:16:37.094661 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.manager [None req-68b560ef-9b82-4aa3-aa6f-b1ad555cee98 tempest-VolumesExtendTest-1596427776 None] Notifying Schedulers of capabilities ... {{(pid=134148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 18 21:16:37.099447 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-68b560ef-9b82-4aa3-aa6f-b1ad555cee98 tempest-VolumesExtendTest-1596427776 None] Deleted volume successfully. Dec 18 21:16:37.114710 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.coordination [None req-68b560ef-9b82-4aa3-aa6f-b1ad555cee98 tempest-VolumesExtendTest-1596427776 None] Lock "b'cinder-875afc35-fd86-43f3-a1cc-f2586b97d7e6-delete_volume'" released by "delete_volume" :: held 2.111s {{(pid=134148) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 18 21:16:37.499141 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.quota [None req-1fb25d30-e774-4bf7-ad1a-dc52e69b66f4 tempest-AttachVolumeShelveTestJSON-764429992 None] Created reservations ['f400fb5c-4280-4b90-9647-926c0ccd4303', '5cfa4310-7e3a-475e-9094-817002f3de4b', '37fe937f-672d-4143-b57c-62610d591d08', '666165ec-7af4-4ce8-bfc0-0736b273f945'] {{(pid=134148) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 18 21:16:37.559559 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-1fb25d30-e774-4bf7-ad1a-dc52e69b66f4 tempest-AttachVolumeShelveTestJSON-764429992 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:16:37.603085 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-1fb25d30-e774-4bf7-ad1a-dc52e69b66f4 tempest-AttachVolumeShelveTestJSON-764429992 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:16:37.688902 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.manager [None req-1fb25d30-e774-4bf7-ad1a-dc52e69b66f4 tempest-AttachVolumeShelveTestJSON-764429992 None] Notifying Schedulers of capabilities ... {{(pid=134148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 18 21:16:37.695267 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-1fb25d30-e774-4bf7-ad1a-dc52e69b66f4 tempest-AttachVolumeShelveTestJSON-764429992 None] Deleted volume successfully. Dec 18 21:16:37.726782 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.coordination [None req-1fb25d30-e774-4bf7-ad1a-dc52e69b66f4 tempest-AttachVolumeShelveTestJSON-764429992 None] Lock "b'cinder-ead49322-abed-4471-af58-9f89b29a5107-delete_volume'" released by "delete_volume" :: held 0.935s {{(pid=134148) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 18 21:16:37.878380 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.coordination [None req-ba28e67b-b31f-40c1-bf7f-6f1433e7325a tempest-AttachVolumeShelveTestJSON-764429992 None] Lock "b'cinder-87b40d06-8666-40c6-a69a-c359ce3aa4fc-delete_volume'" acquired by "delete_volume" :: waited 0.014s {{(pid=134148) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 18 21:16:37.943195 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-ba28e67b-b31f-40c1-bf7f-6f1433e7325a tempest-AttachVolumeShelveTestJSON-764429992 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:16:38.028935 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-ba28e67b-b31f-40c1-bf7f-6f1433e7325a tempest-AttachVolumeShelveTestJSON-764429992 None] volume has no backup snaps {{(pid=134148) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Dec 18 21:16:38.029408 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-ba28e67b-b31f-40c1-bf7f-6f1433e7325a tempest-AttachVolumeShelveTestJSON-764429992 None] Volume volume-87b40d06-8666-40c6-a69a-c359ce3aa4fc is not a clone. {{(pid=134148) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Dec 18 21:16:38.035990 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-ba28e67b-b31f-40c1-bf7f-6f1433e7325a tempest-AttachVolumeShelveTestJSON-764429992 None] deleting rbd volume volume-87b40d06-8666-40c6-a69a-c359ce3aa4fc {{(pid=134148) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Dec 18 21:16:38.418230 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.quota [None req-ba28e67b-b31f-40c1-bf7f-6f1433e7325a tempest-AttachVolumeShelveTestJSON-764429992 None] Created reservations ['51374c35-6138-4dfc-af26-46a442ee9ed7', '261abb37-05e7-4eea-adb4-97e3670940fa', 'ebc41bea-575b-413a-85b9-d7b7659537c6', '8c259674-acc1-4ee4-8c1d-3f7dc7609652'] {{(pid=134148) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 18 21:16:38.473395 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-ba28e67b-b31f-40c1-bf7f-6f1433e7325a tempest-AttachVolumeShelveTestJSON-764429992 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:16:38.540952 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-ba28e67b-b31f-40c1-bf7f-6f1433e7325a tempest-AttachVolumeShelveTestJSON-764429992 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:16:38.579006 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.manager [None req-ba28e67b-b31f-40c1-bf7f-6f1433e7325a tempest-AttachVolumeShelveTestJSON-764429992 None] Notifying Schedulers of capabilities ... {{(pid=134148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 18 21:16:38.591114 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-ba28e67b-b31f-40c1-bf7f-6f1433e7325a tempest-AttachVolumeShelveTestJSON-764429992 None] Deleted volume successfully. Dec 18 21:16:38.607750 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.coordination [None req-ba28e67b-b31f-40c1-bf7f-6f1433e7325a tempest-AttachVolumeShelveTestJSON-764429992 None] Lock "b'cinder-87b40d06-8666-40c6-a69a-c359ce3aa4fc-delete_volume'" released by "delete_volume" :: held 0.729s {{(pid=134148) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 18 21:16:39.634992 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.flows.manager.create_volume [None req-539d8d3a-d6b9-44d8-a98e-2c5f6609c580 tempest-VolumesGetTest-1188281619 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134148) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Dec 18 21:16:39.641093 ncdv-master-1 cinder-volume[134148]: WARNING stevedore.named [None req-539d8d3a-d6b9-44d8-a98e-2c5f6609c580 tempest-VolumesGetTest-1188281619 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Dec 18 21:16:39.641682 ncdv-master-1 cinder-volume[134148]: WARNING castellan.key_manager [None req-539d8d3a-d6b9-44d8-a98e-2c5f6609c580 tempest-VolumesGetTest-1188281619 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Dec 18 21:16:39.655328 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-539d8d3a-d6b9-44d8-a98e-2c5f6609c580 tempest-VolumesGetTest-1188281619 None] Flow 'volume_create_manager' (4659dc68-7fcd-4bd0-9faf-60be1766614a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 18 21:16:39.658864 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-539d8d3a-d6b9-44d8-a98e-2c5f6609c580 tempest-VolumesGetTest-1188281619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d14d0d74-549f-4d32-9062-0b72b536f5d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:16:39.665356 ncdv-master-1 cinder-volume[134148]: DEBUG oslo_db.sqlalchemy.engines [None req-539d8d3a-d6b9-44d8-a98e-2c5f6609c580 tempest-VolumesGetTest-1188281619 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134148) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 18 21:16:39.679652 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-539d8d3a-d6b9-44d8-a98e-2c5f6609c580 tempest-VolumesGetTest-1188281619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d14d0d74-549f-4d32-9062-0b72b536f5d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-12-18T21:16:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-215150441',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=a0ba3188-125d-4b16-b105-545a4a6ff1a1,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='d33644610c5c4f1aae112d75d4c5cbc4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-12-18T21:16:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-12-18T21:16:40Z,use_quota=True,user_id='d4ca5004855f40c7b85944eefe85de93',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f2e1fe1-9fd6-411e-9ed9-368f463ccb6f),volume_type_id=1f2e1fe1-9fd6-411e-9ed9-368f463ccb6f)' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:16:39.682403 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-539d8d3a-d6b9-44d8-a98e-2c5f6609c580 tempest-VolumesGetTest-1188281619 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6843bc23-f66e-40ac-b934-cb9b003d78c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:16:39.684683 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-539d8d3a-d6b9-44d8-a98e-2c5f6609c580 tempest-VolumesGetTest-1188281619 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6843bc23-f66e-40ac-b934-cb9b003d78c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:16:39.687191 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-539d8d3a-d6b9-44d8-a98e-2c5f6609c580 tempest-VolumesGetTest-1188281619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90d062ed-dad3-4f58-988b-13a1fbfdf434) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:16:39.690031 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-539d8d3a-d6b9-44d8-a98e-2c5f6609c580 tempest-VolumesGetTest-1188281619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90d062ed-dad3-4f58-988b-13a1fbfdf434) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a0ba3188-125d-4b16-b105-545a4a6ff1a1', 'volume_name': 'volume-a0ba3188-125d-4b16-b105-545a4a6ff1a1', 'volume_size': 1}' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:16:39.692711 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-539d8d3a-d6b9-44d8-a98e-2c5f6609c580 tempest-VolumesGetTest-1188281619 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d591db7-3fef-4067-9699-1c8f8c2f473b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:16:39.694963 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-539d8d3a-d6b9-44d8-a98e-2c5f6609c580 tempest-VolumesGetTest-1188281619 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d591db7-3fef-4067-9699-1c8f8c2f473b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:16:39.697214 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-539d8d3a-d6b9-44d8-a98e-2c5f6609c580 tempest-VolumesGetTest-1188281619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65ea18aa-22cf-49f0-9863-0f5a7ce84974) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:16:39.698006 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.flows.manager.create_volume [None req-539d8d3a-d6b9-44d8-a98e-2c5f6609c580 tempest-VolumesGetTest-1188281619 None] Volume a0ba3188-125d-4b16-b105-545a4a6ff1a1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a0ba3188-125d-4b16-b105-545a4a6ff1a1', 'volume_size': 1} Dec 18 21:16:39.698746 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-539d8d3a-d6b9-44d8-a98e-2c5f6609c580 tempest-VolumesGetTest-1188281619 None] creating volume 'volume-a0ba3188-125d-4b16-b105-545a4a6ff1a1' {{(pid=134148) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Dec 18 21:16:39.699454 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-539d8d3a-d6b9-44d8-a98e-2c5f6609c580 tempest-VolumesGetTest-1188281619 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:16:39.784054 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-539d8d3a-d6b9-44d8-a98e-2c5f6609c580 tempest-VolumesGetTest-1188281619 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134148) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 18 21:16:39.784433 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-539d8d3a-d6b9-44d8-a98e-2c5f6609c580 tempest-VolumesGetTest-1188281619 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134148) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 18 21:16:39.786502 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-539d8d3a-d6b9-44d8-a98e-2c5f6609c580 tempest-VolumesGetTest-1188281619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65ea18aa-22cf-49f0-9863-0f5a7ce84974) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a0ba3188-125d-4b16-b105-545a4a6ff1a1', 'volume_size': 1}' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:16:39.788982 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-539d8d3a-d6b9-44d8-a98e-2c5f6609c580 tempest-VolumesGetTest-1188281619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b599ac0-0c6b-4d8b-8eea-285d987b55a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:16:39.808711 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.flows.manager.create_volume [None req-539d8d3a-d6b9-44d8-a98e-2c5f6609c580 tempest-VolumesGetTest-1188281619 None] Volume volume-a0ba3188-125d-4b16-b105-545a4a6ff1a1 (a0ba3188-125d-4b16-b105-545a4a6ff1a1): created successfully Dec 18 21:16:39.811833 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-539d8d3a-d6b9-44d8-a98e-2c5f6609c580 tempest-VolumesGetTest-1188281619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b599ac0-0c6b-4d8b-8eea-285d987b55a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:16:39.816889 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-539d8d3a-d6b9-44d8-a98e-2c5f6609c580 tempest-VolumesGetTest-1188281619 None] Flow 'volume_create_manager' (4659dc68-7fcd-4bd0-9faf-60be1766614a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134148) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 18 21:16:39.830504 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-539d8d3a-d6b9-44d8-a98e-2c5f6609c580 tempest-VolumesGetTest-1188281619 None] Created volume successfully. Dec 18 21:16:41.277289 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.flows.manager.create_volume [None req-8783d3a2-5d85-495d-8db0-89efb2bfb3f4 tempest-VolumesGetTest-1188281619 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134148) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Dec 18 21:16:41.283278 ncdv-master-1 cinder-volume[134148]: WARNING stevedore.named [None req-8783d3a2-5d85-495d-8db0-89efb2bfb3f4 tempest-VolumesGetTest-1188281619 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Dec 18 21:16:41.284278 ncdv-master-1 cinder-volume[134148]: WARNING castellan.key_manager [None req-8783d3a2-5d85-495d-8db0-89efb2bfb3f4 tempest-VolumesGetTest-1188281619 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Dec 18 21:16:41.297341 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-8783d3a2-5d85-495d-8db0-89efb2bfb3f4 tempest-VolumesGetTest-1188281619 None] Flow 'volume_create_manager' (6c277d6e-e23b-44f5-aef1-953df5a11959) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 18 21:16:41.305865 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-8783d3a2-5d85-495d-8db0-89efb2bfb3f4 tempest-VolumesGetTest-1188281619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6b805bd-e014-40f8-924e-bae645c13f87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:16:41.312980 ncdv-master-1 cinder-volume[134148]: DEBUG oslo_db.sqlalchemy.engines [None req-8783d3a2-5d85-495d-8db0-89efb2bfb3f4 tempest-VolumesGetTest-1188281619 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134148) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 18 21:16:41.329131 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-8783d3a2-5d85-495d-8db0-89efb2bfb3f4 tempest-VolumesGetTest-1188281619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6b805bd-e014-40f8-924e-bae645c13f87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-12-18T21:16:41Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1088203465',display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=24227056-f162-44f1-bd7a-c4b605792ac6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d33644610c5c4f1aae112d75d4c5cbc4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-12-18T21:16:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-12-18T21:16:41Z,use_quota=True,user_id='d4ca5004855f40c7b85944eefe85de93',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f2e1fe1-9fd6-411e-9ed9-368f463ccb6f),volume_type_id=1f2e1fe1-9fd6-411e-9ed9-368f463ccb6f)' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:16:41.333415 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-8783d3a2-5d85-495d-8db0-89efb2bfb3f4 tempest-VolumesGetTest-1188281619 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea642dc6-ebf6-4b77-9a4e-ff2f784148f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:16:41.335944 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-8783d3a2-5d85-495d-8db0-89efb2bfb3f4 tempest-VolumesGetTest-1188281619 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea642dc6-ebf6-4b77-9a4e-ff2f784148f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:16:41.339500 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-8783d3a2-5d85-495d-8db0-89efb2bfb3f4 tempest-VolumesGetTest-1188281619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c78ea374-5fb4-4992-97b5-6f24189a26c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:16:41.342744 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-8783d3a2-5d85-495d-8db0-89efb2bfb3f4 tempest-VolumesGetTest-1188281619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c78ea374-5fb4-4992-97b5-6f24189a26c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '24227056-f162-44f1-bd7a-c4b605792ac6', 'volume_name': 'volume-24227056-f162-44f1-bd7a-c4b605792ac6', 'volume_size': 1}' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:16:41.346726 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-8783d3a2-5d85-495d-8db0-89efb2bfb3f4 tempest-VolumesGetTest-1188281619 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ce2a6e1-6b3c-4708-94d8-3dbcf919b10a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:16:41.349646 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-8783d3a2-5d85-495d-8db0-89efb2bfb3f4 tempest-VolumesGetTest-1188281619 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ce2a6e1-6b3c-4708-94d8-3dbcf919b10a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:16:41.352977 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-8783d3a2-5d85-495d-8db0-89efb2bfb3f4 tempest-VolumesGetTest-1188281619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3d3531f-127f-4a1b-87f3-bbbc1fae7a40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:16:41.354186 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.flows.manager.create_volume [None req-8783d3a2-5d85-495d-8db0-89efb2bfb3f4 tempest-VolumesGetTest-1188281619 None] Volume 24227056-f162-44f1-bd7a-c4b605792ac6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-24227056-f162-44f1-bd7a-c4b605792ac6', 'volume_size': 1} Dec 18 21:16:41.354879 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-8783d3a2-5d85-495d-8db0-89efb2bfb3f4 tempest-VolumesGetTest-1188281619 None] creating volume 'volume-24227056-f162-44f1-bd7a-c4b605792ac6' {{(pid=134148) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Dec 18 21:16:41.356310 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-8783d3a2-5d85-495d-8db0-89efb2bfb3f4 tempest-VolumesGetTest-1188281619 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:16:41.470951 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-8783d3a2-5d85-495d-8db0-89efb2bfb3f4 tempest-VolumesGetTest-1188281619 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134148) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 18 21:16:41.471616 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-8783d3a2-5d85-495d-8db0-89efb2bfb3f4 tempest-VolumesGetTest-1188281619 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134148) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 18 21:16:41.474519 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-8783d3a2-5d85-495d-8db0-89efb2bfb3f4 tempest-VolumesGetTest-1188281619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3d3531f-127f-4a1b-87f3-bbbc1fae7a40) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-24227056-f162-44f1-bd7a-c4b605792ac6', 'volume_size': 1}' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:16:41.477523 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-8783d3a2-5d85-495d-8db0-89efb2bfb3f4 tempest-VolumesGetTest-1188281619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f6e40ab-73a5-44f3-80a3-7c7e4980793e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:16:41.492661 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.flows.manager.create_volume [None req-8783d3a2-5d85-495d-8db0-89efb2bfb3f4 tempest-VolumesGetTest-1188281619 None] Volume volume-24227056-f162-44f1-bd7a-c4b605792ac6 (24227056-f162-44f1-bd7a-c4b605792ac6): created successfully Dec 18 21:16:41.496231 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-8783d3a2-5d85-495d-8db0-89efb2bfb3f4 tempest-VolumesGetTest-1188281619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f6e40ab-73a5-44f3-80a3-7c7e4980793e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:16:41.503622 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-8783d3a2-5d85-495d-8db0-89efb2bfb3f4 tempest-VolumesGetTest-1188281619 None] Flow 'volume_create_manager' (6c277d6e-e23b-44f5-aef1-953df5a11959) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134148) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 18 21:16:41.512752 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-8783d3a2-5d85-495d-8db0-89efb2bfb3f4 tempest-VolumesGetTest-1188281619 None] Created volume successfully. Dec 18 21:16:42.421567 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.coordination [None req-7d77860c-6743-4691-ba49-95a8c3cbead0 tempest-VolumesGetTest-1188281619 None] Lock "b'cinder-24227056-f162-44f1-bd7a-c4b605792ac6-delete_volume'" acquired by "delete_volume" :: waited 0.020s {{(pid=134148) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 18 21:16:42.462833 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-7d77860c-6743-4691-ba49-95a8c3cbead0 tempest-VolumesGetTest-1188281619 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:16:42.524800 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-7d77860c-6743-4691-ba49-95a8c3cbead0 tempest-VolumesGetTest-1188281619 None] volume has no backup snaps {{(pid=134148) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Dec 18 21:16:42.525221 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-7d77860c-6743-4691-ba49-95a8c3cbead0 tempest-VolumesGetTest-1188281619 None] Volume volume-24227056-f162-44f1-bd7a-c4b605792ac6 is not a clone. {{(pid=134148) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Dec 18 21:16:42.534866 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-7d77860c-6743-4691-ba49-95a8c3cbead0 tempest-VolumesGetTest-1188281619 None] deleting rbd volume volume-24227056-f162-44f1-bd7a-c4b605792ac6 {{(pid=134148) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Dec 18 21:16:42.881201 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.quota [None req-7d77860c-6743-4691-ba49-95a8c3cbead0 tempest-VolumesGetTest-1188281619 None] Created reservations ['42d3b05a-1615-486d-85cc-0eb891c6d919', '83d8d34a-a115-4c4c-b98a-15bc3626b6c1', '003e657d-f7e4-48aa-94cc-44b13ffd1960', '304ca00b-ef63-4a39-b309-40be11541492'] {{(pid=134148) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 18 21:16:42.946087 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-7d77860c-6743-4691-ba49-95a8c3cbead0 tempest-VolumesGetTest-1188281619 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:16:43.012353 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-7d77860c-6743-4691-ba49-95a8c3cbead0 tempest-VolumesGetTest-1188281619 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:16:43.070936 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.manager [None req-7d77860c-6743-4691-ba49-95a8c3cbead0 tempest-VolumesGetTest-1188281619 None] Notifying Schedulers of capabilities ... {{(pid=134148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 18 21:16:43.077102 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-7d77860c-6743-4691-ba49-95a8c3cbead0 tempest-VolumesGetTest-1188281619 None] Deleted volume successfully. Dec 18 21:16:43.091900 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.coordination [None req-7d77860c-6743-4691-ba49-95a8c3cbead0 tempest-VolumesGetTest-1188281619 None] Lock "b'cinder-24227056-f162-44f1-bd7a-c4b605792ac6-delete_volume'" released by "delete_volume" :: held 0.670s {{(pid=134148) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 18 21:16:43.542980 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.coordination [None req-f21c9384-d14d-4cea-88f4-ff83ae9a5e3a tempest-VolumesGetTest-1188281619 None] Lock "b'cinder-a0ba3188-125d-4b16-b105-545a4a6ff1a1-delete_volume'" acquired by "delete_volume" :: waited 0.013s {{(pid=134148) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 18 21:16:43.578204 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-f21c9384-d14d-4cea-88f4-ff83ae9a5e3a tempest-VolumesGetTest-1188281619 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:16:43.622393 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-f21c9384-d14d-4cea-88f4-ff83ae9a5e3a tempest-VolumesGetTest-1188281619 None] volume has no backup snaps {{(pid=134148) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Dec 18 21:16:43.622810 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-f21c9384-d14d-4cea-88f4-ff83ae9a5e3a tempest-VolumesGetTest-1188281619 None] Volume volume-a0ba3188-125d-4b16-b105-545a4a6ff1a1 is not a clone. {{(pid=134148) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Dec 18 21:16:43.630183 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-f21c9384-d14d-4cea-88f4-ff83ae9a5e3a tempest-VolumesGetTest-1188281619 None] deleting rbd volume volume-a0ba3188-125d-4b16-b105-545a4a6ff1a1 {{(pid=134148) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Dec 18 21:16:43.850040 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.quota [None req-f21c9384-d14d-4cea-88f4-ff83ae9a5e3a tempest-VolumesGetTest-1188281619 None] Created reservations ['602194f5-f943-4713-853c-f2a3c0b79405', '1cd96114-f01e-4796-84cb-a159bc78f1b3', '4f2c29b9-4ef1-4f9c-87d0-9f01a6cc9069', 'd7b22008-3a7b-43ad-bea0-58c48b9e8a0a'] {{(pid=134148) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 18 21:16:43.890915 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-f21c9384-d14d-4cea-88f4-ff83ae9a5e3a tempest-VolumesGetTest-1188281619 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:16:43.917593 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-f21c9384-d14d-4cea-88f4-ff83ae9a5e3a tempest-VolumesGetTest-1188281619 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:16:43.945908 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.manager [None req-f21c9384-d14d-4cea-88f4-ff83ae9a5e3a tempest-VolumesGetTest-1188281619 None] Notifying Schedulers of capabilities ... {{(pid=134148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 18 21:16:43.950415 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-f21c9384-d14d-4cea-88f4-ff83ae9a5e3a tempest-VolumesGetTest-1188281619 None] Deleted volume successfully. Dec 18 21:16:43.962710 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.coordination [None req-f21c9384-d14d-4cea-88f4-ff83ae9a5e3a tempest-VolumesGetTest-1188281619 None] Lock "b'cinder-a0ba3188-125d-4b16-b105-545a4a6ff1a1-delete_volume'" released by "delete_volume" :: held 0.420s {{(pid=134148) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 18 21:16:44.937337 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.flows.manager.create_volume [None req-ab294929-8eb5-4096-b686-1168f0a0c48f tempest-VolumesGetTest-1188281619 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134148) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Dec 18 21:16:44.940715 ncdv-master-1 cinder-volume[134148]: WARNING stevedore.named [None req-ab294929-8eb5-4096-b686-1168f0a0c48f tempest-VolumesGetTest-1188281619 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Dec 18 21:16:44.941408 ncdv-master-1 cinder-volume[134148]: WARNING castellan.key_manager [None req-ab294929-8eb5-4096-b686-1168f0a0c48f tempest-VolumesGetTest-1188281619 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Dec 18 21:16:44.954396 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-ab294929-8eb5-4096-b686-1168f0a0c48f tempest-VolumesGetTest-1188281619 None] Flow 'volume_create_manager' (d7b86fdc-9094-40cc-8519-00154d77bb44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 18 21:16:44.957609 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-ab294929-8eb5-4096-b686-1168f0a0c48f tempest-VolumesGetTest-1188281619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2eca93f-08f4-474e-a58f-cb991d6b1605) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:16:44.964068 ncdv-master-1 cinder-volume[134148]: DEBUG oslo_db.sqlalchemy.engines [None req-ab294929-8eb5-4096-b686-1168f0a0c48f tempest-VolumesGetTest-1188281619 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134148) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 18 21:16:44.988609 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-ab294929-8eb5-4096-b686-1168f0a0c48f tempest-VolumesGetTest-1188281619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2eca93f-08f4-474e-a58f-cb991d6b1605) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-12-18T21:16:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-357943215',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=6df63251-2b33-410d-90b6-b9d9c0c4725a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d33644610c5c4f1aae112d75d4c5cbc4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-12-18T21:16:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-12-18T21:16:45Z,use_quota=True,user_id='d4ca5004855f40c7b85944eefe85de93',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f2e1fe1-9fd6-411e-9ed9-368f463ccb6f),volume_type_id=1f2e1fe1-9fd6-411e-9ed9-368f463ccb6f)' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:16:44.991857 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-ab294929-8eb5-4096-b686-1168f0a0c48f tempest-VolumesGetTest-1188281619 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70127784-2db1-4474-94c8-4c6c4657b010) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:16:44.994414 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-ab294929-8eb5-4096-b686-1168f0a0c48f tempest-VolumesGetTest-1188281619 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70127784-2db1-4474-94c8-4c6c4657b010) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:16:44.996996 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-ab294929-8eb5-4096-b686-1168f0a0c48f tempest-VolumesGetTest-1188281619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f2dd70a-bf9b-4fe8-bbd7-fd85b4c7ec83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:16:44.999447 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-ab294929-8eb5-4096-b686-1168f0a0c48f tempest-VolumesGetTest-1188281619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f2dd70a-bf9b-4fe8-bbd7-fd85b4c7ec83) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6df63251-2b33-410d-90b6-b9d9c0c4725a', 'volume_name': 'volume-6df63251-2b33-410d-90b6-b9d9c0c4725a', 'volume_size': 1}' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:16:45.001962 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-ab294929-8eb5-4096-b686-1168f0a0c48f tempest-VolumesGetTest-1188281619 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45fd646a-8fd9-45e8-8819-4d3fe6504b20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:16:45.004122 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-ab294929-8eb5-4096-b686-1168f0a0c48f tempest-VolumesGetTest-1188281619 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45fd646a-8fd9-45e8-8819-4d3fe6504b20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:16:45.007497 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-ab294929-8eb5-4096-b686-1168f0a0c48f tempest-VolumesGetTest-1188281619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a19248e1-5578-4abd-a57d-b3e3b2b06180) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:16:45.011277 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.flows.manager.create_volume [None req-ab294929-8eb5-4096-b686-1168f0a0c48f tempest-VolumesGetTest-1188281619 None] Volume 6df63251-2b33-410d-90b6-b9d9c0c4725a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6df63251-2b33-410d-90b6-b9d9c0c4725a', 'volume_size': 1} Dec 18 21:16:45.011716 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-ab294929-8eb5-4096-b686-1168f0a0c48f tempest-VolumesGetTest-1188281619 None] creating volume 'volume-6df63251-2b33-410d-90b6-b9d9c0c4725a' {{(pid=134148) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Dec 18 21:16:45.012767 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-ab294929-8eb5-4096-b686-1168f0a0c48f tempest-VolumesGetTest-1188281619 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:16:45.074805 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-ab294929-8eb5-4096-b686-1168f0a0c48f tempest-VolumesGetTest-1188281619 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134148) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 18 21:16:45.075414 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-ab294929-8eb5-4096-b686-1168f0a0c48f tempest-VolumesGetTest-1188281619 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134148) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 18 21:16:45.078759 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-ab294929-8eb5-4096-b686-1168f0a0c48f tempest-VolumesGetTest-1188281619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a19248e1-5578-4abd-a57d-b3e3b2b06180) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6df63251-2b33-410d-90b6-b9d9c0c4725a', 'volume_size': 1}' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:16:45.081761 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-ab294929-8eb5-4096-b686-1168f0a0c48f tempest-VolumesGetTest-1188281619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01eaabde-649e-43a9-8091-fc545f63ceb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:16:45.091259 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.flows.manager.create_volume [None req-ab294929-8eb5-4096-b686-1168f0a0c48f tempest-VolumesGetTest-1188281619 None] Volume volume-6df63251-2b33-410d-90b6-b9d9c0c4725a (6df63251-2b33-410d-90b6-b9d9c0c4725a): created successfully Dec 18 21:16:45.093542 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-ab294929-8eb5-4096-b686-1168f0a0c48f tempest-VolumesGetTest-1188281619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01eaabde-649e-43a9-8091-fc545f63ceb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:16:45.096612 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-ab294929-8eb5-4096-b686-1168f0a0c48f tempest-VolumesGetTest-1188281619 None] Flow 'volume_create_manager' (d7b86fdc-9094-40cc-8519-00154d77bb44) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134148) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 18 21:16:45.104144 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-ab294929-8eb5-4096-b686-1168f0a0c48f tempest-VolumesGetTest-1188281619 None] Created volume successfully. Dec 18 21:16:45.772134 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.flows.manager.create_volume [req-99c447f4-41a8-44db-9f0d-705970c8fe55 req-17220a62-d8d7-4f50-b3e1-14e66b39d39b tempest-VolumesSnapshotsTestJSON-1206846574 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134148) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Dec 18 21:16:45.775391 ncdv-master-1 cinder-volume[134148]: WARNING stevedore.named [req-99c447f4-41a8-44db-9f0d-705970c8fe55 req-17220a62-d8d7-4f50-b3e1-14e66b39d39b tempest-VolumesSnapshotsTestJSON-1206846574 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Dec 18 21:16:45.775898 ncdv-master-1 cinder-volume[134148]: WARNING castellan.key_manager [req-99c447f4-41a8-44db-9f0d-705970c8fe55 req-17220a62-d8d7-4f50-b3e1-14e66b39d39b tempest-VolumesSnapshotsTestJSON-1206846574 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Dec 18 21:16:45.787950 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [req-99c447f4-41a8-44db-9f0d-705970c8fe55 req-17220a62-d8d7-4f50-b3e1-14e66b39d39b tempest-VolumesSnapshotsTestJSON-1206846574 None] Flow 'volume_create_manager' (f110ccca-a734-4106-8b26-99c1fabf113d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 18 21:16:45.791920 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [req-99c447f4-41a8-44db-9f0d-705970c8fe55 req-17220a62-d8d7-4f50-b3e1-14e66b39d39b tempest-VolumesSnapshotsTestJSON-1206846574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0241eb8a-d7c1-487f-b328-1359c7c1afd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:16:45.801622 ncdv-master-1 cinder-volume[134148]: DEBUG oslo_db.sqlalchemy.engines [req-99c447f4-41a8-44db-9f0d-705970c8fe55 req-17220a62-d8d7-4f50-b3e1-14e66b39d39b tempest-VolumesSnapshotsTestJSON-1206846574 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134148) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 18 21:16:45.821488 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [req-99c447f4-41a8-44db-9f0d-705970c8fe55 req-17220a62-d8d7-4f50-b3e1-14e66b39d39b tempest-VolumesSnapshotsTestJSON-1206846574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0241eb8a-d7c1-487f-b328-1359c7c1afd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-12-18T21:16:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-800121965',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=aefbe96f-d1ec-4188-99c4-b4da233de88e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='757b8ebe833d422891a28187ee5b7887',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-12-18T21:16:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-12-18T21:16:46Z,use_quota=True,user_id='66b65268b3834da5b1ee59f12dfc04c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f2e1fe1-9fd6-411e-9ed9-368f463ccb6f),volume_type_id=1f2e1fe1-9fd6-411e-9ed9-368f463ccb6f)' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:16:45.824206 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [req-99c447f4-41a8-44db-9f0d-705970c8fe55 req-17220a62-d8d7-4f50-b3e1-14e66b39d39b tempest-VolumesSnapshotsTestJSON-1206846574 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (422a9559-f59f-457b-8bbb-a937447e57e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:16:45.826536 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [req-99c447f4-41a8-44db-9f0d-705970c8fe55 req-17220a62-d8d7-4f50-b3e1-14e66b39d39b tempest-VolumesSnapshotsTestJSON-1206846574 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (422a9559-f59f-457b-8bbb-a937447e57e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:16:45.829057 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [req-99c447f4-41a8-44db-9f0d-705970c8fe55 req-17220a62-d8d7-4f50-b3e1-14e66b39d39b tempest-VolumesSnapshotsTestJSON-1206846574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ccc9afa5-26fa-4f07-91ec-f4b0620243c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:16:45.831921 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [req-99c447f4-41a8-44db-9f0d-705970c8fe55 req-17220a62-d8d7-4f50-b3e1-14e66b39d39b tempest-VolumesSnapshotsTestJSON-1206846574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ccc9afa5-26fa-4f07-91ec-f4b0620243c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aefbe96f-d1ec-4188-99c4-b4da233de88e', 'volume_name': 'volume-aefbe96f-d1ec-4188-99c4-b4da233de88e', 'volume_size': 1}' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:16:45.834278 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [req-99c447f4-41a8-44db-9f0d-705970c8fe55 req-17220a62-d8d7-4f50-b3e1-14e66b39d39b tempest-VolumesSnapshotsTestJSON-1206846574 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ae6f0c0-8098-4dc3-a1b5-736edbd33e6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:16:45.836422 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [req-99c447f4-41a8-44db-9f0d-705970c8fe55 req-17220a62-d8d7-4f50-b3e1-14e66b39d39b tempest-VolumesSnapshotsTestJSON-1206846574 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ae6f0c0-8098-4dc3-a1b5-736edbd33e6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:16:45.838683 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [req-99c447f4-41a8-44db-9f0d-705970c8fe55 req-17220a62-d8d7-4f50-b3e1-14e66b39d39b tempest-VolumesSnapshotsTestJSON-1206846574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d54f229-f057-4026-8455-170c0851e634) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:16:45.839473 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.flows.manager.create_volume [req-99c447f4-41a8-44db-9f0d-705970c8fe55 req-17220a62-d8d7-4f50-b3e1-14e66b39d39b tempest-VolumesSnapshotsTestJSON-1206846574 None] Volume aefbe96f-d1ec-4188-99c4-b4da233de88e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aefbe96f-d1ec-4188-99c4-b4da233de88e', 'volume_size': 1} Dec 18 21:16:45.839859 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [req-99c447f4-41a8-44db-9f0d-705970c8fe55 req-17220a62-d8d7-4f50-b3e1-14e66b39d39b tempest-VolumesSnapshotsTestJSON-1206846574 None] creating volume 'volume-aefbe96f-d1ec-4188-99c4-b4da233de88e' {{(pid=134148) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Dec 18 21:16:45.840832 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [req-99c447f4-41a8-44db-9f0d-705970c8fe55 req-17220a62-d8d7-4f50-b3e1-14e66b39d39b tempest-VolumesSnapshotsTestJSON-1206846574 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:16:45.904118 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [req-99c447f4-41a8-44db-9f0d-705970c8fe55 req-17220a62-d8d7-4f50-b3e1-14e66b39d39b tempest-VolumesSnapshotsTestJSON-1206846574 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134148) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 18 21:16:45.904515 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [req-99c447f4-41a8-44db-9f0d-705970c8fe55 req-17220a62-d8d7-4f50-b3e1-14e66b39d39b tempest-VolumesSnapshotsTestJSON-1206846574 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134148) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 18 21:16:45.907250 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [req-99c447f4-41a8-44db-9f0d-705970c8fe55 req-17220a62-d8d7-4f50-b3e1-14e66b39d39b tempest-VolumesSnapshotsTestJSON-1206846574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d54f229-f057-4026-8455-170c0851e634) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aefbe96f-d1ec-4188-99c4-b4da233de88e', 'volume_size': 1}' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:16:45.909686 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [req-99c447f4-41a8-44db-9f0d-705970c8fe55 req-17220a62-d8d7-4f50-b3e1-14e66b39d39b tempest-VolumesSnapshotsTestJSON-1206846574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a63b70f4-4c06-4716-afb7-fb04e67860c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:16:45.919973 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.flows.manager.create_volume [req-99c447f4-41a8-44db-9f0d-705970c8fe55 req-17220a62-d8d7-4f50-b3e1-14e66b39d39b tempest-VolumesSnapshotsTestJSON-1206846574 None] Volume volume-aefbe96f-d1ec-4188-99c4-b4da233de88e (aefbe96f-d1ec-4188-99c4-b4da233de88e): created successfully Dec 18 21:16:45.924020 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [req-99c447f4-41a8-44db-9f0d-705970c8fe55 req-17220a62-d8d7-4f50-b3e1-14e66b39d39b tempest-VolumesSnapshotsTestJSON-1206846574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a63b70f4-4c06-4716-afb7-fb04e67860c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:16:45.929180 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [req-99c447f4-41a8-44db-9f0d-705970c8fe55 req-17220a62-d8d7-4f50-b3e1-14e66b39d39b tempest-VolumesSnapshotsTestJSON-1206846574 None] Flow 'volume_create_manager' (f110ccca-a734-4106-8b26-99c1fabf113d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134148) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 18 21:16:45.946331 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [req-99c447f4-41a8-44db-9f0d-705970c8fe55 req-17220a62-d8d7-4f50-b3e1-14e66b39d39b tempest-VolumesSnapshotsTestJSON-1206846574 None] Created volume successfully. Dec 18 21:16:46.284820 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.flows.manager.create_volume [None req-58bd36f7-f9af-42a2-9c40-b10410694a68 tempest-VolumesGetTest-1188281619 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134148) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Dec 18 21:16:46.288000 ncdv-master-1 cinder-volume[134148]: WARNING stevedore.named [None req-58bd36f7-f9af-42a2-9c40-b10410694a68 tempest-VolumesGetTest-1188281619 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Dec 18 21:16:46.288437 ncdv-master-1 cinder-volume[134148]: WARNING castellan.key_manager [None req-58bd36f7-f9af-42a2-9c40-b10410694a68 tempest-VolumesGetTest-1188281619 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Dec 18 21:16:46.308986 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-58bd36f7-f9af-42a2-9c40-b10410694a68 tempest-VolumesGetTest-1188281619 None] Flow 'volume_create_manager' (35638b54-baaa-4452-ad3b-7a42c6dd06df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 18 21:16:46.312569 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-58bd36f7-f9af-42a2-9c40-b10410694a68 tempest-VolumesGetTest-1188281619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6bbc373c-662b-45f9-bc85-2a0ee07f4756) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:16:46.318929 ncdv-master-1 cinder-volume[134148]: DEBUG oslo_db.sqlalchemy.engines [None req-58bd36f7-f9af-42a2-9c40-b10410694a68 tempest-VolumesGetTest-1188281619 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134148) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 18 21:16:46.333482 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-58bd36f7-f9af-42a2-9c40-b10410694a68 tempest-VolumesGetTest-1188281619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6bbc373c-662b-45f9-bc85-2a0ee07f4756) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-12-18T21:16:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1632171715',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=2407702d-970f-4b54-87c2-bb2c587f46ea,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='d33644610c5c4f1aae112d75d4c5cbc4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-12-18T21:16:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=6df63251-2b33-410d-90b6-b9d9c0c4725a,status='creating',terminated_at=None,updated_at=2021-12-18T21:16:46Z,use_quota=True,user_id='d4ca5004855f40c7b85944eefe85de93',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f2e1fe1-9fd6-411e-9ed9-368f463ccb6f),volume_type_id=1f2e1fe1-9fd6-411e-9ed9-368f463ccb6f)' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:16:46.336688 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-58bd36f7-f9af-42a2-9c40-b10410694a68 tempest-VolumesGetTest-1188281619 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35307744-7675-4ac2-8476-267839f8c5b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:16:46.338905 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-58bd36f7-f9af-42a2-9c40-b10410694a68 tempest-VolumesGetTest-1188281619 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35307744-7675-4ac2-8476-267839f8c5b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:16:46.341414 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-58bd36f7-f9af-42a2-9c40-b10410694a68 tempest-VolumesGetTest-1188281619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba92895f-88ab-48a3-8e05-9215d17b05e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:16:46.357035 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-58bd36f7-f9af-42a2-9c40-b10410694a68 tempest-VolumesGetTest-1188281619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba92895f-88ab-48a3-8e05-9215d17b05e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '2407702d-970f-4b54-87c2-bb2c587f46ea', 'volume_name': 'volume-2407702d-970f-4b54-87c2-bb2c587f46ea', 'volume_size': 1, 'source_volid': '6df63251-2b33-410d-90b6-b9d9c0c4725a', 'source_volstatus': 'available'}' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:16:46.360069 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-58bd36f7-f9af-42a2-9c40-b10410694a68 tempest-VolumesGetTest-1188281619 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5ddcffd-c5c5-47d5-8632-897304f7c7b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:16:46.363220 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-58bd36f7-f9af-42a2-9c40-b10410694a68 tempest-VolumesGetTest-1188281619 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5ddcffd-c5c5-47d5-8632-897304f7c7b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:16:46.365560 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-58bd36f7-f9af-42a2-9c40-b10410694a68 tempest-VolumesGetTest-1188281619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a614bdd7-5aa7-4227-8e34-cfe60fd78bdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:16:46.366461 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.flows.manager.create_volume [None req-58bd36f7-f9af-42a2-9c40-b10410694a68 tempest-VolumesGetTest-1188281619 None] Volume 2407702d-970f-4b54-87c2-bb2c587f46ea: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-2407702d-970f-4b54-87c2-bb2c587f46ea', 'volume_size': 1, 'source_volid': '6df63251-2b33-410d-90b6-b9d9c0c4725a', 'source_volstatus': 'available'} Dec 18 21:16:46.381151 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-58bd36f7-f9af-42a2-9c40-b10410694a68 tempest-VolumesGetTest-1188281619 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:16:46.421151 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-58bd36f7-f9af-42a2-9c40-b10410694a68 tempest-VolumesGetTest-1188281619 None] creating snapshot='volume-2407702d-970f-4b54-87c2-bb2c587f46ea.clone_snap' {{(pid=134148) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:725}} Dec 18 21:16:46.715741 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-58bd36f7-f9af-42a2-9c40-b10410694a68 tempest-VolumesGetTest-1188281619 None] cloning 'volume-6df63251-2b33-410d-90b6-b9d9c0c4725a@volume-2407702d-970f-4b54-87c2-bb2c587f46ea.clone_snap' to 'volume-2407702d-970f-4b54-87c2-bb2c587f46ea' {{(pid=134148) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:731}} Dec 18 21:16:46.809233 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-58bd36f7-f9af-42a2-9c40-b10410694a68 tempest-VolumesGetTest-1188281619 None] Volume volume-6df63251-2b33-410d-90b6-b9d9c0c4725a is not a clone. {{(pid=134148) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Dec 18 21:16:46.810580 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-58bd36f7-f9af-42a2-9c40-b10410694a68 tempest-VolumesGetTest-1188281619 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134148) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 18 21:16:46.810953 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-58bd36f7-f9af-42a2-9c40-b10410694a68 tempest-VolumesGetTest-1188281619 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134148) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 18 21:16:46.830322 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-58bd36f7-f9af-42a2-9c40-b10410694a68 tempest-VolumesGetTest-1188281619 None] clone created successfully {{(pid=134148) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:803}} Dec 18 21:16:46.832693 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-58bd36f7-f9af-42a2-9c40-b10410694a68 tempest-VolumesGetTest-1188281619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a614bdd7-5aa7-4227-8e34-cfe60fd78bdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2407702d-970f-4b54-87c2-bb2c587f46ea', 'volume_size': 1, 'source_volid': '6df63251-2b33-410d-90b6-b9d9c0c4725a', 'source_volstatus': 'available'}' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:16:46.834880 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-58bd36f7-f9af-42a2-9c40-b10410694a68 tempest-VolumesGetTest-1188281619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (704b215e-40e3-48f8-ac15-bfdeb669aaf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:16:46.845973 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.flows.manager.create_volume [None req-58bd36f7-f9af-42a2-9c40-b10410694a68 tempest-VolumesGetTest-1188281619 None] Volume volume-2407702d-970f-4b54-87c2-bb2c587f46ea (2407702d-970f-4b54-87c2-bb2c587f46ea): created successfully Dec 18 21:16:46.845973 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-58bd36f7-f9af-42a2-9c40-b10410694a68 tempest-VolumesGetTest-1188281619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (704b215e-40e3-48f8-ac15-bfdeb669aaf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:16:46.851369 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-58bd36f7-f9af-42a2-9c40-b10410694a68 tempest-VolumesGetTest-1188281619 None] Flow 'volume_create_manager' (35638b54-baaa-4452-ad3b-7a42c6dd06df) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134148) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 18 21:16:46.877531 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-58bd36f7-f9af-42a2-9c40-b10410694a68 tempest-VolumesGetTest-1188281619 None] Created volume successfully. Dec 18 21:16:47.141176 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [req-5cde3c73-6713-4b1d-8a25-2624532e0302 req-f2d51b4b-264a-4152-ac93-6ba87daa4ffa tempest-VolumesSnapshotsTestJSON-1206846574 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:16:47.818230 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [req-5cde3c73-6713-4b1d-8a25-2624532e0302 req-f2d51b4b-264a-4152-ac93-6ba87daa4ffa tempest-VolumesSnapshotsTestJSON-1206846574 None] Create snapshot completed successfully Dec 18 21:16:47.824029 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.flows.manager.create_volume [None req-c7fa43a0-86e8-49bc-b7b1-addc7f978f7f tempest-VolumesGetTest-1188281619 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134148) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Dec 18 21:16:47.827631 ncdv-master-1 cinder-volume[134148]: WARNING stevedore.named [None req-c7fa43a0-86e8-49bc-b7b1-addc7f978f7f tempest-VolumesGetTest-1188281619 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Dec 18 21:16:47.828229 ncdv-master-1 cinder-volume[134148]: WARNING castellan.key_manager [None req-c7fa43a0-86e8-49bc-b7b1-addc7f978f7f tempest-VolumesGetTest-1188281619 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Dec 18 21:16:47.852170 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-c7fa43a0-86e8-49bc-b7b1-addc7f978f7f tempest-VolumesGetTest-1188281619 None] Flow 'volume_create_manager' (60f2095e-8c6b-44ad-a322-ea3febff6986) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 18 21:16:47.857241 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-c7fa43a0-86e8-49bc-b7b1-addc7f978f7f tempest-VolumesGetTest-1188281619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60383fa7-d71b-4a66-9d13-1f222f97ea2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:16:47.865780 ncdv-master-1 cinder-volume[134148]: DEBUG oslo_db.sqlalchemy.engines [None req-c7fa43a0-86e8-49bc-b7b1-addc7f978f7f tempest-VolumesGetTest-1188281619 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134148) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 18 21:16:47.878388 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-c7fa43a0-86e8-49bc-b7b1-addc7f978f7f tempest-VolumesGetTest-1188281619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60383fa7-d71b-4a66-9d13-1f222f97ea2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-12-18T21:16:48Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-889968856',display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=5e00a706-c1e1-4c03-a554-5ac03be3aa79,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d33644610c5c4f1aae112d75d4c5cbc4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-12-18T21:16:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-12-18T21:16:48Z,use_quota=True,user_id='d4ca5004855f40c7b85944eefe85de93',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f2e1fe1-9fd6-411e-9ed9-368f463ccb6f),volume_type_id=1f2e1fe1-9fd6-411e-9ed9-368f463ccb6f)' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:16:47.881055 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-c7fa43a0-86e8-49bc-b7b1-addc7f978f7f tempest-VolumesGetTest-1188281619 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c3ff547-5e0f-43ea-97c5-79b4f598b481) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:16:47.883282 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-c7fa43a0-86e8-49bc-b7b1-addc7f978f7f tempest-VolumesGetTest-1188281619 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c3ff547-5e0f-43ea-97c5-79b4f598b481) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:16:47.885722 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-c7fa43a0-86e8-49bc-b7b1-addc7f978f7f tempest-VolumesGetTest-1188281619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09a706af-3c2a-4040-8514-49a38584f3de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:16:47.888010 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-c7fa43a0-86e8-49bc-b7b1-addc7f978f7f tempest-VolumesGetTest-1188281619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09a706af-3c2a-4040-8514-49a38584f3de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5e00a706-c1e1-4c03-a554-5ac03be3aa79', 'volume_name': 'volume-5e00a706-c1e1-4c03-a554-5ac03be3aa79', 'volume_size': 1}' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:16:47.890392 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-c7fa43a0-86e8-49bc-b7b1-addc7f978f7f tempest-VolumesGetTest-1188281619 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47ab9bab-4bf5-45e4-ba3a-3a32e6fd2eeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:16:47.892750 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-c7fa43a0-86e8-49bc-b7b1-addc7f978f7f tempest-VolumesGetTest-1188281619 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47ab9bab-4bf5-45e4-ba3a-3a32e6fd2eeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:16:47.895049 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-c7fa43a0-86e8-49bc-b7b1-addc7f978f7f tempest-VolumesGetTest-1188281619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f7d8158-b80c-4884-8d08-bb25a4906453) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:16:47.895834 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.flows.manager.create_volume [None req-c7fa43a0-86e8-49bc-b7b1-addc7f978f7f tempest-VolumesGetTest-1188281619 None] Volume 5e00a706-c1e1-4c03-a554-5ac03be3aa79: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5e00a706-c1e1-4c03-a554-5ac03be3aa79', 'volume_size': 1} Dec 18 21:16:47.896221 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-c7fa43a0-86e8-49bc-b7b1-addc7f978f7f tempest-VolumesGetTest-1188281619 None] creating volume 'volume-5e00a706-c1e1-4c03-a554-5ac03be3aa79' {{(pid=134148) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Dec 18 21:16:47.897251 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-c7fa43a0-86e8-49bc-b7b1-addc7f978f7f tempest-VolumesGetTest-1188281619 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:16:47.958696 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-c7fa43a0-86e8-49bc-b7b1-addc7f978f7f tempest-VolumesGetTest-1188281619 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134148) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 18 21:16:47.959095 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-c7fa43a0-86e8-49bc-b7b1-addc7f978f7f tempest-VolumesGetTest-1188281619 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134148) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 18 21:16:47.961113 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-c7fa43a0-86e8-49bc-b7b1-addc7f978f7f tempest-VolumesGetTest-1188281619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f7d8158-b80c-4884-8d08-bb25a4906453) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5e00a706-c1e1-4c03-a554-5ac03be3aa79', 'volume_size': 1}' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:16:47.963327 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-c7fa43a0-86e8-49bc-b7b1-addc7f978f7f tempest-VolumesGetTest-1188281619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (633c5c7c-eddf-4f74-ba32-419908c6bf8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:16:47.974926 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.flows.manager.create_volume [None req-c7fa43a0-86e8-49bc-b7b1-addc7f978f7f tempest-VolumesGetTest-1188281619 None] Volume volume-5e00a706-c1e1-4c03-a554-5ac03be3aa79 (5e00a706-c1e1-4c03-a554-5ac03be3aa79): created successfully Dec 18 21:16:47.974926 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-c7fa43a0-86e8-49bc-b7b1-addc7f978f7f tempest-VolumesGetTest-1188281619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (633c5c7c-eddf-4f74-ba32-419908c6bf8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:16:47.977165 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-c7fa43a0-86e8-49bc-b7b1-addc7f978f7f tempest-VolumesGetTest-1188281619 None] Flow 'volume_create_manager' (60f2095e-8c6b-44ad-a322-ea3febff6986) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134148) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 18 21:16:47.984907 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-c7fa43a0-86e8-49bc-b7b1-addc7f978f7f tempest-VolumesGetTest-1188281619 None] Created volume successfully. Dec 18 21:16:48.331959 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.coordination [req-19a888c4-b9ea-436f-bac6-75a56e0ae2cc req-5f0b441a-135a-471f-8e75-ba8115046dea tempest-VolumesSnapshotsTestJSON-1206846574 None] Lock "b'cinder-15751919-f5ee-47a7-8014-a5e788730d20-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.010s {{(pid=134148) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 18 21:16:48.333591 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [req-19a888c4-b9ea-436f-bac6-75a56e0ae2cc req-5f0b441a-135a-471f-8e75-ba8115046dea tempest-VolumesSnapshotsTestJSON-1206846574 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:16:48.797606 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.quota [req-19a888c4-b9ea-436f-bac6-75a56e0ae2cc req-5f0b441a-135a-471f-8e75-ba8115046dea tempest-VolumesSnapshotsTestJSON-1206846574 None] Created reservations ['7b54981c-d9ed-4874-ad3c-fbbb65f4b4e9', '73252ca3-9366-491f-a7f2-076b160df15c', 'f309ef43-a273-41cd-8009-dfec96224b5e', '252bad37-1300-47c4-86e8-174cbe609a83'] {{(pid=134148) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 18 21:16:48.841452 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [req-19a888c4-b9ea-436f-bac6-75a56e0ae2cc req-5f0b441a-135a-471f-8e75-ba8115046dea tempest-VolumesSnapshotsTestJSON-1206846574 None] Delete snapshot completed successfully. Dec 18 21:16:48.846983 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.coordination [req-19a888c4-b9ea-436f-bac6-75a56e0ae2cc req-5f0b441a-135a-471f-8e75-ba8115046dea tempest-VolumesSnapshotsTestJSON-1206846574 None] Lock "b'cinder-15751919-f5ee-47a7-8014-a5e788730d20-delete_snapshot'" released by "delete_snapshot" :: held 0.515s {{(pid=134148) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 18 21:16:48.934080 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.coordination [None req-14fb892b-8173-4897-a6b0-8f778aec3eaf tempest-VolumesGetTest-1188281619 None] Lock "b'cinder-5e00a706-c1e1-4c03-a554-5ac03be3aa79-delete_volume'" acquired by "delete_volume" :: waited 0.019s {{(pid=134148) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 18 21:16:48.973708 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-14fb892b-8173-4897-a6b0-8f778aec3eaf tempest-VolumesGetTest-1188281619 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:16:49.027931 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-14fb892b-8173-4897-a6b0-8f778aec3eaf tempest-VolumesGetTest-1188281619 None] volume has no backup snaps {{(pid=134148) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Dec 18 21:16:49.028750 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-14fb892b-8173-4897-a6b0-8f778aec3eaf tempest-VolumesGetTest-1188281619 None] Volume volume-5e00a706-c1e1-4c03-a554-5ac03be3aa79 is not a clone. {{(pid=134148) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Dec 18 21:16:49.034835 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-14fb892b-8173-4897-a6b0-8f778aec3eaf tempest-VolumesGetTest-1188281619 None] deleting rbd volume volume-5e00a706-c1e1-4c03-a554-5ac03be3aa79 {{(pid=134148) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Dec 18 21:16:49.253543 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.quota [None req-14fb892b-8173-4897-a6b0-8f778aec3eaf tempest-VolumesGetTest-1188281619 None] Created reservations ['78a4a018-7c08-4cb1-8880-1912b18919a3', '846eac16-b5b1-42e2-83d8-63cc7c7fb9c6', 'd0e7c03e-b68d-481d-8ab9-89d352735129', 'e2e8673f-76ae-4621-9819-8397b813cc06'] {{(pid=134148) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 18 21:16:49.292532 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-14fb892b-8173-4897-a6b0-8f778aec3eaf tempest-VolumesGetTest-1188281619 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:16:49.319861 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-14fb892b-8173-4897-a6b0-8f778aec3eaf tempest-VolumesGetTest-1188281619 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:16:49.347938 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.manager [None req-14fb892b-8173-4897-a6b0-8f778aec3eaf tempest-VolumesGetTest-1188281619 None] Notifying Schedulers of capabilities ... {{(pid=134148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 18 21:16:49.352437 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-14fb892b-8173-4897-a6b0-8f778aec3eaf tempest-VolumesGetTest-1188281619 None] Deleted volume successfully. Dec 18 21:16:49.364756 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.coordination [None req-14fb892b-8173-4897-a6b0-8f778aec3eaf tempest-VolumesGetTest-1188281619 None] Lock "b'cinder-5e00a706-c1e1-4c03-a554-5ac03be3aa79-delete_volume'" released by "delete_volume" :: held 0.431s {{(pid=134148) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 18 21:16:49.485513 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.coordination [req-59e93975-3181-4e47-b7d2-637de54f5ed5 req-2ce79d58-da27-411a-8eaf-7f6f8acdff04 tempest-VolumesSnapshotsTestJSON-1206846574 None] Lock "b'cinder-aefbe96f-d1ec-4188-99c4-b4da233de88e-delete_volume'" acquired by "delete_volume" :: waited 0.014s {{(pid=134148) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 18 21:16:49.517356 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [req-59e93975-3181-4e47-b7d2-637de54f5ed5 req-2ce79d58-da27-411a-8eaf-7f6f8acdff04 tempest-VolumesSnapshotsTestJSON-1206846574 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:16:49.582500 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [req-59e93975-3181-4e47-b7d2-637de54f5ed5 req-2ce79d58-da27-411a-8eaf-7f6f8acdff04 tempest-VolumesSnapshotsTestJSON-1206846574 None] volume has no backup snaps {{(pid=134148) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Dec 18 21:16:49.583052 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [req-59e93975-3181-4e47-b7d2-637de54f5ed5 req-2ce79d58-da27-411a-8eaf-7f6f8acdff04 tempest-VolumesSnapshotsTestJSON-1206846574 None] Volume volume-aefbe96f-d1ec-4188-99c4-b4da233de88e is not a clone. {{(pid=134148) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Dec 18 21:16:49.590955 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [req-59e93975-3181-4e47-b7d2-637de54f5ed5 req-2ce79d58-da27-411a-8eaf-7f6f8acdff04 tempest-VolumesSnapshotsTestJSON-1206846574 None] deleting rbd volume volume-aefbe96f-d1ec-4188-99c4-b4da233de88e {{(pid=134148) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Dec 18 21:16:49.811438 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.quota [req-59e93975-3181-4e47-b7d2-637de54f5ed5 req-2ce79d58-da27-411a-8eaf-7f6f8acdff04 tempest-VolumesSnapshotsTestJSON-1206846574 None] Created reservations ['4445a02c-47eb-4a56-9b07-e319d1590f9b', 'b8ed7c88-f29e-465a-990e-0079eab28298', 'bb4c41f1-5eb6-4cbe-af54-3e86a326c47b', '993ad472-8e48-49be-8267-f4bb1da70a4d'] {{(pid=134148) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 18 21:16:49.856007 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [req-59e93975-3181-4e47-b7d2-637de54f5ed5 req-2ce79d58-da27-411a-8eaf-7f6f8acdff04 tempest-VolumesSnapshotsTestJSON-1206846574 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:16:49.879205 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [req-59e93975-3181-4e47-b7d2-637de54f5ed5 req-2ce79d58-da27-411a-8eaf-7f6f8acdff04 tempest-VolumesSnapshotsTestJSON-1206846574 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:16:49.905670 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.manager [req-59e93975-3181-4e47-b7d2-637de54f5ed5 req-2ce79d58-da27-411a-8eaf-7f6f8acdff04 tempest-VolumesSnapshotsTestJSON-1206846574 None] Notifying Schedulers of capabilities ... {{(pid=134148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 18 21:16:49.910400 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [req-59e93975-3181-4e47-b7d2-637de54f5ed5 req-2ce79d58-da27-411a-8eaf-7f6f8acdff04 tempest-VolumesSnapshotsTestJSON-1206846574 None] Deleted volume successfully. Dec 18 21:16:49.922740 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.coordination [req-59e93975-3181-4e47-b7d2-637de54f5ed5 req-2ce79d58-da27-411a-8eaf-7f6f8acdff04 tempest-VolumesSnapshotsTestJSON-1206846574 None] Lock "b'cinder-aefbe96f-d1ec-4188-99c4-b4da233de88e-delete_volume'" released by "delete_volume" :: held 0.437s {{(pid=134148) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 18 21:16:50.060477 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.coordination [None req-4e244b68-a8da-4c9f-8892-b7674f1582ea tempest-VolumesGetTest-1188281619 None] Lock "b'cinder-2407702d-970f-4b54-87c2-bb2c587f46ea-delete_volume'" acquired by "delete_volume" :: waited 0.010s {{(pid=134148) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 18 21:16:50.106070 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-4e244b68-a8da-4c9f-8892-b7674f1582ea tempest-VolumesGetTest-1188281619 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:16:50.166151 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-4e244b68-a8da-4c9f-8892-b7674f1582ea tempest-VolumesGetTest-1188281619 None] volume has no backup snaps {{(pid=134148) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Dec 18 21:16:50.172556 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-4e244b68-a8da-4c9f-8892-b7674f1582ea tempest-VolumesGetTest-1188281619 None] deleting rbd volume volume-2407702d-970f-4b54-87c2-bb2c587f46ea {{(pid=134148) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Dec 18 21:16:50.358233 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-4e244b68-a8da-4c9f-8892-b7674f1582ea tempest-VolumesGetTest-1188281619 None] volume is a clone so cleaning references {{(pid=134148) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1266}} Dec 18 21:16:50.375832 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-4e244b68-a8da-4c9f-8892-b7674f1582ea tempest-VolumesGetTest-1188281619 None] Volume volume-6df63251-2b33-410d-90b6-b9d9c0c4725a is not a clone. {{(pid=134148) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Dec 18 21:16:50.377002 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-4e244b68-a8da-4c9f-8892-b7674f1582ea tempest-VolumesGetTest-1188281619 None] deleting parent snapshot volume-2407702d-970f-4b54-87c2-bb2c587f46ea.clone_snap {{(pid=134148) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1158}} Dec 18 21:16:50.831692 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.quota [None req-4e244b68-a8da-4c9f-8892-b7674f1582ea tempest-VolumesGetTest-1188281619 None] Created reservations ['0f005e76-b0e5-48b7-a651-31e44f1d2799', '9a357b59-b74a-48c6-8601-841ac28c3197', '501cae21-b43c-425a-b0a8-d9ea9bca079f', '3ef2fa94-249c-43b3-9a64-af989b6a0294'] {{(pid=134148) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 18 21:16:50.875534 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-4e244b68-a8da-4c9f-8892-b7674f1582ea tempest-VolumesGetTest-1188281619 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:16:50.904479 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-4e244b68-a8da-4c9f-8892-b7674f1582ea tempest-VolumesGetTest-1188281619 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:16:50.936771 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.manager [None req-4e244b68-a8da-4c9f-8892-b7674f1582ea tempest-VolumesGetTest-1188281619 None] Notifying Schedulers of capabilities ... {{(pid=134148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 18 21:16:50.941576 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-4e244b68-a8da-4c9f-8892-b7674f1582ea tempest-VolumesGetTest-1188281619 None] Deleted volume successfully. Dec 18 21:16:50.959458 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.coordination [None req-4e244b68-a8da-4c9f-8892-b7674f1582ea tempest-VolumesGetTest-1188281619 None] Lock "b'cinder-2407702d-970f-4b54-87c2-bb2c587f46ea-delete_volume'" released by "delete_volume" :: held 0.899s {{(pid=134148) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 18 21:16:51.707795 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.flows.manager.create_volume [None req-7e663019-03d4-4d1a-8a2c-ac639e17ac2b tempest-VolumesGetTest-1188281619 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134148) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Dec 18 21:16:51.717682 ncdv-master-1 cinder-volume[134148]: WARNING stevedore.named [None req-7e663019-03d4-4d1a-8a2c-ac639e17ac2b tempest-VolumesGetTest-1188281619 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Dec 18 21:16:51.718381 ncdv-master-1 cinder-volume[134148]: WARNING castellan.key_manager [None req-7e663019-03d4-4d1a-8a2c-ac639e17ac2b tempest-VolumesGetTest-1188281619 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Dec 18 21:16:51.730558 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-7e663019-03d4-4d1a-8a2c-ac639e17ac2b tempest-VolumesGetTest-1188281619 None] Flow 'volume_create_manager' (604c133e-9a52-43d3-b8ae-1e30ffcc4773) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 18 21:16:51.741458 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-7e663019-03d4-4d1a-8a2c-ac639e17ac2b tempest-VolumesGetTest-1188281619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a815a04f-ed04-4f4d-877a-6535af4becf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:16:51.752970 ncdv-master-1 cinder-volume[134148]: DEBUG oslo_db.sqlalchemy.engines [None req-7e663019-03d4-4d1a-8a2c-ac639e17ac2b tempest-VolumesGetTest-1188281619 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134148) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 18 21:16:51.766337 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-7e663019-03d4-4d1a-8a2c-ac639e17ac2b tempest-VolumesGetTest-1188281619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a815a04f-ed04-4f4d-877a-6535af4becf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-12-18T21:16:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1387885341',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=afc364a0-1866-491c-9abc-555df821385a,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='d33644610c5c4f1aae112d75d4c5cbc4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-12-18T21:16:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-12-18T21:16:52Z,use_quota=True,user_id='d4ca5004855f40c7b85944eefe85de93',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f2e1fe1-9fd6-411e-9ed9-368f463ccb6f),volume_type_id=1f2e1fe1-9fd6-411e-9ed9-368f463ccb6f)' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:16:51.770105 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-7e663019-03d4-4d1a-8a2c-ac639e17ac2b tempest-VolumesGetTest-1188281619 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df01f7b2-34ca-4ed9-bbc2-bd53d9f391d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:16:51.772336 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-7e663019-03d4-4d1a-8a2c-ac639e17ac2b tempest-VolumesGetTest-1188281619 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df01f7b2-34ca-4ed9-bbc2-bd53d9f391d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:16:51.774833 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-7e663019-03d4-4d1a-8a2c-ac639e17ac2b tempest-VolumesGetTest-1188281619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a44c8fb1-49bc-460f-9aed-23662d2cea5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:16:51.896360 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-7e663019-03d4-4d1a-8a2c-ac639e17ac2b tempest-VolumesGetTest-1188281619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a44c8fb1-49bc-460f-9aed-23662d2cea5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'afc364a0-1866-491c-9abc-555df821385a', 'volume_name': 'volume-afc364a0-1866-491c-9abc-555df821385a', 'volume_size': 1, 'image_id': '394b3891-80f2-44c9-a9aa-56fe23a5acb3', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b04c3d19c79d4c208395e97f9d293618', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '394b3891-80f2-44c9-a9aa-56fe23a5acb3', 'created_at': datetime.datetime(2021, 12, 18, 20, 38, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 12, 18, 20, 38, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/394b3891-80f2-44c9-a9aa-56fe23a5acb3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:16:51.898813 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-7e663019-03d4-4d1a-8a2c-ac639e17ac2b tempest-VolumesGetTest-1188281619 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d076d613-77c4-45f9-9222-c6d8ba9df1f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:16:51.901257 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-7e663019-03d4-4d1a-8a2c-ac639e17ac2b tempest-VolumesGetTest-1188281619 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d076d613-77c4-45f9-9222-c6d8ba9df1f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:16:51.906528 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-7e663019-03d4-4d1a-8a2c-ac639e17ac2b tempest-VolumesGetTest-1188281619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf03a13c-bebd-4cc5-80f5-ea2b4d5788d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:16:51.907406 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.flows.manager.create_volume [None req-7e663019-03d4-4d1a-8a2c-ac639e17ac2b tempest-VolumesGetTest-1188281619 None] Volume afc364a0-1866-491c-9abc-555df821385a: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-afc364a0-1866-491c-9abc-555df821385a', 'volume_size': 1, 'image_id': '394b3891-80f2-44c9-a9aa-56fe23a5acb3', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b04c3d19c79d4c208395e97f9d293618', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '394b3891-80f2-44c9-a9aa-56fe23a5acb3', 'created_at': datetime.datetime(2021, 12, 18, 20, 38, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 12, 18, 20, 38, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/394b3891-80f2-44c9-a9aa-56fe23a5acb3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Dec 18 21:16:51.907984 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.flows.manager.create_volume [None req-7e663019-03d4-4d1a-8a2c-ac639e17ac2b tempest-VolumesGetTest-1188281619 None] Cloning afc364a0-1866-491c-9abc-555df821385a from image 394b3891-80f2-44c9-a9aa-56fe23a5acb3 at location (None, None). {{(pid=134148) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1047}} Dec 18 21:16:51.919429 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.coordination [None req-7e663019-03d4-4d1a-8a2c-ac639e17ac2b tempest-VolumesGetTest-1188281619 None] Lock "b'cinder-394b3891-80f2-44c9-a9aa-56fe23a5acb3'" acquired by "_prepare_image_cache_entry" :: waited 0.011s {{(pid=134148) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 18 21:16:51.934806 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.image.cache [None req-7e663019-03d4-4d1a-8a2c-ac639e17ac2b tempest-VolumesGetTest-1188281619 None] Found image-volume cache entry: {'id': 1, 'image_id': '394b3891-80f2-44c9-a9aa-56fe23a5acb3', 'volume_id': 'e6411a45-48fa-4beb-a5a0-eb6a6ca3f525', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2021, 12, 18, 20, 38, 21), 'last_used': datetime.datetime(2021, 12, 18, 21, 16, 51, 924498)}. {{(pid=134148) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Dec 18 21:16:51.935299 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.image.cache [None req-7e663019-03d4-4d1a-8a2c-ac639e17ac2b tempest-VolumesGetTest-1188281619 None] Image-volume cache entry image_update_at = 2021-12-18 20:38:21+00:00, requested image updated_at = 2021-12-18 20:38:21+00:00. {{(pid=134148) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Dec 18 21:16:51.935780 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.flows.manager.create_volume [None req-7e663019-03d4-4d1a-8a2c-ac639e17ac2b tempest-VolumesGetTest-1188281619 None] Found cache entry for image = 394b3891-80f2-44c9-a9aa-56fe23a5acb3 on host ncdv-master-1@ceph#ceph. {{(pid=134148) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:870}} Dec 18 21:16:51.941761 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.coordination [None req-7e663019-03d4-4d1a-8a2c-ac639e17ac2b tempest-VolumesGetTest-1188281619 None] Lock "b'cinder-394b3891-80f2-44c9-a9aa-56fe23a5acb3'" released by "_prepare_image_cache_entry" :: held 0.022s {{(pid=134148) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 18 21:16:51.943255 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.flows.manager.create_volume [None req-7e663019-03d4-4d1a-8a2c-ac639e17ac2b tempest-VolumesGetTest-1188281619 None] Attempting to retrieve cache entry for image = 394b3891-80f2-44c9-a9aa-56fe23a5acb3 on host ncdv-master-1@ceph#ceph. {{(pid=134148) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:811}} Dec 18 21:16:51.949101 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.image.cache [None req-7e663019-03d4-4d1a-8a2c-ac639e17ac2b tempest-VolumesGetTest-1188281619 None] Found image-volume cache entry: {'id': 1, 'image_id': '394b3891-80f2-44c9-a9aa-56fe23a5acb3', 'volume_id': 'e6411a45-48fa-4beb-a5a0-eb6a6ca3f525', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2021, 12, 18, 20, 38, 21), 'last_used': datetime.datetime(2021, 12, 18, 21, 16, 51, 946543)}. {{(pid=134148) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Dec 18 21:16:51.949509 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.image.cache [None req-7e663019-03d4-4d1a-8a2c-ac639e17ac2b tempest-VolumesGetTest-1188281619 None] Image-volume cache entry image_update_at = 2021-12-18 20:38:21+00:00, requested image updated_at = 2021-12-18 20:38:21+00:00. {{(pid=134148) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Dec 18 21:16:51.950105 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.flows.manager.create_volume [None req-7e663019-03d4-4d1a-8a2c-ac639e17ac2b tempest-VolumesGetTest-1188281619 None] Creating from source image-volume e6411a45-48fa-4beb-a5a0-eb6a6ca3f525 {{(pid=134148) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:825}} Dec 18 21:16:51.963028 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-7e663019-03d4-4d1a-8a2c-ac639e17ac2b tempest-VolumesGetTest-1188281619 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:16:52.036871 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-7e663019-03d4-4d1a-8a2c-ac639e17ac2b tempest-VolumesGetTest-1188281619 None] creating snapshot='volume-afc364a0-1866-491c-9abc-555df821385a.clone_snap' {{(pid=134148) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:725}} Dec 18 21:16:52.796707 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-7e663019-03d4-4d1a-8a2c-ac639e17ac2b tempest-VolumesGetTest-1188281619 None] cloning 'volume-e6411a45-48fa-4beb-a5a0-eb6a6ca3f525@volume-afc364a0-1866-491c-9abc-555df821385a.clone_snap' to 'volume-afc364a0-1866-491c-9abc-555df821385a' {{(pid=134148) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:731}} Dec 18 21:16:53.025022 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-7e663019-03d4-4d1a-8a2c-ac639e17ac2b tempest-VolumesGetTest-1188281619 None] Volume volume-9f5f7417-3abc-4462-988f-ef519750d753.deleted is not a clone. {{(pid=134148) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Dec 18 21:16:53.027142 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-7e663019-03d4-4d1a-8a2c-ac639e17ac2b tempest-VolumesGetTest-1188281619 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134148) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 18 21:16:53.027827 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-7e663019-03d4-4d1a-8a2c-ac639e17ac2b tempest-VolumesGetTest-1188281619 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134148) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 18 21:16:53.053895 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-7e663019-03d4-4d1a-8a2c-ac639e17ac2b tempest-VolumesGetTest-1188281619 None] clone created successfully {{(pid=134148) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:803}} Dec 18 21:16:53.054530 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.volume_utils [None req-7e663019-03d4-4d1a-8a2c-ac639e17ac2b tempest-VolumesGetTest-1188281619 None] Marking volume afc364a0-1866-491c-9abc-555df821385a as bootable. {{(pid=134148) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1178}} Dec 18 21:16:53.062661 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.flows.manager.create_volume [None req-7e663019-03d4-4d1a-8a2c-ac639e17ac2b tempest-VolumesGetTest-1188281619 None] Copying metadata from image 394b3891-80f2-44c9-a9aa-56fe23a5acb3 to afc364a0-1866-491c-9abc-555df821385a. {{(pid=134148) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:444}} Dec 18 21:16:53.063441 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.flows.manager.create_volume [None req-7e663019-03d4-4d1a-8a2c-ac639e17ac2b tempest-VolumesGetTest-1188281619 None] Creating volume glance metadata for volume afc364a0-1866-491c-9abc-555df821385a backed by image 394b3891-80f2-44c9-a9aa-56fe23a5acb3 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '394b3891-80f2-44c9-a9aa-56fe23a5acb3', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=134148) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:667}} Dec 18 21:16:53.116256 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-7e663019-03d4-4d1a-8a2c-ac639e17ac2b tempest-VolumesGetTest-1188281619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf03a13c-bebd-4cc5-80f5-ea2b4d5788d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-afc364a0-1866-491c-9abc-555df821385a', 'volume_size': 1, 'image_id': '394b3891-80f2-44c9-a9aa-56fe23a5acb3', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b04c3d19c79d4c208395e97f9d293618', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '394b3891-80f2-44c9-a9aa-56fe23a5acb3', 'created_at': datetime.datetime(2021, 12, 18, 20, 38, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 12, 18, 20, 38, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/394b3891-80f2-44c9-a9aa-56fe23a5acb3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:16:53.119008 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-7e663019-03d4-4d1a-8a2c-ac639e17ac2b tempest-VolumesGetTest-1188281619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7b12b60-21df-4768-81b8-2d8bf47b16e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:16:53.128743 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.flows.manager.create_volume [None req-7e663019-03d4-4d1a-8a2c-ac639e17ac2b tempest-VolumesGetTest-1188281619 None] Volume volume-afc364a0-1866-491c-9abc-555df821385a (afc364a0-1866-491c-9abc-555df821385a): created successfully Dec 18 21:16:53.131559 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-7e663019-03d4-4d1a-8a2c-ac639e17ac2b tempest-VolumesGetTest-1188281619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7b12b60-21df-4768-81b8-2d8bf47b16e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:16:53.134045 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-7e663019-03d4-4d1a-8a2c-ac639e17ac2b tempest-VolumesGetTest-1188281619 None] Flow 'volume_create_manager' (604c133e-9a52-43d3-b8ae-1e30ffcc4773) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134148) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 18 21:16:53.143658 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-7e663019-03d4-4d1a-8a2c-ac639e17ac2b tempest-VolumesGetTest-1188281619 None] Created volume successfully. Dec 18 21:16:54.233451 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.flows.manager.create_volume [None req-c9bb61ff-4338-41b9-a9cd-d0550fb6c377 tempest-VolumesGetTest-1188281619 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134148) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Dec 18 21:16:54.236754 ncdv-master-1 cinder-volume[134148]: WARNING stevedore.named [None req-c9bb61ff-4338-41b9-a9cd-d0550fb6c377 tempest-VolumesGetTest-1188281619 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Dec 18 21:16:54.237186 ncdv-master-1 cinder-volume[134148]: WARNING castellan.key_manager [None req-c9bb61ff-4338-41b9-a9cd-d0550fb6c377 tempest-VolumesGetTest-1188281619 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Dec 18 21:16:54.249124 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-c9bb61ff-4338-41b9-a9cd-d0550fb6c377 tempest-VolumesGetTest-1188281619 None] Flow 'volume_create_manager' (0d1861aa-00a8-4fea-9c0a-9cf9f4137c22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 18 21:16:54.253124 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-c9bb61ff-4338-41b9-a9cd-d0550fb6c377 tempest-VolumesGetTest-1188281619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b7bf6ff-67d3-4054-ae1e-efab48654a59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:16:54.259891 ncdv-master-1 cinder-volume[134148]: DEBUG oslo_db.sqlalchemy.engines [None req-c9bb61ff-4338-41b9-a9cd-d0550fb6c377 tempest-VolumesGetTest-1188281619 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134148) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 18 21:16:54.275880 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-c9bb61ff-4338-41b9-a9cd-d0550fb6c377 tempest-VolumesGetTest-1188281619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b7bf6ff-67d3-4054-ae1e-efab48654a59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-12-18T21:16:54Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1248168025',display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=ec2459b3-90a9-47a8-8904-d9c7b44425e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d33644610c5c4f1aae112d75d4c5cbc4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-12-18T21:16:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-12-18T21:16:54Z,use_quota=True,user_id='d4ca5004855f40c7b85944eefe85de93',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f2e1fe1-9fd6-411e-9ed9-368f463ccb6f),volume_type_id=1f2e1fe1-9fd6-411e-9ed9-368f463ccb6f)' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:16:54.278825 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-c9bb61ff-4338-41b9-a9cd-d0550fb6c377 tempest-VolumesGetTest-1188281619 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a822f6b-cddc-4074-8b75-a983a48ce038) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:16:54.281109 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-c9bb61ff-4338-41b9-a9cd-d0550fb6c377 tempest-VolumesGetTest-1188281619 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a822f6b-cddc-4074-8b75-a983a48ce038) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:16:54.284644 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-c9bb61ff-4338-41b9-a9cd-d0550fb6c377 tempest-VolumesGetTest-1188281619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e00156d9-15a0-494f-ae81-604ce29a06cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:16:54.287798 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-c9bb61ff-4338-41b9-a9cd-d0550fb6c377 tempest-VolumesGetTest-1188281619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e00156d9-15a0-494f-ae81-604ce29a06cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ec2459b3-90a9-47a8-8904-d9c7b44425e1', 'volume_name': 'volume-ec2459b3-90a9-47a8-8904-d9c7b44425e1', 'volume_size': 1}' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:16:54.290432 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-c9bb61ff-4338-41b9-a9cd-d0550fb6c377 tempest-VolumesGetTest-1188281619 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a54cbf5-b1c2-428e-b146-1cb6ab94218e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:16:54.293371 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-c9bb61ff-4338-41b9-a9cd-d0550fb6c377 tempest-VolumesGetTest-1188281619 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a54cbf5-b1c2-428e-b146-1cb6ab94218e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:16:54.298337 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-c9bb61ff-4338-41b9-a9cd-d0550fb6c377 tempest-VolumesGetTest-1188281619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5390142b-0483-483f-a7cc-34ebc82e9f3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:16:54.299560 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.flows.manager.create_volume [None req-c9bb61ff-4338-41b9-a9cd-d0550fb6c377 tempest-VolumesGetTest-1188281619 None] Volume ec2459b3-90a9-47a8-8904-d9c7b44425e1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ec2459b3-90a9-47a8-8904-d9c7b44425e1', 'volume_size': 1} Dec 18 21:16:54.300052 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-c9bb61ff-4338-41b9-a9cd-d0550fb6c377 tempest-VolumesGetTest-1188281619 None] creating volume 'volume-ec2459b3-90a9-47a8-8904-d9c7b44425e1' {{(pid=134148) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Dec 18 21:16:54.301139 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-c9bb61ff-4338-41b9-a9cd-d0550fb6c377 tempest-VolumesGetTest-1188281619 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:16:54.364683 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-c9bb61ff-4338-41b9-a9cd-d0550fb6c377 tempest-VolumesGetTest-1188281619 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134148) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 18 21:16:54.365248 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-c9bb61ff-4338-41b9-a9cd-d0550fb6c377 tempest-VolumesGetTest-1188281619 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134148) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 18 21:16:54.367688 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-c9bb61ff-4338-41b9-a9cd-d0550fb6c377 tempest-VolumesGetTest-1188281619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5390142b-0483-483f-a7cc-34ebc82e9f3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ec2459b3-90a9-47a8-8904-d9c7b44425e1', 'volume_size': 1}' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:16:54.370192 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-c9bb61ff-4338-41b9-a9cd-d0550fb6c377 tempest-VolumesGetTest-1188281619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25281edc-d8a2-417c-bb2e-d2b89d6069c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:16:54.381189 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.flows.manager.create_volume [None req-c9bb61ff-4338-41b9-a9cd-d0550fb6c377 tempest-VolumesGetTest-1188281619 None] Volume volume-ec2459b3-90a9-47a8-8904-d9c7b44425e1 (ec2459b3-90a9-47a8-8904-d9c7b44425e1): created successfully Dec 18 21:16:54.383227 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-c9bb61ff-4338-41b9-a9cd-d0550fb6c377 tempest-VolumesGetTest-1188281619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25281edc-d8a2-417c-bb2e-d2b89d6069c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:16:54.386296 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-c9bb61ff-4338-41b9-a9cd-d0550fb6c377 tempest-VolumesGetTest-1188281619 None] Flow 'volume_create_manager' (0d1861aa-00a8-4fea-9c0a-9cf9f4137c22) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134148) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 18 21:16:54.394728 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-c9bb61ff-4338-41b9-a9cd-d0550fb6c377 tempest-VolumesGetTest-1188281619 None] Created volume successfully. Dec 18 21:16:55.437812 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.coordination [None req-2f10507c-8c2d-4758-ac2c-3e2d43105552 tempest-VolumesGetTest-1188281619 None] Lock "b'cinder-ec2459b3-90a9-47a8-8904-d9c7b44425e1-delete_volume'" acquired by "delete_volume" :: waited 0.014s {{(pid=134148) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 18 21:16:55.500098 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-2f10507c-8c2d-4758-ac2c-3e2d43105552 tempest-VolumesGetTest-1188281619 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:16:55.565412 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-2f10507c-8c2d-4758-ac2c-3e2d43105552 tempest-VolumesGetTest-1188281619 None] volume has no backup snaps {{(pid=134148) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Dec 18 21:16:55.566567 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-2f10507c-8c2d-4758-ac2c-3e2d43105552 tempest-VolumesGetTest-1188281619 None] Volume volume-ec2459b3-90a9-47a8-8904-d9c7b44425e1 is not a clone. {{(pid=134148) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Dec 18 21:16:55.580638 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-2f10507c-8c2d-4758-ac2c-3e2d43105552 tempest-VolumesGetTest-1188281619 None] deleting rbd volume volume-ec2459b3-90a9-47a8-8904-d9c7b44425e1 {{(pid=134148) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Dec 18 21:16:55.932211 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.quota [None req-2f10507c-8c2d-4758-ac2c-3e2d43105552 tempest-VolumesGetTest-1188281619 None] Created reservations ['1f3853db-640b-435b-a681-921666e3ad76', 'e16cb5f7-cc75-4ab5-95c7-fa16bab65ece', 'c63df563-5bec-4933-8c36-f2e9f781cb57', 'cd47201b-840d-4559-b100-52328feee131'] {{(pid=134148) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 18 21:16:55.976881 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-2f10507c-8c2d-4758-ac2c-3e2d43105552 tempest-VolumesGetTest-1188281619 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:16:56.027004 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-2f10507c-8c2d-4758-ac2c-3e2d43105552 tempest-VolumesGetTest-1188281619 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:16:56.073701 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.manager [None req-2f10507c-8c2d-4758-ac2c-3e2d43105552 tempest-VolumesGetTest-1188281619 None] Notifying Schedulers of capabilities ... {{(pid=134148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 18 21:16:56.083195 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-2f10507c-8c2d-4758-ac2c-3e2d43105552 tempest-VolumesGetTest-1188281619 None] Deleted volume successfully. Dec 18 21:16:56.097214 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.coordination [None req-2f10507c-8c2d-4758-ac2c-3e2d43105552 tempest-VolumesGetTest-1188281619 None] Lock "b'cinder-ec2459b3-90a9-47a8-8904-d9c7b44425e1-delete_volume'" released by "delete_volume" :: held 0.661s {{(pid=134148) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 18 21:16:56.598202 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.coordination [None req-b217f3f9-212b-4d22-a6c6-a639a95066c1 tempest-VolumesGetTest-1188281619 None] Lock "b'cinder-afc364a0-1866-491c-9abc-555df821385a-delete_volume'" acquired by "delete_volume" :: waited 0.012s {{(pid=134148) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 18 21:16:56.687382 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-b217f3f9-212b-4d22-a6c6-a639a95066c1 tempest-VolumesGetTest-1188281619 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:16:56.809554 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-b217f3f9-212b-4d22-a6c6-a639a95066c1 tempest-VolumesGetTest-1188281619 None] volume has no backup snaps {{(pid=134148) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Dec 18 21:16:56.816961 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-b217f3f9-212b-4d22-a6c6-a639a95066c1 tempest-VolumesGetTest-1188281619 None] deleting rbd volume volume-afc364a0-1866-491c-9abc-555df821385a {{(pid=134148) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Dec 18 21:16:57.056858 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-b217f3f9-212b-4d22-a6c6-a639a95066c1 tempest-VolumesGetTest-1188281619 None] volume is a clone so cleaning references {{(pid=134148) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1266}} Dec 18 21:16:57.095577 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-b217f3f9-212b-4d22-a6c6-a639a95066c1 tempest-VolumesGetTest-1188281619 None] deleting parent snapshot volume-afc364a0-1866-491c-9abc-555df821385a.clone_snap {{(pid=134148) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1158}} Dec 18 21:16:57.882094 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.quota [None req-b217f3f9-212b-4d22-a6c6-a639a95066c1 tempest-VolumesGetTest-1188281619 None] Created reservations ['12dd681d-6ed3-40d3-af06-4711f9ebb057', 'bfbc5142-e286-476f-9f12-d02572161f94', '9f4b3dfd-a78a-4269-ad52-f8dbbeb23e29', '152f6659-7ab2-4a8a-bfe0-7491b5f7a11f'] {{(pid=134148) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 18 21:16:57.924639 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-b217f3f9-212b-4d22-a6c6-a639a95066c1 tempest-VolumesGetTest-1188281619 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:16:57.951375 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-b217f3f9-212b-4d22-a6c6-a639a95066c1 tempest-VolumesGetTest-1188281619 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:16:57.980196 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.manager [None req-b217f3f9-212b-4d22-a6c6-a639a95066c1 tempest-VolumesGetTest-1188281619 None] Notifying Schedulers of capabilities ... {{(pid=134148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 18 21:16:57.985090 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-b217f3f9-212b-4d22-a6c6-a639a95066c1 tempest-VolumesGetTest-1188281619 None] Deleted volume successfully. Dec 18 21:16:57.997738 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.coordination [None req-b217f3f9-212b-4d22-a6c6-a639a95066c1 tempest-VolumesGetTest-1188281619 None] Lock "b'cinder-afc364a0-1866-491c-9abc-555df821385a-delete_volume'" released by "delete_volume" :: held 1.400s {{(pid=134148) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 18 21:16:58.890459 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.coordination [None req-e4845daf-c879-41f7-a4d6-2029368b5c29 tempest-VolumesGetTest-1188281619 None] Lock "b'cinder-6df63251-2b33-410d-90b6-b9d9c0c4725a-delete_volume'" acquired by "delete_volume" :: waited 0.023s {{(pid=134148) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 18 21:16:58.941918 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-e4845daf-c879-41f7-a4d6-2029368b5c29 tempest-VolumesGetTest-1188281619 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:16:59.024323 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-e4845daf-c879-41f7-a4d6-2029368b5c29 tempest-VolumesGetTest-1188281619 None] volume has no backup snaps {{(pid=134148) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Dec 18 21:16:59.024834 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-e4845daf-c879-41f7-a4d6-2029368b5c29 tempest-VolumesGetTest-1188281619 None] Volume volume-6df63251-2b33-410d-90b6-b9d9c0c4725a is not a clone. {{(pid=134148) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Dec 18 21:16:59.035409 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-e4845daf-c879-41f7-a4d6-2029368b5c29 tempest-VolumesGetTest-1188281619 None] deleting rbd volume volume-6df63251-2b33-410d-90b6-b9d9c0c4725a {{(pid=134148) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Dec 18 21:16:59.307743 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.quota [None req-e4845daf-c879-41f7-a4d6-2029368b5c29 tempest-VolumesGetTest-1188281619 None] Created reservations ['b235a22d-a3ee-4192-8fa1-803f8c7121a7', '171b1e38-f082-4e7f-b8f7-fbbb15864334', 'ce669a38-e378-4560-80cc-1f547bdc9db6', 'ef14330f-eeec-41c4-a0d5-7d5e340f9281'] {{(pid=134148) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 18 21:16:59.352814 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-e4845daf-c879-41f7-a4d6-2029368b5c29 tempest-VolumesGetTest-1188281619 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:16:59.388267 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-e4845daf-c879-41f7-a4d6-2029368b5c29 tempest-VolumesGetTest-1188281619 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:16:59.421024 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.manager [None req-e4845daf-c879-41f7-a4d6-2029368b5c29 tempest-VolumesGetTest-1188281619 None] Notifying Schedulers of capabilities ... {{(pid=134148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 18 21:16:59.425677 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-e4845daf-c879-41f7-a4d6-2029368b5c29 tempest-VolumesGetTest-1188281619 None] Deleted volume successfully. Dec 18 21:16:59.440726 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.coordination [None req-e4845daf-c879-41f7-a4d6-2029368b5c29 tempest-VolumesGetTest-1188281619 None] Lock "b'cinder-6df63251-2b33-410d-90b6-b9d9c0c4725a-delete_volume'" released by "delete_volume" :: held 0.552s {{(pid=134148) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 18 21:17:03.593067 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.flows.manager.create_volume [None req-d2d59ed8-fadd-41d6-b64c-ba0496574224 tempest-VolumesSnapshotTestJSON-1921935471 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134148) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Dec 18 21:17:03.597826 ncdv-master-1 cinder-volume[134148]: WARNING stevedore.named [None req-d2d59ed8-fadd-41d6-b64c-ba0496574224 tempest-VolumesSnapshotTestJSON-1921935471 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Dec 18 21:17:03.598411 ncdv-master-1 cinder-volume[134148]: WARNING castellan.key_manager [None req-d2d59ed8-fadd-41d6-b64c-ba0496574224 tempest-VolumesSnapshotTestJSON-1921935471 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Dec 18 21:17:03.615716 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-d2d59ed8-fadd-41d6-b64c-ba0496574224 tempest-VolumesSnapshotTestJSON-1921935471 None] Flow 'volume_create_manager' (0abee38c-7004-476f-8d1b-877f98695be3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 18 21:17:03.621879 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-d2d59ed8-fadd-41d6-b64c-ba0496574224 tempest-VolumesSnapshotTestJSON-1921935471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ccf1c23-f201-439c-9009-2b2537d178a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:17:03.629997 ncdv-master-1 cinder-volume[134148]: DEBUG oslo_db.sqlalchemy.engines [None req-d2d59ed8-fadd-41d6-b64c-ba0496574224 tempest-VolumesSnapshotTestJSON-1921935471 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134148) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 18 21:17:03.652976 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-d2d59ed8-fadd-41d6-b64c-ba0496574224 tempest-VolumesSnapshotTestJSON-1921935471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ccf1c23-f201-439c-9009-2b2537d178a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-12-18T21:17:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1558749852',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=453214a7-66ea-4df2-bb71-f35aa118fee6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2d14b131ac74307b9aa94aded5f3f5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-12-18T21:17:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-12-18T21:17:04Z,use_quota=True,user_id='84883df65dac439a8c1e454b7ad570e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f2e1fe1-9fd6-411e-9ed9-368f463ccb6f),volume_type_id=1f2e1fe1-9fd6-411e-9ed9-368f463ccb6f)' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:17:03.658465 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-d2d59ed8-fadd-41d6-b64c-ba0496574224 tempest-VolumesSnapshotTestJSON-1921935471 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (daf70758-0fa1-4563-8a8e-ca1dd410fe3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:17:03.662223 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-d2d59ed8-fadd-41d6-b64c-ba0496574224 tempest-VolumesSnapshotTestJSON-1921935471 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (daf70758-0fa1-4563-8a8e-ca1dd410fe3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:17:03.665464 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-d2d59ed8-fadd-41d6-b64c-ba0496574224 tempest-VolumesSnapshotTestJSON-1921935471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d1b8341-f674-4e37-8db0-f9817cc0009a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:17:03.668463 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-d2d59ed8-fadd-41d6-b64c-ba0496574224 tempest-VolumesSnapshotTestJSON-1921935471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d1b8341-f674-4e37-8db0-f9817cc0009a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '453214a7-66ea-4df2-bb71-f35aa118fee6', 'volume_name': 'volume-453214a7-66ea-4df2-bb71-f35aa118fee6', 'volume_size': 1}' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:17:03.671421 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-d2d59ed8-fadd-41d6-b64c-ba0496574224 tempest-VolumesSnapshotTestJSON-1921935471 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d55343c3-822e-49c8-bced-cc910953b222) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:17:03.674346 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-d2d59ed8-fadd-41d6-b64c-ba0496574224 tempest-VolumesSnapshotTestJSON-1921935471 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d55343c3-822e-49c8-bced-cc910953b222) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:17:03.676923 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-d2d59ed8-fadd-41d6-b64c-ba0496574224 tempest-VolumesSnapshotTestJSON-1921935471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32aa5c70-48ae-4431-a6fc-e0a1a8d8fe93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:17:03.677972 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.flows.manager.create_volume [None req-d2d59ed8-fadd-41d6-b64c-ba0496574224 tempest-VolumesSnapshotTestJSON-1921935471 None] Volume 453214a7-66ea-4df2-bb71-f35aa118fee6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-453214a7-66ea-4df2-bb71-f35aa118fee6', 'volume_size': 1} Dec 18 21:17:03.678734 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-d2d59ed8-fadd-41d6-b64c-ba0496574224 tempest-VolumesSnapshotTestJSON-1921935471 None] creating volume 'volume-453214a7-66ea-4df2-bb71-f35aa118fee6' {{(pid=134148) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Dec 18 21:17:03.680030 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-d2d59ed8-fadd-41d6-b64c-ba0496574224 tempest-VolumesSnapshotTestJSON-1921935471 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:17:03.806384 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-d2d59ed8-fadd-41d6-b64c-ba0496574224 tempest-VolumesSnapshotTestJSON-1921935471 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134148) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 18 21:17:03.807881 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-d2d59ed8-fadd-41d6-b64c-ba0496574224 tempest-VolumesSnapshotTestJSON-1921935471 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134148) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 18 21:17:03.810081 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-d2d59ed8-fadd-41d6-b64c-ba0496574224 tempest-VolumesSnapshotTestJSON-1921935471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32aa5c70-48ae-4431-a6fc-e0a1a8d8fe93) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-453214a7-66ea-4df2-bb71-f35aa118fee6', 'volume_size': 1}' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:17:03.812492 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-d2d59ed8-fadd-41d6-b64c-ba0496574224 tempest-VolumesSnapshotTestJSON-1921935471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (536334ec-50f9-4e46-b920-eda15ad21ea8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:17:03.823723 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.flows.manager.create_volume [None req-d2d59ed8-fadd-41d6-b64c-ba0496574224 tempest-VolumesSnapshotTestJSON-1921935471 None] Volume volume-453214a7-66ea-4df2-bb71-f35aa118fee6 (453214a7-66ea-4df2-bb71-f35aa118fee6): created successfully Dec 18 21:17:03.826419 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-d2d59ed8-fadd-41d6-b64c-ba0496574224 tempest-VolumesSnapshotTestJSON-1921935471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (536334ec-50f9-4e46-b920-eda15ad21ea8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:17:03.834000 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-d2d59ed8-fadd-41d6-b64c-ba0496574224 tempest-VolumesSnapshotTestJSON-1921935471 None] Flow 'volume_create_manager' (0abee38c-7004-476f-8d1b-877f98695be3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134148) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 18 21:17:03.846586 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-d2d59ed8-fadd-41d6-b64c-ba0496574224 tempest-VolumesSnapshotTestJSON-1921935471 None] Created volume successfully. Dec 18 21:17:04.914214 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-bf5dbf24-e8bd-4993-b4f9-909acb46c313 tempest-VolumesSnapshotTestJSON-1921935471 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:17:05.806356 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-bf5dbf24-e8bd-4993-b4f9-909acb46c313 tempest-VolumesSnapshotTestJSON-1921935471 None] Create snapshot completed successfully Dec 18 21:17:06.620835 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.driver [None req-7cf4f7a1-6990-452e-aa61-6bb9abcf075b tempest-VolumesSnapshotTestJSON-1921935471 None] Creating a new backup for volume volume-453214a7-66ea-4df2-bb71-f35aa118fee6. {{(pid=134148) _get_backup_volume_temp_volume /opt/stack/cinder/cinder/volume/driver.py:1226}} Dec 18 21:17:06.696701 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-7cf4f7a1-6990-452e-aa61-6bb9abcf075b tempest-VolumesSnapshotTestJSON-1921935471 None] cloning volumes/volume-453214a7-66ea-4df2-bb71-f35aa118fee6@snapshot-2660e5ba-05af-4047-b2fa-0f83ae62129e to volume-b2cc5dd1-96f1-46b9-87ee-fa96efb6245f {{(pid=134148) _clone /opt/stack/cinder/cinder/volume/drivers/rbd.py:1028}} Dec 18 21:17:06.698928 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-7cf4f7a1-6990-452e-aa61-6bb9abcf075b tempest-VolumesSnapshotTestJSON-1921935471 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:17:06.800886 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-7cf4f7a1-6990-452e-aa61-6bb9abcf075b tempest-VolumesSnapshotTestJSON-1921935471 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:17:07.023848 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-7cf4f7a1-6990-452e-aa61-6bb9abcf075b tempest-VolumesSnapshotTestJSON-1921935471 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134148) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 18 21:17:07.025200 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-7cf4f7a1-6990-452e-aa61-6bb9abcf075b tempest-VolumesSnapshotTestJSON-1921935471 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134148) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 18 21:17:07.102650 ncdv-master-1 cinder-volume[134148]: DEBUG oslo_concurrency.processutils [None req-7cf4f7a1-6990-452e-aa61-6bb9abcf075b tempest-VolumesSnapshotTestJSON-1921935471 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=134148) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Dec 18 21:17:08.034693 ncdv-master-1 cinder-volume[134148]: DEBUG oslo_concurrency.processutils [None req-7cf4f7a1-6990-452e-aa61-6bb9abcf075b tempest-VolumesSnapshotTestJSON-1921935471 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.931s {{(pid=134148) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Dec 18 21:17:08.036607 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-7cf4f7a1-6990-452e-aa61-6bb9abcf075b tempest-VolumesSnapshotTestJSON-1921935471 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-b2cc5dd1-96f1-46b9-87ee-fa96efb6245f', 'hosts': ['10.222.0.13'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '946d1715-d12c-4dbf-8a79-181222df6e2e', 'volume_id': 'b2cc5dd1-96f1-46b9-87ee-fa96efb6245f', 'discard': True}} {{(pid=134148) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Dec 18 21:17:08.066434 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-7cf4f7a1-6990-452e-aa61-6bb9abcf075b tempest-VolumesSnapshotTestJSON-1921935471 None] Initialize volume connection completed successfully. Dec 18 21:17:19.558570 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-7cf4f7a1-6990-452e-aa61-6bb9abcf075b tempest-VolumesSnapshotTestJSON-1921935471 None] Terminate volume connection completed successfully. Dec 18 21:17:19.576602 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-7cf4f7a1-6990-452e-aa61-6bb9abcf075b tempest-VolumesSnapshotTestJSON-1921935471 None] Remove volume export completed successfully. Dec 18 21:17:19.623116 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.coordination [None req-7cf4f7a1-6990-452e-aa61-6bb9abcf075b tempest-VolumesSnapshotTestJSON-1921935471 None] Lock "b'cinder-b2cc5dd1-96f1-46b9-87ee-fa96efb6245f-delete_volume'" acquired by "delete_volume" :: waited 0.016s {{(pid=134148) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 18 21:17:19.639468 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-7cf4f7a1-6990-452e-aa61-6bb9abcf075b tempest-VolumesSnapshotTestJSON-1921935471 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:17:19.724393 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-7cf4f7a1-6990-452e-aa61-6bb9abcf075b tempest-VolumesSnapshotTestJSON-1921935471 None] volume has no backup snaps {{(pid=134148) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Dec 18 21:17:19.738197 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-7cf4f7a1-6990-452e-aa61-6bb9abcf075b tempest-VolumesSnapshotTestJSON-1921935471 None] deleting rbd volume volume-b2cc5dd1-96f1-46b9-87ee-fa96efb6245f {{(pid=134148) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Dec 18 21:17:20.165500 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-7cf4f7a1-6990-452e-aa61-6bb9abcf075b tempest-VolumesSnapshotTestJSON-1921935471 None] Deleted volume successfully. Dec 18 21:17:20.177716 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.coordination [None req-7cf4f7a1-6990-452e-aa61-6bb9abcf075b tempest-VolumesSnapshotTestJSON-1921935471 None] Lock "b'cinder-b2cc5dd1-96f1-46b9-87ee-fa96efb6245f-delete_volume'" released by "delete_volume" :: held 0.554s {{(pid=134148) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 18 21:17:34.344760 ncdv-master-1 cinder-volume[134148]: DEBUG oslo_service.periodic_task [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134148) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Dec 18 21:17:34.345661 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:17:34.395327 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:17:34.445122 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.manager [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] Notifying Schedulers of capabilities ... {{(pid=134148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 18 21:17:34.665413 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.flows.manager.create_volume [None req-fa47212f-4ea9-42cb-b608-1e75ba0624d5 tempest-VolumesSnapshotTestJSON-1921935471 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134148) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Dec 18 21:17:34.669935 ncdv-master-1 cinder-volume[134148]: WARNING stevedore.named [None req-fa47212f-4ea9-42cb-b608-1e75ba0624d5 tempest-VolumesSnapshotTestJSON-1921935471 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Dec 18 21:17:34.670026 ncdv-master-1 cinder-volume[134148]: WARNING castellan.key_manager [None req-fa47212f-4ea9-42cb-b608-1e75ba0624d5 tempest-VolumesSnapshotTestJSON-1921935471 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Dec 18 21:17:34.684569 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-fa47212f-4ea9-42cb-b608-1e75ba0624d5 tempest-VolumesSnapshotTestJSON-1921935471 None] Flow 'volume_create_manager' (be57991d-b3f3-4d73-840b-de4e68a4e3f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 18 21:17:34.688040 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-fa47212f-4ea9-42cb-b608-1e75ba0624d5 tempest-VolumesSnapshotTestJSON-1921935471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1214ad2b-7af5-4eea-8e52-f9ad0a062ed1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:17:34.696059 ncdv-master-1 cinder-volume[134148]: DEBUG oslo_db.sqlalchemy.engines [None req-fa47212f-4ea9-42cb-b608-1e75ba0624d5 tempest-VolumesSnapshotTestJSON-1921935471 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134148) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 18 21:17:34.715055 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-fa47212f-4ea9-42cb-b608-1e75ba0624d5 tempest-VolumesSnapshotTestJSON-1921935471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1214ad2b-7af5-4eea-8e52-f9ad0a062ed1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-12-18T21:17:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-911173609',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=a6a5227f-3cf0-4d6b-aa2f-ba6a5904e103,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2d14b131ac74307b9aa94aded5f3f5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-12-18T21:17:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-12-18T21:17:35Z,use_quota=True,user_id='84883df65dac439a8c1e454b7ad570e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f2e1fe1-9fd6-411e-9ed9-368f463ccb6f),volume_type_id=1f2e1fe1-9fd6-411e-9ed9-368f463ccb6f)' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:17:34.719342 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-fa47212f-4ea9-42cb-b608-1e75ba0624d5 tempest-VolumesSnapshotTestJSON-1921935471 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9d51abf-af3e-4efc-9226-17952f5651c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:17:34.721018 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-fa47212f-4ea9-42cb-b608-1e75ba0624d5 tempest-VolumesSnapshotTestJSON-1921935471 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9d51abf-af3e-4efc-9226-17952f5651c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:17:34.724755 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-fa47212f-4ea9-42cb-b608-1e75ba0624d5 tempest-VolumesSnapshotTestJSON-1921935471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4456f467-a9ba-417f-8ef6-6c4c2d8829be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:17:34.831720 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-fa47212f-4ea9-42cb-b608-1e75ba0624d5 tempest-VolumesSnapshotTestJSON-1921935471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4456f467-a9ba-417f-8ef6-6c4c2d8829be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'a6a5227f-3cf0-4d6b-aa2f-ba6a5904e103', 'volume_name': 'volume-a6a5227f-3cf0-4d6b-aa2f-ba6a5904e103', 'volume_size': 1, 'image_id': '394b3891-80f2-44c9-a9aa-56fe23a5acb3', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b04c3d19c79d4c208395e97f9d293618', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '394b3891-80f2-44c9-a9aa-56fe23a5acb3', 'created_at': datetime.datetime(2021, 12, 18, 20, 38, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 12, 18, 20, 38, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/394b3891-80f2-44c9-a9aa-56fe23a5acb3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:17:34.835311 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-fa47212f-4ea9-42cb-b608-1e75ba0624d5 tempest-VolumesSnapshotTestJSON-1921935471 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab83d744-6d68-4164-a89a-233ad7681cad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:17:34.838540 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-fa47212f-4ea9-42cb-b608-1e75ba0624d5 tempest-VolumesSnapshotTestJSON-1921935471 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab83d744-6d68-4164-a89a-233ad7681cad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:17:34.841693 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-fa47212f-4ea9-42cb-b608-1e75ba0624d5 tempest-VolumesSnapshotTestJSON-1921935471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f905486-2d55-4a35-a972-5bba920d8184) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:17:34.844366 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.flows.manager.create_volume [None req-fa47212f-4ea9-42cb-b608-1e75ba0624d5 tempest-VolumesSnapshotTestJSON-1921935471 None] Volume a6a5227f-3cf0-4d6b-aa2f-ba6a5904e103: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-a6a5227f-3cf0-4d6b-aa2f-ba6a5904e103', 'volume_size': 1, 'image_id': '394b3891-80f2-44c9-a9aa-56fe23a5acb3', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b04c3d19c79d4c208395e97f9d293618', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '394b3891-80f2-44c9-a9aa-56fe23a5acb3', 'created_at': datetime.datetime(2021, 12, 18, 20, 38, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 12, 18, 20, 38, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/394b3891-80f2-44c9-a9aa-56fe23a5acb3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Dec 18 21:17:34.844951 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.flows.manager.create_volume [None req-fa47212f-4ea9-42cb-b608-1e75ba0624d5 tempest-VolumesSnapshotTestJSON-1921935471 None] Cloning a6a5227f-3cf0-4d6b-aa2f-ba6a5904e103 from image 394b3891-80f2-44c9-a9aa-56fe23a5acb3 at location (None, None). {{(pid=134148) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1047}} Dec 18 21:17:34.859423 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.coordination [None req-fa47212f-4ea9-42cb-b608-1e75ba0624d5 tempest-VolumesSnapshotTestJSON-1921935471 None] Lock "b'cinder-394b3891-80f2-44c9-a9aa-56fe23a5acb3'" acquired by "_prepare_image_cache_entry" :: waited 0.013s {{(pid=134148) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 18 21:17:34.871106 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.image.cache [None req-fa47212f-4ea9-42cb-b608-1e75ba0624d5 tempest-VolumesSnapshotTestJSON-1921935471 None] Found image-volume cache entry: {'id': 1, 'image_id': '394b3891-80f2-44c9-a9aa-56fe23a5acb3', 'volume_id': 'e6411a45-48fa-4beb-a5a0-eb6a6ca3f525', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2021, 12, 18, 20, 38, 21), 'last_used': datetime.datetime(2021, 12, 18, 21, 17, 34, 864019)}. {{(pid=134148) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Dec 18 21:17:34.871613 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.image.cache [None req-fa47212f-4ea9-42cb-b608-1e75ba0624d5 tempest-VolumesSnapshotTestJSON-1921935471 None] Image-volume cache entry image_update_at = 2021-12-18 20:38:21+00:00, requested image updated_at = 2021-12-18 20:38:21+00:00. {{(pid=134148) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Dec 18 21:17:34.872206 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.flows.manager.create_volume [None req-fa47212f-4ea9-42cb-b608-1e75ba0624d5 tempest-VolumesSnapshotTestJSON-1921935471 None] Found cache entry for image = 394b3891-80f2-44c9-a9aa-56fe23a5acb3 on host ncdv-master-1@ceph#ceph. {{(pid=134148) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:870}} Dec 18 21:17:34.879530 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.coordination [None req-fa47212f-4ea9-42cb-b608-1e75ba0624d5 tempest-VolumesSnapshotTestJSON-1921935471 None] Lock "b'cinder-394b3891-80f2-44c9-a9aa-56fe23a5acb3'" released by "_prepare_image_cache_entry" :: held 0.021s {{(pid=134148) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 18 21:17:34.881557 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.flows.manager.create_volume [None req-fa47212f-4ea9-42cb-b608-1e75ba0624d5 tempest-VolumesSnapshotTestJSON-1921935471 None] Attempting to retrieve cache entry for image = 394b3891-80f2-44c9-a9aa-56fe23a5acb3 on host ncdv-master-1@ceph#ceph. {{(pid=134148) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:811}} Dec 18 21:17:34.889207 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.image.cache [None req-fa47212f-4ea9-42cb-b608-1e75ba0624d5 tempest-VolumesSnapshotTestJSON-1921935471 None] Found image-volume cache entry: {'id': 1, 'image_id': '394b3891-80f2-44c9-a9aa-56fe23a5acb3', 'volume_id': 'e6411a45-48fa-4beb-a5a0-eb6a6ca3f525', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2021, 12, 18, 20, 38, 21), 'last_used': datetime.datetime(2021, 12, 18, 21, 17, 34, 886393)}. {{(pid=134148) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Dec 18 21:17:34.889674 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.image.cache [None req-fa47212f-4ea9-42cb-b608-1e75ba0624d5 tempest-VolumesSnapshotTestJSON-1921935471 None] Image-volume cache entry image_update_at = 2021-12-18 20:38:21+00:00, requested image updated_at = 2021-12-18 20:38:21+00:00. {{(pid=134148) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Dec 18 21:17:34.890094 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.flows.manager.create_volume [None req-fa47212f-4ea9-42cb-b608-1e75ba0624d5 tempest-VolumesSnapshotTestJSON-1921935471 None] Creating from source image-volume e6411a45-48fa-4beb-a5a0-eb6a6ca3f525 {{(pid=134148) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:825}} Dec 18 21:17:34.905738 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-fa47212f-4ea9-42cb-b608-1e75ba0624d5 tempest-VolumesSnapshotTestJSON-1921935471 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:17:34.980432 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-fa47212f-4ea9-42cb-b608-1e75ba0624d5 tempest-VolumesSnapshotTestJSON-1921935471 None] creating snapshot='volume-a6a5227f-3cf0-4d6b-aa2f-ba6a5904e103.clone_snap' {{(pid=134148) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:725}} Dec 18 21:17:35.155392 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-fa47212f-4ea9-42cb-b608-1e75ba0624d5 tempest-VolumesSnapshotTestJSON-1921935471 None] cloning 'volume-e6411a45-48fa-4beb-a5a0-eb6a6ca3f525@volume-a6a5227f-3cf0-4d6b-aa2f-ba6a5904e103.clone_snap' to 'volume-a6a5227f-3cf0-4d6b-aa2f-ba6a5904e103' {{(pid=134148) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:731}} Dec 18 21:17:35.346085 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-fa47212f-4ea9-42cb-b608-1e75ba0624d5 tempest-VolumesSnapshotTestJSON-1921935471 None] Volume volume-9f5f7417-3abc-4462-988f-ef519750d753.deleted is not a clone. {{(pid=134148) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Dec 18 21:17:35.347370 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-fa47212f-4ea9-42cb-b608-1e75ba0624d5 tempest-VolumesSnapshotTestJSON-1921935471 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134148) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 18 21:17:35.347816 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-fa47212f-4ea9-42cb-b608-1e75ba0624d5 tempest-VolumesSnapshotTestJSON-1921935471 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134148) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 18 21:17:35.373980 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-fa47212f-4ea9-42cb-b608-1e75ba0624d5 tempest-VolumesSnapshotTestJSON-1921935471 None] clone created successfully {{(pid=134148) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:803}} Dec 18 21:17:35.374793 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.volume_utils [None req-fa47212f-4ea9-42cb-b608-1e75ba0624d5 tempest-VolumesSnapshotTestJSON-1921935471 None] Marking volume a6a5227f-3cf0-4d6b-aa2f-ba6a5904e103 as bootable. {{(pid=134148) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1178}} Dec 18 21:17:35.384475 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.flows.manager.create_volume [None req-fa47212f-4ea9-42cb-b608-1e75ba0624d5 tempest-VolumesSnapshotTestJSON-1921935471 None] Copying metadata from image 394b3891-80f2-44c9-a9aa-56fe23a5acb3 to a6a5227f-3cf0-4d6b-aa2f-ba6a5904e103. {{(pid=134148) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:444}} Dec 18 21:17:35.384904 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.flows.manager.create_volume [None req-fa47212f-4ea9-42cb-b608-1e75ba0624d5 tempest-VolumesSnapshotTestJSON-1921935471 None] Creating volume glance metadata for volume a6a5227f-3cf0-4d6b-aa2f-ba6a5904e103 backed by image 394b3891-80f2-44c9-a9aa-56fe23a5acb3 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '394b3891-80f2-44c9-a9aa-56fe23a5acb3', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=134148) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:667}} Dec 18 21:17:35.437082 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-fa47212f-4ea9-42cb-b608-1e75ba0624d5 tempest-VolumesSnapshotTestJSON-1921935471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f905486-2d55-4a35-a972-5bba920d8184) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a6a5227f-3cf0-4d6b-aa2f-ba6a5904e103', 'volume_size': 1, 'image_id': '394b3891-80f2-44c9-a9aa-56fe23a5acb3', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b04c3d19c79d4c208395e97f9d293618', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '394b3891-80f2-44c9-a9aa-56fe23a5acb3', 'created_at': datetime.datetime(2021, 12, 18, 20, 38, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 12, 18, 20, 38, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/394b3891-80f2-44c9-a9aa-56fe23a5acb3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:17:35.439539 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-fa47212f-4ea9-42cb-b608-1e75ba0624d5 tempest-VolumesSnapshotTestJSON-1921935471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7253bc0-ab65-448f-9526-e4a1b922ff20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:17:35.451665 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.flows.manager.create_volume [None req-fa47212f-4ea9-42cb-b608-1e75ba0624d5 tempest-VolumesSnapshotTestJSON-1921935471 None] Volume volume-a6a5227f-3cf0-4d6b-aa2f-ba6a5904e103 (a6a5227f-3cf0-4d6b-aa2f-ba6a5904e103): created successfully Dec 18 21:17:35.454420 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-fa47212f-4ea9-42cb-b608-1e75ba0624d5 tempest-VolumesSnapshotTestJSON-1921935471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7253bc0-ab65-448f-9526-e4a1b922ff20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:17:35.457476 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-fa47212f-4ea9-42cb-b608-1e75ba0624d5 tempest-VolumesSnapshotTestJSON-1921935471 None] Flow 'volume_create_manager' (be57991d-b3f3-4d73-840b-de4e68a4e3f5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134148) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 18 21:17:35.466371 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-fa47212f-4ea9-42cb-b608-1e75ba0624d5 tempest-VolumesSnapshotTestJSON-1921935471 None] Created volume successfully. Dec 18 21:17:36.150953 ncdv-master-1 cinder-volume[134148]: DEBUG oslo_concurrency.processutils [req-bf5e0cd6-37f4-42b0-aac1-05e90ba10597 req-cab684ff-9354-410f-83e4-757f741d107e tempest-VolumesSnapshotTestJSON-1921935471 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=134148) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Dec 18 21:17:36.985581 ncdv-master-1 cinder-volume[134148]: DEBUG oslo_concurrency.processutils [req-bf5e0cd6-37f4-42b0-aac1-05e90ba10597 req-cab684ff-9354-410f-83e4-757f741d107e tempest-VolumesSnapshotTestJSON-1921935471 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.834s {{(pid=134148) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Dec 18 21:17:36.986399 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [req-bf5e0cd6-37f4-42b0-aac1-05e90ba10597 req-cab684ff-9354-410f-83e4-757f741d107e tempest-VolumesSnapshotTestJSON-1921935471 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-a6a5227f-3cf0-4d6b-aa2f-ba6a5904e103', 'hosts': ['10.222.0.13'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '946d1715-d12c-4dbf-8a79-181222df6e2e', 'volume_id': 'a6a5227f-3cf0-4d6b-aa2f-ba6a5904e103', 'discard': True}} {{(pid=134148) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Dec 18 21:17:37.011278 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [req-bf5e0cd6-37f4-42b0-aac1-05e90ba10597 req-cab684ff-9354-410f-83e4-757f741d107e tempest-VolumesSnapshotTestJSON-1921935471 None] Connection info returned from driver {'name': 'volumes/volume-a6a5227f-3cf0-4d6b-aa2f-ba6a5904e103', 'hosts': ['10.222.0.13'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'a6a5227f-3cf0-4d6b-aa2f-ba6a5904e103', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '5f0d9371-e1c8-466d-bcf7-8ddd2cc9d6b7'} {{(pid=134148) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4812}} Dec 18 21:17:37.071375 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [req-bf5e0cd6-37f4-42b0-aac1-05e90ba10597 req-cab684ff-9354-410f-83e4-757f741d107e tempest-VolumesSnapshotTestJSON-1921935471 None] attachment_update completed successfully. Dec 18 21:17:39.481323 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-191bceaa-0630-415d-aa37-fb5495d95570 tempest-VolumesSnapshotTestJSON-1921935471 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:17:39.811087 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-191bceaa-0630-415d-aa37-fb5495d95570 tempest-VolumesSnapshotTestJSON-1921935471 None] Create snapshot completed successfully Dec 18 21:17:40.752431 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-0680fac4-ea09-4bc2-b9ff-78d5505abc98 tempest-VolumesSnapshotTestJSON-1921935471 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:17:41.918379 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-0680fac4-ea09-4bc2-b9ff-78d5505abc98 tempest-VolumesSnapshotTestJSON-1921935471 None] Create snapshot completed successfully Dec 18 21:17:43.077488 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-00ceabaa-d486-44bf-a93a-6b32d9957fa1 tempest-VolumesSnapshotTestJSON-1921935471 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:17:44.097570 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-00ceabaa-d486-44bf-a93a-6b32d9957fa1 tempest-VolumesSnapshotTestJSON-1921935471 None] Create snapshot completed successfully Dec 18 21:17:45.214799 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.coordination [None req-62f4b51c-e070-4cbe-b234-34c8d6041d7b tempest-VolumesSnapshotTestJSON-1921935471 None] Lock "b'cinder-a678e8cc-2df1-49b7-acd4-36b376646a3a-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.014s {{(pid=134148) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 18 21:17:45.219926 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-62f4b51c-e070-4cbe-b234-34c8d6041d7b tempest-VolumesSnapshotTestJSON-1921935471 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:18:14.453545 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [req-9e50c38f-ea93-4640-b575-a6c7970d84e9 req-ae529a46-f827-4fd2-af89-234f43977a42 tempest-TestVolumeBootPattern-1320248540 None] Terminate volume connection completed successfully. Dec 18 21:18:14.454147 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [req-9e50c38f-ea93-4640-b575-a6c7970d84e9 req-ae529a46-f827-4fd2-af89-234f43977a42 tempest-TestVolumeBootPattern-1320248540 None] Deleting attachment 29c6279d-48b9-4ad0-a6f2-58314b434166. {{(pid=134148) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4948}} Dec 18 21:18:15.194503 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-f8ce009f-8a9a-40d0-bdfe-a5e8b205e3b9 tempest-GroupsTest-720754250 None] Group tempest-Group1-537348990: creating Dec 18 21:18:15.210930 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-f8ce009f-8a9a-40d0-bdfe-a5e8b205e3b9 tempest-GroupsTest-720754250 None] Group tempest-Group1-537348990: created successfully Dec 18 21:18:15.220377 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-f8ce009f-8a9a-40d0-bdfe-a5e8b205e3b9 tempest-GroupsTest-720754250 None] Create group completed successfully. Dec 18 21:18:15.450540 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.quota [None req-62f4b51c-e070-4cbe-b234-34c8d6041d7b tempest-VolumesSnapshotTestJSON-1921935471 None] Created reservations ['2afa937c-ddbb-45fb-84f2-67312eca96b8', '6cc2f52e-0581-4dd2-ad0a-283303d1dcdc', '3251e8b3-ffad-49e3-988b-e40efb83ed75', 'b4a29de5-e73f-476f-a809-9fe597bd6dc7'] {{(pid=134148) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 18 21:18:15.502555 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-62f4b51c-e070-4cbe-b234-34c8d6041d7b tempest-VolumesSnapshotTestJSON-1921935471 None] Delete snapshot completed successfully. Dec 18 21:18:15.507085 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.coordination [None req-62f4b51c-e070-4cbe-b234-34c8d6041d7b tempest-VolumesSnapshotTestJSON-1921935471 None] Lock "b'cinder-a678e8cc-2df1-49b7-acd4-36b376646a3a-delete_snapshot'" released by "delete_snapshot" :: held 30.294s {{(pid=134148) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 18 21:18:15.879622 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.coordination [None req-b51e437f-2373-4215-a8fa-98995b72f687 tempest-TestVolumeBootPattern-1320248540 None] Lock "b'cinder-41536881-3ff9-4059-a3bb-d571589e7a54-delete_volume'" acquired by "delete_volume" :: waited 0.010s {{(pid=134148) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 18 21:18:15.918780 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-b51e437f-2373-4215-a8fa-98995b72f687 tempest-TestVolumeBootPattern-1320248540 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:18:16.030853 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-b51e437f-2373-4215-a8fa-98995b72f687 tempest-TestVolumeBootPattern-1320248540 None] volume has no backup snaps {{(pid=134148) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Dec 18 21:18:16.040138 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-b51e437f-2373-4215-a8fa-98995b72f687 tempest-TestVolumeBootPattern-1320248540 None] deleting rbd volume volume-41536881-3ff9-4059-a3bb-d571589e7a54 {{(pid=134148) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Dec 18 21:18:16.368660 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.quota [None req-b51e437f-2373-4215-a8fa-98995b72f687 tempest-TestVolumeBootPattern-1320248540 None] Created reservations ['c5544b82-d750-4d22-83d1-9c9bb3371603', 'fa8f8ddb-aa3e-4c8f-aa3c-a3c45f90f58f', 'be38acec-5917-4490-9cfa-23db8f7e2c69', 'a5b1394e-c220-42ea-a256-f2f8948fae0e'] {{(pid=134148) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 18 21:18:16.410478 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-84271314-b00f-413a-bc2f-d2e6402f5b24 tempest-GroupsTest-720754250 None] Group tempest-Group2-1557033279: creating Dec 18 21:18:16.450343 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.coordination [None req-2bfd8e97-65dc-443a-bcfc-5cfd3086e24d tempest-VolumesSnapshotTestJSON-1921935471 None] Lock "b'cinder-e7cc5e96-ab15-4d2f-9e03-98b02e02ba2a-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.041s {{(pid=134148) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 18 21:18:16.452145 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-2bfd8e97-65dc-443a-bcfc-5cfd3086e24d tempest-VolumesSnapshotTestJSON-1921935471 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:18:16.565634 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-84271314-b00f-413a-bc2f-d2e6402f5b24 tempest-GroupsTest-720754250 None] Group tempest-Group2-1557033279: created successfully Dec 18 21:18:16.580641 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-84271314-b00f-413a-bc2f-d2e6402f5b24 tempest-GroupsTest-720754250 None] Create group completed successfully. Dec 18 21:18:16.582523 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-b51e437f-2373-4215-a8fa-98995b72f687 tempest-TestVolumeBootPattern-1320248540 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:18:16.628994 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-b51e437f-2373-4215-a8fa-98995b72f687 tempest-TestVolumeBootPattern-1320248540 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:18:16.662864 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.manager [None req-b51e437f-2373-4215-a8fa-98995b72f687 tempest-TestVolumeBootPattern-1320248540 None] Notifying Schedulers of capabilities ... {{(pid=134148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 18 21:18:16.667969 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-b51e437f-2373-4215-a8fa-98995b72f687 tempest-TestVolumeBootPattern-1320248540 None] Deleted volume successfully. Dec 18 21:18:16.679485 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.coordination [None req-b51e437f-2373-4215-a8fa-98995b72f687 tempest-TestVolumeBootPattern-1320248540 None] Lock "b'cinder-41536881-3ff9-4059-a3bb-d571589e7a54-delete_volume'" released by "delete_volume" :: held 0.800s {{(pid=134148) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 18 21:18:17.008092 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.coordination [None req-5e410468-492e-4d3c-91c2-2339e8164cf9 tempest-TestVolumeBootPattern-1320248540 None] Lock "b'cinder-38d8249f-a253-43e2-b429-d8a7c1a23757-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.010s {{(pid=134148) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 18 21:18:17.009709 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-5e410468-492e-4d3c-91c2-2339e8164cf9 tempest-TestVolumeBootPattern-1320248540 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:18:17.799678 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.flows.manager.create_volume [None req-e39a2412-92af-4df9-aabd-dbf55176571b tempest-GroupsTest-720754250 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134148) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Dec 18 21:18:17.803328 ncdv-master-1 cinder-volume[134148]: WARNING stevedore.named [None req-e39a2412-92af-4df9-aabd-dbf55176571b tempest-GroupsTest-720754250 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Dec 18 21:18:17.803800 ncdv-master-1 cinder-volume[134148]: WARNING castellan.key_manager [None req-e39a2412-92af-4df9-aabd-dbf55176571b tempest-GroupsTest-720754250 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Dec 18 21:18:17.816302 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-e39a2412-92af-4df9-aabd-dbf55176571b tempest-GroupsTest-720754250 None] Flow 'volume_create_manager' (94eaeab7-4d56-46e4-9885-2d25a931cc0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 18 21:18:17.819988 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-e39a2412-92af-4df9-aabd-dbf55176571b tempest-GroupsTest-720754250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ab62abd-3e40-4ed6-8a95-8c23b9c8f5b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:18:17.826433 ncdv-master-1 cinder-volume[134148]: DEBUG oslo_db.sqlalchemy.engines [None req-e39a2412-92af-4df9-aabd-dbf55176571b tempest-GroupsTest-720754250 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134148) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 18 21:18:17.838727 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-e39a2412-92af-4df9-aabd-dbf55176571b tempest-GroupsTest-720754250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ab62abd-3e40-4ed6-8a95-8c23b9c8f5b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-12-18T21:18:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1155230147',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=244c9fc4-7d66-4789-a479-0232e53852f1,host='ncdv-master-1@ceph#ceph',id=9849f763-5d9c-4dc5-b692-5a382379100b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='77c414586ca040b6ab572fb952debf9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-12-18T21:18:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-12-18T21:18:18Z,use_quota=True,user_id='26b847b1d5f144fbb9c2e95bd76450b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bfc63221-d1af-41cf-aefa-acdb9a11168a),volume_type_id=bfc63221-d1af-41cf-aefa-acdb9a11168a)' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:18:17.841335 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-e39a2412-92af-4df9-aabd-dbf55176571b tempest-GroupsTest-720754250 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f952efb9-14e8-4c3d-aea7-5289e0464eb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:18:17.844107 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-e39a2412-92af-4df9-aabd-dbf55176571b tempest-GroupsTest-720754250 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f952efb9-14e8-4c3d-aea7-5289e0464eb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:18:17.846541 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-e39a2412-92af-4df9-aabd-dbf55176571b tempest-GroupsTest-720754250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1222f44b-6d66-4692-b0bc-6b8213f358e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:18:17.848776 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-e39a2412-92af-4df9-aabd-dbf55176571b tempest-GroupsTest-720754250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1222f44b-6d66-4692-b0bc-6b8213f358e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9849f763-5d9c-4dc5-b692-5a382379100b', 'volume_name': 'volume-9849f763-5d9c-4dc5-b692-5a382379100b', 'volume_size': 1}' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:18:17.851115 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-e39a2412-92af-4df9-aabd-dbf55176571b tempest-GroupsTest-720754250 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a306994c-b6b7-4b25-acd3-3f28decf43b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:18:17.853217 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-e39a2412-92af-4df9-aabd-dbf55176571b tempest-GroupsTest-720754250 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a306994c-b6b7-4b25-acd3-3f28decf43b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:18:17.855440 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-e39a2412-92af-4df9-aabd-dbf55176571b tempest-GroupsTest-720754250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45fbe8b1-1d0c-4a0f-a1fd-ce2dca6e4ec0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:18:17.869903 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.flows.manager.create_volume [None req-e39a2412-92af-4df9-aabd-dbf55176571b tempest-GroupsTest-720754250 None] Volume 9849f763-5d9c-4dc5-b692-5a382379100b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9849f763-5d9c-4dc5-b692-5a382379100b', 'volume_size': 1} Dec 18 21:18:17.870347 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-e39a2412-92af-4df9-aabd-dbf55176571b tempest-GroupsTest-720754250 None] creating volume 'volume-9849f763-5d9c-4dc5-b692-5a382379100b' {{(pid=134148) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Dec 18 21:18:17.871397 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-e39a2412-92af-4df9-aabd-dbf55176571b tempest-GroupsTest-720754250 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:18:17.928605 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-e39a2412-92af-4df9-aabd-dbf55176571b tempest-GroupsTest-720754250 None] extra_specs: {} {{(pid=134148) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 18 21:18:17.928981 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-e39a2412-92af-4df9-aabd-dbf55176571b tempest-GroupsTest-720754250 None] extra_specs: {} {{(pid=134148) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 18 21:18:17.931137 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-e39a2412-92af-4df9-aabd-dbf55176571b tempest-GroupsTest-720754250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45fbe8b1-1d0c-4a0f-a1fd-ce2dca6e4ec0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9849f763-5d9c-4dc5-b692-5a382379100b', 'volume_size': 1}' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:18:17.933393 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-e39a2412-92af-4df9-aabd-dbf55176571b tempest-GroupsTest-720754250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f62ec947-f7c0-4d52-ad5f-3cd6c7ec15b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:18:17.942710 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.flows.manager.create_volume [None req-e39a2412-92af-4df9-aabd-dbf55176571b tempest-GroupsTest-720754250 None] Volume volume-9849f763-5d9c-4dc5-b692-5a382379100b (9849f763-5d9c-4dc5-b692-5a382379100b): created successfully Dec 18 21:18:17.944751 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-e39a2412-92af-4df9-aabd-dbf55176571b tempest-GroupsTest-720754250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f62ec947-f7c0-4d52-ad5f-3cd6c7ec15b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:18:17.947817 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-e39a2412-92af-4df9-aabd-dbf55176571b tempest-GroupsTest-720754250 None] Flow 'volume_create_manager' (94eaeab7-4d56-46e4-9885-2d25a931cc0a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134148) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 18 21:18:17.955719 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-e39a2412-92af-4df9-aabd-dbf55176571b tempest-GroupsTest-720754250 None] Created volume successfully. Dec 18 21:18:19.235486 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-c538a991-8c52-4f35-84a9-7b5214f36348 tempest-GroupsTest-720754250 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:18:19.290132 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-c538a991-8c52-4f35-84a9-7b5214f36348 tempest-GroupsTest-720754250 None] volume has no backup snaps {{(pid=134148) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Dec 18 21:18:19.290602 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-c538a991-8c52-4f35-84a9-7b5214f36348 tempest-GroupsTest-720754250 None] Volume volume-9849f763-5d9c-4dc5-b692-5a382379100b is not a clone. {{(pid=134148) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Dec 18 21:18:19.297386 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-c538a991-8c52-4f35-84a9-7b5214f36348 tempest-GroupsTest-720754250 None] deleting rbd volume volume-9849f763-5d9c-4dc5-b692-5a382379100b {{(pid=134148) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Dec 18 21:18:19.539773 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.quota [None req-c538a991-8c52-4f35-84a9-7b5214f36348 tempest-GroupsTest-720754250 None] Created reservations ['0305244d-e1f3-43c9-96fc-4d3f69b9e8da'] {{(pid=134148) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 18 21:18:19.555535 ncdv-master-1 cinder-volume[134148]: WARNING cinder.quota [None req-c538a991-8c52-4f35-84a9-7b5214f36348 tempest-GroupsTest-720754250 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-703549527 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-703549527, it is now deprecated. Please use the default quota class for default quota. Dec 18 21:18:19.556310 ncdv-master-1 cinder-volume[134148]: WARNING cinder.quota [None req-c538a991-8c52-4f35-84a9-7b5214f36348 tempest-GroupsTest-720754250 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-703549527 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-703549527, it is now deprecated. Please use the default quota class for default quota. Dec 18 21:18:19.570616 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.quota [None req-c538a991-8c52-4f35-84a9-7b5214f36348 tempest-GroupsTest-720754250 None] Created reservations ['df544405-b623-4639-9885-2fd3351271a2', '08f3ab65-ba60-46a3-960f-4bd22fbd7a6d', 'bbd718c0-450f-42be-8b9d-9b539c1f52a6', '45e1facd-e80b-4247-9bcb-4203fe9bef86'] {{(pid=134148) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 18 21:18:19.645603 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-c538a991-8c52-4f35-84a9-7b5214f36348 tempest-GroupsTest-720754250 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:18:19.669086 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-c538a991-8c52-4f35-84a9-7b5214f36348 tempest-GroupsTest-720754250 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:18:19.702097 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.manager [None req-c538a991-8c52-4f35-84a9-7b5214f36348 tempest-GroupsTest-720754250 None] Notifying Schedulers of capabilities ... {{(pid=134148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 18 21:18:19.716107 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-c538a991-8c52-4f35-84a9-7b5214f36348 tempest-GroupsTest-720754250 None] Delete group completed successfully. Dec 18 21:18:20.443620 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.quota [None req-0404dd56-8fb4-4c12-937e-9e4712bf64bf tempest-GroupsTest-720754250 None] Created reservations ['533d70da-22de-40d2-9774-dbeea4b6bc36'] {{(pid=134148) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 18 21:18:20.473348 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-0404dd56-8fb4-4c12-937e-9e4712bf64bf tempest-GroupsTest-720754250 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:18:20.503249 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-0404dd56-8fb4-4c12-937e-9e4712bf64bf tempest-GroupsTest-720754250 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:18:20.528935 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.manager [None req-0404dd56-8fb4-4c12-937e-9e4712bf64bf tempest-GroupsTest-720754250 None] Notifying Schedulers of capabilities ... {{(pid=134148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 18 21:18:20.532690 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-0404dd56-8fb4-4c12-937e-9e4712bf64bf tempest-GroupsTest-720754250 None] Delete group completed successfully. Dec 18 21:18:21.843445 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-97ea0cc5-dcc9-486b-983a-0fd64eb048c3 tempest-GroupsTest-720754250 None] Group tempest-GroupsTest-Group-6421869: creating Dec 18 21:18:21.861659 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-97ea0cc5-dcc9-486b-983a-0fd64eb048c3 tempest-GroupsTest-720754250 None] Group tempest-GroupsTest-Group-6421869: created successfully Dec 18 21:18:21.873178 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-97ea0cc5-dcc9-486b-983a-0fd64eb048c3 tempest-GroupsTest-720754250 None] Create group completed successfully. Dec 18 21:18:23.236281 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.flows.manager.create_volume [None req-aa7e4387-c934-456b-9282-1f6dfbc491a4 tempest-GroupsTest-720754250 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134148) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Dec 18 21:18:23.239672 ncdv-master-1 cinder-volume[134148]: WARNING stevedore.named [None req-aa7e4387-c934-456b-9282-1f6dfbc491a4 tempest-GroupsTest-720754250 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Dec 18 21:18:23.240117 ncdv-master-1 cinder-volume[134148]: WARNING castellan.key_manager [None req-aa7e4387-c934-456b-9282-1f6dfbc491a4 tempest-GroupsTest-720754250 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Dec 18 21:18:23.253810 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-aa7e4387-c934-456b-9282-1f6dfbc491a4 tempest-GroupsTest-720754250 None] Flow 'volume_create_manager' (d90c726a-d65e-48e9-bc3d-cd915aa03be4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 18 21:18:23.257072 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-aa7e4387-c934-456b-9282-1f6dfbc491a4 tempest-GroupsTest-720754250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19a5ea9d-4cd2-48c0-be49-8a0828237ce0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:18:23.264128 ncdv-master-1 cinder-volume[134148]: DEBUG oslo_db.sqlalchemy.engines [None req-aa7e4387-c934-456b-9282-1f6dfbc491a4 tempest-GroupsTest-720754250 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134148) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 18 21:18:23.277328 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-aa7e4387-c934-456b-9282-1f6dfbc491a4 tempest-GroupsTest-720754250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19a5ea9d-4cd2-48c0-be49-8a0828237ce0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-12-18T21:18:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-GroupsTest-Volume-1192633340',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=57342641-7ba0-4636-a6db-dbce9a80ced9,host='ncdv-master-1@ceph#ceph',id=53d292b3-6f74-4c29-a1bf-177b18209c90,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='77c414586ca040b6ab572fb952debf9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-12-18T21:18:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-12-18T21:18:23Z,use_quota=True,user_id='26b847b1d5f144fbb9c2e95bd76450b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c794eb3-4749-44fc-a09a-6466de13a2fd),volume_type_id=3c794eb3-4749-44fc-a09a-6466de13a2fd)' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:18:23.280811 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-aa7e4387-c934-456b-9282-1f6dfbc491a4 tempest-GroupsTest-720754250 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07aa81cc-e6f2-41bd-81d2-f59753e4ecb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:18:23.283698 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-aa7e4387-c934-456b-9282-1f6dfbc491a4 tempest-GroupsTest-720754250 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07aa81cc-e6f2-41bd-81d2-f59753e4ecb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:18:23.286342 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-aa7e4387-c934-456b-9282-1f6dfbc491a4 tempest-GroupsTest-720754250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f136ef33-a6e4-4bbe-9bfa-0e7d587213f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:18:23.288564 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-aa7e4387-c934-456b-9282-1f6dfbc491a4 tempest-GroupsTest-720754250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f136ef33-a6e4-4bbe-9bfa-0e7d587213f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '53d292b3-6f74-4c29-a1bf-177b18209c90', 'volume_name': 'volume-53d292b3-6f74-4c29-a1bf-177b18209c90', 'volume_size': 1}' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:18:23.290903 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-aa7e4387-c934-456b-9282-1f6dfbc491a4 tempest-GroupsTest-720754250 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (378bc806-1619-44e0-af82-942caa5357cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:18:23.293115 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-aa7e4387-c934-456b-9282-1f6dfbc491a4 tempest-GroupsTest-720754250 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (378bc806-1619-44e0-af82-942caa5357cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:18:23.295369 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-aa7e4387-c934-456b-9282-1f6dfbc491a4 tempest-GroupsTest-720754250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9b7f0a3-a736-4f57-b1b5-d232975d3f8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:18:23.309410 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.flows.manager.create_volume [None req-aa7e4387-c934-456b-9282-1f6dfbc491a4 tempest-GroupsTest-720754250 None] Volume 53d292b3-6f74-4c29-a1bf-177b18209c90: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-53d292b3-6f74-4c29-a1bf-177b18209c90', 'volume_size': 1} Dec 18 21:18:23.310461 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-aa7e4387-c934-456b-9282-1f6dfbc491a4 tempest-GroupsTest-720754250 None] creating volume 'volume-53d292b3-6f74-4c29-a1bf-177b18209c90' {{(pid=134148) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Dec 18 21:18:23.311549 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-aa7e4387-c934-456b-9282-1f6dfbc491a4 tempest-GroupsTest-720754250 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:18:23.387290 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-aa7e4387-c934-456b-9282-1f6dfbc491a4 tempest-GroupsTest-720754250 None] extra_specs: {} {{(pid=134148) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 18 21:18:23.387792 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-aa7e4387-c934-456b-9282-1f6dfbc491a4 tempest-GroupsTest-720754250 None] extra_specs: {} {{(pid=134148) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 18 21:18:23.390054 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-aa7e4387-c934-456b-9282-1f6dfbc491a4 tempest-GroupsTest-720754250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9b7f0a3-a736-4f57-b1b5-d232975d3f8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-53d292b3-6f74-4c29-a1bf-177b18209c90', 'volume_size': 1}' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:18:23.392374 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-aa7e4387-c934-456b-9282-1f6dfbc491a4 tempest-GroupsTest-720754250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c458832b-03b8-42a6-842f-acb8e2040162) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:18:23.401020 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.flows.manager.create_volume [None req-aa7e4387-c934-456b-9282-1f6dfbc491a4 tempest-GroupsTest-720754250 None] Volume volume-53d292b3-6f74-4c29-a1bf-177b18209c90 (53d292b3-6f74-4c29-a1bf-177b18209c90): created successfully Dec 18 21:18:23.403356 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-aa7e4387-c934-456b-9282-1f6dfbc491a4 tempest-GroupsTest-720754250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c458832b-03b8-42a6-842f-acb8e2040162) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:18:23.406569 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-aa7e4387-c934-456b-9282-1f6dfbc491a4 tempest-GroupsTest-720754250 None] Flow 'volume_create_manager' (d90c726a-d65e-48e9-bc3d-cd915aa03be4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134148) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 18 21:18:23.414582 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-aa7e4387-c934-456b-9282-1f6dfbc491a4 tempest-GroupsTest-720754250 None] Created volume successfully. Dec 18 21:18:24.668521 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.flows.manager.create_volume [None req-230500a8-94f8-41d1-bb0d-c6c3b4d9f22d tempest-GroupsTest-720754250 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134148) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Dec 18 21:18:24.672353 ncdv-master-1 cinder-volume[134148]: WARNING stevedore.named [None req-230500a8-94f8-41d1-bb0d-c6c3b4d9f22d tempest-GroupsTest-720754250 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Dec 18 21:18:24.672805 ncdv-master-1 cinder-volume[134148]: WARNING castellan.key_manager [None req-230500a8-94f8-41d1-bb0d-c6c3b4d9f22d tempest-GroupsTest-720754250 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Dec 18 21:18:24.687869 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-230500a8-94f8-41d1-bb0d-c6c3b4d9f22d tempest-GroupsTest-720754250 None] Flow 'volume_create_manager' (08bc24e7-aeb5-4876-9c25-bb0692fb3cc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 18 21:18:24.691497 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-230500a8-94f8-41d1-bb0d-c6c3b4d9f22d tempest-GroupsTest-720754250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d44b60a-8131-48c6-87f2-eeb542eda18f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:18:24.698152 ncdv-master-1 cinder-volume[134148]: DEBUG oslo_db.sqlalchemy.engines [None req-230500a8-94f8-41d1-bb0d-c6c3b4d9f22d tempest-GroupsTest-720754250 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134148) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 18 21:18:24.711623 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-230500a8-94f8-41d1-bb0d-c6c3b4d9f22d tempest-GroupsTest-720754250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d44b60a-8131-48c6-87f2-eeb542eda18f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-12-18T21:18:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-GroupsTest-Volume-1629781518',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=57342641-7ba0-4636-a6db-dbce9a80ced9,host='ncdv-master-1@ceph#ceph',id=e7b0322c-311c-4389-8a8d-14841283e1e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='77c414586ca040b6ab572fb952debf9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-12-18T21:18:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-12-18T21:18:25Z,use_quota=True,user_id='26b847b1d5f144fbb9c2e95bd76450b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c794eb3-4749-44fc-a09a-6466de13a2fd),volume_type_id=3c794eb3-4749-44fc-a09a-6466de13a2fd)' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:18:24.714318 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-230500a8-94f8-41d1-bb0d-c6c3b4d9f22d tempest-GroupsTest-720754250 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79331f6c-068d-4b5a-ad8c-97956d67fe00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:18:24.716778 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-230500a8-94f8-41d1-bb0d-c6c3b4d9f22d tempest-GroupsTest-720754250 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79331f6c-068d-4b5a-ad8c-97956d67fe00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:18:24.719492 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-230500a8-94f8-41d1-bb0d-c6c3b4d9f22d tempest-GroupsTest-720754250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5fecf7a-3278-4659-b810-988ce45bf801) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:18:24.721967 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-230500a8-94f8-41d1-bb0d-c6c3b4d9f22d tempest-GroupsTest-720754250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5fecf7a-3278-4659-b810-988ce45bf801) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e7b0322c-311c-4389-8a8d-14841283e1e3', 'volume_name': 'volume-e7b0322c-311c-4389-8a8d-14841283e1e3', 'volume_size': 1}' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:18:24.724398 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-230500a8-94f8-41d1-bb0d-c6c3b4d9f22d tempest-GroupsTest-720754250 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (370228a6-4b9c-4513-bd79-c5c806490c6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:18:24.726746 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-230500a8-94f8-41d1-bb0d-c6c3b4d9f22d tempest-GroupsTest-720754250 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (370228a6-4b9c-4513-bd79-c5c806490c6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:18:24.729007 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-230500a8-94f8-41d1-bb0d-c6c3b4d9f22d tempest-GroupsTest-720754250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8e2768f-b429-4d3b-8a8f-c45f15b05fce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:18:24.743982 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.flows.manager.create_volume [None req-230500a8-94f8-41d1-bb0d-c6c3b4d9f22d tempest-GroupsTest-720754250 None] Volume e7b0322c-311c-4389-8a8d-14841283e1e3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e7b0322c-311c-4389-8a8d-14841283e1e3', 'volume_size': 1} Dec 18 21:18:24.744485 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-230500a8-94f8-41d1-bb0d-c6c3b4d9f22d tempest-GroupsTest-720754250 None] creating volume 'volume-e7b0322c-311c-4389-8a8d-14841283e1e3' {{(pid=134148) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Dec 18 21:18:24.745595 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-230500a8-94f8-41d1-bb0d-c6c3b4d9f22d tempest-GroupsTest-720754250 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:18:24.803971 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-230500a8-94f8-41d1-bb0d-c6c3b4d9f22d tempest-GroupsTest-720754250 None] extra_specs: {} {{(pid=134148) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 18 21:18:24.804582 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-230500a8-94f8-41d1-bb0d-c6c3b4d9f22d tempest-GroupsTest-720754250 None] extra_specs: {} {{(pid=134148) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 18 21:18:24.806742 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-230500a8-94f8-41d1-bb0d-c6c3b4d9f22d tempest-GroupsTest-720754250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8e2768f-b429-4d3b-8a8f-c45f15b05fce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e7b0322c-311c-4389-8a8d-14841283e1e3', 'volume_size': 1}' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:18:24.809155 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-230500a8-94f8-41d1-bb0d-c6c3b4d9f22d tempest-GroupsTest-720754250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04dc7077-55f0-448f-a2e9-ab24387ebe4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:18:24.818777 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.flows.manager.create_volume [None req-230500a8-94f8-41d1-bb0d-c6c3b4d9f22d tempest-GroupsTest-720754250 None] Volume volume-e7b0322c-311c-4389-8a8d-14841283e1e3 (e7b0322c-311c-4389-8a8d-14841283e1e3): created successfully Dec 18 21:18:24.820733 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-230500a8-94f8-41d1-bb0d-c6c3b4d9f22d tempest-GroupsTest-720754250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04dc7077-55f0-448f-a2e9-ab24387ebe4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:18:24.823777 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-230500a8-94f8-41d1-bb0d-c6c3b4d9f22d tempest-GroupsTest-720754250 None] Flow 'volume_create_manager' (08bc24e7-aeb5-4876-9c25-bb0692fb3cc1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134148) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 18 21:18:24.831950 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-230500a8-94f8-41d1-bb0d-c6c3b4d9f22d tempest-GroupsTest-720754250 None] Created volume successfully. Dec 18 21:18:25.826626 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-01575539-cae0-4aa7-9a74-1ccaf2fd1421 tempest-GroupsTest-720754250 None] Update group completed successfully. Dec 18 21:18:27.093238 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-14ab8da5-43ce-446f-a404-0f4629f3b09f tempest-GroupsTest-720754250 None] Update group completed successfully. Dec 18 21:18:27.462982 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-c5d4fbfc-b466-466c-81cb-9f789d3f9d1f tempest-BackendsCapabilitiesAdminTestsJSON-1007049146 None] Obtained capabilities list: {'vendor_name': 'Open Source', 'driver_version': '1.2.0', 'storage_protocol': 'ceph', 'total_capacity_gb': 19.94, 'free_capacity_gb': 19.94, 'reserved_percentage': 0, 'multiattach': True, 'thin_provisioning_support': True, 'max_over_subscription_ratio': '20.0', 'location_info': 'ceph:/etc/ceph/ceph.conf:e7c44f79-aa86-465d-8345-ce16ab5c8677:cinder:volumes', 'backend_state': 'up', 'volume_backend_name': 'ceph', 'replication_enabled': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=134148) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4733}} Dec 18 21:18:27.494683 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-0457643e-a80e-479a-82f8-b0f0f121440a tempest-BackendsCapabilitiesAdminTestsJSON-1007049146 None] Obtained capabilities list: {'vendor_name': 'Open Source', 'driver_version': '1.2.0', 'storage_protocol': 'ceph', 'total_capacity_gb': 19.94, 'free_capacity_gb': 19.94, 'reserved_percentage': 0, 'multiattach': True, 'thin_provisioning_support': True, 'max_over_subscription_ratio': '20.0', 'location_info': 'ceph:/etc/ceph/ceph.conf:e7c44f79-aa86-465d-8345-ce16ab5c8677:cinder:volumes', 'backend_state': 'up', 'volume_backend_name': 'ceph', 'replication_enabled': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=134148) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4733}} Dec 18 21:18:28.477390 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-10442666-bb56-4284-8ab7-4057699d9e74 tempest-GroupsTest-720754250 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:18:28.532775 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-10442666-bb56-4284-8ab7-4057699d9e74 tempest-GroupsTest-720754250 None] volume has no backup snaps {{(pid=134148) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Dec 18 21:18:28.533165 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-10442666-bb56-4284-8ab7-4057699d9e74 tempest-GroupsTest-720754250 None] Volume volume-53d292b3-6f74-4c29-a1bf-177b18209c90 is not a clone. {{(pid=134148) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Dec 18 21:18:28.538282 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-10442666-bb56-4284-8ab7-4057699d9e74 tempest-GroupsTest-720754250 None] deleting rbd volume volume-53d292b3-6f74-4c29-a1bf-177b18209c90 {{(pid=134148) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Dec 18 21:18:28.725097 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-10442666-bb56-4284-8ab7-4057699d9e74 tempest-GroupsTest-720754250 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:18:28.769054 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-10442666-bb56-4284-8ab7-4057699d9e74 tempest-GroupsTest-720754250 None] volume has no backup snaps {{(pid=134148) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Dec 18 21:18:28.769559 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-10442666-bb56-4284-8ab7-4057699d9e74 tempest-GroupsTest-720754250 None] Volume volume-e7b0322c-311c-4389-8a8d-14841283e1e3 is not a clone. {{(pid=134148) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Dec 18 21:18:28.777426 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-10442666-bb56-4284-8ab7-4057699d9e74 tempest-GroupsTest-720754250 None] deleting rbd volume volume-e7b0322c-311c-4389-8a8d-14841283e1e3 {{(pid=134148) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Dec 18 21:18:29.027749 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.quota [None req-10442666-bb56-4284-8ab7-4057699d9e74 tempest-GroupsTest-720754250 None] Created reservations ['e9b84067-e255-4b1f-96ef-01e4ac4adc16'] {{(pid=134148) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 18 21:18:29.046423 ncdv-master-1 cinder-volume[134148]: WARNING cinder.quota [None req-10442666-bb56-4284-8ab7-4057699d9e74 tempest-GroupsTest-720754250 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1812160989 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1812160989, it is now deprecated. Please use the default quota class for default quota. Dec 18 21:18:29.047205 ncdv-master-1 cinder-volume[134148]: WARNING cinder.quota [None req-10442666-bb56-4284-8ab7-4057699d9e74 tempest-GroupsTest-720754250 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1812160989 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1812160989, it is now deprecated. Please use the default quota class for default quota. Dec 18 21:18:29.063938 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.quota [None req-10442666-bb56-4284-8ab7-4057699d9e74 tempest-GroupsTest-720754250 None] Created reservations ['2f5fb0f4-64ed-4d7e-9dae-7c60da6f8ccc', 'd12b489c-a6f1-4bfd-970e-6a1c744bb0a9', '254322b4-3a12-41b3-874c-58781d91b8b8', '89317b5a-5f91-4316-9af7-64e4f3dc1c8d'] {{(pid=134148) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 18 21:18:29.130751 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.quota [None req-10442666-bb56-4284-8ab7-4057699d9e74 tempest-GroupsTest-720754250 None] Created reservations ['e31cfce9-870d-4281-b733-28849f6d5a79', '7f89c313-8132-4566-b054-2801507b1eef', 'fdee483f-11eb-4965-a094-abdb346f2fe7', 'f48439bf-9395-4a48-a614-ed43184a3f21'] {{(pid=134148) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 18 21:18:29.201418 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-10442666-bb56-4284-8ab7-4057699d9e74 tempest-GroupsTest-720754250 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:18:29.226423 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-10442666-bb56-4284-8ab7-4057699d9e74 tempest-GroupsTest-720754250 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:18:29.254863 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.manager [None req-10442666-bb56-4284-8ab7-4057699d9e74 tempest-GroupsTest-720754250 None] Notifying Schedulers of capabilities ... {{(pid=134148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 18 21:18:29.259706 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-10442666-bb56-4284-8ab7-4057699d9e74 tempest-GroupsTest-720754250 None] Delete group completed successfully. Dec 18 21:18:33.616218 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-ed7f2098-09d0-41a7-982a-54b70daba858 tempest-GroupsV314Test-1431943990 None] Group tempest-GroupsV314Test-Group-1833074613: creating Dec 18 21:18:33.633708 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-ed7f2098-09d0-41a7-982a-54b70daba858 tempest-GroupsV314Test-1431943990 None] Group tempest-GroupsV314Test-Group-1833074613: created successfully Dec 18 21:18:33.643808 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-ed7f2098-09d0-41a7-982a-54b70daba858 tempest-GroupsV314Test-1431943990 None] Create group completed successfully. Dec 18 21:18:34.350200 ncdv-master-1 cinder-volume[134148]: DEBUG oslo_service.periodic_task [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134148) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Dec 18 21:18:34.350881 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:18:34.378587 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:18:34.407905 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.manager [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] Notifying Schedulers of capabilities ... {{(pid=134148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 18 21:18:35.012180 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.flows.manager.create_volume [None req-4c1520c1-0056-447e-9932-ac918dd82750 tempest-GroupsV314Test-1431943990 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134148) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Dec 18 21:18:35.015369 ncdv-master-1 cinder-volume[134148]: WARNING stevedore.named [None req-4c1520c1-0056-447e-9932-ac918dd82750 tempest-GroupsV314Test-1431943990 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Dec 18 21:18:35.015807 ncdv-master-1 cinder-volume[134148]: WARNING castellan.key_manager [None req-4c1520c1-0056-447e-9932-ac918dd82750 tempest-GroupsV314Test-1431943990 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Dec 18 21:18:35.029173 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-4c1520c1-0056-447e-9932-ac918dd82750 tempest-GroupsV314Test-1431943990 None] Flow 'volume_create_manager' (3ca73b6c-cca9-4671-bc28-76137c09fe61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 18 21:18:35.032441 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-4c1520c1-0056-447e-9932-ac918dd82750 tempest-GroupsV314Test-1431943990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9cd53238-69f7-4354-ae37-480d76460fa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:18:35.039195 ncdv-master-1 cinder-volume[134148]: DEBUG oslo_db.sqlalchemy.engines [None req-4c1520c1-0056-447e-9932-ac918dd82750 tempest-GroupsV314Test-1431943990 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134148) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 18 21:18:35.053221 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-4c1520c1-0056-447e-9932-ac918dd82750 tempest-GroupsV314Test-1431943990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9cd53238-69f7-4354-ae37-480d76460fa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-12-18T21:18:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-GroupsV314Test-Volume-2083801248',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=b592250d-4716-4abb-94c4-ad02ee2c082d,host='ncdv-master-1@ceph#ceph',id=af89a6b8-34ff-4a94-812f-69a00e1abd03,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='443754b6c278464ea41c9a3d3530643a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-12-18T21:18:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-12-18T21:18:35Z,use_quota=True,user_id='fe6a996f07dc42d686a737b4f2fc08c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fbf0e653-661b-4d7c-820f-bed0f86ab6d0),volume_type_id=fbf0e653-661b-4d7c-820f-bed0f86ab6d0)' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:18:35.055940 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-4c1520c1-0056-447e-9932-ac918dd82750 tempest-GroupsV314Test-1431943990 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04615daa-4e57-4917-9468-f91e82d8c612) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:18:35.058118 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-4c1520c1-0056-447e-9932-ac918dd82750 tempest-GroupsV314Test-1431943990 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04615daa-4e57-4917-9468-f91e82d8c612) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:18:35.060700 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-4c1520c1-0056-447e-9932-ac918dd82750 tempest-GroupsV314Test-1431943990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe7288ad-bb45-4f62-98bf-6e3ecd0bbe3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:18:35.062997 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-4c1520c1-0056-447e-9932-ac918dd82750 tempest-GroupsV314Test-1431943990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe7288ad-bb45-4f62-98bf-6e3ecd0bbe3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'af89a6b8-34ff-4a94-812f-69a00e1abd03', 'volume_name': 'volume-af89a6b8-34ff-4a94-812f-69a00e1abd03', 'volume_size': 1}' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:18:35.065338 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-4c1520c1-0056-447e-9932-ac918dd82750 tempest-GroupsV314Test-1431943990 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fee6d6d4-4a61-4c11-8aa7-a9e2a234fb2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:18:35.067740 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-4c1520c1-0056-447e-9932-ac918dd82750 tempest-GroupsV314Test-1431943990 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fee6d6d4-4a61-4c11-8aa7-a9e2a234fb2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:18:35.069985 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-4c1520c1-0056-447e-9932-ac918dd82750 tempest-GroupsV314Test-1431943990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a24b0100-cf4e-4043-97d1-d4b13a7f298e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:18:35.083548 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.flows.manager.create_volume [None req-4c1520c1-0056-447e-9932-ac918dd82750 tempest-GroupsV314Test-1431943990 None] Volume af89a6b8-34ff-4a94-812f-69a00e1abd03: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-af89a6b8-34ff-4a94-812f-69a00e1abd03', 'volume_size': 1} Dec 18 21:18:35.083953 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-4c1520c1-0056-447e-9932-ac918dd82750 tempest-GroupsV314Test-1431943990 None] creating volume 'volume-af89a6b8-34ff-4a94-812f-69a00e1abd03' {{(pid=134148) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Dec 18 21:18:35.084957 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-4c1520c1-0056-447e-9932-ac918dd82750 tempest-GroupsV314Test-1431943990 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:18:35.140262 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-4c1520c1-0056-447e-9932-ac918dd82750 tempest-GroupsV314Test-1431943990 None] extra_specs: {} {{(pid=134148) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 18 21:18:35.140639 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-4c1520c1-0056-447e-9932-ac918dd82750 tempest-GroupsV314Test-1431943990 None] extra_specs: {} {{(pid=134148) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 18 21:18:35.142810 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-4c1520c1-0056-447e-9932-ac918dd82750 tempest-GroupsV314Test-1431943990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a24b0100-cf4e-4043-97d1-d4b13a7f298e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-af89a6b8-34ff-4a94-812f-69a00e1abd03', 'volume_size': 1}' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:18:35.145016 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-4c1520c1-0056-447e-9932-ac918dd82750 tempest-GroupsV314Test-1431943990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9217ce92-0f83-46d7-bea9-1e1128a98664) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:18:35.154488 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.flows.manager.create_volume [None req-4c1520c1-0056-447e-9932-ac918dd82750 tempest-GroupsV314Test-1431943990 None] Volume volume-af89a6b8-34ff-4a94-812f-69a00e1abd03 (af89a6b8-34ff-4a94-812f-69a00e1abd03): created successfully Dec 18 21:18:35.156366 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-4c1520c1-0056-447e-9932-ac918dd82750 tempest-GroupsV314Test-1431943990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9217ce92-0f83-46d7-bea9-1e1128a98664) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:18:35.159355 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-4c1520c1-0056-447e-9932-ac918dd82750 tempest-GroupsV314Test-1431943990 None] Flow 'volume_create_manager' (3ca73b6c-cca9-4671-bc28-76137c09fe61) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134148) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 18 21:18:35.166797 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-4c1520c1-0056-447e-9932-ac918dd82750 tempest-GroupsV314Test-1431943990 None] Created volume successfully. Dec 18 21:18:36.468444 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-12a07d53-36e4-4340-abfe-1cfb5b579845 tempest-GroupsV314Test-1431943990 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:18:36.525399 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-12a07d53-36e4-4340-abfe-1cfb5b579845 tempest-GroupsV314Test-1431943990 None] creating snapshot='volume-a9e6f830-4ad3-4265-aba1-26f2f52efc0e.clone_snap' {{(pid=134148) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:725}} Dec 18 21:18:37.103456 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-12a07d53-36e4-4340-abfe-1cfb5b579845 tempest-GroupsV314Test-1431943990 None] cloning 'volume-af89a6b8-34ff-4a94-812f-69a00e1abd03@volume-a9e6f830-4ad3-4265-aba1-26f2f52efc0e.clone_snap' to 'volume-a9e6f830-4ad3-4265-aba1-26f2f52efc0e' {{(pid=134148) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:731}} Dec 18 21:18:37.199588 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-12a07d53-36e4-4340-abfe-1cfb5b579845 tempest-GroupsV314Test-1431943990 None] Volume volume-af89a6b8-34ff-4a94-812f-69a00e1abd03 is not a clone. {{(pid=134148) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Dec 18 21:18:37.204665 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-12a07d53-36e4-4340-abfe-1cfb5b579845 tempest-GroupsV314Test-1431943990 None] extra_specs: {} {{(pid=134148) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 18 21:18:37.205131 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-12a07d53-36e4-4340-abfe-1cfb5b579845 tempest-GroupsV314Test-1431943990 None] extra_specs: {} {{(pid=134148) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 18 21:18:37.223349 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-12a07d53-36e4-4340-abfe-1cfb5b579845 tempest-GroupsV314Test-1431943990 None] clone created successfully {{(pid=134148) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:803}} Dec 18 21:18:37.268860 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-12a07d53-36e4-4340-abfe-1cfb5b579845 tempest-GroupsV314Test-1431943990 None] Create group from source-group-b592250d-4716-4abb-94c4-ad02ee2c082d completed successfully. Dec 18 21:18:37.984359 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-65f38f07-4006-4796-b65d-5630dd028231 tempest-GroupsV314Test-1431943990 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:18:38.072186 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-65f38f07-4006-4796-b65d-5630dd028231 tempest-GroupsV314Test-1431943990 None] volume has no backup snaps {{(pid=134148) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Dec 18 21:18:38.084478 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-65f38f07-4006-4796-b65d-5630dd028231 tempest-GroupsV314Test-1431943990 None] deleting rbd volume volume-a9e6f830-4ad3-4265-aba1-26f2f52efc0e {{(pid=134148) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Dec 18 21:18:38.306131 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-65f38f07-4006-4796-b65d-5630dd028231 tempest-GroupsV314Test-1431943990 None] volume is a clone so cleaning references {{(pid=134148) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1266}} Dec 18 21:18:38.326282 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-65f38f07-4006-4796-b65d-5630dd028231 tempest-GroupsV314Test-1431943990 None] Volume volume-af89a6b8-34ff-4a94-812f-69a00e1abd03 is not a clone. {{(pid=134148) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Dec 18 21:18:38.326869 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-65f38f07-4006-4796-b65d-5630dd028231 tempest-GroupsV314Test-1431943990 None] deleting parent snapshot volume-a9e6f830-4ad3-4265-aba1-26f2f52efc0e.clone_snap {{(pid=134148) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1158}} Dec 18 21:18:39.197511 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.quota [None req-65f38f07-4006-4796-b65d-5630dd028231 tempest-GroupsV314Test-1431943990 None] Created reservations ['39a5ae8c-2705-4bb7-acd9-d0222e229277'] {{(pid=134148) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 18 21:18:39.221638 ncdv-master-1 cinder-volume[134148]: WARNING cinder.quota [None req-65f38f07-4006-4796-b65d-5630dd028231 tempest-GroupsV314Test-1431943990 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-1209864930 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-1209864930, it is now deprecated. Please use the default quota class for default quota. Dec 18 21:18:39.222590 ncdv-master-1 cinder-volume[134148]: WARNING cinder.quota [None req-65f38f07-4006-4796-b65d-5630dd028231 tempest-GroupsV314Test-1431943990 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-1209864930 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-1209864930, it is now deprecated. Please use the default quota class for default quota. Dec 18 21:18:39.235701 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.quota [None req-65f38f07-4006-4796-b65d-5630dd028231 tempest-GroupsV314Test-1431943990 None] Created reservations ['41c2d81d-93fb-4d73-acf3-6509047a83eb', '546d0e92-17c5-411c-bbcf-1712384df489', '166a2e72-f0e8-4a5b-ae24-278f949d9ec1', 'b0cae4a3-6327-4cc9-aff3-f9f163cdff3b'] {{(pid=134148) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 18 21:18:39.270134 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.flows.manager.create_volume [None req-4b3125d4-0d02-48c6-9708-64e34cea545d tempest-VolumeSnapshotQuotasNegativeTestJSON-1872815004 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134148) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Dec 18 21:18:39.273265 ncdv-master-1 cinder-volume[134148]: WARNING stevedore.named [None req-4b3125d4-0d02-48c6-9708-64e34cea545d tempest-VolumeSnapshotQuotasNegativeTestJSON-1872815004 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Dec 18 21:18:39.273701 ncdv-master-1 cinder-volume[134148]: WARNING castellan.key_manager [None req-4b3125d4-0d02-48c6-9708-64e34cea545d tempest-VolumeSnapshotQuotasNegativeTestJSON-1872815004 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Dec 18 21:18:39.285929 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-4b3125d4-0d02-48c6-9708-64e34cea545d tempest-VolumeSnapshotQuotasNegativeTestJSON-1872815004 None] Flow 'volume_create_manager' (ec3424fd-a446-4708-b413-8614b6df536c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 18 21:18:39.289122 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-4b3125d4-0d02-48c6-9708-64e34cea545d tempest-VolumeSnapshotQuotasNegativeTestJSON-1872815004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f477f1f-7e1a-4d06-b174-e1bb1197e2c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:18:39.300163 ncdv-master-1 cinder-volume[134148]: DEBUG oslo_db.sqlalchemy.engines [None req-4b3125d4-0d02-48c6-9708-64e34cea545d tempest-VolumeSnapshotQuotasNegativeTestJSON-1872815004 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134148) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 18 21:18:39.315360 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-4b3125d4-0d02-48c6-9708-64e34cea545d tempest-VolumeSnapshotQuotasNegativeTestJSON-1872815004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f477f1f-7e1a-4d06-b174-e1bb1197e2c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-12-18T21:18:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1832466143',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=a49b817d-4fd7-4a93-adc5-489405c1f829,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f611af1fd922479788c6c7b294186add',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-12-18T21:18:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-12-18T21:18:39Z,use_quota=True,user_id='b31bb5ec543e47d7b1a72c8611b2dca1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f2e1fe1-9fd6-411e-9ed9-368f463ccb6f),volume_type_id=1f2e1fe1-9fd6-411e-9ed9-368f463ccb6f)' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:18:39.318207 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-4b3125d4-0d02-48c6-9708-64e34cea545d tempest-VolumeSnapshotQuotasNegativeTestJSON-1872815004 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ba2c43a-1d77-4d0a-a801-bf2955288995) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:18:39.320491 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-4b3125d4-0d02-48c6-9708-64e34cea545d tempest-VolumeSnapshotQuotasNegativeTestJSON-1872815004 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ba2c43a-1d77-4d0a-a801-bf2955288995) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:18:39.325295 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-4b3125d4-0d02-48c6-9708-64e34cea545d tempest-VolumeSnapshotQuotasNegativeTestJSON-1872815004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a8e62d6-902c-4d91-bbfa-c3e704f16359) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:18:39.329602 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-4b3125d4-0d02-48c6-9708-64e34cea545d tempest-VolumeSnapshotQuotasNegativeTestJSON-1872815004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a8e62d6-902c-4d91-bbfa-c3e704f16359) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a49b817d-4fd7-4a93-adc5-489405c1f829', 'volume_name': 'volume-a49b817d-4fd7-4a93-adc5-489405c1f829', 'volume_size': 1}' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:18:39.332607 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-4b3125d4-0d02-48c6-9708-64e34cea545d tempest-VolumeSnapshotQuotasNegativeTestJSON-1872815004 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21cea06a-e533-44b5-8eab-c0c96e0d7f72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:18:39.334779 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-4b3125d4-0d02-48c6-9708-64e34cea545d tempest-VolumeSnapshotQuotasNegativeTestJSON-1872815004 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21cea06a-e533-44b5-8eab-c0c96e0d7f72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:18:39.337004 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-4b3125d4-0d02-48c6-9708-64e34cea545d tempest-VolumeSnapshotQuotasNegativeTestJSON-1872815004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (308f7a86-177a-4268-ad69-55982d3f1dbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:18:39.337797 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.flows.manager.create_volume [None req-4b3125d4-0d02-48c6-9708-64e34cea545d tempest-VolumeSnapshotQuotasNegativeTestJSON-1872815004 None] Volume a49b817d-4fd7-4a93-adc5-489405c1f829: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a49b817d-4fd7-4a93-adc5-489405c1f829', 'volume_size': 1} Dec 18 21:18:39.338182 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-4b3125d4-0d02-48c6-9708-64e34cea545d tempest-VolumeSnapshotQuotasNegativeTestJSON-1872815004 None] creating volume 'volume-a49b817d-4fd7-4a93-adc5-489405c1f829' {{(pid=134148) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Dec 18 21:18:39.339191 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-4b3125d4-0d02-48c6-9708-64e34cea545d tempest-VolumeSnapshotQuotasNegativeTestJSON-1872815004 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:18:39.394437 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-4b3125d4-0d02-48c6-9708-64e34cea545d tempest-VolumeSnapshotQuotasNegativeTestJSON-1872815004 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134148) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 18 21:18:39.394795 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-4b3125d4-0d02-48c6-9708-64e34cea545d tempest-VolumeSnapshotQuotasNegativeTestJSON-1872815004 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134148) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 18 21:18:39.396906 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-4b3125d4-0d02-48c6-9708-64e34cea545d tempest-VolumeSnapshotQuotasNegativeTestJSON-1872815004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (308f7a86-177a-4268-ad69-55982d3f1dbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a49b817d-4fd7-4a93-adc5-489405c1f829', 'volume_size': 1}' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:18:39.399132 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-4b3125d4-0d02-48c6-9708-64e34cea545d tempest-VolumeSnapshotQuotasNegativeTestJSON-1872815004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09142915-82ac-48fe-b99b-c749896b9d93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:18:39.408152 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-65f38f07-4006-4796-b65d-5630dd028231 tempest-GroupsV314Test-1431943990 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:18:39.428898 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-65f38f07-4006-4796-b65d-5630dd028231 tempest-GroupsV314Test-1431943990 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:18:39.453296 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.manager [None req-65f38f07-4006-4796-b65d-5630dd028231 tempest-GroupsV314Test-1431943990 None] Notifying Schedulers of capabilities ... {{(pid=134148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 18 21:18:39.457430 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-65f38f07-4006-4796-b65d-5630dd028231 tempest-GroupsV314Test-1431943990 None] Delete group completed successfully. Dec 18 21:18:39.465373 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.flows.manager.create_volume [None req-4b3125d4-0d02-48c6-9708-64e34cea545d tempest-VolumeSnapshotQuotasNegativeTestJSON-1872815004 None] Volume volume-a49b817d-4fd7-4a93-adc5-489405c1f829 (a49b817d-4fd7-4a93-adc5-489405c1f829): created successfully Dec 18 21:18:39.467996 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-4b3125d4-0d02-48c6-9708-64e34cea545d tempest-VolumeSnapshotQuotasNegativeTestJSON-1872815004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09142915-82ac-48fe-b99b-c749896b9d93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:18:39.471056 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-4b3125d4-0d02-48c6-9708-64e34cea545d tempest-VolumeSnapshotQuotasNegativeTestJSON-1872815004 None] Flow 'volume_create_manager' (ec3424fd-a446-4708-b413-8614b6df536c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134148) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 18 21:18:39.477895 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-4b3125d4-0d02-48c6-9708-64e34cea545d tempest-VolumeSnapshotQuotasNegativeTestJSON-1872815004 None] Created volume successfully. Dec 18 21:18:40.340870 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-b7a871fc-af04-42fa-9ef7-29de16703026 tempest-GroupsV314Test-1431943990 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:18:40.390595 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-b7a871fc-af04-42fa-9ef7-29de16703026 tempest-GroupsV314Test-1431943990 None] volume has no backup snaps {{(pid=134148) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Dec 18 21:18:40.391121 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-b7a871fc-af04-42fa-9ef7-29de16703026 tempest-GroupsV314Test-1431943990 None] Volume volume-af89a6b8-34ff-4a94-812f-69a00e1abd03 is not a clone. {{(pid=134148) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Dec 18 21:18:40.397586 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-b7a871fc-af04-42fa-9ef7-29de16703026 tempest-GroupsV314Test-1431943990 None] deleting rbd volume volume-af89a6b8-34ff-4a94-812f-69a00e1abd03 {{(pid=134148) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Dec 18 21:18:40.453865 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-b8029a2a-62ba-48f5-9a04-3f83a90b74a0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1872815004 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:18:40.615336 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.quota [None req-b7a871fc-af04-42fa-9ef7-29de16703026 tempest-GroupsV314Test-1431943990 None] Created reservations ['f0636e2b-1c3f-4536-95c7-782d63546251'] {{(pid=134148) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 18 21:18:40.644058 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.quota [None req-b7a871fc-af04-42fa-9ef7-29de16703026 tempest-GroupsV314Test-1431943990 None] Created reservations ['45458a19-4b6b-4c37-b6ba-582baa979cf2', '198734cd-e92a-441b-b04b-143f715e3c49', 'e419db6d-d9d9-4c5b-abc7-e49febbd4398', 'ed31469d-22b0-406f-91fd-f5d074b991f9'] {{(pid=134148) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 18 21:18:40.712662 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-b7a871fc-af04-42fa-9ef7-29de16703026 tempest-GroupsV314Test-1431943990 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:18:40.733989 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-b7a871fc-af04-42fa-9ef7-29de16703026 tempest-GroupsV314Test-1431943990 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:18:40.757741 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.manager [None req-b7a871fc-af04-42fa-9ef7-29de16703026 tempest-GroupsV314Test-1431943990 None] Notifying Schedulers of capabilities ... {{(pid=134148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 18 21:18:40.761490 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-b7a871fc-af04-42fa-9ef7-29de16703026 tempest-GroupsV314Test-1431943990 None] Delete group completed successfully. Dec 18 21:18:41.163757 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-b8029a2a-62ba-48f5-9a04-3f83a90b74a0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1872815004 None] Create snapshot completed successfully Dec 18 21:18:41.836479 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.coordination [None req-d95117a2-72c8-48e1-8523-227df3ac8844 tempest-VolumeSnapshotQuotasNegativeTestJSON-1872815004 None] Lock "b'cinder-e5c2027e-5a44-4c8c-ad3a-50cdfaf7638c-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.010s {{(pid=134148) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 18 21:18:41.838571 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-d95117a2-72c8-48e1-8523-227df3ac8844 tempest-VolumeSnapshotQuotasNegativeTestJSON-1872815004 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:18:42.235256 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.quota [None req-d95117a2-72c8-48e1-8523-227df3ac8844 tempest-VolumeSnapshotQuotasNegativeTestJSON-1872815004 None] Created reservations ['62e282c0-c67c-4e64-bc8f-d639a1f1dbfe', '813fa52d-bfe2-4ed9-89b8-c7808d40788a', 'b454eec9-38f0-4bc0-976a-32c15d43c68b', '2a7ecc4d-b619-47a7-b3de-f4369a9849b4'] {{(pid=134148) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 18 21:18:42.271142 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-d95117a2-72c8-48e1-8523-227df3ac8844 tempest-VolumeSnapshotQuotasNegativeTestJSON-1872815004 None] Delete snapshot completed successfully. Dec 18 21:18:42.275834 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.coordination [None req-d95117a2-72c8-48e1-8523-227df3ac8844 tempest-VolumeSnapshotQuotasNegativeTestJSON-1872815004 None] Lock "b'cinder-e5c2027e-5a44-4c8c-ad3a-50cdfaf7638c-delete_snapshot'" released by "delete_snapshot" :: held 0.439s {{(pid=134148) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 18 21:18:42.936830 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.coordination [None req-0da7f626-1031-4cf9-b8b2-7d874cfcead7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1872815004 None] Lock "b'cinder-a49b817d-4fd7-4a93-adc5-489405c1f829-delete_volume'" acquired by "delete_volume" :: waited 0.012s {{(pid=134148) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 18 21:18:42.972159 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-0da7f626-1031-4cf9-b8b2-7d874cfcead7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1872815004 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:18:43.013190 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-0da7f626-1031-4cf9-b8b2-7d874cfcead7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1872815004 None] volume has no backup snaps {{(pid=134148) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Dec 18 21:18:43.013620 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-0da7f626-1031-4cf9-b8b2-7d874cfcead7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1872815004 None] Volume volume-a49b817d-4fd7-4a93-adc5-489405c1f829 is not a clone. {{(pid=134148) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Dec 18 21:18:43.019491 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-0da7f626-1031-4cf9-b8b2-7d874cfcead7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1872815004 None] deleting rbd volume volume-a49b817d-4fd7-4a93-adc5-489405c1f829 {{(pid=134148) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Dec 18 21:18:43.246104 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.quota [None req-0da7f626-1031-4cf9-b8b2-7d874cfcead7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1872815004 None] Created reservations ['fc865b01-9151-4231-b988-e78754f69f97', '87dc6c6b-ee24-4e38-bbeb-06cb2d6770a8', '18052305-18db-47e9-bf18-4b0e2044e8d2', '1071b91c-9ff7-47d9-bc54-8a4ba4e07f09'] {{(pid=134148) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 18 21:18:43.292559 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-0da7f626-1031-4cf9-b8b2-7d874cfcead7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1872815004 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:18:43.320927 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-0da7f626-1031-4cf9-b8b2-7d874cfcead7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1872815004 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:18:43.354112 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.manager [None req-0da7f626-1031-4cf9-b8b2-7d874cfcead7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1872815004 None] Notifying Schedulers of capabilities ... {{(pid=134148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 18 21:18:43.358101 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-0da7f626-1031-4cf9-b8b2-7d874cfcead7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1872815004 None] Deleted volume successfully. Dec 18 21:18:43.370665 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.coordination [None req-0da7f626-1031-4cf9-b8b2-7d874cfcead7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1872815004 None] Lock "b'cinder-a49b817d-4fd7-4a93-adc5-489405c1f829-delete_volume'" released by "delete_volume" :: held 0.434s {{(pid=134148) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 18 21:18:44.505767 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.flows.manager.create_volume [None req-1aa80e79-8a2c-4454-8629-a79443fa343f tempest-VolumeRetypeWithoutMigrationTest-2025352982 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134148) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Dec 18 21:18:44.509245 ncdv-master-1 cinder-volume[134148]: WARNING stevedore.named [None req-1aa80e79-8a2c-4454-8629-a79443fa343f tempest-VolumeRetypeWithoutMigrationTest-2025352982 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Dec 18 21:18:44.509750 ncdv-master-1 cinder-volume[134148]: WARNING castellan.key_manager [None req-1aa80e79-8a2c-4454-8629-a79443fa343f tempest-VolumeRetypeWithoutMigrationTest-2025352982 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Dec 18 21:18:44.522025 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-1aa80e79-8a2c-4454-8629-a79443fa343f tempest-VolumeRetypeWithoutMigrationTest-2025352982 None] Flow 'volume_create_manager' (46e638e1-d12c-465f-ae54-78dd21a38b8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 18 21:18:44.525353 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-1aa80e79-8a2c-4454-8629-a79443fa343f tempest-VolumeRetypeWithoutMigrationTest-2025352982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e68bd1eb-4d8e-43a6-a5ac-d6cba0ccef59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:18:44.533788 ncdv-master-1 cinder-volume[134148]: DEBUG oslo_db.sqlalchemy.engines [None req-1aa80e79-8a2c-4454-8629-a79443fa343f tempest-VolumeRetypeWithoutMigrationTest-2025352982 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134148) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 18 21:18:44.547756 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-1aa80e79-8a2c-4454-8629-a79443fa343f tempest-VolumeRetypeWithoutMigrationTest-2025352982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e68bd1eb-4d8e-43a6-a5ac-d6cba0ccef59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-12-18T21:18:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1806403356',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=d41fa1f4-1259-4d96-9346-b55ba0392f8b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4cdf08de0149458b8e0d406196ec5633',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-12-18T21:18:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-12-18T21:18:44Z,use_quota=True,user_id='ff76fa11a9ed4e5bba94c5e614314737',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(520a36d2-ffaf-4d98-89f4-456248ad5e74),volume_type_id=520a36d2-ffaf-4d98-89f4-456248ad5e74)' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:18:44.550411 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-1aa80e79-8a2c-4454-8629-a79443fa343f tempest-VolumeRetypeWithoutMigrationTest-2025352982 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f00ba4e7-52ee-4974-8257-716931525f78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:18:44.552883 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-1aa80e79-8a2c-4454-8629-a79443fa343f tempest-VolumeRetypeWithoutMigrationTest-2025352982 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f00ba4e7-52ee-4974-8257-716931525f78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:18:44.555892 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-1aa80e79-8a2c-4454-8629-a79443fa343f tempest-VolumeRetypeWithoutMigrationTest-2025352982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (418510d3-708a-4519-8b8e-4f5d121025b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:18:44.558592 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-1aa80e79-8a2c-4454-8629-a79443fa343f tempest-VolumeRetypeWithoutMigrationTest-2025352982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (418510d3-708a-4519-8b8e-4f5d121025b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd41fa1f4-1259-4d96-9346-b55ba0392f8b', 'volume_name': 'volume-d41fa1f4-1259-4d96-9346-b55ba0392f8b', 'volume_size': 1}' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:18:44.561360 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-1aa80e79-8a2c-4454-8629-a79443fa343f tempest-VolumeRetypeWithoutMigrationTest-2025352982 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (edcf2a93-b05f-47a6-b6c0-02ab3250f527) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:18:44.563705 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-1aa80e79-8a2c-4454-8629-a79443fa343f tempest-VolumeRetypeWithoutMigrationTest-2025352982 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (edcf2a93-b05f-47a6-b6c0-02ab3250f527) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:18:44.566176 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-1aa80e79-8a2c-4454-8629-a79443fa343f tempest-VolumeRetypeWithoutMigrationTest-2025352982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad151d62-ef0d-4e53-81e3-58491dbcd5b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:18:44.567198 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.flows.manager.create_volume [None req-1aa80e79-8a2c-4454-8629-a79443fa343f tempest-VolumeRetypeWithoutMigrationTest-2025352982 None] Volume d41fa1f4-1259-4d96-9346-b55ba0392f8b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d41fa1f4-1259-4d96-9346-b55ba0392f8b', 'volume_size': 1} Dec 18 21:18:44.568164 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-1aa80e79-8a2c-4454-8629-a79443fa343f tempest-VolumeRetypeWithoutMigrationTest-2025352982 None] creating volume 'volume-d41fa1f4-1259-4d96-9346-b55ba0392f8b' {{(pid=134148) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Dec 18 21:18:44.569140 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-1aa80e79-8a2c-4454-8629-a79443fa343f tempest-VolumeRetypeWithoutMigrationTest-2025352982 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:18:44.624521 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-1aa80e79-8a2c-4454-8629-a79443fa343f tempest-VolumeRetypeWithoutMigrationTest-2025352982 None] extra_specs: {} {{(pid=134148) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 18 21:18:44.625155 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-1aa80e79-8a2c-4454-8629-a79443fa343f tempest-VolumeRetypeWithoutMigrationTest-2025352982 None] extra_specs: {} {{(pid=134148) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 18 21:18:44.627633 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-1aa80e79-8a2c-4454-8629-a79443fa343f tempest-VolumeRetypeWithoutMigrationTest-2025352982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad151d62-ef0d-4e53-81e3-58491dbcd5b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d41fa1f4-1259-4d96-9346-b55ba0392f8b', 'volume_size': 1}' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:18:44.629636 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-1aa80e79-8a2c-4454-8629-a79443fa343f tempest-VolumeRetypeWithoutMigrationTest-2025352982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16f22454-2b23-423c-ab80-7e2c5ce00317) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:18:44.638977 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.flows.manager.create_volume [None req-1aa80e79-8a2c-4454-8629-a79443fa343f tempest-VolumeRetypeWithoutMigrationTest-2025352982 None] Volume volume-d41fa1f4-1259-4d96-9346-b55ba0392f8b (d41fa1f4-1259-4d96-9346-b55ba0392f8b): created successfully Dec 18 21:18:44.641278 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-1aa80e79-8a2c-4454-8629-a79443fa343f tempest-VolumeRetypeWithoutMigrationTest-2025352982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16f22454-2b23-423c-ab80-7e2c5ce00317) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:18:44.644424 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-1aa80e79-8a2c-4454-8629-a79443fa343f tempest-VolumeRetypeWithoutMigrationTest-2025352982 None] Flow 'volume_create_manager' (46e638e1-d12c-465f-ae54-78dd21a38b8f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134148) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 18 21:18:44.654389 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-1aa80e79-8a2c-4454-8629-a79443fa343f tempest-VolumeRetypeWithoutMigrationTest-2025352982 None] Created volume successfully. Dec 18 21:18:45.815452 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-355c01a5-bd11-41e6-85bb-ab33b08eddfb tempest-VolumeRetypeWithoutMigrationTest-2025352982 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:18:45.838600 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-355c01a5-bd11-41e6-85bb-ab33b08eddfb tempest-VolumeRetypeWithoutMigrationTest-2025352982 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:18:45.865989 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.manager [None req-355c01a5-bd11-41e6-85bb-ab33b08eddfb tempest-VolumeRetypeWithoutMigrationTest-2025352982 None] Notifying Schedulers of capabilities ... {{(pid=134148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 18 21:18:45.869784 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-355c01a5-bd11-41e6-85bb-ab33b08eddfb tempest-VolumeRetypeWithoutMigrationTest-2025352982 None] Retype volume completed successfully. Dec 18 21:18:46.672775 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.quota [None req-2bfd8e97-65dc-443a-bcfc-5cfd3086e24d tempest-VolumesSnapshotTestJSON-1921935471 None] Created reservations ['eab8f244-3759-48bb-bf0b-2b8b4c9e1439', 'a48670e9-b80f-40fe-8ccb-d4e8712a9228', '4700b9be-3694-439e-8756-f4200c6363d6', 'bfdbe9a0-2b8b-48e9-a3f8-f8fa90aa2e96'] {{(pid=134148) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 18 21:18:46.714648 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-2bfd8e97-65dc-443a-bcfc-5cfd3086e24d tempest-VolumesSnapshotTestJSON-1921935471 None] Delete snapshot completed successfully. Dec 18 21:18:46.721990 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.coordination [None req-2bfd8e97-65dc-443a-bcfc-5cfd3086e24d tempest-VolumesSnapshotTestJSON-1921935471 None] Lock "b'cinder-e7cc5e96-ab15-4d2f-9e03-98b02e02ba2a-delete_snapshot'" released by "delete_snapshot" :: held 30.272s {{(pid=134148) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 18 21:18:46.983373 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.coordination [None req-957c1c91-900b-4d1c-9423-2033e5fa7366 tempest-VolumeRetypeWithoutMigrationTest-2025352982 None] Lock "b'cinder-d41fa1f4-1259-4d96-9346-b55ba0392f8b-delete_volume'" acquired by "delete_volume" :: waited 0.011s {{(pid=134148) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 18 21:18:47.019002 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-957c1c91-900b-4d1c-9423-2033e5fa7366 tempest-VolumeRetypeWithoutMigrationTest-2025352982 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:18:47.069049 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-957c1c91-900b-4d1c-9423-2033e5fa7366 tempest-VolumeRetypeWithoutMigrationTest-2025352982 None] volume has no backup snaps {{(pid=134148) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Dec 18 21:18:47.069475 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-957c1c91-900b-4d1c-9423-2033e5fa7366 tempest-VolumeRetypeWithoutMigrationTest-2025352982 None] Volume volume-d41fa1f4-1259-4d96-9346-b55ba0392f8b is not a clone. {{(pid=134148) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Dec 18 21:18:47.075760 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-957c1c91-900b-4d1c-9423-2033e5fa7366 tempest-VolumeRetypeWithoutMigrationTest-2025352982 None] deleting rbd volume volume-d41fa1f4-1259-4d96-9346-b55ba0392f8b {{(pid=134148) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Dec 18 21:18:47.133321 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.flows.manager.create_volume [None req-e6c014d0-d789-4f27-893b-de1a43fe79c3 tempest-VolumeTypesTest-827227295 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134148) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Dec 18 21:18:47.136682 ncdv-master-1 cinder-volume[134148]: WARNING stevedore.named [None req-e6c014d0-d789-4f27-893b-de1a43fe79c3 tempest-VolumeTypesTest-827227295 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Dec 18 21:18:47.137163 ncdv-master-1 cinder-volume[134148]: WARNING castellan.key_manager [None req-e6c014d0-d789-4f27-893b-de1a43fe79c3 tempest-VolumeTypesTest-827227295 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Dec 18 21:18:47.150641 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-e6c014d0-d789-4f27-893b-de1a43fe79c3 tempest-VolumeTypesTest-827227295 None] Flow 'volume_create_manager' (3aaf6b95-afae-4fd6-84aa-f8972f4da0ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 18 21:18:47.155146 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-e6c014d0-d789-4f27-893b-de1a43fe79c3 tempest-VolumeTypesTest-827227295 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37b1f927-f7c1-44b3-ae15-33082945b31f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:18:47.162794 ncdv-master-1 cinder-volume[134148]: DEBUG oslo_db.sqlalchemy.engines [None req-e6c014d0-d789-4f27-893b-de1a43fe79c3 tempest-VolumeTypesTest-827227295 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134148) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 18 21:18:47.184221 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-e6c014d0-d789-4f27-893b-de1a43fe79c3 tempest-VolumeTypesTest-827227295 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37b1f927-f7c1-44b3-ae15-33082945b31f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-12-18T21:18:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesTest-volume-2075159981',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=c417f480-966f-43a9-aa77-65821febbc3b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a9b1da363674623bfab3da0ef60a62d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-12-18T21:18:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-12-18T21:18:47Z,use_quota=True,user_id='4a2f4eb279914c21912e022444361cc5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab7defa7-148f-41af-a0a8-dcc39dc0f755),volume_type_id=ab7defa7-148f-41af-a0a8-dcc39dc0f755)' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:18:47.186848 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-e6c014d0-d789-4f27-893b-de1a43fe79c3 tempest-VolumeTypesTest-827227295 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62d0ddf8-0f45-4c03-a160-eedde2742381) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:18:47.189004 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-e6c014d0-d789-4f27-893b-de1a43fe79c3 tempest-VolumeTypesTest-827227295 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62d0ddf8-0f45-4c03-a160-eedde2742381) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:18:47.191705 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-e6c014d0-d789-4f27-893b-de1a43fe79c3 tempest-VolumeTypesTest-827227295 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9dc1801-ebd5-45cd-b844-31e6c96a73d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:18:47.193927 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-e6c014d0-d789-4f27-893b-de1a43fe79c3 tempest-VolumeTypesTest-827227295 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9dc1801-ebd5-45cd-b844-31e6c96a73d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c417f480-966f-43a9-aa77-65821febbc3b', 'volume_name': 'volume-c417f480-966f-43a9-aa77-65821febbc3b', 'volume_size': 1}' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:18:47.196280 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-e6c014d0-d789-4f27-893b-de1a43fe79c3 tempest-VolumeTypesTest-827227295 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ab1e6f4-c240-4857-a89d-e4055a669e10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:18:47.198430 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-e6c014d0-d789-4f27-893b-de1a43fe79c3 tempest-VolumeTypesTest-827227295 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ab1e6f4-c240-4857-a89d-e4055a669e10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:18:47.200688 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-e6c014d0-d789-4f27-893b-de1a43fe79c3 tempest-VolumeTypesTest-827227295 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7ec8f35-69dd-45df-9a8e-f112b6230247) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:18:47.201464 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.flows.manager.create_volume [None req-e6c014d0-d789-4f27-893b-de1a43fe79c3 tempest-VolumeTypesTest-827227295 None] Volume c417f480-966f-43a9-aa77-65821febbc3b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c417f480-966f-43a9-aa77-65821febbc3b', 'volume_size': 1} Dec 18 21:18:47.201838 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-e6c014d0-d789-4f27-893b-de1a43fe79c3 tempest-VolumeTypesTest-827227295 None] creating volume 'volume-c417f480-966f-43a9-aa77-65821febbc3b' {{(pid=134148) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Dec 18 21:18:47.202826 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-e6c014d0-d789-4f27-893b-de1a43fe79c3 tempest-VolumeTypesTest-827227295 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:18:47.265347 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-e6c014d0-d789-4f27-893b-de1a43fe79c3 tempest-VolumeTypesTest-827227295 None] extra_specs: {'storage_protocol': 'ceph', 'vendor_name': 'Open Source'} {{(pid=134148) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 18 21:18:47.265655 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-e6c014d0-d789-4f27-893b-de1a43fe79c3 tempest-VolumeTypesTest-827227295 None] extra_specs: {'storage_protocol': 'ceph', 'vendor_name': 'Open Source'} {{(pid=134148) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 18 21:18:47.267724 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-e6c014d0-d789-4f27-893b-de1a43fe79c3 tempest-VolumeTypesTest-827227295 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7ec8f35-69dd-45df-9a8e-f112b6230247) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c417f480-966f-43a9-aa77-65821febbc3b', 'volume_size': 1}' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:18:47.270010 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-e6c014d0-d789-4f27-893b-de1a43fe79c3 tempest-VolumeTypesTest-827227295 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5617d59-a377-4232-94b0-a1f03929ede5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:18:47.285010 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.quota [None req-5e410468-492e-4d3c-91c2-2339e8164cf9 tempest-TestVolumeBootPattern-1320248540 None] Created reservations ['49125205-dd01-4dec-9d2c-ea4e964cd6fa', '6c55c121-2548-462c-b497-a739421f6ec1', '576d7b13-bff8-442f-98b4-f57a8ef67e8c', '596a2fb3-ff9b-4df1-a820-f683f256f77f'] {{(pid=134148) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 18 21:18:47.287275 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.flows.manager.create_volume [None req-e6c014d0-d789-4f27-893b-de1a43fe79c3 tempest-VolumeTypesTest-827227295 None] Volume volume-c417f480-966f-43a9-aa77-65821febbc3b (c417f480-966f-43a9-aa77-65821febbc3b): created successfully Dec 18 21:18:47.289200 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-e6c014d0-d789-4f27-893b-de1a43fe79c3 tempest-VolumeTypesTest-827227295 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5617d59-a377-4232-94b0-a1f03929ede5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:18:47.292156 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-e6c014d0-d789-4f27-893b-de1a43fe79c3 tempest-VolumeTypesTest-827227295 None] Flow 'volume_create_manager' (3aaf6b95-afae-4fd6-84aa-f8972f4da0ed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134148) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 18 21:18:47.308522 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-e6c014d0-d789-4f27-893b-de1a43fe79c3 tempest-VolumeTypesTest-827227295 None] Created volume successfully. Dec 18 21:18:47.327484 ncdv-master-1 cinder-volume[134148]: WARNING cinder.quota [None req-957c1c91-900b-4d1c-9423-2033e5fa7366 tempest-VolumeRetypeWithoutMigrationTest-2025352982 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Dec 18 21:18:47.328273 ncdv-master-1 cinder-volume[134148]: WARNING cinder.quota [None req-957c1c91-900b-4d1c-9423-2033e5fa7366 tempest-VolumeRetypeWithoutMigrationTest-2025352982 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Dec 18 21:18:47.351113 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-5e410468-492e-4d3c-91c2-2339e8164cf9 tempest-TestVolumeBootPattern-1320248540 None] Delete snapshot completed successfully. Dec 18 21:18:47.358988 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.coordination [None req-5e410468-492e-4d3c-91c2-2339e8164cf9 tempest-TestVolumeBootPattern-1320248540 None] Lock "b'cinder-38d8249f-a253-43e2-b429-d8a7c1a23757-delete_snapshot'" released by "delete_snapshot" :: held 30.351s {{(pid=134148) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 18 21:18:47.362515 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.quota [None req-957c1c91-900b-4d1c-9423-2033e5fa7366 tempest-VolumeRetypeWithoutMigrationTest-2025352982 None] Created reservations ['90f03bb3-3645-4f3e-bfe7-35b1fd8409a9', '5dfee379-5924-4012-b9ba-0a131592c152', '3210357d-6359-4c8e-b540-4095926b8375', 'cd1281b2-dfc6-4fd8-b467-80e9f8adf04f'] {{(pid=134148) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 18 21:18:47.412811 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.coordination [None req-141567ea-01a8-4e5f-b178-85d8fdf36e1d tempest-VolumesSnapshotTestJSON-1921935471 None] Lock "b'cinder-7979f0ac-1929-47b8-a4f5-183a4d61dc0d-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.015s {{(pid=134148) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 18 21:18:47.414698 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-141567ea-01a8-4e5f-b178-85d8fdf36e1d tempest-VolumesSnapshotTestJSON-1921935471 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:18:47.480064 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-957c1c91-900b-4d1c-9423-2033e5fa7366 tempest-VolumeRetypeWithoutMigrationTest-2025352982 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:18:47.500969 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-957c1c91-900b-4d1c-9423-2033e5fa7366 tempest-VolumeRetypeWithoutMigrationTest-2025352982 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:18:47.523110 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.manager [None req-957c1c91-900b-4d1c-9423-2033e5fa7366 tempest-VolumeRetypeWithoutMigrationTest-2025352982 None] Notifying Schedulers of capabilities ... {{(pid=134148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 18 21:18:47.528506 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-957c1c91-900b-4d1c-9423-2033e5fa7366 tempest-VolumeRetypeWithoutMigrationTest-2025352982 None] Deleted volume successfully. Dec 18 21:18:47.544856 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.coordination [None req-957c1c91-900b-4d1c-9423-2033e5fa7366 tempest-VolumeRetypeWithoutMigrationTest-2025352982 None] Lock "b'cinder-d41fa1f4-1259-4d96-9346-b55ba0392f8b-delete_volume'" released by "delete_volume" :: held 0.561s {{(pid=134148) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 18 21:18:48.475844 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-5a62e3ef-c06e-4001-ac7b-dcba36f26470 tempest-VolumeTypesTest-827227295 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:18:48.511811 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-5a62e3ef-c06e-4001-ac7b-dcba36f26470 tempest-VolumeTypesTest-827227295 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:18:48.546002 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.manager [None req-5a62e3ef-c06e-4001-ac7b-dcba36f26470 tempest-VolumeTypesTest-827227295 None] Notifying Schedulers of capabilities ... {{(pid=134148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 18 21:18:48.555035 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-5a62e3ef-c06e-4001-ac7b-dcba36f26470 tempest-VolumeTypesTest-827227295 None] Retype volume completed successfully. Dec 18 21:18:50.438470 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [req-70afdd75-bc17-4c52-8f24-c68069c100a1 req-dbfc4b9c-7d7e-4029-a4ff-c33cc3b41abe tempest-TestVolumeBootPattern-1320248540 None] Terminate volume connection completed successfully. Dec 18 21:18:50.439108 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [req-70afdd75-bc17-4c52-8f24-c68069c100a1 req-dbfc4b9c-7d7e-4029-a4ff-c33cc3b41abe tempest-TestVolumeBootPattern-1320248540 None] Deleting attachment b8d0f2d6-9f7e-485e-b873-fb067093bcba. {{(pid=134148) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4948}} Dec 18 21:18:50.645042 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.coordination [None req-5b4fd0d4-4761-40ef-85ee-eba48765c9fe tempest-VolumeTypesTest-827227295 None] Lock "b'cinder-c417f480-966f-43a9-aa77-65821febbc3b-delete_volume'" acquired by "delete_volume" :: waited 0.014s {{(pid=134148) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 18 21:18:50.686629 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-5b4fd0d4-4761-40ef-85ee-eba48765c9fe tempest-VolumeTypesTest-827227295 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:18:50.758915 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-5b4fd0d4-4761-40ef-85ee-eba48765c9fe tempest-VolumeTypesTest-827227295 None] volume has no backup snaps {{(pid=134148) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Dec 18 21:18:50.759428 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-5b4fd0d4-4761-40ef-85ee-eba48765c9fe tempest-VolumeTypesTest-827227295 None] Volume volume-c417f480-966f-43a9-aa77-65821febbc3b is not a clone. {{(pid=134148) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Dec 18 21:18:50.768376 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-5b4fd0d4-4761-40ef-85ee-eba48765c9fe tempest-VolumeTypesTest-827227295 None] deleting rbd volume volume-c417f480-966f-43a9-aa77-65821febbc3b {{(pid=134148) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Dec 18 21:18:51.013679 ncdv-master-1 cinder-volume[134148]: WARNING cinder.quota [None req-5b4fd0d4-4761-40ef-85ee-eba48765c9fe tempest-VolumeTypesTest-827227295 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesTest-volume-type-1671504704 is set by the default quota flag: quota_volumes_tempest-VolumeTypesTest-volume-type-1671504704, it is now deprecated. Please use the default quota class for default quota. Dec 18 21:18:51.014483 ncdv-master-1 cinder-volume[134148]: WARNING cinder.quota [None req-5b4fd0d4-4761-40ef-85ee-eba48765c9fe tempest-VolumeTypesTest-827227295 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesTest-volume-type-1671504704 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesTest-volume-type-1671504704, it is now deprecated. Please use the default quota class for default quota. Dec 18 21:18:51.029044 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.quota [None req-5b4fd0d4-4761-40ef-85ee-eba48765c9fe tempest-VolumeTypesTest-827227295 None] Created reservations ['7c78eff8-9ae3-4dc4-9355-1c5532427c89', '77f8a275-7380-4f7e-855e-8b9d90dd35af', 'cf7c33c0-eb96-4166-b257-4e11d0af8306', '9e417a7b-fffd-4df3-9564-8ca857fe439c'] {{(pid=134148) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 18 21:18:51.077202 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-5b4fd0d4-4761-40ef-85ee-eba48765c9fe tempest-VolumeTypesTest-827227295 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:18:51.116909 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-5b4fd0d4-4761-40ef-85ee-eba48765c9fe tempest-VolumeTypesTest-827227295 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:18:51.140056 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.manager [None req-5b4fd0d4-4761-40ef-85ee-eba48765c9fe tempest-VolumeTypesTest-827227295 None] Notifying Schedulers of capabilities ... {{(pid=134148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 18 21:18:51.143967 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-5b4fd0d4-4761-40ef-85ee-eba48765c9fe tempest-VolumeTypesTest-827227295 None] Deleted volume successfully. Dec 18 21:18:51.155600 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.coordination [None req-5b4fd0d4-4761-40ef-85ee-eba48765c9fe tempest-VolumeTypesTest-827227295 None] Lock "b'cinder-c417f480-966f-43a9-aa77-65821febbc3b-delete_volume'" released by "delete_volume" :: held 0.511s {{(pid=134148) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 18 21:18:52.230496 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.flows.manager.create_volume [None req-15cce8ea-76c6-46a7-90b3-0d762da6f28d tempest-VolumesTransfersV355Test-986082041 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134148) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Dec 18 21:18:52.235442 ncdv-master-1 cinder-volume[134148]: WARNING stevedore.named [None req-15cce8ea-76c6-46a7-90b3-0d762da6f28d tempest-VolumesTransfersV355Test-986082041 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Dec 18 21:18:52.235952 ncdv-master-1 cinder-volume[134148]: WARNING castellan.key_manager [None req-15cce8ea-76c6-46a7-90b3-0d762da6f28d tempest-VolumesTransfersV355Test-986082041 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Dec 18 21:18:52.249052 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-15cce8ea-76c6-46a7-90b3-0d762da6f28d tempest-VolumesTransfersV355Test-986082041 None] Flow 'volume_create_manager' (338e671c-149a-438c-852a-aa470c7d6b28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 18 21:18:52.252556 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-15cce8ea-76c6-46a7-90b3-0d762da6f28d tempest-VolumesTransfersV355Test-986082041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a998e56-2271-46d7-8fbe-8449717881f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:18:52.258951 ncdv-master-1 cinder-volume[134148]: DEBUG oslo_db.sqlalchemy.engines [None req-15cce8ea-76c6-46a7-90b3-0d762da6f28d tempest-VolumesTransfersV355Test-986082041 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134148) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 18 21:18:52.283207 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-15cce8ea-76c6-46a7-90b3-0d762da6f28d tempest-VolumesTransfersV355Test-986082041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a998e56-2271-46d7-8fbe-8449717881f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-12-18T21:18:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-111751062',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=e75cbf89-dfed-4d92-9df7-7d96fe3f6c0b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c696c6cad1c43398c00e0efebc99682',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-12-18T21:18:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-12-18T21:18:52Z,use_quota=True,user_id='df641caa3083410ea417302a3971ebae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f2e1fe1-9fd6-411e-9ed9-368f463ccb6f),volume_type_id=1f2e1fe1-9fd6-411e-9ed9-368f463ccb6f)' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:18:52.285922 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-15cce8ea-76c6-46a7-90b3-0d762da6f28d tempest-VolumesTransfersV355Test-986082041 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7cf142d-c686-4788-bd73-26811743eea3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:18:52.288226 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-15cce8ea-76c6-46a7-90b3-0d762da6f28d tempest-VolumesTransfersV355Test-986082041 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7cf142d-c686-4788-bd73-26811743eea3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:18:52.290806 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-15cce8ea-76c6-46a7-90b3-0d762da6f28d tempest-VolumesTransfersV355Test-986082041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4518b7fe-1903-4da7-a202-5bc9fe088eab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:18:52.293164 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-15cce8ea-76c6-46a7-90b3-0d762da6f28d tempest-VolumesTransfersV355Test-986082041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4518b7fe-1903-4da7-a202-5bc9fe088eab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e75cbf89-dfed-4d92-9df7-7d96fe3f6c0b', 'volume_name': 'volume-e75cbf89-dfed-4d92-9df7-7d96fe3f6c0b', 'volume_size': 1}' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:18:52.296121 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-15cce8ea-76c6-46a7-90b3-0d762da6f28d tempest-VolumesTransfersV355Test-986082041 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8581e286-024f-48a0-92b4-405ef4f5916f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:18:52.298387 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-15cce8ea-76c6-46a7-90b3-0d762da6f28d tempest-VolumesTransfersV355Test-986082041 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8581e286-024f-48a0-92b4-405ef4f5916f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:18:52.300682 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-15cce8ea-76c6-46a7-90b3-0d762da6f28d tempest-VolumesTransfersV355Test-986082041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d52fd65a-3e5e-41b2-83bf-b8a124481d85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:18:52.301522 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.flows.manager.create_volume [None req-15cce8ea-76c6-46a7-90b3-0d762da6f28d tempest-VolumesTransfersV355Test-986082041 None] Volume e75cbf89-dfed-4d92-9df7-7d96fe3f6c0b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e75cbf89-dfed-4d92-9df7-7d96fe3f6c0b', 'volume_size': 1} Dec 18 21:18:52.301968 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-15cce8ea-76c6-46a7-90b3-0d762da6f28d tempest-VolumesTransfersV355Test-986082041 None] creating volume 'volume-e75cbf89-dfed-4d92-9df7-7d96fe3f6c0b' {{(pid=134148) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Dec 18 21:18:52.303265 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-15cce8ea-76c6-46a7-90b3-0d762da6f28d tempest-VolumesTransfersV355Test-986082041 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:18:52.347532 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.coordination [None req-75bf79f6-187f-4669-8c0c-4b20df90799c tempest-TestVolumeBootPattern-1320248540 None] Lock "b'cinder-13376864-8f52-4c3a-8fb8-d44948ce92e4-delete_volume'" acquired by "delete_volume" :: waited 0.073s {{(pid=134148) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 18 21:18:52.401556 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-15cce8ea-76c6-46a7-90b3-0d762da6f28d tempest-VolumesTransfersV355Test-986082041 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134148) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 18 21:18:52.401923 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-15cce8ea-76c6-46a7-90b3-0d762da6f28d tempest-VolumesTransfersV355Test-986082041 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134148) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 18 21:18:52.404496 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-15cce8ea-76c6-46a7-90b3-0d762da6f28d tempest-VolumesTransfersV355Test-986082041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d52fd65a-3e5e-41b2-83bf-b8a124481d85) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e75cbf89-dfed-4d92-9df7-7d96fe3f6c0b', 'volume_size': 1}' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:18:52.406673 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-15cce8ea-76c6-46a7-90b3-0d762da6f28d tempest-VolumesTransfersV355Test-986082041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71b28c55-87d8-4243-bf91-5f30e34cb884) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:18:52.417293 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-75bf79f6-187f-4669-8c0c-4b20df90799c tempest-TestVolumeBootPattern-1320248540 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:18:52.488259 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-75bf79f6-187f-4669-8c0c-4b20df90799c tempest-TestVolumeBootPattern-1320248540 None] volume has no backup snaps {{(pid=134148) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Dec 18 21:18:52.494563 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-75bf79f6-187f-4669-8c0c-4b20df90799c tempest-TestVolumeBootPattern-1320248540 None] deleting rbd volume volume-13376864-8f52-4c3a-8fb8-d44948ce92e4 {{(pid=134148) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Dec 18 21:18:52.496820 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.flows.manager.create_volume [None req-15cce8ea-76c6-46a7-90b3-0d762da6f28d tempest-VolumesTransfersV355Test-986082041 None] Volume volume-e75cbf89-dfed-4d92-9df7-7d96fe3f6c0b (e75cbf89-dfed-4d92-9df7-7d96fe3f6c0b): created successfully Dec 18 21:18:52.499103 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-15cce8ea-76c6-46a7-90b3-0d762da6f28d tempest-VolumesTransfersV355Test-986082041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71b28c55-87d8-4243-bf91-5f30e34cb884) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:18:52.502328 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-15cce8ea-76c6-46a7-90b3-0d762da6f28d tempest-VolumesTransfersV355Test-986082041 None] Flow 'volume_create_manager' (338e671c-149a-438c-852a-aa470c7d6b28) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134148) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 18 21:18:52.511438 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-15cce8ea-76c6-46a7-90b3-0d762da6f28d tempest-VolumesTransfersV355Test-986082041 None] Created volume successfully. Dec 18 21:18:52.819087 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-75bf79f6-187f-4669-8c0c-4b20df90799c tempest-TestVolumeBootPattern-1320248540 None] volume is a clone so cleaning references {{(pid=134148) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1266}} Dec 18 21:18:52.855839 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-75bf79f6-187f-4669-8c0c-4b20df90799c tempest-TestVolumeBootPattern-1320248540 None] deleting parent snapshot volume-13376864-8f52-4c3a-8fb8-d44948ce92e4.clone_snap {{(pid=134148) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1158}} Dec 18 21:18:53.114881 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.quota [None req-75bf79f6-187f-4669-8c0c-4b20df90799c tempest-TestVolumeBootPattern-1320248540 None] Created reservations ['50ffe3eb-3a80-49d7-98f0-496db1d524c1', '18e504d7-4c45-4a05-a1e4-e5ee7aa0d9b6', '49800783-85e8-4b88-a358-cb30567cd15f', '139ad553-2851-44d6-ac2c-4ae735049c7a'] {{(pid=134148) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 18 21:18:53.160411 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-75bf79f6-187f-4669-8c0c-4b20df90799c tempest-TestVolumeBootPattern-1320248540 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:18:53.210647 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-75bf79f6-187f-4669-8c0c-4b20df90799c tempest-TestVolumeBootPattern-1320248540 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:18:53.238057 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.manager [None req-75bf79f6-187f-4669-8c0c-4b20df90799c tempest-TestVolumeBootPattern-1320248540 None] Notifying Schedulers of capabilities ... {{(pid=134148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 18 21:18:53.249008 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-75bf79f6-187f-4669-8c0c-4b20df90799c tempest-TestVolumeBootPattern-1320248540 None] Deleted volume successfully. Dec 18 21:18:53.263626 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.coordination [None req-75bf79f6-187f-4669-8c0c-4b20df90799c tempest-TestVolumeBootPattern-1320248540 None] Lock "b'cinder-13376864-8f52-4c3a-8fb8-d44948ce92e4-delete_volume'" released by "delete_volume" :: held 0.916s {{(pid=134148) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 18 21:18:53.939445 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-c6bab734-4075-402f-b641-d8c76679f0a0 tempest-VolumesTransfersV355Test-1182015289 None] Transfer volume completed successfully. Dec 18 21:18:54.439747 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.coordination [None req-f4437e43-23a3-4dc3-859c-b681a838e895 tempest-VolumesTransfersV355Test-1568843634 None] Lock "b'cinder-e75cbf89-dfed-4d92-9df7-7d96fe3f6c0b-delete_volume'" acquired by "delete_volume" :: waited 0.016s {{(pid=134148) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 18 21:18:54.469517 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-f4437e43-23a3-4dc3-859c-b681a838e895 tempest-VolumesTransfersV355Test-1568843634 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:18:54.526883 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-f4437e43-23a3-4dc3-859c-b681a838e895 tempest-VolumesTransfersV355Test-1568843634 None] volume has no backup snaps {{(pid=134148) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Dec 18 21:18:54.527308 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-f4437e43-23a3-4dc3-859c-b681a838e895 tempest-VolumesTransfersV355Test-1568843634 None] Volume volume-e75cbf89-dfed-4d92-9df7-7d96fe3f6c0b is not a clone. {{(pid=134148) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Dec 18 21:18:54.534057 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-f4437e43-23a3-4dc3-859c-b681a838e895 tempest-VolumesTransfersV355Test-1568843634 None] deleting rbd volume volume-e75cbf89-dfed-4d92-9df7-7d96fe3f6c0b {{(pid=134148) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Dec 18 21:18:54.836423 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.quota [None req-f4437e43-23a3-4dc3-859c-b681a838e895 tempest-VolumesTransfersV355Test-1568843634 None] Created reservations ['a97ab842-35b6-47ef-851c-ddd8c6073332', 'd1f68a9e-be20-4358-ac4f-65b58a116895', '0481ef42-c197-42c9-9045-3af0c79ec426', 'd85883a6-5ac7-4ac9-8397-139a13f02f75'] {{(pid=134148) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 18 21:18:54.889661 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-f4437e43-23a3-4dc3-859c-b681a838e895 tempest-VolumesTransfersV355Test-1568843634 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:18:54.926653 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-f4437e43-23a3-4dc3-859c-b681a838e895 tempest-VolumesTransfersV355Test-1568843634 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:18:54.976961 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.manager [None req-f4437e43-23a3-4dc3-859c-b681a838e895 tempest-VolumesTransfersV355Test-1568843634 None] Notifying Schedulers of capabilities ... {{(pid=134148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 18 21:18:54.994582 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-f4437e43-23a3-4dc3-859c-b681a838e895 tempest-VolumesTransfersV355Test-1568843634 None] Deleted volume successfully. Dec 18 21:18:55.013528 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.coordination [None req-f4437e43-23a3-4dc3-859c-b681a838e895 tempest-VolumesTransfersV355Test-1568843634 None] Lock "b'cinder-e75cbf89-dfed-4d92-9df7-7d96fe3f6c0b-delete_volume'" released by "delete_volume" :: held 0.574s {{(pid=134148) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 18 21:18:56.084848 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.flows.manager.create_volume [None req-b091d8c2-8391-462d-8ecb-5542f268a4dc tempest-VolumesTransfersV355Test-986082041 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134148) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Dec 18 21:18:56.091318 ncdv-master-1 cinder-volume[134148]: WARNING stevedore.named [None req-b091d8c2-8391-462d-8ecb-5542f268a4dc tempest-VolumesTransfersV355Test-986082041 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Dec 18 21:18:56.092358 ncdv-master-1 cinder-volume[134148]: WARNING castellan.key_manager [None req-b091d8c2-8391-462d-8ecb-5542f268a4dc tempest-VolumesTransfersV355Test-986082041 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Dec 18 21:18:56.111348 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-b091d8c2-8391-462d-8ecb-5542f268a4dc tempest-VolumesTransfersV355Test-986082041 None] Flow 'volume_create_manager' (adb72ab5-8cf0-4e7a-9403-715f1ae66752) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 18 21:18:56.116804 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-b091d8c2-8391-462d-8ecb-5542f268a4dc tempest-VolumesTransfersV355Test-986082041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b924799-b807-4568-b231-5f103c24d491) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:18:56.124495 ncdv-master-1 cinder-volume[134148]: DEBUG oslo_db.sqlalchemy.engines [None req-b091d8c2-8391-462d-8ecb-5542f268a4dc tempest-VolumesTransfersV355Test-986082041 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134148) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 18 21:18:56.142713 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-b091d8c2-8391-462d-8ecb-5542f268a4dc tempest-VolumesTransfersV355Test-986082041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b924799-b807-4568-b231-5f103c24d491) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-12-18T21:18:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1788572974',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=2a03b7f3-5cb8-488a-8541-6c2ef57ce21d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c696c6cad1c43398c00e0efebc99682',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-12-18T21:18:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-12-18T21:18:56Z,use_quota=True,user_id='df641caa3083410ea417302a3971ebae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f2e1fe1-9fd6-411e-9ed9-368f463ccb6f),volume_type_id=1f2e1fe1-9fd6-411e-9ed9-368f463ccb6f)' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:18:56.145568 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-b091d8c2-8391-462d-8ecb-5542f268a4dc tempest-VolumesTransfersV355Test-986082041 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1bd69430-7a27-46d0-bca3-a0cf860d67ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:18:56.147902 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-b091d8c2-8391-462d-8ecb-5542f268a4dc tempest-VolumesTransfersV355Test-986082041 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1bd69430-7a27-46d0-bca3-a0cf860d67ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:18:56.150904 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-b091d8c2-8391-462d-8ecb-5542f268a4dc tempest-VolumesTransfersV355Test-986082041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8f58a07-64d3-49a5-8f3e-10dcaff3d2e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:18:56.152934 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-b091d8c2-8391-462d-8ecb-5542f268a4dc tempest-VolumesTransfersV355Test-986082041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8f58a07-64d3-49a5-8f3e-10dcaff3d2e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2a03b7f3-5cb8-488a-8541-6c2ef57ce21d', 'volume_name': 'volume-2a03b7f3-5cb8-488a-8541-6c2ef57ce21d', 'volume_size': 1}' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:18:56.155806 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-b091d8c2-8391-462d-8ecb-5542f268a4dc tempest-VolumesTransfersV355Test-986082041 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd62f759-db56-460e-9cbb-3715faa58654) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:18:56.158769 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-b091d8c2-8391-462d-8ecb-5542f268a4dc tempest-VolumesTransfersV355Test-986082041 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd62f759-db56-460e-9cbb-3715faa58654) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:18:56.161144 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-b091d8c2-8391-462d-8ecb-5542f268a4dc tempest-VolumesTransfersV355Test-986082041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2aa485f-3437-4e85-93a9-a2344dec77c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:18:56.162095 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.flows.manager.create_volume [None req-b091d8c2-8391-462d-8ecb-5542f268a4dc tempest-VolumesTransfersV355Test-986082041 None] Volume 2a03b7f3-5cb8-488a-8541-6c2ef57ce21d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2a03b7f3-5cb8-488a-8541-6c2ef57ce21d', 'volume_size': 1} Dec 18 21:18:56.162610 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-b091d8c2-8391-462d-8ecb-5542f268a4dc tempest-VolumesTransfersV355Test-986082041 None] creating volume 'volume-2a03b7f3-5cb8-488a-8541-6c2ef57ce21d' {{(pid=134148) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Dec 18 21:18:56.163706 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-b091d8c2-8391-462d-8ecb-5542f268a4dc tempest-VolumesTransfersV355Test-986082041 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:18:56.242371 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-b091d8c2-8391-462d-8ecb-5542f268a4dc tempest-VolumesTransfersV355Test-986082041 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134148) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 18 21:18:56.242992 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-b091d8c2-8391-462d-8ecb-5542f268a4dc tempest-VolumesTransfersV355Test-986082041 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134148) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 18 21:18:56.254998 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-b091d8c2-8391-462d-8ecb-5542f268a4dc tempest-VolumesTransfersV355Test-986082041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2aa485f-3437-4e85-93a9-a2344dec77c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2a03b7f3-5cb8-488a-8541-6c2ef57ce21d', 'volume_size': 1}' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:18:56.261326 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-b091d8c2-8391-462d-8ecb-5542f268a4dc tempest-VolumesTransfersV355Test-986082041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a576f547-6b51-495f-b833-d14950152253) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:18:56.287171 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.flows.manager.create_volume [None req-b091d8c2-8391-462d-8ecb-5542f268a4dc tempest-VolumesTransfersV355Test-986082041 None] Volume volume-2a03b7f3-5cb8-488a-8541-6c2ef57ce21d (2a03b7f3-5cb8-488a-8541-6c2ef57ce21d): created successfully Dec 18 21:18:56.289386 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-b091d8c2-8391-462d-8ecb-5542f268a4dc tempest-VolumesTransfersV355Test-986082041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a576f547-6b51-495f-b833-d14950152253) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:18:56.292678 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-b091d8c2-8391-462d-8ecb-5542f268a4dc tempest-VolumesTransfersV355Test-986082041 None] Flow 'volume_create_manager' (adb72ab5-8cf0-4e7a-9403-715f1ae66752) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134148) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 18 21:18:56.312326 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-b091d8c2-8391-462d-8ecb-5542f268a4dc tempest-VolumesTransfersV355Test-986082041 None] Created volume successfully. Dec 18 21:18:57.454905 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.coordination [None req-0a306b52-7197-42a2-adc4-a2e50f7a8dc7 tempest-VolumesTransfersV355Test-1568843634 None] Lock "b'cinder-2a03b7f3-5cb8-488a-8541-6c2ef57ce21d-delete_volume'" acquired by "delete_volume" :: waited 0.016s {{(pid=134148) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 18 21:18:57.505905 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-0a306b52-7197-42a2-adc4-a2e50f7a8dc7 tempest-VolumesTransfersV355Test-1568843634 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:18:57.576357 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-0a306b52-7197-42a2-adc4-a2e50f7a8dc7 tempest-VolumesTransfersV355Test-1568843634 None] volume has no backup snaps {{(pid=134148) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Dec 18 21:18:57.576789 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-0a306b52-7197-42a2-adc4-a2e50f7a8dc7 tempest-VolumesTransfersV355Test-1568843634 None] Volume volume-2a03b7f3-5cb8-488a-8541-6c2ef57ce21d is not a clone. {{(pid=134148) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Dec 18 21:18:57.593917 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-0a306b52-7197-42a2-adc4-a2e50f7a8dc7 tempest-VolumesTransfersV355Test-1568843634 None] deleting rbd volume volume-2a03b7f3-5cb8-488a-8541-6c2ef57ce21d {{(pid=134148) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Dec 18 21:18:57.915191 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.quota [None req-0a306b52-7197-42a2-adc4-a2e50f7a8dc7 tempest-VolumesTransfersV355Test-1568843634 None] Created reservations ['795d52ee-7fba-440e-9bc2-7d5754b427af', '5b6501bb-028e-4703-b257-68aab4ed41b1', 'cd6349f5-b582-4956-bdcd-a3a899c9dd2a', '08d38234-2f55-49c6-9f8d-d78e46d11668'] {{(pid=134148) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 18 21:18:57.972271 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-0a306b52-7197-42a2-adc4-a2e50f7a8dc7 tempest-VolumesTransfersV355Test-1568843634 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:18:58.001038 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-0a306b52-7197-42a2-adc4-a2e50f7a8dc7 tempest-VolumesTransfersV355Test-1568843634 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:18:58.037560 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.manager [None req-0a306b52-7197-42a2-adc4-a2e50f7a8dc7 tempest-VolumesTransfersV355Test-1568843634 None] Notifying Schedulers of capabilities ... {{(pid=134148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 18 21:18:58.042514 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-0a306b52-7197-42a2-adc4-a2e50f7a8dc7 tempest-VolumesTransfersV355Test-1568843634 None] Deleted volume successfully. Dec 18 21:18:58.056643 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.coordination [None req-0a306b52-7197-42a2-adc4-a2e50f7a8dc7 tempest-VolumesTransfersV355Test-1568843634 None] Lock "b'cinder-2a03b7f3-5cb8-488a-8541-6c2ef57ce21d-delete_volume'" released by "delete_volume" :: held 0.602s {{(pid=134148) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 18 21:18:58.919636 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.flows.manager.create_volume [None req-e55cf601-938c-4c1e-85c0-a31cfe2e4a00 tempest-SnapshotMetadataTestJSON-768173521 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134148) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Dec 18 21:18:58.923943 ncdv-master-1 cinder-volume[134148]: WARNING stevedore.named [None req-e55cf601-938c-4c1e-85c0-a31cfe2e4a00 tempest-SnapshotMetadataTestJSON-768173521 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Dec 18 21:18:58.924472 ncdv-master-1 cinder-volume[134148]: WARNING castellan.key_manager [None req-e55cf601-938c-4c1e-85c0-a31cfe2e4a00 tempest-SnapshotMetadataTestJSON-768173521 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Dec 18 21:18:58.941660 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-e55cf601-938c-4c1e-85c0-a31cfe2e4a00 tempest-SnapshotMetadataTestJSON-768173521 None] Flow 'volume_create_manager' (96f095f6-95e6-4233-a3f8-8ccea08c7dbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 18 21:18:58.946618 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-e55cf601-938c-4c1e-85c0-a31cfe2e4a00 tempest-SnapshotMetadataTestJSON-768173521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c1e92a1-ca84-4883-a3f6-01fe63744d38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:18:58.956461 ncdv-master-1 cinder-volume[134148]: DEBUG oslo_db.sqlalchemy.engines [None req-e55cf601-938c-4c1e-85c0-a31cfe2e4a00 tempest-SnapshotMetadataTestJSON-768173521 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134148) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 18 21:18:58.969337 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-e55cf601-938c-4c1e-85c0-a31cfe2e4a00 tempest-SnapshotMetadataTestJSON-768173521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c1e92a1-ca84-4883-a3f6-01fe63744d38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-12-18T21:18:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1228474389',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=1348b420-9014-4b5b-8508-cdeade209de6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='811b51c4fb9b4bebb5c0c2097d53b345',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-12-18T21:18:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-12-18T21:18:59Z,use_quota=True,user_id='758e5861ca584e189fc8a8bb95045d8e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f2e1fe1-9fd6-411e-9ed9-368f463ccb6f),volume_type_id=1f2e1fe1-9fd6-411e-9ed9-368f463ccb6f)' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:18:58.972073 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-e55cf601-938c-4c1e-85c0-a31cfe2e4a00 tempest-SnapshotMetadataTestJSON-768173521 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d05017e4-efbb-4e70-8e67-fd03be5fd9f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:18:58.975543 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-e55cf601-938c-4c1e-85c0-a31cfe2e4a00 tempest-SnapshotMetadataTestJSON-768173521 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d05017e4-efbb-4e70-8e67-fd03be5fd9f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:18:58.979780 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-e55cf601-938c-4c1e-85c0-a31cfe2e4a00 tempest-SnapshotMetadataTestJSON-768173521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bedd5ee1-fcf4-4b4b-9777-4c49de93dff3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:18:58.983324 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-e55cf601-938c-4c1e-85c0-a31cfe2e4a00 tempest-SnapshotMetadataTestJSON-768173521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bedd5ee1-fcf4-4b4b-9777-4c49de93dff3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1348b420-9014-4b5b-8508-cdeade209de6', 'volume_name': 'volume-1348b420-9014-4b5b-8508-cdeade209de6', 'volume_size': 1}' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:18:58.985951 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-e55cf601-938c-4c1e-85c0-a31cfe2e4a00 tempest-SnapshotMetadataTestJSON-768173521 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8a94205-586b-4306-acbf-5195008fa3dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:18:58.988473 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-e55cf601-938c-4c1e-85c0-a31cfe2e4a00 tempest-SnapshotMetadataTestJSON-768173521 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8a94205-586b-4306-acbf-5195008fa3dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:18:58.991324 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-e55cf601-938c-4c1e-85c0-a31cfe2e4a00 tempest-SnapshotMetadataTestJSON-768173521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60e1c2f5-a616-4de1-9139-2cd6d7e3e90d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:18:58.992647 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.flows.manager.create_volume [None req-e55cf601-938c-4c1e-85c0-a31cfe2e4a00 tempest-SnapshotMetadataTestJSON-768173521 None] Volume 1348b420-9014-4b5b-8508-cdeade209de6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1348b420-9014-4b5b-8508-cdeade209de6', 'volume_size': 1} Dec 18 21:18:58.993406 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-e55cf601-938c-4c1e-85c0-a31cfe2e4a00 tempest-SnapshotMetadataTestJSON-768173521 None] creating volume 'volume-1348b420-9014-4b5b-8508-cdeade209de6' {{(pid=134148) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Dec 18 21:18:58.994872 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-e55cf601-938c-4c1e-85c0-a31cfe2e4a00 tempest-SnapshotMetadataTestJSON-768173521 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:18:59.061336 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-e55cf601-938c-4c1e-85c0-a31cfe2e4a00 tempest-SnapshotMetadataTestJSON-768173521 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134148) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 18 21:18:59.061813 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-e55cf601-938c-4c1e-85c0-a31cfe2e4a00 tempest-SnapshotMetadataTestJSON-768173521 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134148) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 18 21:18:59.063882 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-e55cf601-938c-4c1e-85c0-a31cfe2e4a00 tempest-SnapshotMetadataTestJSON-768173521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60e1c2f5-a616-4de1-9139-2cd6d7e3e90d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1348b420-9014-4b5b-8508-cdeade209de6', 'volume_size': 1}' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:18:59.066947 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-e55cf601-938c-4c1e-85c0-a31cfe2e4a00 tempest-SnapshotMetadataTestJSON-768173521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba6fa59c-0ddf-4e23-880b-6cc5676fb72f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:18:59.077657 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.flows.manager.create_volume [None req-e55cf601-938c-4c1e-85c0-a31cfe2e4a00 tempest-SnapshotMetadataTestJSON-768173521 None] Volume volume-1348b420-9014-4b5b-8508-cdeade209de6 (1348b420-9014-4b5b-8508-cdeade209de6): created successfully Dec 18 21:18:59.080338 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-e55cf601-938c-4c1e-85c0-a31cfe2e4a00 tempest-SnapshotMetadataTestJSON-768173521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba6fa59c-0ddf-4e23-880b-6cc5676fb72f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:18:59.084056 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-e55cf601-938c-4c1e-85c0-a31cfe2e4a00 tempest-SnapshotMetadataTestJSON-768173521 None] Flow 'volume_create_manager' (96f095f6-95e6-4233-a3f8-8ccea08c7dbb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134148) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 18 21:18:59.093531 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-e55cf601-938c-4c1e-85c0-a31cfe2e4a00 tempest-SnapshotMetadataTestJSON-768173521 None] Created volume successfully. Dec 18 21:19:00.140128 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-0978d544-682f-4d1f-a06e-ab68aae321b3 tempest-SnapshotMetadataTestJSON-768173521 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:19:01.171480 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-0978d544-682f-4d1f-a06e-ab68aae321b3 tempest-SnapshotMetadataTestJSON-768173521 None] Create snapshot completed successfully Dec 18 21:19:02.855091 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.coordination [None req-47b25e13-e881-495e-bac8-daba8d0bb691 tempest-SnapshotMetadataTestJSON-768173521 None] Lock "b'cinder-24be0ccc-7316-45a5-8e38-a351ca13da2c-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.017s {{(pid=134148) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 18 21:19:02.858883 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-47b25e13-e881-495e-bac8-daba8d0bb691 tempest-SnapshotMetadataTestJSON-768173521 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:19:03.174543 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.quota [None req-47b25e13-e881-495e-bac8-daba8d0bb691 tempest-SnapshotMetadataTestJSON-768173521 None] Created reservations ['1c2a8d11-2b40-459f-8a53-db813248d944', 'e6ec3c8f-f0a5-4d10-b368-dde63f4f3ecb', '1055ec4f-2c58-4808-b154-6ad9cf1c0ed9', 'e244443d-cf6c-484c-9bb3-c560f4c8fba9'] {{(pid=134148) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 18 21:19:03.209932 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-47b25e13-e881-495e-bac8-daba8d0bb691 tempest-SnapshotMetadataTestJSON-768173521 None] Delete snapshot completed successfully. Dec 18 21:19:03.215438 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.coordination [None req-47b25e13-e881-495e-bac8-daba8d0bb691 tempest-SnapshotMetadataTestJSON-768173521 None] Lock "b'cinder-24be0ccc-7316-45a5-8e38-a351ca13da2c-delete_snapshot'" released by "delete_snapshot" :: held 0.360s {{(pid=134148) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 18 21:19:03.955796 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.coordination [None req-b0247760-180c-45bc-b2cd-8b1f21f250e3 tempest-SnapshotMetadataTestJSON-768173521 None] Lock "b'cinder-1348b420-9014-4b5b-8508-cdeade209de6-delete_volume'" acquired by "delete_volume" :: waited 0.010s {{(pid=134148) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 18 21:19:03.989742 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-b0247760-180c-45bc-b2cd-8b1f21f250e3 tempest-SnapshotMetadataTestJSON-768173521 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:19:04.034494 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-b0247760-180c-45bc-b2cd-8b1f21f250e3 tempest-SnapshotMetadataTestJSON-768173521 None] volume has no backup snaps {{(pid=134148) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Dec 18 21:19:04.035026 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-b0247760-180c-45bc-b2cd-8b1f21f250e3 tempest-SnapshotMetadataTestJSON-768173521 None] Volume volume-1348b420-9014-4b5b-8508-cdeade209de6 is not a clone. {{(pid=134148) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Dec 18 21:19:04.042054 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-b0247760-180c-45bc-b2cd-8b1f21f250e3 tempest-SnapshotMetadataTestJSON-768173521 None] deleting rbd volume volume-1348b420-9014-4b5b-8508-cdeade209de6 {{(pid=134148) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Dec 18 21:19:04.288911 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.quota [None req-b0247760-180c-45bc-b2cd-8b1f21f250e3 tempest-SnapshotMetadataTestJSON-768173521 None] Created reservations ['457b3bfb-e71c-44be-9f32-0f00e2076044', 'd04cf0a2-e6dd-4a40-8aad-49620479f7b6', 'f482bd11-8009-4c29-8306-278b10bf93fa', 'dc31f3e7-c801-47c1-a827-0e337a591d6e'] {{(pid=134148) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 18 21:19:04.331115 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-b0247760-180c-45bc-b2cd-8b1f21f250e3 tempest-SnapshotMetadataTestJSON-768173521 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:19:04.364283 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-b0247760-180c-45bc-b2cd-8b1f21f250e3 tempest-SnapshotMetadataTestJSON-768173521 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:19:04.390298 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.manager [None req-b0247760-180c-45bc-b2cd-8b1f21f250e3 tempest-SnapshotMetadataTestJSON-768173521 None] Notifying Schedulers of capabilities ... {{(pid=134148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 18 21:19:04.394471 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-b0247760-180c-45bc-b2cd-8b1f21f250e3 tempest-SnapshotMetadataTestJSON-768173521 None] Deleted volume successfully. Dec 18 21:19:04.407392 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.coordination [None req-b0247760-180c-45bc-b2cd-8b1f21f250e3 tempest-SnapshotMetadataTestJSON-768173521 None] Lock "b'cinder-1348b420-9014-4b5b-8508-cdeade209de6-delete_volume'" released by "delete_volume" :: held 0.452s {{(pid=134148) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 18 21:19:08.310483 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.flows.manager.create_volume [None req-c3974b44-867a-4341-97bb-9b3e889ed066 tempest-VolumesActionsTest-1443685035 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134148) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Dec 18 21:19:08.315467 ncdv-master-1 cinder-volume[134148]: WARNING stevedore.named [None req-c3974b44-867a-4341-97bb-9b3e889ed066 tempest-VolumesActionsTest-1443685035 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Dec 18 21:19:08.316592 ncdv-master-1 cinder-volume[134148]: WARNING castellan.key_manager [None req-c3974b44-867a-4341-97bb-9b3e889ed066 tempest-VolumesActionsTest-1443685035 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Dec 18 21:19:08.331892 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-c3974b44-867a-4341-97bb-9b3e889ed066 tempest-VolumesActionsTest-1443685035 None] Flow 'volume_create_manager' (15cedd92-5738-4186-828d-5b588159c6d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 18 21:19:08.335343 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-c3974b44-867a-4341-97bb-9b3e889ed066 tempest-VolumesActionsTest-1443685035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5049584d-b79e-4a39-9c35-06f313d45034) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:19:08.342820 ncdv-master-1 cinder-volume[134148]: DEBUG oslo_db.sqlalchemy.engines [None req-c3974b44-867a-4341-97bb-9b3e889ed066 tempest-VolumesActionsTest-1443685035 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134148) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 18 21:19:08.359884 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-c3974b44-867a-4341-97bb-9b3e889ed066 tempest-VolumesActionsTest-1443685035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5049584d-b79e-4a39-9c35-06f313d45034) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-12-18T21:19:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1381082968',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=f1ac04ee-d412-4982-a9f5-38c48bc6133f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='126c6d3b7ace4bd2ae9d84ba23cf9ccb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-12-18T21:19:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-12-18T21:19:08Z,use_quota=True,user_id='90e59ad9f3924293afdb08a62848402f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f2e1fe1-9fd6-411e-9ed9-368f463ccb6f),volume_type_id=1f2e1fe1-9fd6-411e-9ed9-368f463ccb6f)' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:19:08.362869 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-c3974b44-867a-4341-97bb-9b3e889ed066 tempest-VolumesActionsTest-1443685035 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8bcb78ac-b460-43c6-84de-6c1e1812dc7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:19:08.367302 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-c3974b44-867a-4341-97bb-9b3e889ed066 tempest-VolumesActionsTest-1443685035 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8bcb78ac-b460-43c6-84de-6c1e1812dc7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:19:08.370156 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-c3974b44-867a-4341-97bb-9b3e889ed066 tempest-VolumesActionsTest-1443685035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dbb79170-e319-40a0-a479-cbdadf1c55d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:19:08.373739 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-c3974b44-867a-4341-97bb-9b3e889ed066 tempest-VolumesActionsTest-1443685035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dbb79170-e319-40a0-a479-cbdadf1c55d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f1ac04ee-d412-4982-a9f5-38c48bc6133f', 'volume_name': 'volume-f1ac04ee-d412-4982-a9f5-38c48bc6133f', 'volume_size': 1}' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:19:08.376430 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-c3974b44-867a-4341-97bb-9b3e889ed066 tempest-VolumesActionsTest-1443685035 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8a2eb5b-c905-4fba-8481-e792b15149c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:19:08.378901 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-c3974b44-867a-4341-97bb-9b3e889ed066 tempest-VolumesActionsTest-1443685035 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8a2eb5b-c905-4fba-8481-e792b15149c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:19:08.381359 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-c3974b44-867a-4341-97bb-9b3e889ed066 tempest-VolumesActionsTest-1443685035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46d2e835-6888-4ea7-92ef-90c64e4480e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:19:08.382335 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.flows.manager.create_volume [None req-c3974b44-867a-4341-97bb-9b3e889ed066 tempest-VolumesActionsTest-1443685035 None] Volume f1ac04ee-d412-4982-a9f5-38c48bc6133f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f1ac04ee-d412-4982-a9f5-38c48bc6133f', 'volume_size': 1} Dec 18 21:19:08.382572 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-c3974b44-867a-4341-97bb-9b3e889ed066 tempest-VolumesActionsTest-1443685035 None] creating volume 'volume-f1ac04ee-d412-4982-a9f5-38c48bc6133f' {{(pid=134148) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Dec 18 21:19:08.383750 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-c3974b44-867a-4341-97bb-9b3e889ed066 tempest-VolumesActionsTest-1443685035 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:19:08.489185 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-c3974b44-867a-4341-97bb-9b3e889ed066 tempest-VolumesActionsTest-1443685035 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134148) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 18 21:19:08.489567 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-c3974b44-867a-4341-97bb-9b3e889ed066 tempest-VolumesActionsTest-1443685035 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134148) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 18 21:19:08.491905 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-c3974b44-867a-4341-97bb-9b3e889ed066 tempest-VolumesActionsTest-1443685035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46d2e835-6888-4ea7-92ef-90c64e4480e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f1ac04ee-d412-4982-a9f5-38c48bc6133f', 'volume_size': 1}' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:19:08.494391 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-c3974b44-867a-4341-97bb-9b3e889ed066 tempest-VolumesActionsTest-1443685035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6509de7-a7d4-423a-9a84-46fe67ad30bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:19:08.506162 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.flows.manager.create_volume [None req-c3974b44-867a-4341-97bb-9b3e889ed066 tempest-VolumesActionsTest-1443685035 None] Volume volume-f1ac04ee-d412-4982-a9f5-38c48bc6133f (f1ac04ee-d412-4982-a9f5-38c48bc6133f): created successfully Dec 18 21:19:08.508222 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-c3974b44-867a-4341-97bb-9b3e889ed066 tempest-VolumesActionsTest-1443685035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6509de7-a7d4-423a-9a84-46fe67ad30bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:19:08.511305 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-c3974b44-867a-4341-97bb-9b3e889ed066 tempest-VolumesActionsTest-1443685035 None] Flow 'volume_create_manager' (15cedd92-5738-4186-828d-5b588159c6d2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134148) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 18 21:19:08.519151 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-c3974b44-867a-4341-97bb-9b3e889ed066 tempest-VolumesActionsTest-1443685035 None] Created volume successfully. Dec 18 21:19:17.625814 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.quota [None req-141567ea-01a8-4e5f-b178-85d8fdf36e1d tempest-VolumesSnapshotTestJSON-1921935471 None] Created reservations ['5de67245-ae72-40c2-a60d-afc25900a8b8', '7947be52-8b85-417b-a5a8-0b5bfc6a971b', '157b49f1-4df1-4f1b-b772-6292b2818f16', '2bee066d-890a-4165-b0bf-9ca5fea0e62c'] {{(pid=134148) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 18 21:19:17.663103 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-141567ea-01a8-4e5f-b178-85d8fdf36e1d tempest-VolumesSnapshotTestJSON-1921935471 None] Delete snapshot completed successfully. Dec 18 21:19:17.668921 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.coordination [None req-141567ea-01a8-4e5f-b178-85d8fdf36e1d tempest-VolumesSnapshotTestJSON-1921935471 None] Lock "b'cinder-7979f0ac-1929-47b8-a4f5-183a4d61dc0d-delete_snapshot'" released by "delete_snapshot" :: held 30.256s {{(pid=134148) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 18 21:19:19.427858 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [req-b296ac74-df96-415c-b6bd-7ce5c9fb0ef1 req-c9a66cbb-6e1e-4d8c-8d0d-5ff73b12fcb6 tempest-VolumesSnapshotTestJSON-1921935471 None] Terminate volume connection completed successfully. Dec 18 21:19:19.428532 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [req-b296ac74-df96-415c-b6bd-7ce5c9fb0ef1 req-c9a66cbb-6e1e-4d8c-8d0d-5ff73b12fcb6 tempest-VolumesSnapshotTestJSON-1921935471 None] Deleting attachment 5f0d9371-e1c8-466d-bcf7-8ddd2cc9d6b7. {{(pid=134148) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4948}} Dec 18 21:19:19.953551 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.coordination [None req-555261f2-1ba8-40e0-bb6c-4564a04d0178 tempest-VolumesActionsTest-1443685035 None] Lock "b'cinder-f1ac04ee-d412-4982-a9f5-38c48bc6133f'" acquired by "attach_volume" :: waited 0.012s {{(pid=134148) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 18 21:19:19.999178 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-555261f2-1ba8-40e0-bb6c-4564a04d0178 tempest-VolumesActionsTest-1443685035 None] Attaching volume f1ac04ee-d412-4982-a9f5-38c48bc6133f to instance c334c3db-916a-4592-9542-858ac227a676 at mountpoint /dev/sdb on host None. Dec 18 21:19:20.024421 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-555261f2-1ba8-40e0-bb6c-4564a04d0178 tempest-VolumesActionsTest-1443685035 None] Attach volume completed successfully. Dec 18 21:19:20.030461 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.coordination [None req-555261f2-1ba8-40e0-bb6c-4564a04d0178 tempest-VolumesActionsTest-1443685035 None] Lock "b'cinder-f1ac04ee-d412-4982-a9f5-38c48bc6133f'" released by "attach_volume" :: held 0.077s {{(pid=134148) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 18 21:19:20.146214 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.coordination [None req-d4b548a2-bd78-4890-80e3-750f869ba36e tempest-VolumesActionsTest-1443685035 None] Lock "b'cinder-f1ac04ee-d412-4982-a9f5-38c48bc6133f-detach_volume'" acquired by "detach_volume" :: waited 0.009s {{(pid=134148) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 18 21:19:20.146706 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-d4b548a2-bd78-4890-80e3-750f869ba36e tempest-VolumesActionsTest-1443685035 None] Detaching volume f1ac04ee-d412-4982-a9f5-38c48bc6133f from instance c334c3db-916a-4592-9542-858ac227a676. Dec 18 21:19:20.189931 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-d4b548a2-bd78-4890-80e3-750f869ba36e tempest-VolumesActionsTest-1443685035 None] Detach volume completed successfully. Dec 18 21:19:20.194677 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.coordination [None req-d4b548a2-bd78-4890-80e3-750f869ba36e tempest-VolumesActionsTest-1443685035 None] Lock "b'cinder-f1ac04ee-d412-4982-a9f5-38c48bc6133f-detach_volume'" released by "detach_volume" :: held 0.049s {{(pid=134148) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 18 21:19:23.725153 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-41ddcabf-eb33-4e98-b08b-b4eb47f03a74 tempest-VolumesSnapshotTestJSON-1921935471 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:19:24.248971 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-41ddcabf-eb33-4e98-b08b-b4eb47f03a74 tempest-VolumesSnapshotTestJSON-1921935471 None] Create snapshot completed successfully Dec 18 21:19:24.926943 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.coordination [None req-77b171ce-8b78-4eee-8e86-32bf8b78da76 tempest-VolumesSnapshotTestJSON-1921935471 None] Lock "b'cinder-e0861d73-9c60-4853-abfa-218a549253e2-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.014s {{(pid=134148) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 18 21:19:24.928332 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-77b171ce-8b78-4eee-8e86-32bf8b78da76 tempest-VolumesSnapshotTestJSON-1921935471 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:19:25.268733 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.quota [None req-77b171ce-8b78-4eee-8e86-32bf8b78da76 tempest-VolumesSnapshotTestJSON-1921935471 None] Created reservations ['4a15511c-f8b6-4f88-8e0a-a9f8ac8900bc', 'b9a0cec3-309f-4366-88d2-e3239783f9ac', '6c22bcf9-f669-4b7b-9fdf-9819a1625473', 'aab4cde8-9f73-4a37-9905-7d30fcd78686'] {{(pid=134148) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 18 21:19:25.304031 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-77b171ce-8b78-4eee-8e86-32bf8b78da76 tempest-VolumesSnapshotTestJSON-1921935471 None] Delete snapshot completed successfully. Dec 18 21:19:25.308904 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.coordination [None req-77b171ce-8b78-4eee-8e86-32bf8b78da76 tempest-VolumesSnapshotTestJSON-1921935471 None] Lock "b'cinder-e0861d73-9c60-4853-abfa-218a549253e2-delete_snapshot'" released by "delete_snapshot" :: held 0.382s {{(pid=134148) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 18 21:19:26.150056 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-08f2e0d1-4af2-4405-ad9d-d52fe69bd6b9 tempest-VolumesSnapshotTestJSON-1921935471 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:19:27.266995 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-08f2e0d1-4af2-4405-ad9d-d52fe69bd6b9 tempest-VolumesSnapshotTestJSON-1921935471 None] Create snapshot completed successfully Dec 18 21:19:34.352955 ncdv-master-1 cinder-volume[134148]: DEBUG oslo_service.periodic_task [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134148) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Dec 18 21:19:34.353700 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:19:34.375462 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:19:34.397327 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.manager [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] Notifying Schedulers of capabilities ... {{(pid=134148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 18 21:19:36.486119 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.coordination [None req-587eaef4-c9f3-4f87-9afd-0577a77d9f48 tempest-VolumesActionsTest-1443685035 None] Lock "b'cinder-f1ac04ee-d412-4982-a9f5-38c48bc6133f'" acquired by "attach_volume" :: waited 0.009s {{(pid=134148) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 18 21:19:36.521673 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-587eaef4-c9f3-4f87-9afd-0577a77d9f48 tempest-VolumesActionsTest-1443685035 None] Attaching volume f1ac04ee-d412-4982-a9f5-38c48bc6133f to instance cfa4399a-9312-45b5-9afd-22ef3108c648 at mountpoint /dev/sdb on host None. Dec 18 21:19:36.543652 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-587eaef4-c9f3-4f87-9afd-0577a77d9f48 tempest-VolumesActionsTest-1443685035 None] Attach volume completed successfully. Dec 18 21:19:36.548401 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.coordination [None req-587eaef4-c9f3-4f87-9afd-0577a77d9f48 tempest-VolumesActionsTest-1443685035 None] Lock "b'cinder-f1ac04ee-d412-4982-a9f5-38c48bc6133f'" released by "attach_volume" :: held 0.062s {{(pid=134148) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 18 21:19:36.701762 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.coordination [None req-42f39127-2bfa-4451-adaf-ff0e48acfe3f tempest-VolumesActionsTest-1443685035 None] Lock "b'cinder-f1ac04ee-d412-4982-a9f5-38c48bc6133f-detach_volume'" acquired by "detach_volume" :: waited 0.009s {{(pid=134148) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 18 21:19:36.702219 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-42f39127-2bfa-4451-adaf-ff0e48acfe3f tempest-VolumesActionsTest-1443685035 None] Detaching volume f1ac04ee-d412-4982-a9f5-38c48bc6133f from instance cfa4399a-9312-45b5-9afd-22ef3108c648. Dec 18 21:19:36.736319 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-42f39127-2bfa-4451-adaf-ff0e48acfe3f tempest-VolumesActionsTest-1443685035 None] Detach volume completed successfully. Dec 18 21:19:36.740656 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.coordination [None req-42f39127-2bfa-4451-adaf-ff0e48acfe3f tempest-VolumesActionsTest-1443685035 None] Lock "b'cinder-f1ac04ee-d412-4982-a9f5-38c48bc6133f-detach_volume'" released by "detach_volume" :: held 0.039s {{(pid=134148) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 18 21:19:40.346888 ncdv-master-1 cinder-volume[134148]: DEBUG oslo_concurrency.processutils [req-c957a6c5-55e1-4d59-b1d0-371bc50d47cb req-0930de02-cd3e-4e37-bce6-c99f8a8bcc4d tempest-VolumesSnapshotTestJSON-1921935471 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=134148) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Dec 18 21:19:40.979891 ncdv-master-1 cinder-volume[134148]: DEBUG oslo_concurrency.processutils [req-c957a6c5-55e1-4d59-b1d0-371bc50d47cb req-0930de02-cd3e-4e37-bce6-c99f8a8bcc4d tempest-VolumesSnapshotTestJSON-1921935471 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.632s {{(pid=134148) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Dec 18 21:19:40.980617 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [req-c957a6c5-55e1-4d59-b1d0-371bc50d47cb req-0930de02-cd3e-4e37-bce6-c99f8a8bcc4d tempest-VolumesSnapshotTestJSON-1921935471 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-453214a7-66ea-4df2-bb71-f35aa118fee6', 'hosts': ['10.222.0.13'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '946d1715-d12c-4dbf-8a79-181222df6e2e', 'volume_id': '453214a7-66ea-4df2-bb71-f35aa118fee6', 'discard': True}} {{(pid=134148) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Dec 18 21:19:41.004157 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [req-c957a6c5-55e1-4d59-b1d0-371bc50d47cb req-0930de02-cd3e-4e37-bce6-c99f8a8bcc4d tempest-VolumesSnapshotTestJSON-1921935471 None] Connection info returned from driver {'name': 'volumes/volume-453214a7-66ea-4df2-bb71-f35aa118fee6', 'hosts': ['10.222.0.13'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '453214a7-66ea-4df2-bb71-f35aa118fee6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'dcf7e2ac-e319-4fe9-97db-388ebda1d2ef'} {{(pid=134148) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4812}} Dec 18 21:19:41.049095 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [req-c957a6c5-55e1-4d59-b1d0-371bc50d47cb req-0930de02-cd3e-4e37-bce6-c99f8a8bcc4d tempest-VolumesSnapshotTestJSON-1921935471 None] attachment_update completed successfully. Dec 18 21:19:41.115693 ncdv-master-1 cinder-volume[134148]: DEBUG oslo_concurrency.processutils [None req-03df0a30-4f80-43fd-837f-96a6e47805ce tempest-VolumesActionsTest-1443685035 None] Running cmd (subprocess): rbd export --pool volumes volume-f1ac04ee-d412-4982-a9f5-38c48bc6133f /opt/stack/data/cinder/conversion/volume-f1ac04ee-d412-4982-a9f5-38c48bc6133f-b7ebe8a8-c901-41f0-a5cd-cb35933e6551 --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=134148) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Dec 18 21:19:41.586305 ncdv-master-1 cinder-volume[134148]: DEBUG oslo_concurrency.processutils [None req-03df0a30-4f80-43fd-837f-96a6e47805ce tempest-VolumesActionsTest-1443685035 None] CMD "rbd export --pool volumes volume-f1ac04ee-d412-4982-a9f5-38c48bc6133f /opt/stack/data/cinder/conversion/volume-f1ac04ee-d412-4982-a9f5-38c48bc6133f-b7ebe8a8-c901-41f0-a5cd-cb35933e6551 --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.470s {{(pid=134148) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Dec 18 21:19:41.596921 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.image.image_utils [None req-03df0a30-4f80-43fd-837f-96a6e47805ce tempest-VolumesActionsTest-1443685035 None] b7ebe8a8-c901-41f0-a5cd-cb35933e6551 was raw, no need to convert to raw {{(pid=134148) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:815}} Dec 18 21:19:42.608509 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-575304b0-e8e0-4096-9dc1-26a4edb6c946 tempest-VolumesSnapshotTestJSON-1921935471 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:19:43.235645 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-575304b0-e8e0-4096-9dc1-26a4edb6c946 tempest-VolumesSnapshotTestJSON-1921935471 None] Create snapshot completed successfully Dec 18 21:19:43.870312 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-03194789-fd67-44d1-9ad4-24686216d050 tempest-VolumesSnapshotTestJSON-1921935471 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:19:44.279397 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-03194789-fd67-44d1-9ad4-24686216d050 tempest-VolumesSnapshotTestJSON-1921935471 None] Create snapshot completed successfully Dec 18 21:19:44.919697 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.coordination [None req-e5dd2887-b452-49c3-960c-bd9a68856a99 tempest-VolumesSnapshotTestJSON-1921935471 None] Lock "b'cinder-4c8dbb52-ff91-47c9-a84d-f26e849cabd4-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.015s {{(pid=134148) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 18 21:19:44.921296 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-e5dd2887-b452-49c3-960c-bd9a68856a99 tempest-VolumesSnapshotTestJSON-1921935471 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:19:56.390949 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-03df0a30-4f80-43fd-837f-96a6e47805ce tempest-VolumesActionsTest-1443685035 None] Uploaded volume to glance image-id: b7ebe8a8-c901-41f0-a5cd-cb35933e6551. {{(pid=134148) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1747}} Dec 18 21:19:56.407432 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-03df0a30-4f80-43fd-837f-96a6e47805ce tempest-VolumesActionsTest-1443685035 None] Copy volume to image completed successfully. Dec 18 21:19:57.047815 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.coordination [None req-a9032c8b-c558-46e9-8930-58106a0d9e97 tempest-VolumesActionsTest-1443685035 None] Lock "b'cinder-f1ac04ee-d412-4982-a9f5-38c48bc6133f-delete_volume'" acquired by "delete_volume" :: waited 0.014s {{(pid=134148) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 18 21:19:57.077097 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-a9032c8b-c558-46e9-8930-58106a0d9e97 tempest-VolumesActionsTest-1443685035 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:19:57.114891 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-a9032c8b-c558-46e9-8930-58106a0d9e97 tempest-VolumesActionsTest-1443685035 None] volume has no backup snaps {{(pid=134148) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Dec 18 21:19:57.115345 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-a9032c8b-c558-46e9-8930-58106a0d9e97 tempest-VolumesActionsTest-1443685035 None] Volume volume-f1ac04ee-d412-4982-a9f5-38c48bc6133f is not a clone. {{(pid=134148) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Dec 18 21:19:57.120741 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-a9032c8b-c558-46e9-8930-58106a0d9e97 tempest-VolumesActionsTest-1443685035 None] deleting rbd volume volume-f1ac04ee-d412-4982-a9f5-38c48bc6133f {{(pid=134148) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Dec 18 21:19:57.346390 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.quota [None req-a9032c8b-c558-46e9-8930-58106a0d9e97 tempest-VolumesActionsTest-1443685035 None] Created reservations ['ee40a3af-25d6-4517-9715-faaea3dc47b0', '6a14695a-81c0-478f-bc88-e105cfb550a5', 'ded90ca5-a8f7-4b1e-8ffa-a832c713fb9b', 'f15ffb28-b97e-42fa-af39-695bd6a32f32'] {{(pid=134148) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 18 21:19:57.385148 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-a9032c8b-c558-46e9-8930-58106a0d9e97 tempest-VolumesActionsTest-1443685035 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:19:57.406463 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-a9032c8b-c558-46e9-8930-58106a0d9e97 tempest-VolumesActionsTest-1443685035 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:19:57.427589 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.manager [None req-a9032c8b-c558-46e9-8930-58106a0d9e97 tempest-VolumesActionsTest-1443685035 None] Notifying Schedulers of capabilities ... {{(pid=134148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 18 21:19:57.432054 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-a9032c8b-c558-46e9-8930-58106a0d9e97 tempest-VolumesActionsTest-1443685035 None] Deleted volume successfully. Dec 18 21:19:57.444388 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.coordination [None req-a9032c8b-c558-46e9-8930-58106a0d9e97 tempest-VolumesActionsTest-1443685035 None] Lock "b'cinder-f1ac04ee-d412-4982-a9f5-38c48bc6133f-delete_volume'" released by "delete_volume" :: held 0.397s {{(pid=134148) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 18 21:20:15.082133 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.quota [None req-e5dd2887-b452-49c3-960c-bd9a68856a99 tempest-VolumesSnapshotTestJSON-1921935471 None] Created reservations ['b6ddec70-4e65-44c5-8162-faae1df00576', '51f0e2fd-6c19-450e-91df-af1bd74ccb02', '3b6411c6-3617-4897-9c0d-e27e7703e72e', 'ba7d3a4c-d0ad-4544-94cc-c87b70ddea02'] {{(pid=134148) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 18 21:20:15.114688 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-e5dd2887-b452-49c3-960c-bd9a68856a99 tempest-VolumesSnapshotTestJSON-1921935471 None] Delete snapshot completed successfully. Dec 18 21:20:15.119608 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.coordination [None req-e5dd2887-b452-49c3-960c-bd9a68856a99 tempest-VolumesSnapshotTestJSON-1921935471 None] Lock "b'cinder-4c8dbb52-ff91-47c9-a84d-f26e849cabd4-delete_snapshot'" released by "delete_snapshot" :: held 30.200s {{(pid=134148) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 18 21:20:15.968786 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.coordination [None req-d7476345-0643-4222-a831-142c742a9c1b tempest-VolumesSnapshotTestJSON-1921935471 None] Lock "b'cinder-3e15d929-f990-4968-a2e5-037453f07dab-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.011s {{(pid=134148) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 18 21:20:15.970642 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-d7476345-0643-4222-a831-142c742a9c1b tempest-VolumesSnapshotTestJSON-1921935471 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:20:34.352477 ncdv-master-1 cinder-volume[134148]: DEBUG oslo_service.periodic_task [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134148) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Dec 18 21:20:34.354008 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:20:34.389892 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:20:34.429999 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.manager [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] Notifying Schedulers of capabilities ... {{(pid=134148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 18 21:20:46.099540 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.quota [None req-d7476345-0643-4222-a831-142c742a9c1b tempest-VolumesSnapshotTestJSON-1921935471 None] Created reservations ['564db806-0897-43bb-a88e-226e907123b8', '3b635fb2-6333-4786-b223-5d555ff9bbdc', '1160a996-4678-41e4-af10-826007c5a676', 'c0a3c4b0-7f2e-435c-9da6-508195d4c323'] {{(pid=134148) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 18 21:20:46.132479 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-d7476345-0643-4222-a831-142c742a9c1b tempest-VolumesSnapshotTestJSON-1921935471 None] Delete snapshot completed successfully. Dec 18 21:20:46.137175 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.coordination [None req-d7476345-0643-4222-a831-142c742a9c1b tempest-VolumesSnapshotTestJSON-1921935471 None] Lock "b'cinder-3e15d929-f990-4968-a2e5-037453f07dab-delete_snapshot'" released by "delete_snapshot" :: held 30.168s {{(pid=134148) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 18 21:20:46.797923 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.coordination [None req-3aa863db-053c-4510-bd7e-ee54ea2bd354 tempest-VolumesSnapshotTestJSON-1921935471 None] Lock "b'cinder-bfc26a2f-4b59-4984-8ff3-c8e517b57ae4-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.009s {{(pid=134148) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 18 21:20:46.800040 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-3aa863db-053c-4510-bd7e-ee54ea2bd354 tempest-VolumesSnapshotTestJSON-1921935471 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:21:16.929367 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.quota [None req-3aa863db-053c-4510-bd7e-ee54ea2bd354 tempest-VolumesSnapshotTestJSON-1921935471 None] Created reservations ['750451b0-36b1-4edb-9916-8431de71df98', '1aa4dbc6-1a6d-4ac8-906d-e1eb6f6aa0c3', 'cc476910-262d-477b-9603-4c4b88592bdf', '3f75056b-387c-4cc2-b063-bf70446567e1'] {{(pid=134148) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 18 21:21:16.962707 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-3aa863db-053c-4510-bd7e-ee54ea2bd354 tempest-VolumesSnapshotTestJSON-1921935471 None] Delete snapshot completed successfully. Dec 18 21:21:16.969703 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.coordination [None req-3aa863db-053c-4510-bd7e-ee54ea2bd354 tempest-VolumesSnapshotTestJSON-1921935471 None] Lock "b'cinder-bfc26a2f-4b59-4984-8ff3-c8e517b57ae4-delete_snapshot'" released by "delete_snapshot" :: held 30.172s {{(pid=134148) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 18 21:21:18.325324 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [req-ba022321-580c-4171-91d0-1ba2d5597420 req-f6191c44-7100-4425-9ef0-a2609376382c tempest-VolumesSnapshotTestJSON-1921935471 None] Terminate volume connection completed successfully. Dec 18 21:21:18.325988 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [req-ba022321-580c-4171-91d0-1ba2d5597420 req-f6191c44-7100-4425-9ef0-a2609376382c tempest-VolumesSnapshotTestJSON-1921935471 None] Deleting attachment dcf7e2ac-e319-4fe9-97db-388ebda1d2ef. {{(pid=134148) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4948}} Dec 18 21:21:21.606919 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.flows.manager.create_volume [None req-f3a71ffd-16d6-4482-a609-04c91efebc12 tempest-VolumesSnapshotTestJSON-1921935471 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134148) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Dec 18 21:21:21.610413 ncdv-master-1 cinder-volume[134148]: WARNING stevedore.named [None req-f3a71ffd-16d6-4482-a609-04c91efebc12 tempest-VolumesSnapshotTestJSON-1921935471 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Dec 18 21:21:21.610893 ncdv-master-1 cinder-volume[134148]: WARNING castellan.key_manager [None req-f3a71ffd-16d6-4482-a609-04c91efebc12 tempest-VolumesSnapshotTestJSON-1921935471 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Dec 18 21:21:21.624289 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-f3a71ffd-16d6-4482-a609-04c91efebc12 tempest-VolumesSnapshotTestJSON-1921935471 None] Flow 'volume_create_manager' (875f335c-2522-49ed-9810-035e85a58106) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 18 21:21:21.627587 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-f3a71ffd-16d6-4482-a609-04c91efebc12 tempest-VolumesSnapshotTestJSON-1921935471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6754670-0218-47d4-9d05-60c415ee0f7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:21:21.633611 ncdv-master-1 cinder-volume[134148]: DEBUG oslo_db.sqlalchemy.engines [None req-f3a71ffd-16d6-4482-a609-04c91efebc12 tempest-VolumesSnapshotTestJSON-1921935471 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134148) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 18 21:21:21.645867 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-f3a71ffd-16d6-4482-a609-04c91efebc12 tempest-VolumesSnapshotTestJSON-1921935471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6754670-0218-47d4-9d05-60c415ee0f7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-12-18T21:21:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1942680272',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=7a3548fc-1a61-4249-98cc-3eab89c59047,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2d14b131ac74307b9aa94aded5f3f5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-12-18T21:21:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-12-18T21:21:22Z,use_quota=True,user_id='84883df65dac439a8c1e454b7ad570e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f2e1fe1-9fd6-411e-9ed9-368f463ccb6f),volume_type_id=1f2e1fe1-9fd6-411e-9ed9-368f463ccb6f)' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:21:21.648519 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-f3a71ffd-16d6-4482-a609-04c91efebc12 tempest-VolumesSnapshotTestJSON-1921935471 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af5427c8-2725-49ea-952a-61f65bc53a02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:21:21.650692 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-f3a71ffd-16d6-4482-a609-04c91efebc12 tempest-VolumesSnapshotTestJSON-1921935471 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af5427c8-2725-49ea-952a-61f65bc53a02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:21:21.653139 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-f3a71ffd-16d6-4482-a609-04c91efebc12 tempest-VolumesSnapshotTestJSON-1921935471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7ad5f6e-9a9c-4de5-87c2-01a0b0c48619) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:21:21.655413 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-f3a71ffd-16d6-4482-a609-04c91efebc12 tempest-VolumesSnapshotTestJSON-1921935471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7ad5f6e-9a9c-4de5-87c2-01a0b0c48619) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7a3548fc-1a61-4249-98cc-3eab89c59047', 'volume_name': 'volume-7a3548fc-1a61-4249-98cc-3eab89c59047', 'volume_size': 1}' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:21:21.657730 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-f3a71ffd-16d6-4482-a609-04c91efebc12 tempest-VolumesSnapshotTestJSON-1921935471 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b0649b3-e661-4fc7-8dfc-d3cda4ab944b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:21:21.659878 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-f3a71ffd-16d6-4482-a609-04c91efebc12 tempest-VolumesSnapshotTestJSON-1921935471 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b0649b3-e661-4fc7-8dfc-d3cda4ab944b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:21:21.662090 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-f3a71ffd-16d6-4482-a609-04c91efebc12 tempest-VolumesSnapshotTestJSON-1921935471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8399534b-e2ee-4d4d-97f1-9084ea183284) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:21:21.662908 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.flows.manager.create_volume [None req-f3a71ffd-16d6-4482-a609-04c91efebc12 tempest-VolumesSnapshotTestJSON-1921935471 None] Volume 7a3548fc-1a61-4249-98cc-3eab89c59047: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7a3548fc-1a61-4249-98cc-3eab89c59047', 'volume_size': 1} Dec 18 21:21:21.663307 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-f3a71ffd-16d6-4482-a609-04c91efebc12 tempest-VolumesSnapshotTestJSON-1921935471 None] creating volume 'volume-7a3548fc-1a61-4249-98cc-3eab89c59047' {{(pid=134148) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Dec 18 21:21:21.664266 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-f3a71ffd-16d6-4482-a609-04c91efebc12 tempest-VolumesSnapshotTestJSON-1921935471 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:21:21.718648 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-f3a71ffd-16d6-4482-a609-04c91efebc12 tempest-VolumesSnapshotTestJSON-1921935471 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134148) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 18 21:21:21.719050 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-f3a71ffd-16d6-4482-a609-04c91efebc12 tempest-VolumesSnapshotTestJSON-1921935471 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134148) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 18 21:21:21.721065 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-f3a71ffd-16d6-4482-a609-04c91efebc12 tempest-VolumesSnapshotTestJSON-1921935471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8399534b-e2ee-4d4d-97f1-9084ea183284) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7a3548fc-1a61-4249-98cc-3eab89c59047', 'volume_size': 1}' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:21:21.723277 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-f3a71ffd-16d6-4482-a609-04c91efebc12 tempest-VolumesSnapshotTestJSON-1921935471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13476bda-8aaf-4ac5-9db7-2514011364ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:21:21.732703 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.flows.manager.create_volume [None req-f3a71ffd-16d6-4482-a609-04c91efebc12 tempest-VolumesSnapshotTestJSON-1921935471 None] Volume volume-7a3548fc-1a61-4249-98cc-3eab89c59047 (7a3548fc-1a61-4249-98cc-3eab89c59047): created successfully Dec 18 21:21:21.734834 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-f3a71ffd-16d6-4482-a609-04c91efebc12 tempest-VolumesSnapshotTestJSON-1921935471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13476bda-8aaf-4ac5-9db7-2514011364ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:21:21.737835 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-f3a71ffd-16d6-4482-a609-04c91efebc12 tempest-VolumesSnapshotTestJSON-1921935471 None] Flow 'volume_create_manager' (875f335c-2522-49ed-9810-035e85a58106) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134148) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 18 21:21:21.745274 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-f3a71ffd-16d6-4482-a609-04c91efebc12 tempest-VolumesSnapshotTestJSON-1921935471 None] Created volume successfully. Dec 18 21:21:22.780438 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-bb1f7690-92da-4560-8772-5585884e7dcc tempest-VolumesSnapshotTestJSON-1921935471 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:21:23.839227 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-bb1f7690-92da-4560-8772-5585884e7dcc tempest-VolumesSnapshotTestJSON-1921935471 None] Create snapshot completed successfully Dec 18 21:21:25.146389 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.flows.manager.create_volume [None req-f829c751-b633-4526-838b-9e1c5d33f851 tempest-VolumesSnapshotTestJSON-1921935471 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134148) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Dec 18 21:21:25.149512 ncdv-master-1 cinder-volume[134148]: WARNING stevedore.named [None req-f829c751-b633-4526-838b-9e1c5d33f851 tempest-VolumesSnapshotTestJSON-1921935471 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Dec 18 21:21:25.149959 ncdv-master-1 cinder-volume[134148]: WARNING castellan.key_manager [None req-f829c751-b633-4526-838b-9e1c5d33f851 tempest-VolumesSnapshotTestJSON-1921935471 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Dec 18 21:21:25.170658 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-f829c751-b633-4526-838b-9e1c5d33f851 tempest-VolumesSnapshotTestJSON-1921935471 None] Flow 'volume_create_manager' (f1a18143-565e-483a-b9f9-e3619a96a525) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 18 21:21:25.174121 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-f829c751-b633-4526-838b-9e1c5d33f851 tempest-VolumesSnapshotTestJSON-1921935471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4c67409-415d-46ac-8556-0a302904e6d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:21:25.180270 ncdv-master-1 cinder-volume[134148]: DEBUG oslo_db.sqlalchemy.engines [None req-f829c751-b633-4526-838b-9e1c5d33f851 tempest-VolumesSnapshotTestJSON-1921935471 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134148) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 18 21:21:25.193259 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-f829c751-b633-4526-838b-9e1c5d33f851 tempest-VolumesSnapshotTestJSON-1921935471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4c67409-415d-46ac-8556-0a302904e6d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-12-18T21:21:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-985321641',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=01e6e221-2900-4f64-9523-f9f5917510a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2d14b131ac74307b9aa94aded5f3f5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-12-18T21:21:25Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=2160e9ef-789c-4a30-a538-cb1367a203dd,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-12-18T21:21:25Z,use_quota=True,user_id='84883df65dac439a8c1e454b7ad570e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f2e1fe1-9fd6-411e-9ed9-368f463ccb6f),volume_type_id=1f2e1fe1-9fd6-411e-9ed9-368f463ccb6f)' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:21:25.195849 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-f829c751-b633-4526-838b-9e1c5d33f851 tempest-VolumesSnapshotTestJSON-1921935471 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a9009be-8446-4b6a-aa39-766467330e67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:21:25.198018 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-f829c751-b633-4526-838b-9e1c5d33f851 tempest-VolumesSnapshotTestJSON-1921935471 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a9009be-8446-4b6a-aa39-766467330e67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:21:25.200460 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-f829c751-b633-4526-838b-9e1c5d33f851 tempest-VolumesSnapshotTestJSON-1921935471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48ff5b76-787c-4ee4-a057-3fdc21520f20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:21:25.202711 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-f829c751-b633-4526-838b-9e1c5d33f851 tempest-VolumesSnapshotTestJSON-1921935471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48ff5b76-787c-4ee4-a057-3fdc21520f20) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '01e6e221-2900-4f64-9523-f9f5917510a0', 'volume_name': 'volume-01e6e221-2900-4f64-9523-f9f5917510a0', 'volume_size': 2, 'snapshot_id': '2160e9ef-789c-4a30-a538-cb1367a203dd'}' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:21:25.205073 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-f829c751-b633-4526-838b-9e1c5d33f851 tempest-VolumesSnapshotTestJSON-1921935471 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e6237e8-1d66-4957-a1dd-a9c796380452) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:21:25.207777 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-f829c751-b633-4526-838b-9e1c5d33f851 tempest-VolumesSnapshotTestJSON-1921935471 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e6237e8-1d66-4957-a1dd-a9c796380452) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:21:25.209978 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-f829c751-b633-4526-838b-9e1c5d33f851 tempest-VolumesSnapshotTestJSON-1921935471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf0b5f13-0752-4e8d-a5b4-e635ad275222) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:21:25.210787 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.flows.manager.create_volume [None req-f829c751-b633-4526-838b-9e1c5d33f851 tempest-VolumesSnapshotTestJSON-1921935471 None] Volume 01e6e221-2900-4f64-9523-f9f5917510a0: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-01e6e221-2900-4f64-9523-f9f5917510a0', 'volume_size': 2, 'snapshot_id': '2160e9ef-789c-4a30-a538-cb1367a203dd'} Dec 18 21:21:25.227495 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-f829c751-b633-4526-838b-9e1c5d33f851 tempest-VolumesSnapshotTestJSON-1921935471 None] cloning volumes/volume-7a3548fc-1a61-4249-98cc-3eab89c59047@snapshot-2160e9ef-789c-4a30-a538-cb1367a203dd to volume-01e6e221-2900-4f64-9523-f9f5917510a0 {{(pid=134148) _clone /opt/stack/cinder/cinder/volume/drivers/rbd.py:1028}} Dec 18 21:21:25.228381 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-f829c751-b633-4526-838b-9e1c5d33f851 tempest-VolumesSnapshotTestJSON-1921935471 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:21:25.262686 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-f829c751-b633-4526-838b-9e1c5d33f851 tempest-VolumesSnapshotTestJSON-1921935471 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:21:25.356979 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-f829c751-b633-4526-838b-9e1c5d33f851 tempest-VolumesSnapshotTestJSON-1921935471 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134148) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 18 21:21:25.357347 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-f829c751-b633-4526-838b-9e1c5d33f851 tempest-VolumesSnapshotTestJSON-1921935471 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134148) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 18 21:21:25.361307 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-f829c751-b633-4526-838b-9e1c5d33f851 tempest-VolumesSnapshotTestJSON-1921935471 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:21:25.456014 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-f829c751-b633-4526-838b-9e1c5d33f851 tempest-VolumesSnapshotTestJSON-1921935471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf0b5f13-0752-4e8d-a5b4-e635ad275222) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-01e6e221-2900-4f64-9523-f9f5917510a0', 'volume_size': 2, 'snapshot_id': '2160e9ef-789c-4a30-a538-cb1367a203dd'}' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:21:25.458106 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-f829c751-b633-4526-838b-9e1c5d33f851 tempest-VolumesSnapshotTestJSON-1921935471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c08aa1ea-663d-4313-8aa1-57ca43dfdbd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:21:25.466691 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.flows.manager.create_volume [None req-f829c751-b633-4526-838b-9e1c5d33f851 tempest-VolumesSnapshotTestJSON-1921935471 None] Volume volume-01e6e221-2900-4f64-9523-f9f5917510a0 (01e6e221-2900-4f64-9523-f9f5917510a0): created successfully Dec 18 21:21:25.468662 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-f829c751-b633-4526-838b-9e1c5d33f851 tempest-VolumesSnapshotTestJSON-1921935471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c08aa1ea-663d-4313-8aa1-57ca43dfdbd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:21:25.471649 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-f829c751-b633-4526-838b-9e1c5d33f851 tempest-VolumesSnapshotTestJSON-1921935471 None] Flow 'volume_create_manager' (f1a18143-565e-483a-b9f9-e3619a96a525) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134148) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 18 21:21:25.483688 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-f829c751-b633-4526-838b-9e1c5d33f851 tempest-VolumesSnapshotTestJSON-1921935471 None] Created volume successfully. Dec 18 21:21:26.259267 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.coordination [None req-e142ffea-7846-4b04-b554-65080f918c6b tempest-VolumesSnapshotTestJSON-1921935471 None] Lock "b'cinder-01e6e221-2900-4f64-9523-f9f5917510a0-delete_volume'" acquired by "delete_volume" :: waited 0.009s {{(pid=134148) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 18 21:21:26.290553 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-e142ffea-7846-4b04-b554-65080f918c6b tempest-VolumesSnapshotTestJSON-1921935471 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:21:26.345039 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-e142ffea-7846-4b04-b554-65080f918c6b tempest-VolumesSnapshotTestJSON-1921935471 None] volume has no backup snaps {{(pid=134148) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Dec 18 21:21:26.350918 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-e142ffea-7846-4b04-b554-65080f918c6b tempest-VolumesSnapshotTestJSON-1921935471 None] deleting rbd volume volume-01e6e221-2900-4f64-9523-f9f5917510a0 {{(pid=134148) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Dec 18 21:21:26.541009 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.quota [None req-e142ffea-7846-4b04-b554-65080f918c6b tempest-VolumesSnapshotTestJSON-1921935471 None] Created reservations ['e7e5dbbf-ae68-467b-91c5-899fc54cdce4', 'd2914b66-70c9-4f6a-a9b2-23c86419a2b7', '67818e1d-7ccb-463f-835f-398ef038b8fc', '68e4fe32-8180-4699-9bf6-4f67242ac30a'] {{(pid=134148) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 18 21:21:26.579294 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-e142ffea-7846-4b04-b554-65080f918c6b tempest-VolumesSnapshotTestJSON-1921935471 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:21:26.601533 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-e142ffea-7846-4b04-b554-65080f918c6b tempest-VolumesSnapshotTestJSON-1921935471 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:21:26.623886 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.manager [None req-e142ffea-7846-4b04-b554-65080f918c6b tempest-VolumesSnapshotTestJSON-1921935471 None] Notifying Schedulers of capabilities ... {{(pid=134148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 18 21:21:26.627995 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-e142ffea-7846-4b04-b554-65080f918c6b tempest-VolumesSnapshotTestJSON-1921935471 None] Deleted volume successfully. Dec 18 21:21:26.640202 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.coordination [None req-e142ffea-7846-4b04-b554-65080f918c6b tempest-VolumesSnapshotTestJSON-1921935471 None] Lock "b'cinder-01e6e221-2900-4f64-9523-f9f5917510a0-delete_volume'" released by "delete_volume" :: held 0.381s {{(pid=134148) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 18 21:21:27.603681 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.flows.manager.create_volume [None req-27abc0ab-e7ed-465a-8b58-65268c20dacd tempest-VolumesSnapshotTestJSON-1921935471 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134148) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Dec 18 21:21:27.606764 ncdv-master-1 cinder-volume[134148]: WARNING stevedore.named [None req-27abc0ab-e7ed-465a-8b58-65268c20dacd tempest-VolumesSnapshotTestJSON-1921935471 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Dec 18 21:21:27.607201 ncdv-master-1 cinder-volume[134148]: WARNING castellan.key_manager [None req-27abc0ab-e7ed-465a-8b58-65268c20dacd tempest-VolumesSnapshotTestJSON-1921935471 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Dec 18 21:21:27.618689 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-27abc0ab-e7ed-465a-8b58-65268c20dacd tempest-VolumesSnapshotTestJSON-1921935471 None] Flow 'volume_create_manager' (afccd427-d739-487a-826b-d575a1689134) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 18 21:21:27.622141 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-27abc0ab-e7ed-465a-8b58-65268c20dacd tempest-VolumesSnapshotTestJSON-1921935471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0675b962-25ca-4e9f-800a-7c5ee69d0278) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:21:27.628104 ncdv-master-1 cinder-volume[134148]: DEBUG oslo_db.sqlalchemy.engines [None req-27abc0ab-e7ed-465a-8b58-65268c20dacd tempest-VolumesSnapshotTestJSON-1921935471 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134148) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 18 21:21:27.640462 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-27abc0ab-e7ed-465a-8b58-65268c20dacd tempest-VolumesSnapshotTestJSON-1921935471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0675b962-25ca-4e9f-800a-7c5ee69d0278) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-12-18T21:21:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-212143628',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=25aea7d0-177d-47c2-ace4-59254449c789,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2d14b131ac74307b9aa94aded5f3f5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-12-18T21:21:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-12-18T21:21:28Z,use_quota=True,user_id='84883df65dac439a8c1e454b7ad570e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f2e1fe1-9fd6-411e-9ed9-368f463ccb6f),volume_type_id=1f2e1fe1-9fd6-411e-9ed9-368f463ccb6f)' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:21:27.643256 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-27abc0ab-e7ed-465a-8b58-65268c20dacd tempest-VolumesSnapshotTestJSON-1921935471 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7947cd17-a749-4673-acdb-9841cb725ee0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:21:27.645383 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-27abc0ab-e7ed-465a-8b58-65268c20dacd tempest-VolumesSnapshotTestJSON-1921935471 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7947cd17-a749-4673-acdb-9841cb725ee0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:21:27.647820 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-27abc0ab-e7ed-465a-8b58-65268c20dacd tempest-VolumesSnapshotTestJSON-1921935471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (afcde390-2efc-4ee9-b69e-5e5a41fcad86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:21:27.650065 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-27abc0ab-e7ed-465a-8b58-65268c20dacd tempest-VolumesSnapshotTestJSON-1921935471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (afcde390-2efc-4ee9-b69e-5e5a41fcad86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '25aea7d0-177d-47c2-ace4-59254449c789', 'volume_name': 'volume-25aea7d0-177d-47c2-ace4-59254449c789', 'volume_size': 1}' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:21:27.653068 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-27abc0ab-e7ed-465a-8b58-65268c20dacd tempest-VolumesSnapshotTestJSON-1921935471 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a02a400-3c54-425a-8754-333715152189) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:21:27.655195 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-27abc0ab-e7ed-465a-8b58-65268c20dacd tempest-VolumesSnapshotTestJSON-1921935471 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a02a400-3c54-425a-8754-333715152189) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:21:27.657389 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-27abc0ab-e7ed-465a-8b58-65268c20dacd tempest-VolumesSnapshotTestJSON-1921935471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c008c15-7f76-459b-92a7-e2fd5df1f75c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:21:27.658184 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.flows.manager.create_volume [None req-27abc0ab-e7ed-465a-8b58-65268c20dacd tempest-VolumesSnapshotTestJSON-1921935471 None] Volume 25aea7d0-177d-47c2-ace4-59254449c789: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-25aea7d0-177d-47c2-ace4-59254449c789', 'volume_size': 1} Dec 18 21:21:27.658590 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-27abc0ab-e7ed-465a-8b58-65268c20dacd tempest-VolumesSnapshotTestJSON-1921935471 None] creating volume 'volume-25aea7d0-177d-47c2-ace4-59254449c789' {{(pid=134148) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Dec 18 21:21:27.659529 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-27abc0ab-e7ed-465a-8b58-65268c20dacd tempest-VolumesSnapshotTestJSON-1921935471 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:21:27.713711 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-27abc0ab-e7ed-465a-8b58-65268c20dacd tempest-VolumesSnapshotTestJSON-1921935471 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134148) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 18 21:21:27.714089 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-27abc0ab-e7ed-465a-8b58-65268c20dacd tempest-VolumesSnapshotTestJSON-1921935471 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134148) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 18 21:21:27.717022 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-27abc0ab-e7ed-465a-8b58-65268c20dacd tempest-VolumesSnapshotTestJSON-1921935471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c008c15-7f76-459b-92a7-e2fd5df1f75c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-25aea7d0-177d-47c2-ace4-59254449c789', 'volume_size': 1}' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:21:27.719030 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-27abc0ab-e7ed-465a-8b58-65268c20dacd tempest-VolumesSnapshotTestJSON-1921935471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf093294-73cf-4468-8411-247ae4924d1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:21:27.727463 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.flows.manager.create_volume [None req-27abc0ab-e7ed-465a-8b58-65268c20dacd tempest-VolumesSnapshotTestJSON-1921935471 None] Volume volume-25aea7d0-177d-47c2-ace4-59254449c789 (25aea7d0-177d-47c2-ace4-59254449c789): created successfully Dec 18 21:21:27.729331 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-27abc0ab-e7ed-465a-8b58-65268c20dacd tempest-VolumesSnapshotTestJSON-1921935471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf093294-73cf-4468-8411-247ae4924d1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:21:27.732276 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-27abc0ab-e7ed-465a-8b58-65268c20dacd tempest-VolumesSnapshotTestJSON-1921935471 None] Flow 'volume_create_manager' (afccd427-d739-487a-826b-d575a1689134) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134148) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 18 21:21:27.740344 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-27abc0ab-e7ed-465a-8b58-65268c20dacd tempest-VolumesSnapshotTestJSON-1921935471 None] Created volume successfully. Dec 18 21:21:28.771695 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-77265523-350e-47d3-a4c2-7a4446a8f12b tempest-VolumesSnapshotTestJSON-1921935471 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:21:29.843157 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-77265523-350e-47d3-a4c2-7a4446a8f12b tempest-VolumesSnapshotTestJSON-1921935471 None] Create snapshot completed successfully Dec 18 21:21:31.159881 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.flows.manager.create_volume [None req-b0c23003-1342-4138-beb8-c70979aa7388 tempest-VolumesSnapshotTestJSON-1921935471 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134148) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Dec 18 21:21:31.162959 ncdv-master-1 cinder-volume[134148]: WARNING stevedore.named [None req-b0c23003-1342-4138-beb8-c70979aa7388 tempest-VolumesSnapshotTestJSON-1921935471 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Dec 18 21:21:31.163397 ncdv-master-1 cinder-volume[134148]: WARNING castellan.key_manager [None req-b0c23003-1342-4138-beb8-c70979aa7388 tempest-VolumesSnapshotTestJSON-1921935471 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Dec 18 21:21:31.185230 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-b0c23003-1342-4138-beb8-c70979aa7388 tempest-VolumesSnapshotTestJSON-1921935471 None] Flow 'volume_create_manager' (0778134f-233e-4e3a-bf48-6c47c76e53a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 18 21:21:31.188801 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-b0c23003-1342-4138-beb8-c70979aa7388 tempest-VolumesSnapshotTestJSON-1921935471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ae19d24-0780-426f-b26f-556227574937) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:21:31.195198 ncdv-master-1 cinder-volume[134148]: DEBUG oslo_db.sqlalchemy.engines [None req-b0c23003-1342-4138-beb8-c70979aa7388 tempest-VolumesSnapshotTestJSON-1921935471 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134148) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 18 21:21:31.207258 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-b0c23003-1342-4138-beb8-c70979aa7388 tempest-VolumesSnapshotTestJSON-1921935471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ae19d24-0780-426f-b26f-556227574937) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-12-18T21:21:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1158138008',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=469acb7a-f137-451f-bb10-f8812a629587,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2d14b131ac74307b9aa94aded5f3f5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-12-18T21:21:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=9cc2d4ef-c08d-4076-bb25-55f608ef1cbf,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-12-18T21:21:31Z,use_quota=True,user_id='84883df65dac439a8c1e454b7ad570e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f2e1fe1-9fd6-411e-9ed9-368f463ccb6f),volume_type_id=1f2e1fe1-9fd6-411e-9ed9-368f463ccb6f)' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:21:31.209854 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-b0c23003-1342-4138-beb8-c70979aa7388 tempest-VolumesSnapshotTestJSON-1921935471 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bfe7210e-cc44-40be-a17f-3db99d25b08f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:21:31.212033 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-b0c23003-1342-4138-beb8-c70979aa7388 tempest-VolumesSnapshotTestJSON-1921935471 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bfe7210e-cc44-40be-a17f-3db99d25b08f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:21:31.214454 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-b0c23003-1342-4138-beb8-c70979aa7388 tempest-VolumesSnapshotTestJSON-1921935471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a0710c4-b81d-4a9e-a108-83c69c4c6836) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:21:31.216659 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-b0c23003-1342-4138-beb8-c70979aa7388 tempest-VolumesSnapshotTestJSON-1921935471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a0710c4-b81d-4a9e-a108-83c69c4c6836) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '469acb7a-f137-451f-bb10-f8812a629587', 'volume_name': 'volume-469acb7a-f137-451f-bb10-f8812a629587', 'volume_size': 1, 'snapshot_id': '9cc2d4ef-c08d-4076-bb25-55f608ef1cbf'}' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:21:31.218989 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-b0c23003-1342-4138-beb8-c70979aa7388 tempest-VolumesSnapshotTestJSON-1921935471 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9aea0669-d6b4-409b-a930-92c6038c655a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:21:31.221076 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-b0c23003-1342-4138-beb8-c70979aa7388 tempest-VolumesSnapshotTestJSON-1921935471 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9aea0669-d6b4-409b-a930-92c6038c655a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:21:31.223307 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-b0c23003-1342-4138-beb8-c70979aa7388 tempest-VolumesSnapshotTestJSON-1921935471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (586d3874-213e-4281-a0f4-8c2874eb1bae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:21:31.224074 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.flows.manager.create_volume [None req-b0c23003-1342-4138-beb8-c70979aa7388 tempest-VolumesSnapshotTestJSON-1921935471 None] Volume 469acb7a-f137-451f-bb10-f8812a629587: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-469acb7a-f137-451f-bb10-f8812a629587', 'volume_size': 1, 'snapshot_id': '9cc2d4ef-c08d-4076-bb25-55f608ef1cbf'} Dec 18 21:21:31.243581 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-b0c23003-1342-4138-beb8-c70979aa7388 tempest-VolumesSnapshotTestJSON-1921935471 None] cloning volumes/volume-25aea7d0-177d-47c2-ace4-59254449c789@snapshot-9cc2d4ef-c08d-4076-bb25-55f608ef1cbf to volume-469acb7a-f137-451f-bb10-f8812a629587 {{(pid=134148) _clone /opt/stack/cinder/cinder/volume/drivers/rbd.py:1028}} Dec 18 21:21:31.245076 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-b0c23003-1342-4138-beb8-c70979aa7388 tempest-VolumesSnapshotTestJSON-1921935471 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:21:31.277963 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-b0c23003-1342-4138-beb8-c70979aa7388 tempest-VolumesSnapshotTestJSON-1921935471 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:21:31.370736 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-b0c23003-1342-4138-beb8-c70979aa7388 tempest-VolumesSnapshotTestJSON-1921935471 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134148) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 18 21:21:31.371106 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-b0c23003-1342-4138-beb8-c70979aa7388 tempest-VolumesSnapshotTestJSON-1921935471 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134148) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 18 21:21:31.387687 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-b0c23003-1342-4138-beb8-c70979aa7388 tempest-VolumesSnapshotTestJSON-1921935471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (586d3874-213e-4281-a0f4-8c2874eb1bae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-469acb7a-f137-451f-bb10-f8812a629587', 'volume_size': 1, 'snapshot_id': '9cc2d4ef-c08d-4076-bb25-55f608ef1cbf'}' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:21:31.389925 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-b0c23003-1342-4138-beb8-c70979aa7388 tempest-VolumesSnapshotTestJSON-1921935471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a4c6257-dbc3-4bd8-83d8-c81e2df5480d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:21:31.397380 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.flows.manager.create_volume [None req-b0c23003-1342-4138-beb8-c70979aa7388 tempest-VolumesSnapshotTestJSON-1921935471 None] Volume volume-469acb7a-f137-451f-bb10-f8812a629587 (469acb7a-f137-451f-bb10-f8812a629587): created successfully Dec 18 21:21:31.399366 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-b0c23003-1342-4138-beb8-c70979aa7388 tempest-VolumesSnapshotTestJSON-1921935471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a4c6257-dbc3-4bd8-83d8-c81e2df5480d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:21:31.402911 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-b0c23003-1342-4138-beb8-c70979aa7388 tempest-VolumesSnapshotTestJSON-1921935471 None] Flow 'volume_create_manager' (0778134f-233e-4e3a-bf48-6c47c76e53a9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134148) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 18 21:21:31.413947 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-b0c23003-1342-4138-beb8-c70979aa7388 tempest-VolumesSnapshotTestJSON-1921935471 None] Created volume successfully. Dec 18 21:21:32.267547 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.coordination [None req-d499f541-d967-47af-a849-076d009770f2 tempest-VolumesSnapshotTestJSON-1921935471 None] Lock "b'cinder-469acb7a-f137-451f-bb10-f8812a629587-delete_volume'" acquired by "delete_volume" :: waited 0.010s {{(pid=134148) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 18 21:21:32.297941 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-d499f541-d967-47af-a849-076d009770f2 tempest-VolumesSnapshotTestJSON-1921935471 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:21:32.346359 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-d499f541-d967-47af-a849-076d009770f2 tempest-VolumesSnapshotTestJSON-1921935471 None] volume has no backup snaps {{(pid=134148) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Dec 18 21:21:32.352040 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-d499f541-d967-47af-a849-076d009770f2 tempest-VolumesSnapshotTestJSON-1921935471 None] deleting rbd volume volume-469acb7a-f137-451f-bb10-f8812a629587 {{(pid=134148) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Dec 18 21:21:32.547006 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.quota [None req-d499f541-d967-47af-a849-076d009770f2 tempest-VolumesSnapshotTestJSON-1921935471 None] Created reservations ['7d64806a-8666-472b-9988-5b672b6dbf7f', '25e7e027-daae-48f4-97cd-c5679247488d', '20de1e71-8f19-4fd1-848d-b64f2220f1b2', '286dc8f6-c9af-4691-8871-2135340962b0'] {{(pid=134148) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 18 21:21:32.586789 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-d499f541-d967-47af-a849-076d009770f2 tempest-VolumesSnapshotTestJSON-1921935471 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:21:32.609260 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-d499f541-d967-47af-a849-076d009770f2 tempest-VolumesSnapshotTestJSON-1921935471 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:21:32.632427 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.manager [None req-d499f541-d967-47af-a849-076d009770f2 tempest-VolumesSnapshotTestJSON-1921935471 None] Notifying Schedulers of capabilities ... {{(pid=134148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 18 21:21:32.636619 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-d499f541-d967-47af-a849-076d009770f2 tempest-VolumesSnapshotTestJSON-1921935471 None] Deleted volume successfully. Dec 18 21:21:32.648508 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.coordination [None req-d499f541-d967-47af-a849-076d009770f2 tempest-VolumesSnapshotTestJSON-1921935471 None] Lock "b'cinder-469acb7a-f137-451f-bb10-f8812a629587-delete_volume'" released by "delete_volume" :: held 0.381s {{(pid=134148) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 18 21:21:33.405361 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.coordination [None req-9a51718b-3e7a-46a4-ad2e-e678af054539 tempest-VolumesSnapshotTestJSON-1921935471 None] Lock "b'cinder-9cc2d4ef-c08d-4076-bb25-55f608ef1cbf-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.009s {{(pid=134148) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 18 21:21:33.406977 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-9a51718b-3e7a-46a4-ad2e-e678af054539 tempest-VolumesSnapshotTestJSON-1921935471 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:21:33.876937 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.quota [None req-9a51718b-3e7a-46a4-ad2e-e678af054539 tempest-VolumesSnapshotTestJSON-1921935471 None] Created reservations ['4defbce1-d012-4890-85a3-c5377159fb70', 'f57e40e9-24f8-4abc-894a-3b03120ca7b3', 'a23e7cfa-ac4c-4743-8b63-29f9a49d3880', 'd0fe7dbd-3393-4f90-b8a4-7de5c2329d6d'] {{(pid=134148) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 18 21:21:33.909632 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-9a51718b-3e7a-46a4-ad2e-e678af054539 tempest-VolumesSnapshotTestJSON-1921935471 None] Delete snapshot completed successfully. Dec 18 21:21:33.914266 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.coordination [None req-9a51718b-3e7a-46a4-ad2e-e678af054539 tempest-VolumesSnapshotTestJSON-1921935471 None] Lock "b'cinder-9cc2d4ef-c08d-4076-bb25-55f608ef1cbf-delete_snapshot'" released by "delete_snapshot" :: held 0.509s {{(pid=134148) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 18 21:21:34.357466 ncdv-master-1 cinder-volume[134148]: DEBUG oslo_service.periodic_task [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134148) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Dec 18 21:21:34.358484 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:21:34.389377 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:21:34.413694 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.manager [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] Notifying Schedulers of capabilities ... {{(pid=134148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 18 21:21:34.497851 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.coordination [None req-1d9fb859-e3c9-4e7f-9e0d-fdb688512833 tempest-VolumesSnapshotTestJSON-1921935471 None] Lock "b'cinder-25aea7d0-177d-47c2-ace4-59254449c789-delete_volume'" acquired by "delete_volume" :: waited 0.009s {{(pid=134148) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 18 21:21:34.528379 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-1d9fb859-e3c9-4e7f-9e0d-fdb688512833 tempest-VolumesSnapshotTestJSON-1921935471 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:21:34.564240 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-1d9fb859-e3c9-4e7f-9e0d-fdb688512833 tempest-VolumesSnapshotTestJSON-1921935471 None] volume has no backup snaps {{(pid=134148) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Dec 18 21:21:34.564665 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-1d9fb859-e3c9-4e7f-9e0d-fdb688512833 tempest-VolumesSnapshotTestJSON-1921935471 None] Volume volume-25aea7d0-177d-47c2-ace4-59254449c789 is not a clone. {{(pid=134148) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Dec 18 21:21:34.569123 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-1d9fb859-e3c9-4e7f-9e0d-fdb688512833 tempest-VolumesSnapshotTestJSON-1921935471 None] deleting rbd volume volume-25aea7d0-177d-47c2-ace4-59254449c789 {{(pid=134148) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Dec 18 21:21:34.759927 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.quota [None req-1d9fb859-e3c9-4e7f-9e0d-fdb688512833 tempest-VolumesSnapshotTestJSON-1921935471 None] Created reservations ['f02dc09f-6326-4c2f-bae7-c4637fcd9fc9', '102eab62-1d30-4d44-8901-5182f9178723', '3056cce2-aaaa-4eda-a644-bb4c8f76a0d6', 'ccb00e82-327d-45d1-8727-6a25c6a12cb7'] {{(pid=134148) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 18 21:21:34.798256 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-1d9fb859-e3c9-4e7f-9e0d-fdb688512833 tempest-VolumesSnapshotTestJSON-1921935471 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:21:34.829112 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-1d9fb859-e3c9-4e7f-9e0d-fdb688512833 tempest-VolumesSnapshotTestJSON-1921935471 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:21:34.852954 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.manager [None req-1d9fb859-e3c9-4e7f-9e0d-fdb688512833 tempest-VolumesSnapshotTestJSON-1921935471 None] Notifying Schedulers of capabilities ... {{(pid=134148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 18 21:21:34.858361 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-1d9fb859-e3c9-4e7f-9e0d-fdb688512833 tempest-VolumesSnapshotTestJSON-1921935471 None] Deleted volume successfully. Dec 18 21:21:34.870340 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.coordination [None req-1d9fb859-e3c9-4e7f-9e0d-fdb688512833 tempest-VolumesSnapshotTestJSON-1921935471 None] Lock "b'cinder-25aea7d0-177d-47c2-ace4-59254449c789-delete_volume'" released by "delete_volume" :: held 0.372s {{(pid=134148) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 18 21:21:35.632546 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.coordination [None req-e1e23f64-70f6-48a6-bd15-3d17b7ec9147 tempest-VolumesSnapshotTestJSON-1921935471 None] Lock "b'cinder-2160e9ef-789c-4a30-a538-cb1367a203dd-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.010s {{(pid=134148) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 18 21:21:35.634047 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-e1e23f64-70f6-48a6-bd15-3d17b7ec9147 tempest-VolumesSnapshotTestJSON-1921935471 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:21:35.904437 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.quota [None req-e1e23f64-70f6-48a6-bd15-3d17b7ec9147 tempest-VolumesSnapshotTestJSON-1921935471 None] Created reservations ['1eb7a111-402d-49ba-b82a-9acfe2ccff99', '89d8cbfc-4724-45e5-92d2-5b53f530c960', '07e20db4-aca2-4e1d-840c-5bcbe66fc25d', 'a64b50ae-baa0-4add-9b4d-8bb8dad996ee'] {{(pid=134148) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 18 21:21:35.936101 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-e1e23f64-70f6-48a6-bd15-3d17b7ec9147 tempest-VolumesSnapshotTestJSON-1921935471 None] Delete snapshot completed successfully. Dec 18 21:21:35.943426 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.coordination [None req-e1e23f64-70f6-48a6-bd15-3d17b7ec9147 tempest-VolumesSnapshotTestJSON-1921935471 None] Lock "b'cinder-2160e9ef-789c-4a30-a538-cb1367a203dd-delete_snapshot'" released by "delete_snapshot" :: held 0.311s {{(pid=134148) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 18 21:21:36.731990 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.coordination [None req-58a2c863-9fd2-466f-a177-468b93ae717d tempest-VolumesSnapshotTestJSON-1921935471 None] Lock "b'cinder-7a3548fc-1a61-4249-98cc-3eab89c59047-delete_volume'" acquired by "delete_volume" :: waited 0.010s {{(pid=134148) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 18 21:21:36.769529 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-58a2c863-9fd2-466f-a177-468b93ae717d tempest-VolumesSnapshotTestJSON-1921935471 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:21:36.807111 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-58a2c863-9fd2-466f-a177-468b93ae717d tempest-VolumesSnapshotTestJSON-1921935471 None] volume has no backup snaps {{(pid=134148) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Dec 18 21:21:36.807529 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-58a2c863-9fd2-466f-a177-468b93ae717d tempest-VolumesSnapshotTestJSON-1921935471 None] Volume volume-7a3548fc-1a61-4249-98cc-3eab89c59047 is not a clone. {{(pid=134148) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Dec 18 21:21:36.812907 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-58a2c863-9fd2-466f-a177-468b93ae717d tempest-VolumesSnapshotTestJSON-1921935471 None] deleting rbd volume volume-7a3548fc-1a61-4249-98cc-3eab89c59047 {{(pid=134148) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Dec 18 21:21:37.006378 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.quota [None req-58a2c863-9fd2-466f-a177-468b93ae717d tempest-VolumesSnapshotTestJSON-1921935471 None] Created reservations ['24835dd2-7047-4fc4-b474-cd59d6817eaf', 'fd12a2c6-8ad8-4862-98ea-c193fab2d540', 'c2767a36-3d76-4d2c-b8e8-fb4481c98844', '81d33177-9366-46ba-b597-5a49628eb20d'] {{(pid=134148) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 18 21:21:37.046353 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-58a2c863-9fd2-466f-a177-468b93ae717d tempest-VolumesSnapshotTestJSON-1921935471 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:21:37.068183 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-58a2c863-9fd2-466f-a177-468b93ae717d tempest-VolumesSnapshotTestJSON-1921935471 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:21:37.091026 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.manager [None req-58a2c863-9fd2-466f-a177-468b93ae717d tempest-VolumesSnapshotTestJSON-1921935471 None] Notifying Schedulers of capabilities ... {{(pid=134148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 18 21:21:37.094892 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-58a2c863-9fd2-466f-a177-468b93ae717d tempest-VolumesSnapshotTestJSON-1921935471 None] Deleted volume successfully. Dec 18 21:21:37.106292 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.coordination [None req-58a2c863-9fd2-466f-a177-468b93ae717d tempest-VolumesSnapshotTestJSON-1921935471 None] Lock "b'cinder-7a3548fc-1a61-4249-98cc-3eab89c59047-delete_volume'" released by "delete_volume" :: held 0.374s {{(pid=134148) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 18 21:21:37.964825 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.coordination [None req-4aa477d0-000f-499a-a897-615e8fffeb63 tempest-VolumesSnapshotTestJSON-1921935471 None] Lock "b'cinder-a6a5227f-3cf0-4d6b-aa2f-ba6a5904e103-delete_volume'" acquired by "delete_volume" :: waited 0.010s {{(pid=134148) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 18 21:21:37.995482 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-4aa477d0-000f-499a-a897-615e8fffeb63 tempest-VolumesSnapshotTestJSON-1921935471 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:21:38.054662 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-4aa477d0-000f-499a-a897-615e8fffeb63 tempest-VolumesSnapshotTestJSON-1921935471 None] volume has no backup snaps {{(pid=134148) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Dec 18 21:21:38.061734 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-4aa477d0-000f-499a-a897-615e8fffeb63 tempest-VolumesSnapshotTestJSON-1921935471 None] deleting rbd volume volume-a6a5227f-3cf0-4d6b-aa2f-ba6a5904e103 {{(pid=134148) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Dec 18 21:21:38.224659 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-4aa477d0-000f-499a-a897-615e8fffeb63 tempest-VolumesSnapshotTestJSON-1921935471 None] volume is a clone so cleaning references {{(pid=134148) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1266}} Dec 18 21:21:38.253985 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-4aa477d0-000f-499a-a897-615e8fffeb63 tempest-VolumesSnapshotTestJSON-1921935471 None] deleting parent snapshot volume-a6a5227f-3cf0-4d6b-aa2f-ba6a5904e103.clone_snap {{(pid=134148) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1158}} Dec 18 21:21:38.926098 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.quota [None req-4aa477d0-000f-499a-a897-615e8fffeb63 tempest-VolumesSnapshotTestJSON-1921935471 None] Created reservations ['de64efd3-6809-4eba-b930-3bf0b98a1495', '935affdd-a058-4944-8b48-0d04885e92de', 'd3d51dd3-1328-4375-90a6-79b184298a86', '2cfac926-e7ca-4e11-af44-d0fc760c84e9'] {{(pid=134148) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 18 21:21:38.968213 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-4aa477d0-000f-499a-a897-615e8fffeb63 tempest-VolumesSnapshotTestJSON-1921935471 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:21:38.989353 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-4aa477d0-000f-499a-a897-615e8fffeb63 tempest-VolumesSnapshotTestJSON-1921935471 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:21:39.015243 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.manager [None req-4aa477d0-000f-499a-a897-615e8fffeb63 tempest-VolumesSnapshotTestJSON-1921935471 None] Notifying Schedulers of capabilities ... {{(pid=134148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 18 21:21:39.020827 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-4aa477d0-000f-499a-a897-615e8fffeb63 tempest-VolumesSnapshotTestJSON-1921935471 None] Deleted volume successfully. Dec 18 21:21:39.033145 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.coordination [None req-4aa477d0-000f-499a-a897-615e8fffeb63 tempest-VolumesSnapshotTestJSON-1921935471 None] Lock "b'cinder-a6a5227f-3cf0-4d6b-aa2f-ba6a5904e103-delete_volume'" released by "delete_volume" :: held 1.068s {{(pid=134148) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 18 21:21:39.081921 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.coordination [None req-81535324-25ef-4b5f-a8e9-de02b0f563b7 tempest-VolumesSnapshotTestJSON-1921935471 None] Lock "b'cinder-2660e5ba-05af-4047-b2fa-0f83ae62129e-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.009s {{(pid=134148) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 18 21:21:39.083483 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-81535324-25ef-4b5f-a8e9-de02b0f563b7 tempest-VolumesSnapshotTestJSON-1921935471 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:21:39.947617 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.quota [None req-81535324-25ef-4b5f-a8e9-de02b0f563b7 tempest-VolumesSnapshotTestJSON-1921935471 None] Created reservations ['5df855b7-b7de-4bdf-b686-68bb2a1cc447', 'dccfac9e-cfdc-4855-950b-7fbc962085e7', 'f339e968-61f0-473a-8e73-1c6fc0ae583a', '12c3abe2-f747-43f4-ba1a-dfa7c5e4fcf3'] {{(pid=134148) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 18 21:21:39.981267 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-81535324-25ef-4b5f-a8e9-de02b0f563b7 tempest-VolumesSnapshotTestJSON-1921935471 None] Delete snapshot completed successfully. Dec 18 21:21:39.986009 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.coordination [None req-81535324-25ef-4b5f-a8e9-de02b0f563b7 tempest-VolumesSnapshotTestJSON-1921935471 None] Lock "b'cinder-2660e5ba-05af-4047-b2fa-0f83ae62129e-delete_snapshot'" released by "delete_snapshot" :: held 0.904s {{(pid=134148) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 18 21:21:40.391149 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.coordination [None req-f937c4cb-61f9-44ce-9539-557473d8c358 tempest-VolumesSnapshotTestJSON-1921935471 None] Lock "b'cinder-453214a7-66ea-4df2-bb71-f35aa118fee6-delete_volume'" acquired by "delete_volume" :: waited 0.013s {{(pid=134148) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 18 21:21:40.436674 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-f937c4cb-61f9-44ce-9539-557473d8c358 tempest-VolumesSnapshotTestJSON-1921935471 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:21:40.478234 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-f937c4cb-61f9-44ce-9539-557473d8c358 tempest-VolumesSnapshotTestJSON-1921935471 None] volume has no backup snaps {{(pid=134148) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Dec 18 21:21:40.478728 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-f937c4cb-61f9-44ce-9539-557473d8c358 tempest-VolumesSnapshotTestJSON-1921935471 None] Volume volume-453214a7-66ea-4df2-bb71-f35aa118fee6 is not a clone. {{(pid=134148) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Dec 18 21:21:40.483837 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-f937c4cb-61f9-44ce-9539-557473d8c358 tempest-VolumesSnapshotTestJSON-1921935471 None] deleting rbd volume volume-453214a7-66ea-4df2-bb71-f35aa118fee6 {{(pid=134148) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Dec 18 21:21:40.688535 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.quota [None req-f937c4cb-61f9-44ce-9539-557473d8c358 tempest-VolumesSnapshotTestJSON-1921935471 None] Created reservations ['0b84d7be-6800-496a-aaef-55d3a56ba00c', '3fa882be-c4bc-4f59-8083-d4b7d4dfeea7', 'fa9e2d61-6b4f-4511-9948-17d17476bc08', 'dd09d2cc-bef9-45eb-9e74-181180134b4e'] {{(pid=134148) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 18 21:21:40.727494 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-f937c4cb-61f9-44ce-9539-557473d8c358 tempest-VolumesSnapshotTestJSON-1921935471 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:21:40.751509 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-f937c4cb-61f9-44ce-9539-557473d8c358 tempest-VolumesSnapshotTestJSON-1921935471 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:21:40.774376 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.manager [None req-f937c4cb-61f9-44ce-9539-557473d8c358 tempest-VolumesSnapshotTestJSON-1921935471 None] Notifying Schedulers of capabilities ... {{(pid=134148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 18 21:21:40.778232 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-f937c4cb-61f9-44ce-9539-557473d8c358 tempest-VolumesSnapshotTestJSON-1921935471 None] Deleted volume successfully. Dec 18 21:21:40.789468 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.coordination [None req-f937c4cb-61f9-44ce-9539-557473d8c358 tempest-VolumesSnapshotTestJSON-1921935471 None] Lock "b'cinder-453214a7-66ea-4df2-bb71-f35aa118fee6-delete_volume'" released by "delete_volume" :: held 0.399s {{(pid=134148) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 18 21:21:43.467539 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.flows.manager.create_volume [None req-19befbc0-969a-4497-80d1-d2ccce987a99 tempest-VolumesSnapshotNegativeTestJSON-1248568305 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134148) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Dec 18 21:21:43.470629 ncdv-master-1 cinder-volume[134148]: WARNING stevedore.named [None req-19befbc0-969a-4497-80d1-d2ccce987a99 tempest-VolumesSnapshotNegativeTestJSON-1248568305 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Dec 18 21:21:43.471070 ncdv-master-1 cinder-volume[134148]: WARNING castellan.key_manager [None req-19befbc0-969a-4497-80d1-d2ccce987a99 tempest-VolumesSnapshotNegativeTestJSON-1248568305 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Dec 18 21:21:43.483557 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-19befbc0-969a-4497-80d1-d2ccce987a99 tempest-VolumesSnapshotNegativeTestJSON-1248568305 None] Flow 'volume_create_manager' (7d8b553b-28f3-477d-be61-fc364069aa73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 18 21:21:43.487142 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-19befbc0-969a-4497-80d1-d2ccce987a99 tempest-VolumesSnapshotNegativeTestJSON-1248568305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2392cdf6-c16e-4ef7-8aff-5d4c69f35241) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:21:43.495603 ncdv-master-1 cinder-volume[134148]: DEBUG oslo_db.sqlalchemy.engines [None req-19befbc0-969a-4497-80d1-d2ccce987a99 tempest-VolumesSnapshotNegativeTestJSON-1248568305 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134148) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 18 21:21:43.507875 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-19befbc0-969a-4497-80d1-d2ccce987a99 tempest-VolumesSnapshotNegativeTestJSON-1248568305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2392cdf6-c16e-4ef7-8aff-5d4c69f35241) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-12-18T21:21:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1166617000',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=af0b8ae5-6f56-4c2c-9a5d-d0d2b73d9a5a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2d587b9df89484f91c65e226aed736e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-12-18T21:21:43Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-12-18T21:21:43Z,use_quota=True,user_id='0393506d7e8140b2aa49a1d0508a617a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f2e1fe1-9fd6-411e-9ed9-368f463ccb6f),volume_type_id=1f2e1fe1-9fd6-411e-9ed9-368f463ccb6f)' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:21:43.511093 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-19befbc0-969a-4497-80d1-d2ccce987a99 tempest-VolumesSnapshotNegativeTestJSON-1248568305 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7427f66f-7700-4211-8cfb-f7011e889d4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:21:43.513216 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-19befbc0-969a-4497-80d1-d2ccce987a99 tempest-VolumesSnapshotNegativeTestJSON-1248568305 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7427f66f-7700-4211-8cfb-f7011e889d4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:21:43.515634 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-19befbc0-969a-4497-80d1-d2ccce987a99 tempest-VolumesSnapshotNegativeTestJSON-1248568305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c2e28b6-2958-4f03-8621-b768986653c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:21:43.517832 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-19befbc0-969a-4497-80d1-d2ccce987a99 tempest-VolumesSnapshotNegativeTestJSON-1248568305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c2e28b6-2958-4f03-8621-b768986653c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'af0b8ae5-6f56-4c2c-9a5d-d0d2b73d9a5a', 'volume_name': 'volume-af0b8ae5-6f56-4c2c-9a5d-d0d2b73d9a5a', 'volume_size': 2}' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:21:43.520149 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-19befbc0-969a-4497-80d1-d2ccce987a99 tempest-VolumesSnapshotNegativeTestJSON-1248568305 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d116d25d-379f-4c10-9bfa-2d91e11aa7f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:21:43.522236 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-19befbc0-969a-4497-80d1-d2ccce987a99 tempest-VolumesSnapshotNegativeTestJSON-1248568305 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d116d25d-379f-4c10-9bfa-2d91e11aa7f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:21:43.524430 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-19befbc0-969a-4497-80d1-d2ccce987a99 tempest-VolumesSnapshotNegativeTestJSON-1248568305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1615e2a-27c3-4e30-b4f0-fb4c44ffb6c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:21:43.525202 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.flows.manager.create_volume [None req-19befbc0-969a-4497-80d1-d2ccce987a99 tempest-VolumesSnapshotNegativeTestJSON-1248568305 None] Volume af0b8ae5-6f56-4c2c-9a5d-d0d2b73d9a5a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-af0b8ae5-6f56-4c2c-9a5d-d0d2b73d9a5a', 'volume_size': 2} Dec 18 21:21:43.525585 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-19befbc0-969a-4497-80d1-d2ccce987a99 tempest-VolumesSnapshotNegativeTestJSON-1248568305 None] creating volume 'volume-af0b8ae5-6f56-4c2c-9a5d-d0d2b73d9a5a' {{(pid=134148) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Dec 18 21:21:43.526672 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-19befbc0-969a-4497-80d1-d2ccce987a99 tempest-VolumesSnapshotNegativeTestJSON-1248568305 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:21:43.578679 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-19befbc0-969a-4497-80d1-d2ccce987a99 tempest-VolumesSnapshotNegativeTestJSON-1248568305 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134148) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 18 21:21:43.578980 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-19befbc0-969a-4497-80d1-d2ccce987a99 tempest-VolumesSnapshotNegativeTestJSON-1248568305 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134148) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 18 21:21:43.581005 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-19befbc0-969a-4497-80d1-d2ccce987a99 tempest-VolumesSnapshotNegativeTestJSON-1248568305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1615e2a-27c3-4e30-b4f0-fb4c44ffb6c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-af0b8ae5-6f56-4c2c-9a5d-d0d2b73d9a5a', 'volume_size': 2}' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:21:43.583203 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-19befbc0-969a-4497-80d1-d2ccce987a99 tempest-VolumesSnapshotNegativeTestJSON-1248568305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c299816-c129-4680-bd98-6d99ea9f3ede) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:21:43.591548 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.flows.manager.create_volume [None req-19befbc0-969a-4497-80d1-d2ccce987a99 tempest-VolumesSnapshotNegativeTestJSON-1248568305 None] Volume volume-af0b8ae5-6f56-4c2c-9a5d-d0d2b73d9a5a (af0b8ae5-6f56-4c2c-9a5d-d0d2b73d9a5a): created successfully Dec 18 21:21:43.593431 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-19befbc0-969a-4497-80d1-d2ccce987a99 tempest-VolumesSnapshotNegativeTestJSON-1248568305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c299816-c129-4680-bd98-6d99ea9f3ede) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:21:43.596444 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-19befbc0-969a-4497-80d1-d2ccce987a99 tempest-VolumesSnapshotNegativeTestJSON-1248568305 None] Flow 'volume_create_manager' (7d8b553b-28f3-477d-be61-fc364069aa73) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134148) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 18 21:21:43.603954 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-19befbc0-969a-4497-80d1-d2ccce987a99 tempest-VolumesSnapshotNegativeTestJSON-1248568305 None] Created volume successfully. Dec 18 21:21:44.654204 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-7b6b82c5-a3f1-44ec-9759-24217cd2e2d2 tempest-VolumesSnapshotNegativeTestJSON-1248568305 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:21:44.964640 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-7b6b82c5-a3f1-44ec-9759-24217cd2e2d2 tempest-VolumesSnapshotNegativeTestJSON-1248568305 None] Create snapshot completed successfully Dec 18 21:21:45.771605 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.coordination [None req-bf6cc82f-9feb-46bf-bab2-59b2b537e918 tempest-VolumesSnapshotNegativeTestJSON-1248568305 None] Lock "b'cinder-e0a47a73-1dac-4ba9-9426-4846d8b93ccd-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.009s {{(pid=134148) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 18 21:21:45.772966 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-bf6cc82f-9feb-46bf-bab2-59b2b537e918 tempest-VolumesSnapshotNegativeTestJSON-1248568305 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:21:45.994579 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.quota [None req-bf6cc82f-9feb-46bf-bab2-59b2b537e918 tempest-VolumesSnapshotNegativeTestJSON-1248568305 None] Created reservations ['0738f2af-12da-4c3b-820e-36743a6aabaa', '1b3ddd23-5722-4e79-9288-c420f4131159', '2d48cf0f-86cd-4a9a-a4da-9604997c67c7', 'b3539a33-76ea-4006-bc6e-833c45b05211'] {{(pid=134148) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 18 21:21:46.026591 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-bf6cc82f-9feb-46bf-bab2-59b2b537e918 tempest-VolumesSnapshotNegativeTestJSON-1248568305 None] Delete snapshot completed successfully. Dec 18 21:21:46.030955 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.coordination [None req-bf6cc82f-9feb-46bf-bab2-59b2b537e918 tempest-VolumesSnapshotNegativeTestJSON-1248568305 None] Lock "b'cinder-e0a47a73-1dac-4ba9-9426-4846d8b93ccd-delete_snapshot'" released by "delete_snapshot" :: held 0.259s {{(pid=134148) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 18 21:21:46.865417 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.coordination [None req-2cf5e74b-09f5-4ffa-b1ca-eb3c0e1d002f tempest-VolumesSnapshotNegativeTestJSON-1248568305 None] Lock "b'cinder-af0b8ae5-6f56-4c2c-9a5d-d0d2b73d9a5a-delete_volume'" acquired by "delete_volume" :: waited 0.009s {{(pid=134148) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 18 21:21:46.896651 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-2cf5e74b-09f5-4ffa-b1ca-eb3c0e1d002f tempest-VolumesSnapshotNegativeTestJSON-1248568305 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:21:46.940836 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-2cf5e74b-09f5-4ffa-b1ca-eb3c0e1d002f tempest-VolumesSnapshotNegativeTestJSON-1248568305 None] volume has no backup snaps {{(pid=134148) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Dec 18 21:21:46.941260 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-2cf5e74b-09f5-4ffa-b1ca-eb3c0e1d002f tempest-VolumesSnapshotNegativeTestJSON-1248568305 None] Volume volume-af0b8ae5-6f56-4c2c-9a5d-d0d2b73d9a5a is not a clone. {{(pid=134148) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Dec 18 21:21:46.945839 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-2cf5e74b-09f5-4ffa-b1ca-eb3c0e1d002f tempest-VolumesSnapshotNegativeTestJSON-1248568305 None] deleting rbd volume volume-af0b8ae5-6f56-4c2c-9a5d-d0d2b73d9a5a {{(pid=134148) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Dec 18 21:21:47.149705 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.quota [None req-2cf5e74b-09f5-4ffa-b1ca-eb3c0e1d002f tempest-VolumesSnapshotNegativeTestJSON-1248568305 None] Created reservations ['bf1075e3-0568-47e5-99b0-e4fa46a7c617', 'd165af64-17d3-4478-8b78-25e13b14bece', 'dcd652f4-69f9-4e26-9942-e9be3fcd907e', '2bde9815-b7dd-4c5e-9762-0a9995330c9f'] {{(pid=134148) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 18 21:21:47.188060 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-2cf5e74b-09f5-4ffa-b1ca-eb3c0e1d002f tempest-VolumesSnapshotNegativeTestJSON-1248568305 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:21:47.210404 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-2cf5e74b-09f5-4ffa-b1ca-eb3c0e1d002f tempest-VolumesSnapshotNegativeTestJSON-1248568305 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:21:47.235288 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.manager [None req-2cf5e74b-09f5-4ffa-b1ca-eb3c0e1d002f tempest-VolumesSnapshotNegativeTestJSON-1248568305 None] Notifying Schedulers of capabilities ... {{(pid=134148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 18 21:21:47.239200 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-2cf5e74b-09f5-4ffa-b1ca-eb3c0e1d002f tempest-VolumesSnapshotNegativeTestJSON-1248568305 None] Deleted volume successfully. Dec 18 21:21:47.250788 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.coordination [None req-2cf5e74b-09f5-4ffa-b1ca-eb3c0e1d002f tempest-VolumesSnapshotNegativeTestJSON-1248568305 None] Lock "b'cinder-af0b8ae5-6f56-4c2c-9a5d-d0d2b73d9a5a-delete_volume'" released by "delete_volume" :: held 0.385s {{(pid=134148) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 18 21:22:34.359826 ncdv-master-1 cinder-volume[134148]: DEBUG oslo_service.periodic_task [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134148) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Dec 18 21:22:34.360467 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:22:34.381437 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:22:34.403580 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.manager [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] Notifying Schedulers of capabilities ... {{(pid=134148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 18 21:24:34.358828 ncdv-master-1 cinder-volume[134148]: DEBUG oslo_service.periodic_task [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134148) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Dec 18 21:24:34.359475 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:24:34.381459 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:24:34.403216 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.manager [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] Notifying Schedulers of capabilities ... {{(pid=134148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 18 21:25:34.358054 ncdv-master-1 cinder-volume[134148]: DEBUG oslo_service.periodic_task [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134148) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Dec 18 21:25:34.358786 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:25:34.381372 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:25:34.402745 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.manager [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] Notifying Schedulers of capabilities ... {{(pid=134148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 18 21:26:34.357297 ncdv-master-1 cinder-volume[134148]: DEBUG oslo_service.periodic_task [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134148) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Dec 18 21:26:34.358000 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:26:34.379796 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:26:34.402540 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.manager [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] Notifying Schedulers of capabilities ... {{(pid=134148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 18 21:27:34.357309 ncdv-master-1 cinder-volume[134148]: DEBUG oslo_service.periodic_task [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134148) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Dec 18 21:27:34.357950 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:27:34.379235 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:27:34.400819 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.manager [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] Notifying Schedulers of capabilities ... {{(pid=134148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 18 21:28:34.355555 ncdv-master-1 cinder-volume[134148]: DEBUG oslo_service.periodic_task [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134148) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Dec 18 21:28:34.356178 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:28:34.377313 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:28:34.399318 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.manager [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] Notifying Schedulers of capabilities ... {{(pid=134148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 18 21:29:34.353617 ncdv-master-1 cinder-volume[134148]: DEBUG oslo_service.periodic_task [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134148) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Dec 18 21:29:34.354353 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:29:34.377493 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:29:34.399166 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.manager [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] Notifying Schedulers of capabilities ... {{(pid=134148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 18 21:30:34.355118 ncdv-master-1 cinder-volume[134148]: DEBUG oslo_service.periodic_task [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134148) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Dec 18 21:30:34.355625 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:30:34.378214 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:30:34.402507 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.manager [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] Notifying Schedulers of capabilities ... {{(pid=134148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 18 21:31:34.357250 ncdv-master-1 cinder-volume[134148]: DEBUG oslo_service.periodic_task [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134148) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Dec 18 21:31:34.357878 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:31:34.381326 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:31:34.405437 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.manager [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] Notifying Schedulers of capabilities ... {{(pid=134148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 18 21:32:34.361918 ncdv-master-1 cinder-volume[134148]: DEBUG oslo_service.periodic_task [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134148) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Dec 18 21:32:34.362702 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:32:34.394012 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:32:34.419111 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.manager [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] Notifying Schedulers of capabilities ... {{(pid=134148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 18 21:33:34.364128 ncdv-master-1 cinder-volume[134148]: DEBUG oslo_service.periodic_task [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134148) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Dec 18 21:33:34.364798 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:33:34.385789 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:33:34.408403 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.manager [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] Notifying Schedulers of capabilities ... {{(pid=134148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 18 21:34:34.362995 ncdv-master-1 cinder-volume[134148]: DEBUG oslo_service.periodic_task [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134148) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Dec 18 21:34:34.363636 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:34:34.386933 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:34:34.408352 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.manager [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] Notifying Schedulers of capabilities ... {{(pid=134148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 18 21:35:34.362580 ncdv-master-1 cinder-volume[134148]: DEBUG oslo_service.periodic_task [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134148) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Dec 18 21:35:34.363224 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:35:34.384978 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:35:34.406820 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.manager [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] Notifying Schedulers of capabilities ... {{(pid=134148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 18 21:36:34.362938 ncdv-master-1 cinder-volume[134148]: DEBUG oslo_service.periodic_task [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134148) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Dec 18 21:36:34.363582 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:36:34.385602 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:36:34.406680 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.manager [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] Notifying Schedulers of capabilities ... {{(pid=134148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 18 21:37:34.364278 ncdv-master-1 cinder-volume[134148]: DEBUG oslo_service.periodic_task [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134148) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Dec 18 21:37:34.365002 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:37:34.392793 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:37:34.421458 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.manager [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] Notifying Schedulers of capabilities ... {{(pid=134148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 18 21:38:34.367781 ncdv-master-1 cinder-volume[134148]: DEBUG oslo_service.periodic_task [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134148) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Dec 18 21:38:34.368457 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:38:34.389780 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:38:34.411720 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.manager [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] Notifying Schedulers of capabilities ... {{(pid=134148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 18 21:39:34.366952 ncdv-master-1 cinder-volume[134148]: DEBUG oslo_service.periodic_task [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134148) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Dec 18 21:39:34.367599 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:39:34.389183 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:39:34.410976 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.manager [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] Notifying Schedulers of capabilities ... {{(pid=134148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 18 21:40:34.366967 ncdv-master-1 cinder-volume[134148]: DEBUG oslo_service.periodic_task [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134148) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Dec 18 21:40:34.367653 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:40:34.389616 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:40:34.411488 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.manager [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] Notifying Schedulers of capabilities ... {{(pid=134148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 18 21:41:34.368308 ncdv-master-1 cinder-volume[134148]: DEBUG oslo_service.periodic_task [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134148) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Dec 18 21:41:34.369038 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:41:34.391331 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:41:34.413323 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.manager [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] Notifying Schedulers of capabilities ... {{(pid=134148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 18 21:41:43.503630 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.flows.manager.create_volume [None req-bd423e4a-5e46-415b-830b-0da368ac74ba tempest-ServerActionsTestJSON-1912105552 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134148) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Dec 18 21:41:43.506781 ncdv-master-1 cinder-volume[134148]: WARNING stevedore.named [None req-bd423e4a-5e46-415b-830b-0da368ac74ba tempest-ServerActionsTestJSON-1912105552 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Dec 18 21:41:43.507218 ncdv-master-1 cinder-volume[134148]: WARNING castellan.key_manager [None req-bd423e4a-5e46-415b-830b-0da368ac74ba tempest-ServerActionsTestJSON-1912105552 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Dec 18 21:41:43.518663 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-bd423e4a-5e46-415b-830b-0da368ac74ba tempest-ServerActionsTestJSON-1912105552 None] Flow 'volume_create_manager' (598e459b-d3b6-428a-b237-13c0a69f196e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 18 21:41:43.522033 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-bd423e4a-5e46-415b-830b-0da368ac74ba tempest-ServerActionsTestJSON-1912105552 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7362e489-9848-460f-bb33-83bf5e6d71b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:41:43.529268 ncdv-master-1 cinder-volume[134148]: DEBUG oslo_db.sqlalchemy.engines [None req-bd423e4a-5e46-415b-830b-0da368ac74ba tempest-ServerActionsTestJSON-1912105552 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134148) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 18 21:41:43.543250 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-bd423e4a-5e46-415b-830b-0da368ac74ba tempest-ServerActionsTestJSON-1912105552 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7362e489-9848-460f-bb33-83bf5e6d71b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-12-18T21:41:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestJSON-volume-1839499738',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=98550aac-23e9-4b06-bdb9-4688641ed7d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='542852f38d9b4ee7a351cc80abbd3d19',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-12-18T21:41:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-12-18T21:41:43Z,use_quota=True,user_id='8ad7185a2f28494a95c01e273e6f7212',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f2e1fe1-9fd6-411e-9ed9-368f463ccb6f),volume_type_id=1f2e1fe1-9fd6-411e-9ed9-368f463ccb6f)' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:41:43.545809 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-bd423e4a-5e46-415b-830b-0da368ac74ba tempest-ServerActionsTestJSON-1912105552 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f0e7f63-1f86-4626-b49e-d4d550ca6080) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:41:43.547970 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-bd423e4a-5e46-415b-830b-0da368ac74ba tempest-ServerActionsTestJSON-1912105552 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f0e7f63-1f86-4626-b49e-d4d550ca6080) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:41:43.550374 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-bd423e4a-5e46-415b-830b-0da368ac74ba tempest-ServerActionsTestJSON-1912105552 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc5f4b70-1c34-4b3e-8500-273dccc24814) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:41:43.552584 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-bd423e4a-5e46-415b-830b-0da368ac74ba tempest-ServerActionsTestJSON-1912105552 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc5f4b70-1c34-4b3e-8500-273dccc24814) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '98550aac-23e9-4b06-bdb9-4688641ed7d0', 'volume_name': 'volume-98550aac-23e9-4b06-bdb9-4688641ed7d0', 'volume_size': 1}' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:41:43.554903 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-bd423e4a-5e46-415b-830b-0da368ac74ba tempest-ServerActionsTestJSON-1912105552 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37b6337a-7634-4af8-bc16-2201bbdc980a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:41:43.557682 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-bd423e4a-5e46-415b-830b-0da368ac74ba tempest-ServerActionsTestJSON-1912105552 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37b6337a-7634-4af8-bc16-2201bbdc980a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:41:43.559916 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-bd423e4a-5e46-415b-830b-0da368ac74ba tempest-ServerActionsTestJSON-1912105552 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f8034b6-d48c-4af6-904f-98e3c1b92390) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:41:43.561264 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.flows.manager.create_volume [None req-bd423e4a-5e46-415b-830b-0da368ac74ba tempest-ServerActionsTestJSON-1912105552 None] Volume 98550aac-23e9-4b06-bdb9-4688641ed7d0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-98550aac-23e9-4b06-bdb9-4688641ed7d0', 'volume_size': 1} Dec 18 21:41:43.561264 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-bd423e4a-5e46-415b-830b-0da368ac74ba tempest-ServerActionsTestJSON-1912105552 None] creating volume 'volume-98550aac-23e9-4b06-bdb9-4688641ed7d0' {{(pid=134148) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Dec 18 21:41:43.561972 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-bd423e4a-5e46-415b-830b-0da368ac74ba tempest-ServerActionsTestJSON-1912105552 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:41:43.610086 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-bd423e4a-5e46-415b-830b-0da368ac74ba tempest-ServerActionsTestJSON-1912105552 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134148) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 18 21:41:43.610486 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-bd423e4a-5e46-415b-830b-0da368ac74ba tempest-ServerActionsTestJSON-1912105552 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134148) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 18 21:41:43.612469 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-bd423e4a-5e46-415b-830b-0da368ac74ba tempest-ServerActionsTestJSON-1912105552 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f8034b6-d48c-4af6-904f-98e3c1b92390) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-98550aac-23e9-4b06-bdb9-4688641ed7d0', 'volume_size': 1}' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:41:43.614684 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-bd423e4a-5e46-415b-830b-0da368ac74ba tempest-ServerActionsTestJSON-1912105552 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a156d17-bec1-47cc-a61a-26036b43e722) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:41:43.623258 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.flows.manager.create_volume [None req-bd423e4a-5e46-415b-830b-0da368ac74ba tempest-ServerActionsTestJSON-1912105552 None] Volume volume-98550aac-23e9-4b06-bdb9-4688641ed7d0 (98550aac-23e9-4b06-bdb9-4688641ed7d0): created successfully Dec 18 21:41:43.625065 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-bd423e4a-5e46-415b-830b-0da368ac74ba tempest-ServerActionsTestJSON-1912105552 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a156d17-bec1-47cc-a61a-26036b43e722) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:41:43.627988 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-bd423e4a-5e46-415b-830b-0da368ac74ba tempest-ServerActionsTestJSON-1912105552 None] Flow 'volume_create_manager' (598e459b-d3b6-428a-b237-13c0a69f196e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134148) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 18 21:41:43.635122 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-bd423e4a-5e46-415b-830b-0da368ac74ba tempest-ServerActionsTestJSON-1912105552 None] Created volume successfully. Dec 18 21:41:45.362468 ncdv-master-1 cinder-volume[134148]: DEBUG oslo_concurrency.processutils [req-d2e8f999-645e-4173-bf4e-b6ba705c16a2 req-cda67c13-3f30-43b4-a542-11c5110a8ce6 tempest-ServerActionsTestJSON-1912105552 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=134148) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Dec 18 21:41:46.067011 ncdv-master-1 cinder-volume[134148]: DEBUG oslo_concurrency.processutils [req-d2e8f999-645e-4173-bf4e-b6ba705c16a2 req-cda67c13-3f30-43b4-a542-11c5110a8ce6 tempest-ServerActionsTestJSON-1912105552 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.704s {{(pid=134148) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Dec 18 21:41:46.067812 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [req-d2e8f999-645e-4173-bf4e-b6ba705c16a2 req-cda67c13-3f30-43b4-a542-11c5110a8ce6 tempest-ServerActionsTestJSON-1912105552 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-98550aac-23e9-4b06-bdb9-4688641ed7d0', 'hosts': ['10.222.0.13'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '946d1715-d12c-4dbf-8a79-181222df6e2e', 'volume_id': '98550aac-23e9-4b06-bdb9-4688641ed7d0', 'discard': True}} {{(pid=134148) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Dec 18 21:41:46.090764 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [req-d2e8f999-645e-4173-bf4e-b6ba705c16a2 req-cda67c13-3f30-43b4-a542-11c5110a8ce6 tempest-ServerActionsTestJSON-1912105552 None] Connection info returned from driver {'name': 'volumes/volume-98550aac-23e9-4b06-bdb9-4688641ed7d0', 'hosts': ['10.222.0.13'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '98550aac-23e9-4b06-bdb9-4688641ed7d0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '9d22a944-0bfc-4f51-9511-502e8de0dcb0'} {{(pid=134148) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4812}} Dec 18 21:41:46.134374 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [req-d2e8f999-645e-4173-bf4e-b6ba705c16a2 req-cda67c13-3f30-43b4-a542-11c5110a8ce6 tempest-ServerActionsTestJSON-1912105552 None] attachment_update completed successfully. Dec 18 21:42:02.870012 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [req-f39b73ea-47cb-4307-a8b6-acbfad4ea13b req-bc5682e3-f8b1-4a2f-ab7e-e8361d5d9c07 tempest-ServerActionsTestJSON-1912105552 None] Terminate volume connection completed successfully. Dec 18 21:42:02.870675 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [req-f39b73ea-47cb-4307-a8b6-acbfad4ea13b req-bc5682e3-f8b1-4a2f-ab7e-e8361d5d9c07 tempest-ServerActionsTestJSON-1912105552 None] Deleting attachment 9d22a944-0bfc-4f51-9511-502e8de0dcb0. {{(pid=134148) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4948}} Dec 18 21:42:05.110171 ncdv-master-1 cinder-volume[134148]: DEBUG oslo_concurrency.processutils [req-f39b73ea-47cb-4307-a8b6-acbfad4ea13b req-8b6f1649-0bad-48f9-92d1-eaeeac72548a tempest-ServerActionsTestJSON-1912105552 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=134148) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Dec 18 21:42:05.757816 ncdv-master-1 cinder-volume[134148]: DEBUG oslo_concurrency.processutils [req-f39b73ea-47cb-4307-a8b6-acbfad4ea13b req-8b6f1649-0bad-48f9-92d1-eaeeac72548a tempest-ServerActionsTestJSON-1912105552 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.647s {{(pid=134148) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Dec 18 21:42:05.759232 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [req-f39b73ea-47cb-4307-a8b6-acbfad4ea13b req-8b6f1649-0bad-48f9-92d1-eaeeac72548a tempest-ServerActionsTestJSON-1912105552 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-98550aac-23e9-4b06-bdb9-4688641ed7d0', 'hosts': ['10.222.0.13'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '946d1715-d12c-4dbf-8a79-181222df6e2e', 'volume_id': '98550aac-23e9-4b06-bdb9-4688641ed7d0', 'discard': True}} {{(pid=134148) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Dec 18 21:42:05.781748 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [req-f39b73ea-47cb-4307-a8b6-acbfad4ea13b req-8b6f1649-0bad-48f9-92d1-eaeeac72548a tempest-ServerActionsTestJSON-1912105552 None] Connection info returned from driver {'name': 'volumes/volume-98550aac-23e9-4b06-bdb9-4688641ed7d0', 'hosts': ['10.222.0.13'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '98550aac-23e9-4b06-bdb9-4688641ed7d0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '029365b8-ca65-463c-9af1-74bb8a1cabd4'} {{(pid=134148) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4812}} Dec 18 21:42:05.825560 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [req-f39b73ea-47cb-4307-a8b6-acbfad4ea13b req-8b6f1649-0bad-48f9-92d1-eaeeac72548a tempest-ServerActionsTestJSON-1912105552 None] attachment_update completed successfully. Dec 18 21:42:13.106622 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [req-ac6cb6a0-e482-4593-a2b9-e3be9c6f53ae req-f15d0c22-494c-40ef-8a4e-269ebe082e4b tempest-ServerActionsTestJSON-1912105552 None] Terminate volume connection completed successfully. Dec 18 21:42:13.107243 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [req-ac6cb6a0-e482-4593-a2b9-e3be9c6f53ae req-f15d0c22-494c-40ef-8a4e-269ebe082e4b tempest-ServerActionsTestJSON-1912105552 None] Deleting attachment 029365b8-ca65-463c-9af1-74bb8a1cabd4. {{(pid=134148) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4948}} Dec 18 21:42:15.270429 ncdv-master-1 cinder-volume[134148]: DEBUG oslo_concurrency.processutils [req-ac6cb6a0-e482-4593-a2b9-e3be9c6f53ae req-c119e2ac-232a-4af4-873e-941d700bcc12 tempest-ServerActionsTestJSON-1912105552 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=134148) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Dec 18 21:42:15.905505 ncdv-master-1 cinder-volume[134148]: DEBUG oslo_concurrency.processutils [req-ac6cb6a0-e482-4593-a2b9-e3be9c6f53ae req-c119e2ac-232a-4af4-873e-941d700bcc12 tempest-ServerActionsTestJSON-1912105552 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.635s {{(pid=134148) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Dec 18 21:42:15.906378 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [req-ac6cb6a0-e482-4593-a2b9-e3be9c6f53ae req-c119e2ac-232a-4af4-873e-941d700bcc12 tempest-ServerActionsTestJSON-1912105552 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-98550aac-23e9-4b06-bdb9-4688641ed7d0', 'hosts': ['10.222.0.13'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '946d1715-d12c-4dbf-8a79-181222df6e2e', 'volume_id': '98550aac-23e9-4b06-bdb9-4688641ed7d0', 'discard': True}} {{(pid=134148) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Dec 18 21:42:15.928258 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [req-ac6cb6a0-e482-4593-a2b9-e3be9c6f53ae req-c119e2ac-232a-4af4-873e-941d700bcc12 tempest-ServerActionsTestJSON-1912105552 None] Connection info returned from driver {'name': 'volumes/volume-98550aac-23e9-4b06-bdb9-4688641ed7d0', 'hosts': ['10.222.0.13'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '98550aac-23e9-4b06-bdb9-4688641ed7d0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'e0ce2ecc-9203-4c23-aa78-72e677d54357'} {{(pid=134148) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4812}} Dec 18 21:42:15.971670 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [req-ac6cb6a0-e482-4593-a2b9-e3be9c6f53ae req-c119e2ac-232a-4af4-873e-941d700bcc12 tempest-ServerActionsTestJSON-1912105552 None] attachment_update completed successfully. Dec 18 21:42:21.761289 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [req-25f5fe99-489b-47e2-9040-fc0491ed6bbd req-5e7eb0b4-5e09-4d24-8d89-29b30914cfdf tempest-ServerActionsTestJSON-1912105552 None] Terminate volume connection completed successfully. Dec 18 21:42:21.761973 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [req-25f5fe99-489b-47e2-9040-fc0491ed6bbd req-5e7eb0b4-5e09-4d24-8d89-29b30914cfdf tempest-ServerActionsTestJSON-1912105552 None] Deleting attachment e0ce2ecc-9203-4c23-aa78-72e677d54357. {{(pid=134148) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4948}} Dec 18 21:42:22.964357 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.coordination [None req-969cbdf6-774e-4223-a230-4017523f13b3 tempest-ServerActionsTestJSON-1912105552 None] Lock "b'cinder-98550aac-23e9-4b06-bdb9-4688641ed7d0-delete_volume'" acquired by "delete_volume" :: waited 0.010s {{(pid=134148) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 18 21:42:22.995223 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-969cbdf6-774e-4223-a230-4017523f13b3 tempest-ServerActionsTestJSON-1912105552 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:42:23.033966 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-969cbdf6-774e-4223-a230-4017523f13b3 tempest-ServerActionsTestJSON-1912105552 None] volume has no backup snaps {{(pid=134148) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Dec 18 21:42:23.034444 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-969cbdf6-774e-4223-a230-4017523f13b3 tempest-ServerActionsTestJSON-1912105552 None] Volume volume-98550aac-23e9-4b06-bdb9-4688641ed7d0 is not a clone. {{(pid=134148) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Dec 18 21:42:23.039592 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-969cbdf6-774e-4223-a230-4017523f13b3 tempest-ServerActionsTestJSON-1912105552 None] deleting rbd volume volume-98550aac-23e9-4b06-bdb9-4688641ed7d0 {{(pid=134148) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Dec 18 21:42:23.236272 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.quota [None req-969cbdf6-774e-4223-a230-4017523f13b3 tempest-ServerActionsTestJSON-1912105552 None] Created reservations ['81262185-c421-4778-8aba-4b63b0f5808f', '17b7f50d-7c8a-4584-83a2-464dc971d230', 'a05032a0-85f5-4834-93c4-cb98266b23fa', '74f0f616-e855-4181-ad5f-099b38aaf1dc'] {{(pid=134148) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 18 21:42:23.274744 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-969cbdf6-774e-4223-a230-4017523f13b3 tempest-ServerActionsTestJSON-1912105552 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:42:23.296820 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-969cbdf6-774e-4223-a230-4017523f13b3 tempest-ServerActionsTestJSON-1912105552 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:42:23.322892 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.manager [None req-969cbdf6-774e-4223-a230-4017523f13b3 tempest-ServerActionsTestJSON-1912105552 None] Notifying Schedulers of capabilities ... {{(pid=134148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 18 21:42:23.328315 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-969cbdf6-774e-4223-a230-4017523f13b3 tempest-ServerActionsTestJSON-1912105552 None] Deleted volume successfully. Dec 18 21:42:23.340172 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.coordination [None req-969cbdf6-774e-4223-a230-4017523f13b3 tempest-ServerActionsTestJSON-1912105552 None] Lock "b'cinder-98550aac-23e9-4b06-bdb9-4688641ed7d0-delete_volume'" released by "delete_volume" :: held 0.376s {{(pid=134148) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 18 21:42:34.368469 ncdv-master-1 cinder-volume[134148]: DEBUG oslo_service.periodic_task [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134148) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Dec 18 21:42:34.369128 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:42:34.390896 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:42:34.413193 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.manager [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] Notifying Schedulers of capabilities ... {{(pid=134148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 18 21:43:34.370044 ncdv-master-1 cinder-volume[134148]: DEBUG oslo_service.periodic_task [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134148) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Dec 18 21:43:34.370781 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:43:34.408705 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:43:34.446597 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.manager [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] Notifying Schedulers of capabilities ... {{(pid=134148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 18 21:43:57.428965 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.flows.manager.create_volume [None req-68467a68-167d-4f28-a09a-e9ada111eaba tempest-TestMinimumBasicScenario-1655937233 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134148) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Dec 18 21:43:57.433162 ncdv-master-1 cinder-volume[134148]: WARNING stevedore.named [None req-68467a68-167d-4f28-a09a-e9ada111eaba tempest-TestMinimumBasicScenario-1655937233 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Dec 18 21:43:57.433685 ncdv-master-1 cinder-volume[134148]: WARNING castellan.key_manager [None req-68467a68-167d-4f28-a09a-e9ada111eaba tempest-TestMinimumBasicScenario-1655937233 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Dec 18 21:43:57.447002 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-68467a68-167d-4f28-a09a-e9ada111eaba tempest-TestMinimumBasicScenario-1655937233 None] Flow 'volume_create_manager' (bccea9b1-71a3-459d-9645-d0203cdf646d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 18 21:43:57.450313 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-68467a68-167d-4f28-a09a-e9ada111eaba tempest-TestMinimumBasicScenario-1655937233 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (decd3bd5-cb51-4d46-bf32-621ab4b09192) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:43:57.456751 ncdv-master-1 cinder-volume[134148]: DEBUG oslo_db.sqlalchemy.engines [None req-68467a68-167d-4f28-a09a-e9ada111eaba tempest-TestMinimumBasicScenario-1655937233 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134148) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 18 21:43:57.471285 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-68467a68-167d-4f28-a09a-e9ada111eaba tempest-TestMinimumBasicScenario-1655937233 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (decd3bd5-cb51-4d46-bf32-621ab4b09192) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-12-18T21:43:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1868372148',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=c57b6da4-a8a2-442b-b899-a74aef3b9e13,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fb1a66fd59be4793a6090985e8ae5998',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-12-18T21:43:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-12-18T21:43:57Z,use_quota=True,user_id='9ce8de7276144144a52e038b19adda07',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f2e1fe1-9fd6-411e-9ed9-368f463ccb6f),volume_type_id=1f2e1fe1-9fd6-411e-9ed9-368f463ccb6f)' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:43:57.473917 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-68467a68-167d-4f28-a09a-e9ada111eaba tempest-TestMinimumBasicScenario-1655937233 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b2920fe-4b18-4ec7-b8ee-afc4d65c8ef1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:43:57.476113 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-68467a68-167d-4f28-a09a-e9ada111eaba tempest-TestMinimumBasicScenario-1655937233 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b2920fe-4b18-4ec7-b8ee-afc4d65c8ef1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:43:57.478586 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-68467a68-167d-4f28-a09a-e9ada111eaba tempest-TestMinimumBasicScenario-1655937233 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad27db02-3ef8-4cad-9a1a-868e96954502) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:43:57.480822 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-68467a68-167d-4f28-a09a-e9ada111eaba tempest-TestMinimumBasicScenario-1655937233 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad27db02-3ef8-4cad-9a1a-868e96954502) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c57b6da4-a8a2-442b-b899-a74aef3b9e13', 'volume_name': 'volume-c57b6da4-a8a2-442b-b899-a74aef3b9e13', 'volume_size': 1}' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:43:57.483200 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-68467a68-167d-4f28-a09a-e9ada111eaba tempest-TestMinimumBasicScenario-1655937233 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b26b4b94-ac12-4612-a72f-b541960fd63b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:43:57.485295 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-68467a68-167d-4f28-a09a-e9ada111eaba tempest-TestMinimumBasicScenario-1655937233 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b26b4b94-ac12-4612-a72f-b541960fd63b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:43:57.487589 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-68467a68-167d-4f28-a09a-e9ada111eaba tempest-TestMinimumBasicScenario-1655937233 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f142b808-4437-449f-82c9-b1688b9cdeb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:43:57.488375 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.flows.manager.create_volume [None req-68467a68-167d-4f28-a09a-e9ada111eaba tempest-TestMinimumBasicScenario-1655937233 None] Volume c57b6da4-a8a2-442b-b899-a74aef3b9e13: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c57b6da4-a8a2-442b-b899-a74aef3b9e13', 'volume_size': 1} Dec 18 21:43:57.488766 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-68467a68-167d-4f28-a09a-e9ada111eaba tempest-TestMinimumBasicScenario-1655937233 None] creating volume 'volume-c57b6da4-a8a2-442b-b899-a74aef3b9e13' {{(pid=134148) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Dec 18 21:43:57.489707 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-68467a68-167d-4f28-a09a-e9ada111eaba tempest-TestMinimumBasicScenario-1655937233 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:43:57.547757 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-68467a68-167d-4f28-a09a-e9ada111eaba tempest-TestMinimumBasicScenario-1655937233 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134148) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 18 21:43:57.548126 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-68467a68-167d-4f28-a09a-e9ada111eaba tempest-TestMinimumBasicScenario-1655937233 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134148) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 18 21:43:57.550126 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-68467a68-167d-4f28-a09a-e9ada111eaba tempest-TestMinimumBasicScenario-1655937233 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f142b808-4437-449f-82c9-b1688b9cdeb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c57b6da4-a8a2-442b-b899-a74aef3b9e13', 'volume_size': 1}' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:43:57.552381 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-68467a68-167d-4f28-a09a-e9ada111eaba tempest-TestMinimumBasicScenario-1655937233 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aec7452f-dcd0-42f1-b54b-83bff1815512) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:43:57.560897 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.flows.manager.create_volume [None req-68467a68-167d-4f28-a09a-e9ada111eaba tempest-TestMinimumBasicScenario-1655937233 None] Volume volume-c57b6da4-a8a2-442b-b899-a74aef3b9e13 (c57b6da4-a8a2-442b-b899-a74aef3b9e13): created successfully Dec 18 21:43:57.562799 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-68467a68-167d-4f28-a09a-e9ada111eaba tempest-TestMinimumBasicScenario-1655937233 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aec7452f-dcd0-42f1-b54b-83bff1815512) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:43:57.565735 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-68467a68-167d-4f28-a09a-e9ada111eaba tempest-TestMinimumBasicScenario-1655937233 None] Flow 'volume_create_manager' (bccea9b1-71a3-459d-9645-d0203cdf646d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134148) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 18 21:43:57.573202 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-68467a68-167d-4f28-a09a-e9ada111eaba tempest-TestMinimumBasicScenario-1655937233 None] Created volume successfully. Dec 18 21:43:58.982132 ncdv-master-1 cinder-volume[134148]: DEBUG oslo_concurrency.processutils [req-4f8783f7-bfff-485f-b799-83e4b03b32f2 req-f2e7ac1d-ca45-4448-a445-6bdabf85fec0 tempest-TestMinimumBasicScenario-1655937233 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=134148) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Dec 18 21:43:59.616740 ncdv-master-1 cinder-volume[134148]: DEBUG oslo_concurrency.processutils [req-4f8783f7-bfff-485f-b799-83e4b03b32f2 req-f2e7ac1d-ca45-4448-a445-6bdabf85fec0 tempest-TestMinimumBasicScenario-1655937233 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.634s {{(pid=134148) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Dec 18 21:43:59.617541 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [req-4f8783f7-bfff-485f-b799-83e4b03b32f2 req-f2e7ac1d-ca45-4448-a445-6bdabf85fec0 tempest-TestMinimumBasicScenario-1655937233 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-c57b6da4-a8a2-442b-b899-a74aef3b9e13', 'hosts': ['10.222.0.13'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '946d1715-d12c-4dbf-8a79-181222df6e2e', 'volume_id': 'c57b6da4-a8a2-442b-b899-a74aef3b9e13', 'discard': True}} {{(pid=134148) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Dec 18 21:43:59.640408 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [req-4f8783f7-bfff-485f-b799-83e4b03b32f2 req-f2e7ac1d-ca45-4448-a445-6bdabf85fec0 tempest-TestMinimumBasicScenario-1655937233 None] Connection info returned from driver {'name': 'volumes/volume-c57b6da4-a8a2-442b-b899-a74aef3b9e13', 'hosts': ['10.222.0.13'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'c57b6da4-a8a2-442b-b899-a74aef3b9e13', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'cdbd730e-6cc2-45fb-ad5c-7b1f68ad65fe'} {{(pid=134148) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4812}} Dec 18 21:43:59.684330 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [req-4f8783f7-bfff-485f-b799-83e4b03b32f2 req-f2e7ac1d-ca45-4448-a445-6bdabf85fec0 tempest-TestMinimumBasicScenario-1655937233 None] attachment_update completed successfully. Dec 18 21:44:34.372422 ncdv-master-1 cinder-volume[134148]: DEBUG oslo_service.periodic_task [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134148) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Dec 18 21:44:34.373450 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:44:34.396443 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:44:34.419613 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.manager [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] Notifying Schedulers of capabilities ... {{(pid=134148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 18 21:45:21.877766 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [req-ea6efc5b-202e-49c1-92f1-1ca25473f45c req-820eb907-e484-42f6-8085-c18ba7fddaf0 tempest-TestMinimumBasicScenario-1655937233 None] Terminate volume connection completed successfully. Dec 18 21:45:21.878419 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [req-ea6efc5b-202e-49c1-92f1-1ca25473f45c req-820eb907-e484-42f6-8085-c18ba7fddaf0 tempest-TestMinimumBasicScenario-1655937233 None] Deleting attachment cdbd730e-6cc2-45fb-ad5c-7b1f68ad65fe. {{(pid=134148) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4948}} Dec 18 21:45:22.553022 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.coordination [None req-22c10d56-460c-4fc1-927a-b8bc32005956 tempest-TestMinimumBasicScenario-1655937233 None] Lock "b'cinder-c57b6da4-a8a2-442b-b899-a74aef3b9e13-delete_volume'" acquired by "delete_volume" :: waited 0.014s {{(pid=134148) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 18 21:45:22.586779 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-22c10d56-460c-4fc1-927a-b8bc32005956 tempest-TestMinimumBasicScenario-1655937233 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:45:22.630346 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-22c10d56-460c-4fc1-927a-b8bc32005956 tempest-TestMinimumBasicScenario-1655937233 None] volume has no backup snaps {{(pid=134148) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Dec 18 21:45:22.630708 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-22c10d56-460c-4fc1-927a-b8bc32005956 tempest-TestMinimumBasicScenario-1655937233 None] Volume volume-c57b6da4-a8a2-442b-b899-a74aef3b9e13 is not a clone. {{(pid=134148) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Dec 18 21:45:22.635548 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-22c10d56-460c-4fc1-927a-b8bc32005956 tempest-TestMinimumBasicScenario-1655937233 None] deleting rbd volume volume-c57b6da4-a8a2-442b-b899-a74aef3b9e13 {{(pid=134148) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Dec 18 21:45:22.842596 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.quota [None req-22c10d56-460c-4fc1-927a-b8bc32005956 tempest-TestMinimumBasicScenario-1655937233 None] Created reservations ['1ac0ff80-3ce3-495c-bd28-23d8c9621ac6', '07f894c5-2312-44fb-a10c-215d81403cba', 'd06ef1f5-061e-4125-9015-d55ccf1cc188', '07d09446-9491-4e14-8116-82c1617a27dc'] {{(pid=134148) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 18 21:45:22.902652 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-22c10d56-460c-4fc1-927a-b8bc32005956 tempest-TestMinimumBasicScenario-1655937233 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:45:22.925075 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-22c10d56-460c-4fc1-927a-b8bc32005956 tempest-TestMinimumBasicScenario-1655937233 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:45:22.947199 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.manager [None req-22c10d56-460c-4fc1-927a-b8bc32005956 tempest-TestMinimumBasicScenario-1655937233 None] Notifying Schedulers of capabilities ... {{(pid=134148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 18 21:45:22.951251 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-22c10d56-460c-4fc1-927a-b8bc32005956 tempest-TestMinimumBasicScenario-1655937233 None] Deleted volume successfully. Dec 18 21:45:22.963639 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.coordination [None req-22c10d56-460c-4fc1-927a-b8bc32005956 tempest-TestMinimumBasicScenario-1655937233 None] Lock "b'cinder-c57b6da4-a8a2-442b-b899-a74aef3b9e13-delete_volume'" released by "delete_volume" :: held 0.411s {{(pid=134148) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 18 21:45:34.374934 ncdv-master-1 cinder-volume[134148]: DEBUG oslo_service.periodic_task [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134148) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Dec 18 21:45:34.375583 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:45:34.402403 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:45:34.425371 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.manager [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] Notifying Schedulers of capabilities ... {{(pid=134148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 18 21:46:34.371858 ncdv-master-1 cinder-volume[134148]: DEBUG oslo_service.periodic_task [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134148) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Dec 18 21:46:34.372567 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:46:34.394370 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:46:34.416338 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.manager [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] Notifying Schedulers of capabilities ... {{(pid=134148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 18 21:47:34.371948 ncdv-master-1 cinder-volume[134148]: DEBUG oslo_service.periodic_task [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134148) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Dec 18 21:47:34.372587 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:47:34.394794 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:47:34.421331 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.manager [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] Notifying Schedulers of capabilities ... {{(pid=134148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 18 21:48:34.376820 ncdv-master-1 cinder-volume[134148]: DEBUG oslo_service.periodic_task [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134148) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Dec 18 21:48:34.377465 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:48:34.398847 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:48:34.420553 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.manager [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] Notifying Schedulers of capabilities ... {{(pid=134148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 18 21:49:34.376160 ncdv-master-1 cinder-volume[134148]: DEBUG oslo_service.periodic_task [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134148) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Dec 18 21:49:34.376800 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:49:34.398194 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:49:34.422031 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.manager [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] Notifying Schedulers of capabilities ... {{(pid=134148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 18 21:50:34.380085 ncdv-master-1 cinder-volume[134148]: DEBUG oslo_service.periodic_task [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134148) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Dec 18 21:50:34.380736 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:50:34.401812 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:50:34.423128 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.manager [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] Notifying Schedulers of capabilities ... {{(pid=134148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 18 21:51:34.378950 ncdv-master-1 cinder-volume[134148]: DEBUG oslo_service.periodic_task [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134148) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Dec 18 21:51:34.379641 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:51:34.401634 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:51:34.423408 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.manager [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] Notifying Schedulers of capabilities ... {{(pid=134148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 18 21:52:34.379418 ncdv-master-1 cinder-volume[134148]: DEBUG oslo_service.periodic_task [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134148) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Dec 18 21:52:34.380118 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:52:34.401371 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:52:34.423376 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.manager [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] Notifying Schedulers of capabilities ... {{(pid=134148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 18 21:53:34.381309 ncdv-master-1 cinder-volume[134148]: DEBUG oslo_service.periodic_task [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134148) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Dec 18 21:53:34.382015 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:53:34.404053 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:53:34.425697 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.manager [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] Notifying Schedulers of capabilities ... {{(pid=134148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 18 21:54:34.380857 ncdv-master-1 cinder-volume[134148]: DEBUG oslo_service.periodic_task [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134148) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Dec 18 21:54:34.381525 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:54:34.403345 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:54:34.425645 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.manager [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] Notifying Schedulers of capabilities ... {{(pid=134148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 18 21:55:34.381631 ncdv-master-1 cinder-volume[134148]: DEBUG oslo_service.periodic_task [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134148) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Dec 18 21:55:34.382322 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:55:34.405929 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:55:34.427536 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.manager [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] Notifying Schedulers of capabilities ... {{(pid=134148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 18 21:56:34.383384 ncdv-master-1 cinder-volume[134148]: DEBUG oslo_service.periodic_task [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134148) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Dec 18 21:56:34.384060 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:56:34.439136 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:56:34.462168 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.manager [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] Notifying Schedulers of capabilities ... {{(pid=134148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 18 21:57:34.335203 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.flows.manager.create_volume [None req-68fe836c-ab80-4d26-9df5-ee735bc5fbf3 tempest-TestShelveInstance-495639169 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134148) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Dec 18 21:57:34.338939 ncdv-master-1 cinder-volume[134148]: WARNING stevedore.named [None req-68fe836c-ab80-4d26-9df5-ee735bc5fbf3 tempest-TestShelveInstance-495639169 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Dec 18 21:57:34.339409 ncdv-master-1 cinder-volume[134148]: WARNING castellan.key_manager [None req-68fe836c-ab80-4d26-9df5-ee735bc5fbf3 tempest-TestShelveInstance-495639169 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Dec 18 21:57:34.351871 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-68fe836c-ab80-4d26-9df5-ee735bc5fbf3 tempest-TestShelveInstance-495639169 None] Flow 'volume_create_manager' (05f6a2a0-e255-4552-8952-6ade74ce2abb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 18 21:57:34.355137 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-68fe836c-ab80-4d26-9df5-ee735bc5fbf3 tempest-TestShelveInstance-495639169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43e9bd76-9fc6-441a-83ef-4965b810bb79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:57:34.361130 ncdv-master-1 cinder-volume[134148]: DEBUG oslo_db.sqlalchemy.engines [None req-68fe836c-ab80-4d26-9df5-ee735bc5fbf3 tempest-TestShelveInstance-495639169 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134148) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 18 21:57:34.373217 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-68fe836c-ab80-4d26-9df5-ee735bc5fbf3 tempest-TestShelveInstance-495639169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43e9bd76-9fc6-441a-83ef-4965b810bb79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-12-18T21:57:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-421612167',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=1ed2a9ae-e3d5-4846-a4c8-250597c52197,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7e4c296f0144644b9107d08244cb934',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-12-18T21:57:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-12-18T21:57:34Z,use_quota=True,user_id='d138402b28b3454aaca10ca070a1f7e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f2e1fe1-9fd6-411e-9ed9-368f463ccb6f),volume_type_id=1f2e1fe1-9fd6-411e-9ed9-368f463ccb6f)' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:57:34.375794 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-68fe836c-ab80-4d26-9df5-ee735bc5fbf3 tempest-TestShelveInstance-495639169 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf278106-0ef4-45b8-9b99-8998138cb1da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:57:34.377917 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-68fe836c-ab80-4d26-9df5-ee735bc5fbf3 tempest-TestShelveInstance-495639169 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf278106-0ef4-45b8-9b99-8998138cb1da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:57:34.380880 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-68fe836c-ab80-4d26-9df5-ee735bc5fbf3 tempest-TestShelveInstance-495639169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d138dbc-0cdf-4601-becf-b2347beddd90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:57:34.387597 ncdv-master-1 cinder-volume[134148]: DEBUG oslo_service.periodic_task [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134148) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Dec 18 21:57:34.388478 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:57:34.411676 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:57:34.433665 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.manager [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] Notifying Schedulers of capabilities ... {{(pid=134148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 18 21:57:34.492785 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-68fe836c-ab80-4d26-9df5-ee735bc5fbf3 tempest-TestShelveInstance-495639169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d138dbc-0cdf-4601-becf-b2347beddd90) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '1ed2a9ae-e3d5-4846-a4c8-250597c52197', 'volume_name': 'volume-1ed2a9ae-e3d5-4846-a4c8-250597c52197', 'volume_size': 1, 'image_id': '394b3891-80f2-44c9-a9aa-56fe23a5acb3', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b04c3d19c79d4c208395e97f9d293618', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '394b3891-80f2-44c9-a9aa-56fe23a5acb3', 'created_at': datetime.datetime(2021, 12, 18, 20, 38, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 12, 18, 20, 38, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/394b3891-80f2-44c9-a9aa-56fe23a5acb3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:57:34.495257 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-68fe836c-ab80-4d26-9df5-ee735bc5fbf3 tempest-TestShelveInstance-495639169 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83c1e5ba-73e0-40a8-a0ff-fbafcff16d08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:57:34.497398 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-68fe836c-ab80-4d26-9df5-ee735bc5fbf3 tempest-TestShelveInstance-495639169 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83c1e5ba-73e0-40a8-a0ff-fbafcff16d08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:57:34.499624 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-68fe836c-ab80-4d26-9df5-ee735bc5fbf3 tempest-TestShelveInstance-495639169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f47aee31-712e-4df7-bd41-533059b89aea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:57:34.500440 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.flows.manager.create_volume [None req-68fe836c-ab80-4d26-9df5-ee735bc5fbf3 tempest-TestShelveInstance-495639169 None] Volume 1ed2a9ae-e3d5-4846-a4c8-250597c52197: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-1ed2a9ae-e3d5-4846-a4c8-250597c52197', 'volume_size': 1, 'image_id': '394b3891-80f2-44c9-a9aa-56fe23a5acb3', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b04c3d19c79d4c208395e97f9d293618', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '394b3891-80f2-44c9-a9aa-56fe23a5acb3', 'created_at': datetime.datetime(2021, 12, 18, 20, 38, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 12, 18, 20, 38, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/394b3891-80f2-44c9-a9aa-56fe23a5acb3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Dec 18 21:57:34.500993 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.flows.manager.create_volume [None req-68fe836c-ab80-4d26-9df5-ee735bc5fbf3 tempest-TestShelveInstance-495639169 None] Cloning 1ed2a9ae-e3d5-4846-a4c8-250597c52197 from image 394b3891-80f2-44c9-a9aa-56fe23a5acb3 at location (None, None). {{(pid=134148) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1047}} Dec 18 21:57:34.511343 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.coordination [None req-68fe836c-ab80-4d26-9df5-ee735bc5fbf3 tempest-TestShelveInstance-495639169 None] Lock "b'cinder-394b3891-80f2-44c9-a9aa-56fe23a5acb3'" acquired by "_prepare_image_cache_entry" :: waited 0.010s {{(pid=134148) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 18 21:57:34.520029 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.image.cache [None req-68fe836c-ab80-4d26-9df5-ee735bc5fbf3 tempest-TestShelveInstance-495639169 None] Found image-volume cache entry: {'id': 1, 'image_id': '394b3891-80f2-44c9-a9aa-56fe23a5acb3', 'volume_id': 'e6411a45-48fa-4beb-a5a0-eb6a6ca3f525', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2021, 12, 18, 20, 38, 21), 'last_used': datetime.datetime(2021, 12, 18, 21, 57, 34, 515265)}. {{(pid=134148) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Dec 18 21:57:34.520453 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.image.cache [None req-68fe836c-ab80-4d26-9df5-ee735bc5fbf3 tempest-TestShelveInstance-495639169 None] Image-volume cache entry image_update_at = 2021-12-18 20:38:21+00:00, requested image updated_at = 2021-12-18 20:38:21+00:00. {{(pid=134148) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Dec 18 21:57:34.520839 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.flows.manager.create_volume [None req-68fe836c-ab80-4d26-9df5-ee735bc5fbf3 tempest-TestShelveInstance-495639169 None] Found cache entry for image = 394b3891-80f2-44c9-a9aa-56fe23a5acb3 on host ncdv-master-1@ceph#ceph. {{(pid=134148) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:870}} Dec 18 21:57:34.526078 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.coordination [None req-68fe836c-ab80-4d26-9df5-ee735bc5fbf3 tempest-TestShelveInstance-495639169 None] Lock "b'cinder-394b3891-80f2-44c9-a9aa-56fe23a5acb3'" released by "_prepare_image_cache_entry" :: held 0.015s {{(pid=134148) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 18 21:57:34.527003 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.flows.manager.create_volume [None req-68fe836c-ab80-4d26-9df5-ee735bc5fbf3 tempest-TestShelveInstance-495639169 None] Attempting to retrieve cache entry for image = 394b3891-80f2-44c9-a9aa-56fe23a5acb3 on host ncdv-master-1@ceph#ceph. {{(pid=134148) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:811}} Dec 18 21:57:34.533041 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.image.cache [None req-68fe836c-ab80-4d26-9df5-ee735bc5fbf3 tempest-TestShelveInstance-495639169 None] Found image-volume cache entry: {'id': 1, 'image_id': '394b3891-80f2-44c9-a9aa-56fe23a5acb3', 'volume_id': 'e6411a45-48fa-4beb-a5a0-eb6a6ca3f525', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2021, 12, 18, 20, 38, 21), 'last_used': datetime.datetime(2021, 12, 18, 21, 57, 34, 530752)}. {{(pid=134148) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Dec 18 21:57:34.533564 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.image.cache [None req-68fe836c-ab80-4d26-9df5-ee735bc5fbf3 tempest-TestShelveInstance-495639169 None] Image-volume cache entry image_update_at = 2021-12-18 20:38:21+00:00, requested image updated_at = 2021-12-18 20:38:21+00:00. {{(pid=134148) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Dec 18 21:57:34.533989 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.flows.manager.create_volume [None req-68fe836c-ab80-4d26-9df5-ee735bc5fbf3 tempest-TestShelveInstance-495639169 None] Creating from source image-volume e6411a45-48fa-4beb-a5a0-eb6a6ca3f525 {{(pid=134148) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:825}} Dec 18 21:57:34.544806 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-68fe836c-ab80-4d26-9df5-ee735bc5fbf3 tempest-TestShelveInstance-495639169 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:57:34.597250 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-68fe836c-ab80-4d26-9df5-ee735bc5fbf3 tempest-TestShelveInstance-495639169 None] creating snapshot='volume-1ed2a9ae-e3d5-4846-a4c8-250597c52197.clone_snap' {{(pid=134148) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:725}} Dec 18 21:57:34.953636 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-68fe836c-ab80-4d26-9df5-ee735bc5fbf3 tempest-TestShelveInstance-495639169 None] cloning 'volume-e6411a45-48fa-4beb-a5a0-eb6a6ca3f525@volume-1ed2a9ae-e3d5-4846-a4c8-250597c52197.clone_snap' to 'volume-1ed2a9ae-e3d5-4846-a4c8-250597c52197' {{(pid=134148) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:731}} Dec 18 21:57:35.080164 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-68fe836c-ab80-4d26-9df5-ee735bc5fbf3 tempest-TestShelveInstance-495639169 None] Volume volume-9f5f7417-3abc-4462-988f-ef519750d753.deleted is not a clone. {{(pid=134148) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Dec 18 21:57:35.081322 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-68fe836c-ab80-4d26-9df5-ee735bc5fbf3 tempest-TestShelveInstance-495639169 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134148) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 18 21:57:35.081720 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-68fe836c-ab80-4d26-9df5-ee735bc5fbf3 tempest-TestShelveInstance-495639169 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134148) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 18 21:57:35.098856 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-68fe836c-ab80-4d26-9df5-ee735bc5fbf3 tempest-TestShelveInstance-495639169 None] clone created successfully {{(pid=134148) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:803}} Dec 18 21:57:35.099478 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.volume_utils [None req-68fe836c-ab80-4d26-9df5-ee735bc5fbf3 tempest-TestShelveInstance-495639169 None] Marking volume 1ed2a9ae-e3d5-4846-a4c8-250597c52197 as bootable. {{(pid=134148) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1178}} Dec 18 21:57:35.106858 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.flows.manager.create_volume [None req-68fe836c-ab80-4d26-9df5-ee735bc5fbf3 tempest-TestShelveInstance-495639169 None] Copying metadata from image 394b3891-80f2-44c9-a9aa-56fe23a5acb3 to 1ed2a9ae-e3d5-4846-a4c8-250597c52197. {{(pid=134148) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:444}} Dec 18 21:57:35.107276 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.flows.manager.create_volume [None req-68fe836c-ab80-4d26-9df5-ee735bc5fbf3 tempest-TestShelveInstance-495639169 None] Creating volume glance metadata for volume 1ed2a9ae-e3d5-4846-a4c8-250597c52197 backed by image 394b3891-80f2-44c9-a9aa-56fe23a5acb3 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '394b3891-80f2-44c9-a9aa-56fe23a5acb3', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=134148) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:667}} Dec 18 21:57:35.153666 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-68fe836c-ab80-4d26-9df5-ee735bc5fbf3 tempest-TestShelveInstance-495639169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f47aee31-712e-4df7-bd41-533059b89aea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1ed2a9ae-e3d5-4846-a4c8-250597c52197', 'volume_size': 1, 'image_id': '394b3891-80f2-44c9-a9aa-56fe23a5acb3', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b04c3d19c79d4c208395e97f9d293618', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '394b3891-80f2-44c9-a9aa-56fe23a5acb3', 'created_at': datetime.datetime(2021, 12, 18, 20, 38, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 12, 18, 20, 38, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/394b3891-80f2-44c9-a9aa-56fe23a5acb3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:57:35.155948 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-68fe836c-ab80-4d26-9df5-ee735bc5fbf3 tempest-TestShelveInstance-495639169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (154e356d-e6c9-4347-96fc-e81c2a267660) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 18 21:57:35.164219 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.flows.manager.create_volume [None req-68fe836c-ab80-4d26-9df5-ee735bc5fbf3 tempest-TestShelveInstance-495639169 None] Volume volume-1ed2a9ae-e3d5-4846-a4c8-250597c52197 (1ed2a9ae-e3d5-4846-a4c8-250597c52197): created successfully Dec 18 21:57:35.166328 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-68fe836c-ab80-4d26-9df5-ee735bc5fbf3 tempest-TestShelveInstance-495639169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (154e356d-e6c9-4347-96fc-e81c2a267660) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134148) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 18 21:57:35.169402 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [None req-68fe836c-ab80-4d26-9df5-ee735bc5fbf3 tempest-TestShelveInstance-495639169 None] Flow 'volume_create_manager' (05f6a2a0-e255-4552-8952-6ade74ce2abb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134148) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 18 21:57:35.177049 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [None req-68fe836c-ab80-4d26-9df5-ee735bc5fbf3 tempest-TestShelveInstance-495639169 None] Created volume successfully. Dec 18 21:57:41.562991 ncdv-master-1 cinder-volume[134148]: DEBUG oslo_concurrency.processutils [req-bd369e1a-a7f1-4ce9-a862-b927fdc98f1f req-ad6aafcb-5350-4cac-a07b-3a39283041b5 tempest-TestShelveInstance-495639169 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=134148) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Dec 18 21:57:42.570507 ncdv-master-1 cinder-volume[134148]: DEBUG oslo_concurrency.processutils [req-bd369e1a-a7f1-4ce9-a862-b927fdc98f1f req-ad6aafcb-5350-4cac-a07b-3a39283041b5 tempest-TestShelveInstance-495639169 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.007s {{(pid=134148) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Dec 18 21:57:42.571343 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [req-bd369e1a-a7f1-4ce9-a862-b927fdc98f1f req-ad6aafcb-5350-4cac-a07b-3a39283041b5 tempest-TestShelveInstance-495639169 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-1ed2a9ae-e3d5-4846-a4c8-250597c52197', 'hosts': ['10.222.0.13'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '946d1715-d12c-4dbf-8a79-181222df6e2e', 'volume_id': '1ed2a9ae-e3d5-4846-a4c8-250597c52197', 'discard': True}} {{(pid=134148) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Dec 18 21:57:42.597624 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [req-bd369e1a-a7f1-4ce9-a862-b927fdc98f1f req-ad6aafcb-5350-4cac-a07b-3a39283041b5 tempest-TestShelveInstance-495639169 None] Connection info returned from driver {'name': 'volumes/volume-1ed2a9ae-e3d5-4846-a4c8-250597c52197', 'hosts': ['10.222.0.13'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '1ed2a9ae-e3d5-4846-a4c8-250597c52197', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'a0eafc88-72dd-48f0-a90c-9aa063fd0916'} {{(pid=134148) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4812}} Dec 18 21:57:42.653191 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [req-bd369e1a-a7f1-4ce9-a862-b927fdc98f1f req-ad6aafcb-5350-4cac-a07b-3a39283041b5 tempest-TestShelveInstance-495639169 None] attachment_update completed successfully. Dec 18 21:58:34.393607 ncdv-master-1 cinder-volume[134148]: DEBUG oslo_service.periodic_task [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134148) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Dec 18 21:58:34.394609 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:58:34.419598 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:58:34.446917 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.manager [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] Notifying Schedulers of capabilities ... {{(pid=134148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 18 21:59:34.393422 ncdv-master-1 cinder-volume[134148]: DEBUG oslo_service.periodic_task [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134148) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Dec 18 21:59:34.394066 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:59:34.414760 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 21:59:34.435931 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.manager [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] Notifying Schedulers of capabilities ... {{(pid=134148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 18 22:00:10.458367 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [req-505bfd6c-66da-4886-9027-7351350af5d6 req-fe74de2c-a53b-43b0-ad3f-bdce8030a5af tempest-TestShelveInstance-495639169 None] Terminate volume connection completed successfully. Dec 18 22:00:10.459023 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [req-505bfd6c-66da-4886-9027-7351350af5d6 req-fe74de2c-a53b-43b0-ad3f-bdce8030a5af tempest-TestShelveInstance-495639169 None] Deleting attachment a0eafc88-72dd-48f0-a90c-9aa063fd0916. {{(pid=134148) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4948}} Dec 18 22:00:12.023923 ncdv-master-1 cinder-volume[134148]: DEBUG oslo_concurrency.processutils [req-5bd2d312-5b9f-4d4f-8408-12990eb79e45 req-af6ca509-8618-4e5f-af2d-aa9ce1ef9594 tempest-TestShelveInstance-495639169 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=134148) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Dec 18 22:00:12.659837 ncdv-master-1 cinder-volume[134148]: DEBUG oslo_concurrency.processutils [req-5bd2d312-5b9f-4d4f-8408-12990eb79e45 req-af6ca509-8618-4e5f-af2d-aa9ce1ef9594 tempest-TestShelveInstance-495639169 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.636s {{(pid=134148) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Dec 18 22:00:12.660620 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [req-5bd2d312-5b9f-4d4f-8408-12990eb79e45 req-af6ca509-8618-4e5f-af2d-aa9ce1ef9594 tempest-TestShelveInstance-495639169 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-1ed2a9ae-e3d5-4846-a4c8-250597c52197', 'hosts': ['10.222.0.13'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '946d1715-d12c-4dbf-8a79-181222df6e2e', 'volume_id': '1ed2a9ae-e3d5-4846-a4c8-250597c52197', 'discard': True}} {{(pid=134148) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Dec 18 22:00:12.684063 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [req-5bd2d312-5b9f-4d4f-8408-12990eb79e45 req-af6ca509-8618-4e5f-af2d-aa9ce1ef9594 tempest-TestShelveInstance-495639169 None] Connection info returned from driver {'name': 'volumes/volume-1ed2a9ae-e3d5-4846-a4c8-250597c52197', 'hosts': ['10.222.0.13'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '1ed2a9ae-e3d5-4846-a4c8-250597c52197', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'dee4e17e-e9b9-4604-b8aa-2c82d31df5e8'} {{(pid=134148) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4812}} Dec 18 22:00:12.733431 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [req-5bd2d312-5b9f-4d4f-8408-12990eb79e45 req-af6ca509-8618-4e5f-af2d-aa9ce1ef9594 tempest-TestShelveInstance-495639169 None] attachment_update completed successfully. Dec 18 22:00:34.391533 ncdv-master-1 cinder-volume[134148]: DEBUG oslo_service.periodic_task [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134148) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Dec 18 22:00:34.392389 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 22:00:34.415398 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 22:00:34.437485 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.manager [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] Notifying Schedulers of capabilities ... {{(pid=134148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 18 22:01:34.394062 ncdv-master-1 cinder-volume[134148]: DEBUG oslo_service.periodic_task [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134148) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Dec 18 22:01:34.394816 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 22:01:34.415552 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 22:01:34.437124 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.manager [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] Notifying Schedulers of capabilities ... {{(pid=134148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 18 22:01:51.809941 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [req-b1691b5b-3227-4775-a707-7cbd0df8331b req-52440073-c7ee-44d7-b342-f4c7c30d2546 tempest-TestShelveInstance-495639169 None] Terminate volume connection completed successfully. Dec 18 22:01:51.810668 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.manager [req-b1691b5b-3227-4775-a707-7cbd0df8331b req-52440073-c7ee-44d7-b342-f4c7c30d2546 tempest-TestShelveInstance-495639169 None] Deleting attachment dee4e17e-e9b9-4604-b8aa-2c82d31df5e8. {{(pid=134148) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4948}} Dec 18 22:01:51.932565 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.coordination [req-b1691b5b-3227-4775-a707-7cbd0df8331b req-5f3dbefa-1822-46dd-a683-b35642bc2fef tempest-TestShelveInstance-495639169 None] Lock "b'cinder-1ed2a9ae-e3d5-4846-a4c8-250597c52197-delete_volume'" acquired by "delete_volume" :: waited 0.009s {{(pid=134148) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 18 22:01:51.962943 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [req-b1691b5b-3227-4775-a707-7cbd0df8331b req-5f3dbefa-1822-46dd-a683-b35642bc2fef tempest-TestShelveInstance-495639169 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 22:01:52.035251 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [req-b1691b5b-3227-4775-a707-7cbd0df8331b req-5f3dbefa-1822-46dd-a683-b35642bc2fef tempest-TestShelveInstance-495639169 None] volume has no backup snaps {{(pid=134148) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Dec 18 22:01:52.046083 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [req-b1691b5b-3227-4775-a707-7cbd0df8331b req-5f3dbefa-1822-46dd-a683-b35642bc2fef tempest-TestShelveInstance-495639169 None] deleting rbd volume volume-1ed2a9ae-e3d5-4846-a4c8-250597c52197 {{(pid=134148) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Dec 18 22:01:52.273926 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [req-b1691b5b-3227-4775-a707-7cbd0df8331b req-5f3dbefa-1822-46dd-a683-b35642bc2fef tempest-TestShelveInstance-495639169 None] volume is a clone so cleaning references {{(pid=134148) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1266}} Dec 18 22:01:52.307506 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [req-b1691b5b-3227-4775-a707-7cbd0df8331b req-5f3dbefa-1822-46dd-a683-b35642bc2fef tempest-TestShelveInstance-495639169 None] deleting parent snapshot volume-1ed2a9ae-e3d5-4846-a4c8-250597c52197.clone_snap {{(pid=134148) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1158}} Dec 18 22:01:52.448037 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.quota [req-b1691b5b-3227-4775-a707-7cbd0df8331b req-5f3dbefa-1822-46dd-a683-b35642bc2fef tempest-TestShelveInstance-495639169 None] Created reservations ['0fae06b5-77d6-4c47-8805-8e730c0fef2f', '5ab952e1-cc68-416d-9fd2-6c5c8ecbcd9a', '50e98ab8-ea69-4154-8513-74bc0090cd5a', '273197a0-6c09-412b-9657-ffd948eb60bd'] {{(pid=134148) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 18 22:01:52.488236 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [req-b1691b5b-3227-4775-a707-7cbd0df8331b req-5f3dbefa-1822-46dd-a683-b35642bc2fef tempest-TestShelveInstance-495639169 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 22:01:52.510070 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [req-b1691b5b-3227-4775-a707-7cbd0df8331b req-5f3dbefa-1822-46dd-a683-b35642bc2fef tempest-TestShelveInstance-495639169 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 22:01:52.532299 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.manager [req-b1691b5b-3227-4775-a707-7cbd0df8331b req-5f3dbefa-1822-46dd-a683-b35642bc2fef tempest-TestShelveInstance-495639169 None] Notifying Schedulers of capabilities ... {{(pid=134148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 18 22:01:52.537046 ncdv-master-1 cinder-volume[134148]: INFO cinder.volume.manager [req-b1691b5b-3227-4775-a707-7cbd0df8331b req-5f3dbefa-1822-46dd-a683-b35642bc2fef tempest-TestShelveInstance-495639169 None] Deleted volume successfully. Dec 18 22:01:52.549311 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.coordination [req-b1691b5b-3227-4775-a707-7cbd0df8331b req-5f3dbefa-1822-46dd-a683-b35642bc2fef tempest-TestShelveInstance-495639169 None] Lock "b'cinder-1ed2a9ae-e3d5-4846-a4c8-250597c52197-delete_volume'" released by "delete_volume" :: held 0.617s {{(pid=134148) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 18 22:02:34.393514 ncdv-master-1 cinder-volume[134148]: DEBUG oslo_service.periodic_task [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134148) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Dec 18 22:02:34.394155 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 22:02:34.416895 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 22:02:34.438586 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.manager [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] Notifying Schedulers of capabilities ... {{(pid=134148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 18 22:03:34.395578 ncdv-master-1 cinder-volume[134148]: DEBUG oslo_service.periodic_task [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134148) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Dec 18 22:03:34.396220 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 22:03:34.417103 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 22:03:34.438551 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.manager [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] Notifying Schedulers of capabilities ... {{(pid=134148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 18 22:04:34.394791 ncdv-master-1 cinder-volume[134148]: DEBUG oslo_service.periodic_task [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134148) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Dec 18 22:04:34.395514 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 22:04:34.425235 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 22:04:34.457272 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.manager [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] Notifying Schedulers of capabilities ... {{(pid=134148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 18 22:05:34.392969 ncdv-master-1 cinder-volume[134148]: DEBUG oslo_service.periodic_task [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134148) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Dec 18 22:05:34.393614 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 22:05:34.427387 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 22:05:34.449689 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.manager [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] Notifying Schedulers of capabilities ... {{(pid=134148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 18 22:06:34.395357 ncdv-master-1 cinder-volume[134148]: DEBUG oslo_service.periodic_task [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134148) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Dec 18 22:06:34.395997 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 22:06:34.416988 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 22:06:34.442986 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.manager [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] Notifying Schedulers of capabilities ... {{(pid=134148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 18 22:07:34.398332 ncdv-master-1 cinder-volume[134148]: DEBUG oslo_service.periodic_task [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134148) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Dec 18 22:07:34.398977 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 22:07:34.431931 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 22:07:34.453842 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.manager [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] Notifying Schedulers of capabilities ... {{(pid=134148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 18 22:08:34.400616 ncdv-master-1 cinder-volume[134148]: DEBUG oslo_service.periodic_task [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134148) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Dec 18 22:08:34.401319 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 22:08:34.423115 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 22:08:34.444744 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.manager [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] Notifying Schedulers of capabilities ... {{(pid=134148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 18 22:09:34.401333 ncdv-master-1 cinder-volume[134148]: DEBUG oslo_service.periodic_task [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134148) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Dec 18 22:09:34.401986 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 22:09:34.423719 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 22:09:34.450317 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.manager [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] Notifying Schedulers of capabilities ... {{(pid=134148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 18 22:10:34.406221 ncdv-master-1 cinder-volume[134148]: DEBUG oslo_service.periodic_task [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134148) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Dec 18 22:10:34.406902 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 22:10:34.428401 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 22:10:34.461978 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.manager [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] Notifying Schedulers of capabilities ... {{(pid=134148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 18 22:11:34.407927 ncdv-master-1 cinder-volume[134148]: DEBUG oslo_service.periodic_task [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134148) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Dec 18 22:11:34.408572 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 22:11:34.430390 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 22:11:34.451647 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.manager [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] Notifying Schedulers of capabilities ... {{(pid=134148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 18 22:12:34.407798 ncdv-master-1 cinder-volume[134148]: DEBUG oslo_service.periodic_task [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134148) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Dec 18 22:12:34.408466 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 22:12:34.430199 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 22:12:34.451459 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.manager [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] Notifying Schedulers of capabilities ... {{(pid=134148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 18 22:13:34.408735 ncdv-master-1 cinder-volume[134148]: DEBUG oslo_service.periodic_task [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134148) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Dec 18 22:13:34.409404 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 22:13:34.430741 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 22:13:34.452461 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.manager [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] Notifying Schedulers of capabilities ... {{(pid=134148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 18 22:14:34.409303 ncdv-master-1 cinder-volume[134148]: DEBUG oslo_service.periodic_task [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134148) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Dec 18 22:14:34.409955 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 22:14:34.432860 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.volume.drivers.rbd [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134148) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 18 22:14:34.455441 ncdv-master-1 cinder-volume[134148]: DEBUG cinder.manager [None req-40088565-63ff-4744-8fdf-2c073fa84468 None None] Notifying Schedulers of capabilities ... {{(pid=134148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}