-- Logs begin at Sat 2022-01-22 20:01:15 UTC, end at Sat 2022-01-22 22:50:15 UTC. -- Jan 22 20:50:20.337163 ncdv-master-1 systemd[1]: Started Devstack devstack@c-vol.service. Jan 22 20:50:23.622257 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=129780) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jan 22 20:50:23.622896 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=129780) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jan 22 20:50:23.995933 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_db.sqlalchemy.engines [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129780) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 22 20:50:24.342294 ncdv-master-1 cinder-volume[129780]: INFO cinder.rpc [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jan 22 20:50:24.346514 ncdv-master-1 cinder-volume[129780]: INFO cinder.rpc [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jan 22 20:50:24.356566 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_db.sqlalchemy.engines [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129780) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 22 20:50:24.425674 ncdv-master-1 cinder-volume[129780]: INFO cinder.volume.manager [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] Determined volume DB was empty at startup. Jan 22 20:50:24.426289 ncdv-master-1 cinder-volume[129780]: DEBUG cinder.volume.manager [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] Cinder Volume DB check: vol_db_empty=True {{(pid=129780) __init__ /opt/stack/cinder/cinder/volume/manager.py:281}} Jan 22 20:50:24.434077 ncdv-master-1 cinder-volume[129780]: INFO cinder.volume.manager [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] Service not found for updating active_backend_id, assuming default for driver init. Jan 22 20:50:24.434886 ncdv-master-1 cinder-volume[129780]: WARNING stevedore.named [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jan 22 20:50:24.435352 ncdv-master-1 cinder-volume[129780]: WARNING castellan.key_manager [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 22 20:50:24.436452 ncdv-master-1 cinder-volume[129780]: WARNING cinder.keymgr.conf_key_mgr [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 22 20:50:24.452084 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_db.sqlalchemy.engines [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129780) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 22 20:50:24.456120 ncdv-master-1 cinder-volume[129780]: INFO cinder.rpc [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Jan 22 20:50:24.459985 ncdv-master-1 cinder-volume[129780]: INFO cinder.rpc [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] Automatically selected cinder-volume RPC version 3.16 as minimum service version. Jan 22 20:50:24.460647 ncdv-master-1 cinder-volume[129780]: WARNING stevedore.named [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jan 22 20:50:24.461058 ncdv-master-1 cinder-volume[129780]: WARNING castellan.key_manager [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 22 20:50:24.462830 ncdv-master-1 cinder-volume[129780]: INFO cinder.volume.manager [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] Image-volume cache enabled for host ncdv-master-1@ceph. Jan 22 20:50:24.467815 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_db.sqlalchemy.engines [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129780) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 22 20:50:24.623729 ncdv-master-1 cinder-volume[129780]: INFO oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] Starting 1 workers Jan 22 20:50:24.630053 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] Started child 129952 {{(pid=129780) _start_child /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:575}} Jan 22 20:50:24.631530 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] Full set of CONF: {{(pid=129780) wait /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:649}} Jan 22 20:50:24.632113 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] ******************************************************************************** {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jan 22 20:50:24.632642 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] Configuration options gathered from: {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jan 22 20:50:24.633222 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jan 22 20:50:24.634088 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jan 22 20:50:24.634630 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] ================================================================================ {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jan 22 20:50:24.635553 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] allow_availability_zone_fallback = False {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:50:24.636083 ncdv-master-1 cinder-volume[129952]: INFO cinder.service [-] Starting cinder-volume node (version 19.1.0) Jan 22 20:50:24.636834 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] allow_compression_on_image_upload = False {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:50:24.637692 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] allowed_direct_url_schemes = [] {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:50:24.638297 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] api_rate_limit = True {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:50:24.638936 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] auth_strategy = keystone {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:50:24.639579 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] az_cache_duration = 3600 {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:50:24.640262 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] backend_availability_zone = None {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:50:24.641034 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] backend_host = None {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:50:24.641681 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] backend_name = None {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:50:24.647205 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] backend_stats_polling_interval = 60 {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:50:24.647205 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] backup_api_class = cinder.backup.api.API {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:50:24.647205 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:50:24.647205 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] backup_name_template = backup-%s {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:50:24.647205 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] backup_use_same_host = False {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:50:24.647205 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] backup_use_temp_snapshot = False {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:50:24.647796 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] chap_password = **** {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:50:24.647796 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] chap_username = {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:50:24.647796 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:50:24.647796 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] cinder_internal_tenant_project_id = 98c62088157141ffa8ace45b5c19d03f {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:50:24.647796 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] cinder_internal_tenant_user_id = adcb6a8499884b4896281bcbd183086e {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:50:24.647796 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] cloned_volume_same_az = True {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:50:24.648171 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] cluster = None {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:50:24.648830 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] compression_format = gzip {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:50:24.649482 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] compute_api_class = cinder.compute.nova.API {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:50:24.650199 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] config_dir = [] {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:50:24.650703 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:50:24.651293 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] config_source = [] {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:50:24.651881 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:50:24.652490 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] control_exchange = openstack {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:50:24.653098 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] debug = True {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:50:24.653690 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] default_availability_zone = None {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:50:24.654272 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] default_group_type = None {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:50:24.655170 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:50:24.658006 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] default_volume_type = ceph {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:50:24.659071 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] driver_client_cert = None {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:50:24.659900 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] driver_client_cert_key = None {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:50:24.660758 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] driver_data_namespace = None {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:50:24.661649 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] driver_ssl_cert_path = None {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:50:24.662434 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] driver_ssl_cert_verify = False {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:50:24.662887 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] driver_use_ssl = False {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:50:24.663351 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] enable_force_upload = False {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:50:24.663781 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] enable_new_services = True {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:50:24.664220 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] enable_unsupported_driver = False {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:50:24.664834 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] enabled_backends = ['ceph'] {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:50:24.665378 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] enforce_multipath_for_image_xfer = False {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:50:24.667325 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] filter_function = None {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:50:24.667893 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] glance_api_insecure = False {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:50:24.668508 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] glance_api_servers = ['http://10.222.0.100/image'] {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:50:24.669191 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] glance_api_ssl_compression = False {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:50:24.669774 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] glance_ca_certificates_file = None {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:50:24.670384 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] glance_catalog_info = image:glance:publicURL {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:50:24.671176 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] glance_certfile = None {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:50:24.671876 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:50:24.673151 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] glance_keyfile = None {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:50:24.673824 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] glance_num_retries = 3 {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:50:24.674436 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] glance_request_timeout = None {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:50:24.674693 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-344f1b11-75c6-45a7-9412-40cb558c91b4 None None] Starting volume driver RBDDriver (1.2.0) Jan 22 20:50:24.675197 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] goodness_function = None {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:50:24.675781 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] graceful_shutdown_timeout = 5 {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:50:24.676344 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] group_api_class = cinder.group.api.API {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:50:24.676839 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] host = ncdv-master-1 {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:50:24.676986 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-344f1b11-75c6-45a7-9412-40cb558c91b4 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 20:50:24.677519 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] iet_conf = /etc/iet/ietd.conf {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:50:24.678146 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] image_compress_on_upload = True {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:50:24.678712 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] image_conversion_address_space_limit = 1 {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:50:24.679405 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] image_conversion_cpu_limit = 60 {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:50:24.680092 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:50:24.680660 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] image_upload_use_cinder_backend = False {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:50:24.681282 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] image_upload_use_internal_tenant = False {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:50:24.681859 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] image_volume_cache_enabled = False {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:50:24.682413 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] image_volume_cache_max_count = 0 {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:50:24.682977 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] image_volume_cache_max_size_gb = 0 {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:50:24.683561 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] init_host_max_objects_retrieval = 0 {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:50:24.684166 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] instance_format = [instance: %(uuid)s] {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:50:24.684747 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:50:24.685343 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] iscsi_iotype = fileio {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:50:24.685948 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] iscsi_secondary_ip_addresses = [] {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:50:24.686519 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] iscsi_target_flags = {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:50:24.687092 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] iscsi_write_cache = on {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:50:24.687774 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] iser_helper = tgtadm {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:50:24.689013 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] iser_ip_address = 10.222.0.100 {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:50:24.689990 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] iser_port = 3260 {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:50:24.690600 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:50:24.691175 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] log_config_append = None {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:50:24.691767 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:50:24.692325 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] log_dir = None {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:50:24.692897 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] log_file = None {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:50:24.693392 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] log_options = True {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:50:24.694014 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] log_rotate_interval = 1 {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:50:24.694658 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] log_rotate_interval_type = days {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:50:24.695277 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] log_rotation_type = none {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:50:24.695785 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:50:24.696280 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:50:24.696864 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:50:24.697460 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:50:24.697869 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:50:24.698362 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] max_age = 0 {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:50:24.698847 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] max_logfile_count = 30 {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:50:24.699332 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] max_logfile_size_mb = 200 {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:50:24.699919 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] max_over_subscription_ratio = 20.0 {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:50:24.700401 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] message_reap_interval = 86400 {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:50:24.700852 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] message_ttl = 2592000 {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:50:24.701331 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] migration_create_volume_timeout_secs = 300 {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:50:24.701840 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] monkey_patch = False {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:50:24.702300 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] monkey_patch_modules = [] {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:50:24.702710 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] my_ip = 10.222.0.100 {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:50:24.703149 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] no_snapshot_gb_quota = False {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:50:24.703643 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] num_iser_scan_tries = 3 {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:50:24.704172 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] num_shell_tries = 3 {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:50:24.704590 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] num_volume_device_scan_tries = 3 {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:50:24.705104 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] nvmet_ns_id = 10 {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:50:24.705604 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] nvmet_port_id = 1 {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:50:24.706225 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] osapi_max_limit = 1000 {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:50:24.707578 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] osapi_volume_ext_list = [] {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:50:24.708063 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:50:24.708530 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] osapi_volume_listen = 0.0.0.0 {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:50:24.709025 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] osapi_volume_listen_port = 8776 {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:50:24.709481 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] osapi_volume_use_ssl = False {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:50:24.710139 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] osapi_volume_workers = 2 {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:50:24.710648 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] per_volume_size_limit = -1 {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:50:24.711207 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] periodic_fuzzy_delay = 60 {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:50:24.711695 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] periodic_interval = 60 {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:50:24.712160 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] public_endpoint = None {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:50:24.712618 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] publish_errors = False {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:50:24.713178 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] quota_backup_gigabytes = 1000 {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:50:24.713792 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] quota_backups = 10 {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:50:24.714345 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] quota_consistencygroups = 10 {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:50:24.714834 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:50:24.715298 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] quota_gigabytes = 1000 {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:50:24.715761 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] quota_groups = 10 {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:50:24.716253 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] quota_snapshots = 10 {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:50:24.716710 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] quota_volumes = 10 {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:50:24.717178 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] rate_limit_burst = 0 {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:50:24.717679 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] rate_limit_except_level = CRITICAL {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:50:24.720743 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] rate_limit_interval = 0 {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:50:24.721272 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] reinit_driver_count = 3 {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:50:24.721786 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] replication_device = **** {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:50:24.722258 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] report_discard_supported = False {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:50:24.722750 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] report_interval = 10 {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:50:24.723599 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] reservation_clean_interval = 86400 {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:50:24.724000 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] reservation_expire = 86400 {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:50:24.724465 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] reserved_percentage = 0 {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:50:24.724986 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:50:24.725448 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:50:24.726155 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] rpc_response_timeout = 120 {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:50:24.726739 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] run_external_periodic_tasks = True {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:50:24.727578 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:50:24.728855 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] scst_target_driver = iscsi {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:50:24.729313 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] scst_target_iqn_name = None {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:50:24.729918 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] service_down_time = 60 {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:50:24.730633 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] snapshot_name_template = snapshot-%s {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:50:24.731226 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] snapshot_same_host = True {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:50:24.731787 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] split_loggers = False {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:50:24.732292 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] state_path = /opt/stack/data/cinder {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:50:24.732860 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] storage_availability_zone = nova {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:50:24.732977 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-344f1b11-75c6-45a7-9412-40cb558c91b4 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 20:50:24.733609 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] storage_protocol = iscsi {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:50:24.734206 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] syslog_log_facility = LOG_USER {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:50:24.735442 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] target_helper = lioadm {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:50:24.736135 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] target_ip_address = 10.222.0.100 {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:50:24.736868 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] target_port = 3260 {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:50:24.737432 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:50:24.738044 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] target_protocol = iscsi {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:50:24.738600 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] trace_flags = None {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:50:24.739194 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] transfer_api_class = cinder.transfer.api.API {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:50:24.739770 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] transport_url = **** {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:50:24.740492 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] until_refresh = 0 {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:50:24.741055 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] use_chap_auth = False {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:50:24.741640 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] use_default_quota_class = True {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:50:24.742225 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] use_eventlog = False {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:50:24.742785 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] use_journal = False {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:50:24.743358 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] use_json = False {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:50:24.743910 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] use_multipath_for_image_xfer = False {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:50:24.744503 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] use_stderr = False {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:50:24.744951 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] use_syslog = False {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:50:24.745765 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] verify_glance_signatures = enabled {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:50:24.746231 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] volume_api_class = cinder.volume.api.API {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:50:24.746676 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] volume_backend_name = None {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:50:24.747164 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] volume_clear = zero {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:50:24.747599 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] volume_clear_ionice = None {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:50:24.748052 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] volume_clear_size = 0 {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:50:24.748514 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:50:24.748991 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] volume_copy_bps_limit = 0 {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:50:24.749447 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] volume_dd_blocksize = 1M {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:50:24.749936 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:50:24.750640 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] volume_name_template = volume-%s {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:50:24.751126 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] volume_service_inithost_offload = False {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:50:24.751627 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] volume_usage_audit_period = month {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:50:24.752346 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:50:24.752859 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] watch_log_file = False {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:50:24.753298 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] zoning_mode = None {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:50:24.753988 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.754594 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.755263 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] oslo_policy.enforce_new_defaults = False {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.756011 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] oslo_policy.enforce_scope = False {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.756666 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] oslo_policy.policy_default_rule = default {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.757749 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.758404 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] oslo_policy.policy_file = policy.yaml {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.758908 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.759316 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.759721 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.760139 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.760556 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.761136 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] oslo_concurrency.disable_process_locking = False {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.761591 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.768540 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] keystone_authtoken.admin_password = **** {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.768540 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] keystone_authtoken.admin_tenant_name = admin {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.768540 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] keystone_authtoken.admin_token = **** {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.768540 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] keystone_authtoken.admin_user = None {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.768540 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] keystone_authtoken.auth_admin_prefix = {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.768540 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.768540 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] keystone_authtoken.auth_port = 35357 {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.769170 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] keystone_authtoken.auth_protocol = https {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.769170 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] keystone_authtoken.auth_section = None {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.769170 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] keystone_authtoken.auth_type = password {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.769170 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] keystone_authtoken.auth_uri = None {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.769170 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] keystone_authtoken.auth_version = None {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.769170 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] keystone_authtoken.cache = None {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.769669 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.769669 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] keystone_authtoken.certfile = None {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.769669 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] keystone_authtoken.delay_auth_decision = False {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.769669 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.770228 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] keystone_authtoken.http_connect_timeout = None {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.771061 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.771643 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] keystone_authtoken.identity_uri = None {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.772199 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] keystone_authtoken.include_service_catalog = True {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.772780 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] keystone_authtoken.insecure = False {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.773366 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] keystone_authtoken.interface = public {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.773981 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] keystone_authtoken.keyfile = None {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.774635 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.775546 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.776152 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.776686 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.777245 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.779239 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] keystone_authtoken.memcache_secret_key = **** {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.780349 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] keystone_authtoken.memcache_security_strategy = None {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.780951 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.782173 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.782959 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] keystone_authtoken.region_name = None {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.783462 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.783932 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] keystone_authtoken.service_token_roles_required = False {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.784522 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] keystone_authtoken.service_type = None {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.785099 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] keystone_authtoken.token_cache_time = 300 {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.785560 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] keystone_authtoken.www_authenticate_uri = None {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.785782 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-344f1b11-75c6-45a7-9412-40cb558c91b4 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 20:50:24.786379 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] cache.backend = dogpile.cache.null {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.786941 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] cache.backend_argument = **** {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.787319 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] cache.config_prefix = cache.oslo {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.787708 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] cache.debug_cache_backend = False {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.788077 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] cache.enabled = False {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.788493 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] cache.expiration_time = 600 {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.788828 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] cache.memcache_dead_retry = 300 {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.789222 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.790452 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.790993 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] cache.memcache_pool_maxsize = 10 {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.791489 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] cache.memcache_pool_unused_timeout = 60 {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.792098 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] cache.memcache_servers = ['localhost:11211'] {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.792707 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] cache.memcache_socket_timeout = 1.0 {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.793093 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] cache.proxies = [] {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.793485 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] cache.tls_allowed_ciphers = None {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.793930 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] cache.tls_cafile = None {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.794270 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] cache.tls_certfile = None {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.794649 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] cache.tls_enabled = False {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.794979 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] cache.tls_keyfile = None {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.795387 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] coordination.backend_url = etcd3+http://10.222.0.100:2379 {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.795832 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] database.backend = sqlalchemy {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.796151 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] database.connection = **** {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.796542 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] database.connection_debug = 0 {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.796912 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] database.connection_parameters = {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.797800 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] database.connection_recycle_time = 3600 {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.798190 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] database.connection_trace = False {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.798922 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] database.db_inc_retry_interval = True {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.799316 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] database.db_max_retries = 20 {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.799678 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] database.db_max_retry_interval = 10 {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.800157 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] database.db_retry_interval = 1 {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.800706 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] database.max_overflow = 50 {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.803249 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] database.max_pool_size = 5 {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.803249 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] database.max_retries = 10 {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.803249 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] database.mysql_enable_ndb = False {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.803249 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] database.mysql_sql_mode = TRADITIONAL {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.804067 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] database.pool_timeout = None {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.804457 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] database.retry_interval = 10 {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.804845 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] database.slave_connection = **** {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.805213 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] database.sqlite_synchronous = True {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.805711 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] database.use_db_reconnect = False {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.806295 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.807235 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.807235 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] oslo_messaging_metrics.metrics_process_name = {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.807421 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.807763 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.808197 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] profiler.connection_string = messaging:// {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.808512 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] profiler.enabled = False {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.808878 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] profiler.es_doc_type = notification {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.809400 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] profiler.es_scroll_size = 10000 {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.809831 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] profiler.es_scroll_time = 2m {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.810207 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] profiler.filter_error_trace = False {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.810572 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] profiler.hmac_keys = SECRET_KEY {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.810940 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] profiler.sentinel_service_name = mymaster {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.811315 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] profiler.socket_timeout = 0.1 {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.811669 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] profiler.trace_sqlalchemy = False {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.812096 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] privsep_osbrick.capabilities = [21] {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.812475 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] privsep_osbrick.group = None {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.812875 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] privsep_osbrick.helper_command = None {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.813454 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] privsep_osbrick.logger_name = oslo_privsep.daemon {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.814097 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] privsep_osbrick.thread_pool_size = 4 {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.814468 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] privsep_osbrick.user = None {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.814874 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.815245 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] cinder_sys_admin.group = None {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.815592 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] cinder_sys_admin.helper_command = None {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.815970 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.816333 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.816723 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] cinder_sys_admin.user = None {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.817118 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] service_user.auth_section = None {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.817471 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] service_user.auth_type = None {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.821755 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] service_user.cafile = None {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.822154 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] service_user.certfile = None {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.822725 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] service_user.collect_timing = False {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.823107 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] service_user.insecure = False {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.823486 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] service_user.keyfile = None {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.823853 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] service_user.send_service_user_token = False {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.824369 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] service_user.split_loggers = False {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.824754 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] service_user.timeout = None {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.825278 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] backend_defaults.backend_availability_zone = None {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.827739 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.830672 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.830672 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] backend_defaults.chap_password = **** {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.830672 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] backend_defaults.chap_username = {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.830672 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.831067 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.driver [None req-344f1b11-75c6-45a7-9412-40cb558c91b4 None None] Driver hasn't implemented _init_vendor_properties() Jan 22 20:50:24.831159 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] backend_defaults.deferred_deletion_delay = 0 {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.831159 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] backend_defaults.deferred_deletion_purge_interval = 60 {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.831159 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] backend_defaults.driver_client_cert = None {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.831483 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] backend_defaults.driver_client_cert_key = None {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.831577 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] backend_defaults.driver_data_namespace = None {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.831766 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.driver [None req-344f1b11-75c6-45a7-9412-40cb558c91b4 None None] Initialized capabilities list: {'vendor_name': 'Open Source', 'driver_version': '1.2.0', 'storage_protocol': 'ceph', 'total_capacity_gb': 19.94, 'free_capacity_gb': 19.94, 'reserved_percentage': 0, 'multiattach': True, 'thin_provisioning_support': True, 'max_over_subscription_ratio': '20.0', 'location_info': 'ceph:/etc/ceph/ceph.conf:dc14f9b8-31ee-4f67-aa49-9d166f822655:cinder:volumes', 'backend_state': 'up', 'volume_backend_name': 'ceph', 'replication_enabled': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=129952) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:820}} Jan 22 20:50:24.831907 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] backend_defaults.driver_ssl_cert_path = None {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.832239 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.832599 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] backend_defaults.driver_use_ssl = False {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.832952 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] backend_defaults.enable_deferred_deletion = False {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.833311 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] backend_defaults.enable_unsupported_driver = False {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.835024 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.835024 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] backend_defaults.extra_capabilities = {} {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.835024 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] backend_defaults.filter_function = None {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.835024 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] backend_defaults.goodness_function = None {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.835331 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] backend_defaults.iet_conf = /etc/iet/ietd.conf {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.835437 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.835978 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.836340 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] backend_defaults.image_volume_cache_enabled = False {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.836703 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.837077 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.837460 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] backend_defaults.iscsi_iotype = fileio {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.837851 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] backend_defaults.iscsi_secondary_ip_addresses = [] {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.838303 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] backend_defaults.iscsi_target_flags = {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.838579 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] backend_defaults.iscsi_write_cache = on {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.838947 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] backend_defaults.iser_helper = tgtadm {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.840482 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] backend_defaults.iser_ip_address = 10.222.0.100 {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.840482 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] backend_defaults.iser_port = 3260 {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.840792 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.840925 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.841444 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.841988 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] backend_defaults.num_shell_tries = 3 {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.842344 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.842709 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] backend_defaults.nvmet_ns_id = 10 {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.843062 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] backend_defaults.nvmet_port_id = 1 {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.843434 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] backend_defaults.rados_connect_timeout = -1 {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.843798 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] backend_defaults.rados_connection_interval = 5 {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.844770 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] backend_defaults.rados_connection_retries = 3 {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.845139 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] backend_defaults.rbd_ceph_conf = {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.845565 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] backend_defaults.rbd_cluster_name = ceph {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.845909 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] backend_defaults.rbd_exclusive_cinder_pool = True {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.846009 ncdv-master-1 cinder-volume[129952]: DEBUG oslo_db.sqlalchemy.engines [None req-344f1b11-75c6-45a7-9412-40cb558c91b4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129952) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 22 20:50:24.846289 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] backend_defaults.rbd_flatten_volume_from_snapshot = False {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.846643 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] backend_defaults.rbd_max_clone_depth = 5 {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.847013 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] backend_defaults.rbd_pool = rbd {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.847359 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] backend_defaults.rbd_secret_uuid = None {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.847718 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] backend_defaults.rbd_store_chunk_size = 4 {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.848113 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] backend_defaults.rbd_user = None {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.848477 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] backend_defaults.replication_connect_timeout = 5 {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.848821 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] backend_defaults.replication_device = **** {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.849179 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] backend_defaults.report_discard_supported = False {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.850597 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] backend_defaults.report_dynamic_total_capacity = True {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.850597 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] backend_defaults.reserved_percentage = 0 {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.850597 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] backend_defaults.scst_target_driver = iscsi {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.850597 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] backend_defaults.scst_target_iqn_name = None {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.850954 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] backend_defaults.storage_protocol = iscsi {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.851263 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.851624 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] backend_defaults.target_helper = tgtadm {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.852109 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] backend_defaults.target_ip_address = 10.222.0.100 {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.852492 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] backend_defaults.target_port = 3260 {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.852857 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.853226 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] backend_defaults.target_protocol = iscsi {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.853654 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] backend_defaults.trace_flags = None {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.854189 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] backend_defaults.unique_fqdn_network = True {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.854780 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] backend_defaults.use_chap_auth = False {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.855303 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.855835 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] backend_defaults.volume_backend_name = None {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.856202 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] backend_defaults.volume_clear = zero {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.856550 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] backend_defaults.volume_clear_ionice = None {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.856907 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] backend_defaults.volume_clear_size = 0 {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.857280 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.858621 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.858621 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.858621 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.858909 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.859205 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] oslo_reports.file_event_handler = None {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.859645 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] oslo_reports.file_event_handler_interval = 1 {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.860035 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] oslo_reports.log_dir = None {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.860426 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] ceph.backend_availability_zone = None {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.860774 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] ceph.backend_host = None {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.861107 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] ceph.backend_native_threads_pool_size = None {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.861470 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] ceph.backup_use_temp_snapshot = None {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.861845 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] ceph.chap_password = **** {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.862197 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] ceph.chap_username = None {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.865324 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] ceph.chiscsi_conf = None {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.865324 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] ceph.deferred_deletion_delay = None {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.865324 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] ceph.deferred_deletion_purge_interval = None {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.865324 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] ceph.driver_client_cert = None {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.865324 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] ceph.driver_client_cert_key = None {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.865324 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] ceph.driver_data_namespace = None {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.865324 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] ceph.driver_ssl_cert_path = None {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.865951 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] ceph.driver_ssl_cert_verify = None {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.865951 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] ceph.driver_use_ssl = None {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.865951 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] ceph.enable_deferred_deletion = None {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.865951 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] ceph.enable_unsupported_driver = None {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.866245 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] ceph.enforce_multipath_for_image_xfer = None {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.866705 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] ceph.extra_capabilities = None {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.866927 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] ceph.filter_function = None {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.867274 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] ceph.goodness_function = None {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.867622 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] ceph.iet_conf = None {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.867971 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] ceph.image_upload_use_cinder_backend = None {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.868324 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] ceph.image_upload_use_internal_tenant = None {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.868750 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] ceph.image_volume_cache_enabled = True {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.870347 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] ceph.image_volume_cache_max_count = None {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.870347 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] ceph.image_volume_cache_max_size_gb = None {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.870347 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] ceph.iscsi_iotype = None {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.870347 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] ceph.iscsi_secondary_ip_addresses = None {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.870765 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] ceph.iscsi_target_flags = None {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.871033 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] ceph.iscsi_write_cache = None {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.871389 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] ceph.iser_helper = None {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.871711 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] ceph.iser_ip_address = None {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.872057 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] ceph.iser_port = None {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.872410 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] ceph.iser_target_prefix = None {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.872760 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] ceph.max_over_subscription_ratio = None {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.873107 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] ceph.num_iser_scan_tries = None {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.873475 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] ceph.num_shell_tries = None {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.873850 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] ceph.num_volume_device_scan_tries = None {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.874199 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] ceph.nvmet_ns_id = None {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.874547 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] ceph.nvmet_port_id = None {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.874913 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] ceph.rados_connect_timeout = -1 {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.875313 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] ceph.rados_connection_interval = None {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.875652 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] ceph.rados_connection_retries = None {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.876025 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] ceph.rbd_ceph_conf = /etc/ceph/ceph.conf {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.876365 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] ceph.rbd_cluster_name = None {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.876930 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] ceph.rbd_exclusive_cinder_pool = None {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.877053 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] ceph.rbd_flatten_volume_from_snapshot = False {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.877413 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] ceph.rbd_max_clone_depth = 5 {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.877791 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] ceph.rbd_pool = volumes {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.878157 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] ceph.rbd_secret_uuid = c7ee930a-3b87-450e-91f6-d4eef70cb484 {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.878518 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] ceph.rbd_store_chunk_size = 4 {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.878877 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] ceph.rbd_user = cinder {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.879227 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] ceph.replication_connect_timeout = None {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.879574 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] ceph.replication_device = **** {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.879917 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] ceph.report_discard_supported = None {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.880261 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] ceph.report_dynamic_total_capacity = None {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.880608 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] ceph.reserved_percentage = None {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.880964 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] ceph.scst_target_driver = None {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.881312 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] ceph.scst_target_iqn_name = None {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.882516 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] ceph.storage_protocol = None {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.882516 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] ceph.suppress_requests_ssl_warnings = None {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.882516 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] ceph.target_helper = None {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.882764 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] ceph.target_ip_address = None {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.883018 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] ceph.target_port = None {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.883361 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] ceph.target_prefix = None {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.883708 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] ceph.target_protocol = None {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.885613 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] ceph.trace_flags = None {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.885613 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] ceph.unique_fqdn_network = None {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.885613 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] ceph.use_chap_auth = None {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.885613 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] ceph.use_multipath_for_image_xfer = None {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.885613 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] ceph.volume_backend_name = ceph {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.886631 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] ceph.volume_clear = None {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.887150 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] ceph.volume_clear_ionice = None {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.887674 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] ceph.volume_clear_size = None {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.888206 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] ceph.volume_copy_blkio_cgroup_name = None {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.888560 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] ceph.volume_copy_bps_limit = None {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.888917 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] ceph.volume_dd_blocksize = None {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.889294 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] ceph.volume_driver = cinder.volume.drivers.rbd.RBDDriver {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.889765 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] ceph.volumes_dir = None {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.890372 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.891457 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.891850 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.892349 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.892729 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.893081 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.893468 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.893846 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.894207 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.894572 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.894974 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.895341 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.895829 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.896197 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.896459 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.896847 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.897199 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.900045 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.900045 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.900045 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.900045 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.900371 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.db.sqlalchemy.api [None req-344f1b11-75c6-45a7-9412-40cb558c91b4 None None] Building query based on filter {{(pid=129952) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3156}} Jan 22 20:50:24.900459 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] oslo_messaging_rabbit.ssl = False {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.900459 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.900459 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.900459 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.900459 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] oslo_messaging_rabbit.ssl_version = {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.900811 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] oslo_messaging_notifications.driver = [] {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.901780 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] oslo_messaging_notifications.retry = -1 {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.901780 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.901980 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] oslo_messaging_notifications.transport_url = **** {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.902245 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.902536 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] key_manager.fixed_key = **** {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.902976 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.903324 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] barbican.barbican_api_version = None {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.904287 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] barbican.barbican_endpoint = None {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.904287 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] barbican.barbican_endpoint_type = public {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.904491 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] barbican.barbican_region_name = None {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.904736 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] barbican.cafile = None {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.905075 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] barbican.certfile = None {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.905438 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] barbican.collect_timing = False {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.905844 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] barbican.insecure = False {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.906183 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] barbican.keyfile = None {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.907106 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] barbican.number_of_retries = 60 {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.907628 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] barbican.retry_delay = 1 {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.907974 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] barbican.send_service_user_token = False {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.908341 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] barbican.split_loggers = False {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.908730 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] barbican.timeout = None {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.909034 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] barbican.verify_ssl = True {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.909430 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] barbican.verify_ssl_path = None {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.909915 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] barbican_service_user.auth_section = None {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.910149 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] barbican_service_user.auth_type = None {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.911315 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] barbican_service_user.cafile = None {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.911315 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] barbican_service_user.certfile = None {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.911315 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] barbican_service_user.collect_timing = False {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.911583 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] barbican_service_user.insecure = False {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.911769 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] barbican_service_user.keyfile = None {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.912113 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] barbican_service_user.split_loggers = False {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.912457 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] barbican_service_user.timeout = None {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.912851 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] vault.approle_role_id = None {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.913194 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] vault.approle_secret_id = None {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.914852 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] vault.cafile = None {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.914852 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] vault.certfile = None {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.914852 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] vault.collect_timing = False {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.914852 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] vault.insecure = False {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.914852 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] vault.keyfile = None {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.915286 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] vault.kv_mountpoint = secret {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.915934 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] vault.kv_version = 2 {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.915934 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] vault.namespace = None {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.916286 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] vault.root_token_id = None {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.916682 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] vault.split_loggers = False {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.916961 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] vault.ssl_ca_crt_file = None {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.917305 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] vault.timeout = None {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.918657 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] vault.use_ssl = False {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.919072 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:50:24.919371 ncdv-master-1 cinder-volume[129780]: DEBUG oslo_service.service [None req-b869f535-a374-44ad-b3ad-3ed7da7c388a None None] ******************************************************************************** {{(pid=129780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jan 22 20:50:24.930767 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.image.image_utils [None req-344f1b11-75c6-45a7-9412-40cb558c91b4 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=129952) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:955}} Jan 22 20:50:24.936890 ncdv-master-1 cinder-volume[129952]: INFO cinder.keymgr.migration [None req-27268da4-8f20-4161-936c-b852eec061dc None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jan 22 20:50:24.945261 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-344f1b11-75c6-45a7-9412-40cb558c91b4 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 20:50:24.976944 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-344f1b11-75c6-45a7-9412-40cb558c91b4 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 20:50:25.007649 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.manager [None req-344f1b11-75c6-45a7-9412-40cb558c91b4 None None] Notifying Schedulers of capabilities ... {{(pid=129952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 22 20:50:25.034808 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-344f1b11-75c6-45a7-9412-40cb558c91b4 None None] Driver initialization completed successfully. Jan 22 20:50:25.043953 ncdv-master-1 cinder-volume[129952]: INFO cinder.manager [None req-344f1b11-75c6-45a7-9412-40cb558c91b4 None None] Initiating service 3 cleanup Jan 22 20:50:25.050292 ncdv-master-1 cinder-volume[129952]: INFO cinder.manager [None req-344f1b11-75c6-45a7-9412-40cb558c91b4 None None] Service 3 cleanup completed. Jan 22 20:50:25.052922 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.service [None req-344f1b11-75c6-45a7-9412-40cb558c91b4 None None] Creating RPC server for service cinder-volume {{(pid=129952) start /opt/stack/cinder/cinder/service.py:231}} Jan 22 20:50:25.056885 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.service [None req-344f1b11-75c6-45a7-9412-40cb558c91b4 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=129952) start /opt/stack/cinder/cinder/service.py:237}} Jan 22 20:50:25.109486 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-344f1b11-75c6-45a7-9412-40cb558c91b4 None None] Initializing RPC dependent components of volume driver RBDDriver (1.2.0) Jan 22 20:50:25.109486 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-344f1b11-75c6-45a7-9412-40cb558c91b4 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 20:50:25.135579 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-344f1b11-75c6-45a7-9412-40cb558c91b4 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 20:50:25.256415 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-344f1b11-75c6-45a7-9412-40cb558c91b4 None None] Driver post RPC initialization completed successfully. Jan 22 20:52:09.259637 ncdv-master-1 cinder-volume[129952]: DEBUG oslo_service.periodic_task [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129952) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jan 22 20:52:09.260461 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 20:52:09.282442 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 20:52:09.305459 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.manager [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] Notifying Schedulers of capabilities ... {{(pid=129952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 22 20:53:09.260648 ncdv-master-1 cinder-volume[129952]: DEBUG oslo_service.periodic_task [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129952) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jan 22 20:53:09.261359 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 20:53:09.283594 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 20:53:09.306311 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.manager [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] Notifying Schedulers of capabilities ... {{(pid=129952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 22 20:54:09.261326 ncdv-master-1 cinder-volume[129952]: DEBUG oslo_service.periodic_task [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129952) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jan 22 20:54:09.262065 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 20:54:09.284123 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 20:54:09.305649 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.manager [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] Notifying Schedulers of capabilities ... {{(pid=129952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 22 20:55:09.261286 ncdv-master-1 cinder-volume[129952]: DEBUG oslo_service.periodic_task [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129952) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jan 22 20:55:09.262019 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 20:55:09.283116 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 20:55:09.304112 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.manager [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] Notifying Schedulers of capabilities ... {{(pid=129952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 22 20:56:09.258858 ncdv-master-1 cinder-volume[129952]: DEBUG oslo_service.periodic_task [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129952) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jan 22 20:56:09.259593 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 20:56:09.280754 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 20:56:09.303019 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.manager [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] Notifying Schedulers of capabilities ... {{(pid=129952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 22 20:57:09.257946 ncdv-master-1 cinder-volume[129952]: DEBUG oslo_service.periodic_task [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129952) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jan 22 20:57:09.258592 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 20:57:09.279340 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 20:57:09.300973 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.manager [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] Notifying Schedulers of capabilities ... {{(pid=129952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 22 20:58:09.256311 ncdv-master-1 cinder-volume[129952]: DEBUG oslo_service.periodic_task [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129952) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jan 22 20:58:09.257018 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 20:58:09.278426 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 20:58:09.300124 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.manager [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] Notifying Schedulers of capabilities ... {{(pid=129952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 22 20:59:09.256116 ncdv-master-1 cinder-volume[129952]: DEBUG oslo_service.periodic_task [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129952) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jan 22 20:59:09.257900 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 20:59:09.292910 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 20:59:09.340965 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.manager [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] Notifying Schedulers of capabilities ... {{(pid=129952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 22 21:00:09.259931 ncdv-master-1 cinder-volume[129952]: DEBUG oslo_service.periodic_task [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129952) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jan 22 21:00:09.266717 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:00:09.329116 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:00:09.394662 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.manager [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] Notifying Schedulers of capabilities ... {{(pid=129952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 22 21:01:09.267940 ncdv-master-1 cinder-volume[129952]: DEBUG oslo_service.periodic_task [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129952) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jan 22 21:01:09.271142 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:01:09.350213 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:01:09.411271 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.manager [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] Notifying Schedulers of capabilities ... {{(pid=129952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 22 21:01:50.758909 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.flows.manager.create_volume [None req-5773cf8e-aa2a-4420-938b-79ceacba834d tempest-VolumesAdminNegativeTest-602683037 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129952) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Jan 22 21:01:50.769581 ncdv-master-1 cinder-volume[129952]: DEBUG oslo_db.sqlalchemy.engines [None req-5773cf8e-aa2a-4420-938b-79ceacba834d tempest-VolumesAdminNegativeTest-602683037 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129952) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 22 21:01:50.779676 ncdv-master-1 cinder-volume[129952]: INFO cinder.rpc [None req-5773cf8e-aa2a-4420-938b-79ceacba834d tempest-VolumesAdminNegativeTest-602683037 None] Automatically selected cinder-backup objects version 1.39 as minimum service version. Jan 22 21:01:50.787311 ncdv-master-1 cinder-volume[129952]: INFO cinder.rpc [None req-5773cf8e-aa2a-4420-938b-79ceacba834d tempest-VolumesAdminNegativeTest-602683037 None] Automatically selected cinder-backup RPC version 2.2 as minimum service version. Jan 22 21:01:50.787311 ncdv-master-1 cinder-volume[129952]: WARNING stevedore.named [None req-5773cf8e-aa2a-4420-938b-79ceacba834d tempest-VolumesAdminNegativeTest-602683037 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jan 22 21:01:50.787311 ncdv-master-1 cinder-volume[129952]: WARNING castellan.key_manager [None req-5773cf8e-aa2a-4420-938b-79ceacba834d tempest-VolumesAdminNegativeTest-602683037 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 22 21:01:50.831276 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-5773cf8e-aa2a-4420-938b-79ceacba834d tempest-VolumesAdminNegativeTest-602683037 None] Flow 'volume_create_manager' (16f3e55d-6879-4109-9aa6-c34a40bdc62f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 22 21:01:50.839614 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-5773cf8e-aa2a-4420-938b-79ceacba834d tempest-VolumesAdminNegativeTest-602683037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8fad8ab9-a784-42fa-b5ed-2b05fae14661) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:01:50.847573 ncdv-master-1 cinder-volume[129952]: DEBUG oslo_db.sqlalchemy.engines [None req-5773cf8e-aa2a-4420-938b-79ceacba834d tempest-VolumesAdminNegativeTest-602683037 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129952) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 22 21:01:50.922894 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-5773cf8e-aa2a-4420-938b-79ceacba834d tempest-VolumesAdminNegativeTest-602683037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8fad8ab9-a784-42fa-b5ed-2b05fae14661) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-01-22T21:01:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-208645524',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=501de85a-fda7-4063-a24a-b37457b69381,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ffe12a63826247c889a1700eba378728',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-01-22T21:01:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-01-22T21:01:51Z,use_quota=True,user_id='05643e88435d482fb3ed96d0a7f15208',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6dacb05b-a7ea-4056-85ff-98f0ea5c54eb),volume_type_id=6dacb05b-a7ea-4056-85ff-98f0ea5c54eb)' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:01:50.936486 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-5773cf8e-aa2a-4420-938b-79ceacba834d tempest-VolumesAdminNegativeTest-602683037 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4311554-8d12-4451-80f2-133b91c769d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:01:50.940553 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-5773cf8e-aa2a-4420-938b-79ceacba834d tempest-VolumesAdminNegativeTest-602683037 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4311554-8d12-4451-80f2-133b91c769d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:01:50.946221 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-5773cf8e-aa2a-4420-938b-79ceacba834d tempest-VolumesAdminNegativeTest-602683037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91f3e60e-c33e-42c0-939f-5e95850bc7ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:01:50.958247 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-5773cf8e-aa2a-4420-938b-79ceacba834d tempest-VolumesAdminNegativeTest-602683037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91f3e60e-c33e-42c0-939f-5e95850bc7ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '501de85a-fda7-4063-a24a-b37457b69381', 'volume_name': 'volume-501de85a-fda7-4063-a24a-b37457b69381', 'volume_size': 1}' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:01:50.962884 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-5773cf8e-aa2a-4420-938b-79ceacba834d tempest-VolumesAdminNegativeTest-602683037 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1c859aa-8261-41e8-b3f7-da78db337463) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:01:50.966996 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-5773cf8e-aa2a-4420-938b-79ceacba834d tempest-VolumesAdminNegativeTest-602683037 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1c859aa-8261-41e8-b3f7-da78db337463) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:01:50.973251 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-5773cf8e-aa2a-4420-938b-79ceacba834d tempest-VolumesAdminNegativeTest-602683037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a44653e9-a08a-421c-ad79-a5a0a906fcb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:01:50.976077 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.flows.manager.create_volume [None req-5773cf8e-aa2a-4420-938b-79ceacba834d tempest-VolumesAdminNegativeTest-602683037 None] Volume 501de85a-fda7-4063-a24a-b37457b69381: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-501de85a-fda7-4063-a24a-b37457b69381', 'volume_size': 1} Jan 22 21:01:50.976503 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-5773cf8e-aa2a-4420-938b-79ceacba834d tempest-VolumesAdminNegativeTest-602683037 None] creating volume 'volume-501de85a-fda7-4063-a24a-b37457b69381' {{(pid=129952) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Jan 22 21:01:50.977552 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-5773cf8e-aa2a-4420-938b-79ceacba834d tempest-VolumesAdminNegativeTest-602683037 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:01:51.608601 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-5773cf8e-aa2a-4420-938b-79ceacba834d tempest-VolumesAdminNegativeTest-602683037 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129952) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 22 21:01:51.609883 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-5773cf8e-aa2a-4420-938b-79ceacba834d tempest-VolumesAdminNegativeTest-602683037 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129952) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 22 21:01:51.619469 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-5773cf8e-aa2a-4420-938b-79ceacba834d tempest-VolumesAdminNegativeTest-602683037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a44653e9-a08a-421c-ad79-a5a0a906fcb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-501de85a-fda7-4063-a24a-b37457b69381', 'volume_size': 1}' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:01:51.629429 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-5773cf8e-aa2a-4420-938b-79ceacba834d tempest-VolumesAdminNegativeTest-602683037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (053ba252-f7d0-4b08-bdf9-0f9529478acf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:01:51.704376 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.flows.manager.create_volume [None req-5773cf8e-aa2a-4420-938b-79ceacba834d tempest-VolumesAdminNegativeTest-602683037 None] Volume volume-501de85a-fda7-4063-a24a-b37457b69381 (501de85a-fda7-4063-a24a-b37457b69381): created successfully Jan 22 21:01:51.708049 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-5773cf8e-aa2a-4420-938b-79ceacba834d tempest-VolumesAdminNegativeTest-602683037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (053ba252-f7d0-4b08-bdf9-0f9529478acf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:01:51.713689 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-5773cf8e-aa2a-4420-938b-79ceacba834d tempest-VolumesAdminNegativeTest-602683037 None] Flow 'volume_create_manager' (16f3e55d-6879-4109-9aa6-c34a40bdc62f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129952) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 22 21:01:51.767272 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-5773cf8e-aa2a-4420-938b-79ceacba834d tempest-VolumesAdminNegativeTest-602683037 None] Created volume successfully. Jan 22 21:01:54.118774 ncdv-master-1 cinder-volume[129952]: DEBUG oslo_concurrency.processutils [req-96beb4fc-2ab6-4c25-8109-732d2b31baf8 req-a4118b19-4c38-4fd0-b6fb-adff9508fbba tempest-VolumesAdminNegativeTest-602683037 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129952) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jan 22 21:01:54.995258 ncdv-master-1 cinder-volume[129952]: DEBUG oslo_concurrency.processutils [req-96beb4fc-2ab6-4c25-8109-732d2b31baf8 req-a4118b19-4c38-4fd0-b6fb-adff9508fbba tempest-VolumesAdminNegativeTest-602683037 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.876s {{(pid=129952) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jan 22 21:01:54.996047 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [req-96beb4fc-2ab6-4c25-8109-732d2b31baf8 req-a4118b19-4c38-4fd0-b6fb-adff9508fbba tempest-VolumesAdminNegativeTest-602683037 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-501de85a-fda7-4063-a24a-b37457b69381', 'hosts': ['10.222.0.100'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'c7ee930a-3b87-450e-91f6-d4eef70cb484', 'volume_id': '501de85a-fda7-4063-a24a-b37457b69381', 'discard': True}} {{(pid=129952) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Jan 22 21:01:55.110943 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [req-96beb4fc-2ab6-4c25-8109-732d2b31baf8 req-a4118b19-4c38-4fd0-b6fb-adff9508fbba tempest-VolumesAdminNegativeTest-602683037 None] Connection info returned from driver {'name': 'volumes/volume-501de85a-fda7-4063-a24a-b37457b69381', 'hosts': ['10.222.0.100'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '501de85a-fda7-4063-a24a-b37457b69381', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '252e459b-0f09-4dd4-b96e-93db418b2c59'} {{(pid=129952) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4811}} Jan 22 21:01:55.336290 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [req-96beb4fc-2ab6-4c25-8109-732d2b31baf8 req-a4118b19-4c38-4fd0-b6fb-adff9508fbba tempest-VolumesAdminNegativeTest-602683037 None] attachment_update completed successfully. Jan 22 21:02:04.489987 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [req-f62b0916-c2e7-4527-863b-ea1ebb100319 req-7574d607-bfb2-4147-b9f5-f26fda98e4b6 tempest-VolumesAdminNegativeTest-602683037 None] Terminate volume connection completed successfully. Jan 22 21:02:04.490705 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [req-f62b0916-c2e7-4527-863b-ea1ebb100319 req-7574d607-bfb2-4147-b9f5-f26fda98e4b6 tempest-VolumesAdminNegativeTest-602683037 None] Deleting attachment 252e459b-0f09-4dd4-b96e-93db418b2c59. {{(pid=129952) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4947}} Jan 22 21:02:06.936391 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.flows.manager.create_volume [None req-a02f97c9-4cb2-4ad1-9c20-cb9280300428 tempest-VolumesAdminNegativeTest-602683037 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129952) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Jan 22 21:02:06.942006 ncdv-master-1 cinder-volume[129952]: WARNING stevedore.named [None req-a02f97c9-4cb2-4ad1-9c20-cb9280300428 tempest-VolumesAdminNegativeTest-602683037 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jan 22 21:02:06.942506 ncdv-master-1 cinder-volume[129952]: WARNING castellan.key_manager [None req-a02f97c9-4cb2-4ad1-9c20-cb9280300428 tempest-VolumesAdminNegativeTest-602683037 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 22 21:02:06.989785 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-a02f97c9-4cb2-4ad1-9c20-cb9280300428 tempest-VolumesAdminNegativeTest-602683037 None] Flow 'volume_create_manager' (87ee152e-4b54-46eb-af5e-d8010adb107d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 22 21:02:07.003620 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-a02f97c9-4cb2-4ad1-9c20-cb9280300428 tempest-VolumesAdminNegativeTest-602683037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (734b2b0b-419c-48f6-a817-7fa7b61b3233) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:02:07.022453 ncdv-master-1 cinder-volume[129952]: DEBUG oslo_db.sqlalchemy.engines [None req-a02f97c9-4cb2-4ad1-9c20-cb9280300428 tempest-VolumesAdminNegativeTest-602683037 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129952) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 22 21:02:07.040330 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-a02f97c9-4cb2-4ad1-9c20-cb9280300428 tempest-VolumesAdminNegativeTest-602683037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (734b2b0b-419c-48f6-a817-7fa7b61b3233) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-01-22T21:02:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1851305518',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=b20a5c1c-3e92-457f-a478-05a4796c0718,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ffe12a63826247c889a1700eba378728',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-01-22T21:02:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-01-22T21:02:07Z,use_quota=True,user_id='05643e88435d482fb3ed96d0a7f15208',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6dacb05b-a7ea-4056-85ff-98f0ea5c54eb),volume_type_id=6dacb05b-a7ea-4056-85ff-98f0ea5c54eb)' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:02:07.046619 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-a02f97c9-4cb2-4ad1-9c20-cb9280300428 tempest-VolumesAdminNegativeTest-602683037 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8f6b29d-fa25-4214-8f1b-c83cc5f53876) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:02:07.062216 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-a02f97c9-4cb2-4ad1-9c20-cb9280300428 tempest-VolumesAdminNegativeTest-602683037 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8f6b29d-fa25-4214-8f1b-c83cc5f53876) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:02:07.068945 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-a02f97c9-4cb2-4ad1-9c20-cb9280300428 tempest-VolumesAdminNegativeTest-602683037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40285799-4a5c-4194-acfc-5968c65c3c85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:02:07.073910 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-a02f97c9-4cb2-4ad1-9c20-cb9280300428 tempest-VolumesAdminNegativeTest-602683037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40285799-4a5c-4194-acfc-5968c65c3c85) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b20a5c1c-3e92-457f-a478-05a4796c0718', 'volume_name': 'volume-b20a5c1c-3e92-457f-a478-05a4796c0718', 'volume_size': 1}' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:02:07.080314 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-a02f97c9-4cb2-4ad1-9c20-cb9280300428 tempest-VolumesAdminNegativeTest-602683037 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45e25e7d-8345-4399-844b-cc359af2f4d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:02:07.088016 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-a02f97c9-4cb2-4ad1-9c20-cb9280300428 tempest-VolumesAdminNegativeTest-602683037 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45e25e7d-8345-4399-844b-cc359af2f4d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:02:07.093447 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-a02f97c9-4cb2-4ad1-9c20-cb9280300428 tempest-VolumesAdminNegativeTest-602683037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ccd1b2f-d010-4cdc-a0ec-dc4dcd89f58d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:02:07.094829 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.flows.manager.create_volume [None req-a02f97c9-4cb2-4ad1-9c20-cb9280300428 tempest-VolumesAdminNegativeTest-602683037 None] Volume b20a5c1c-3e92-457f-a478-05a4796c0718: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b20a5c1c-3e92-457f-a478-05a4796c0718', 'volume_size': 1} Jan 22 21:02:07.096093 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-a02f97c9-4cb2-4ad1-9c20-cb9280300428 tempest-VolumesAdminNegativeTest-602683037 None] creating volume 'volume-b20a5c1c-3e92-457f-a478-05a4796c0718' {{(pid=129952) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Jan 22 21:02:07.097795 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-a02f97c9-4cb2-4ad1-9c20-cb9280300428 tempest-VolumesAdminNegativeTest-602683037 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:02:07.724187 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-a02f97c9-4cb2-4ad1-9c20-cb9280300428 tempest-VolumesAdminNegativeTest-602683037 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129952) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 22 21:02:07.724749 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-a02f97c9-4cb2-4ad1-9c20-cb9280300428 tempest-VolumesAdminNegativeTest-602683037 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129952) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 22 21:02:07.729177 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-a02f97c9-4cb2-4ad1-9c20-cb9280300428 tempest-VolumesAdminNegativeTest-602683037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ccd1b2f-d010-4cdc-a0ec-dc4dcd89f58d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b20a5c1c-3e92-457f-a478-05a4796c0718', 'volume_size': 1}' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:02:07.737843 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-a02f97c9-4cb2-4ad1-9c20-cb9280300428 tempest-VolumesAdminNegativeTest-602683037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03d43ae4-82e1-43c4-8bfd-11c8c53918ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:02:07.809321 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.flows.manager.create_volume [None req-a02f97c9-4cb2-4ad1-9c20-cb9280300428 tempest-VolumesAdminNegativeTest-602683037 None] Volume volume-b20a5c1c-3e92-457f-a478-05a4796c0718 (b20a5c1c-3e92-457f-a478-05a4796c0718): created successfully Jan 22 21:02:07.813387 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-a02f97c9-4cb2-4ad1-9c20-cb9280300428 tempest-VolumesAdminNegativeTest-602683037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03d43ae4-82e1-43c4-8bfd-11c8c53918ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:02:07.820045 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-a02f97c9-4cb2-4ad1-9c20-cb9280300428 tempest-VolumesAdminNegativeTest-602683037 None] Flow 'volume_create_manager' (87ee152e-4b54-46eb-af5e-d8010adb107d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129952) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 22 21:02:07.910193 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-a02f97c9-4cb2-4ad1-9c20-cb9280300428 tempest-VolumesAdminNegativeTest-602683037 None] Created volume successfully. Jan 22 21:02:08.987060 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.coordination [None req-532ed6fb-9afa-48e9-bd59-7d283a760e6c tempest-VolumesAdminNegativeTest-602683037 None] Lock "b'cinder-b20a5c1c-3e92-457f-a478-05a4796c0718-delete_volume'" acquired by "delete_volume" :: waited 0.018s {{(pid=129952) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 22 21:02:09.153395 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-532ed6fb-9afa-48e9-bd59-7d283a760e6c tempest-VolumesAdminNegativeTest-602683037 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:02:09.512327 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-532ed6fb-9afa-48e9-bd59-7d283a760e6c tempest-VolumesAdminNegativeTest-602683037 None] volume has no backup snaps {{(pid=129952) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Jan 22 21:02:09.522188 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-532ed6fb-9afa-48e9-bd59-7d283a760e6c tempest-VolumesAdminNegativeTest-602683037 None] Volume volume-b20a5c1c-3e92-457f-a478-05a4796c0718 is not a clone. {{(pid=129952) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Jan 22 21:02:09.659008 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-532ed6fb-9afa-48e9-bd59-7d283a760e6c tempest-VolumesAdminNegativeTest-602683037 None] deleting rbd volume volume-b20a5c1c-3e92-457f-a478-05a4796c0718 {{(pid=129952) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Jan 22 21:02:09.659008 ncdv-master-1 cinder-volume[129952]: DEBUG oslo_service.periodic_task [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129952) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jan 22 21:02:09.666146 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:02:09.768772 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:02:09.882185 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.manager [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] Notifying Schedulers of capabilities ... {{(pid=129952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 22 21:02:14.172291 ncdv-master-1 cinder-volume[129952]: WARNING cinder.quota [None req-532ed6fb-9afa-48e9-bd59-7d283a760e6c tempest-VolumesAdminNegativeTest-602683037 None] Deprecated: Default quota for resource: volumes_ceph is set by the default quota flag: quota_volumes_ceph, it is now deprecated. Please use the default quota class for default quota. Jan 22 21:02:14.176480 ncdv-master-1 cinder-volume[129952]: WARNING cinder.quota [None req-532ed6fb-9afa-48e9-bd59-7d283a760e6c tempest-VolumesAdminNegativeTest-602683037 None] Deprecated: Default quota for resource: gigabytes_ceph is set by the default quota flag: quota_gigabytes_ceph, it is now deprecated. Please use the default quota class for default quota. Jan 22 21:02:14.289852 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.quota [None req-532ed6fb-9afa-48e9-bd59-7d283a760e6c tempest-VolumesAdminNegativeTest-602683037 None] Created reservations ['92d3da28-2fc0-4ca3-a0fb-037b892b43c5', '2c0660cb-2305-4471-ae71-e3c86503b3a3', 'd6f01ae3-b7af-42b4-af95-ab6675850afb', '80c08f6f-a41d-4aa6-81be-6835fe182ab7'] {{(pid=129952) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 22 21:02:14.583029 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-532ed6fb-9afa-48e9-bd59-7d283a760e6c tempest-VolumesAdminNegativeTest-602683037 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:02:14.713084 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-532ed6fb-9afa-48e9-bd59-7d283a760e6c tempest-VolumesAdminNegativeTest-602683037 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:02:14.850429 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.manager [None req-532ed6fb-9afa-48e9-bd59-7d283a760e6c tempest-VolumesAdminNegativeTest-602683037 None] Notifying Schedulers of capabilities ... {{(pid=129952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 22 21:02:14.864843 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-532ed6fb-9afa-48e9-bd59-7d283a760e6c tempest-VolumesAdminNegativeTest-602683037 None] Deleted volume successfully. Jan 22 21:02:14.883258 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.coordination [None req-95d64ab3-e498-44fb-a735-8399a92c8680 tempest-VolumesAdminNegativeTest-602683037 None] Lock "b'cinder-501de85a-fda7-4063-a24a-b37457b69381-delete_volume'" acquired by "delete_volume" :: waited 0.025s {{(pid=129952) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 22 21:02:14.925991 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.coordination [None req-532ed6fb-9afa-48e9-bd59-7d283a760e6c tempest-VolumesAdminNegativeTest-602683037 None] Lock "b'cinder-b20a5c1c-3e92-457f-a478-05a4796c0718-delete_volume'" released by "delete_volume" :: held 5.940s {{(pid=129952) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 22 21:02:15.001543 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-95d64ab3-e498-44fb-a735-8399a92c8680 tempest-VolumesAdminNegativeTest-602683037 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:02:15.218034 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-95d64ab3-e498-44fb-a735-8399a92c8680 tempest-VolumesAdminNegativeTest-602683037 None] volume has no backup snaps {{(pid=129952) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Jan 22 21:02:15.223215 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-95d64ab3-e498-44fb-a735-8399a92c8680 tempest-VolumesAdminNegativeTest-602683037 None] Volume volume-501de85a-fda7-4063-a24a-b37457b69381 is not a clone. {{(pid=129952) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Jan 22 21:02:15.339223 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-95d64ab3-e498-44fb-a735-8399a92c8680 tempest-VolumesAdminNegativeTest-602683037 None] deleting rbd volume volume-501de85a-fda7-4063-a24a-b37457b69381 {{(pid=129952) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Jan 22 21:02:19.430254 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.quota [None req-95d64ab3-e498-44fb-a735-8399a92c8680 tempest-VolumesAdminNegativeTest-602683037 None] Created reservations ['d1525103-2dba-4e97-8f30-ad9d0e21d082', '0117ffc9-688f-4e6a-8358-057302b6ed48', '2a44cccf-7c51-463a-b527-032b36d13e26', '7b003c62-6ba0-482a-b7ff-1dd86d762f8b'] {{(pid=129952) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 22 21:02:19.684278 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-95d64ab3-e498-44fb-a735-8399a92c8680 tempest-VolumesAdminNegativeTest-602683037 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:02:19.778676 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-95d64ab3-e498-44fb-a735-8399a92c8680 tempest-VolumesAdminNegativeTest-602683037 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:02:19.849139 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.manager [None req-95d64ab3-e498-44fb-a735-8399a92c8680 tempest-VolumesAdminNegativeTest-602683037 None] Notifying Schedulers of capabilities ... {{(pid=129952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 22 21:02:19.864835 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-95d64ab3-e498-44fb-a735-8399a92c8680 tempest-VolumesAdminNegativeTest-602683037 None] Deleted volume successfully. Jan 22 21:02:19.928057 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.coordination [None req-95d64ab3-e498-44fb-a735-8399a92c8680 tempest-VolumesAdminNegativeTest-602683037 None] Lock "b'cinder-501de85a-fda7-4063-a24a-b37457b69381-delete_volume'" released by "delete_volume" :: held 5.045s {{(pid=129952) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 22 21:02:35.352195 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.flows.manager.create_volume [None req-76cc3e67-cc99-4d38-92c1-6d35796f535b tempest-LiveMigrationTest-256070455 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129952) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Jan 22 21:02:35.371334 ncdv-master-1 cinder-volume[129952]: WARNING stevedore.named [None req-76cc3e67-cc99-4d38-92c1-6d35796f535b tempest-LiveMigrationTest-256070455 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jan 22 21:02:35.372154 ncdv-master-1 cinder-volume[129952]: WARNING castellan.key_manager [None req-76cc3e67-cc99-4d38-92c1-6d35796f535b tempest-LiveMigrationTest-256070455 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 22 21:02:35.400729 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-76cc3e67-cc99-4d38-92c1-6d35796f535b tempest-LiveMigrationTest-256070455 None] Flow 'volume_create_manager' (832e0978-92e6-42fc-ad3f-eb58f7cce3d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 22 21:02:35.410236 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-76cc3e67-cc99-4d38-92c1-6d35796f535b tempest-LiveMigrationTest-256070455 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de8d8cc8-3adc-4f65-b06c-2f0ce96419f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:02:35.419699 ncdv-master-1 cinder-volume[129952]: DEBUG oslo_db.sqlalchemy.engines [None req-76cc3e67-cc99-4d38-92c1-6d35796f535b tempest-LiveMigrationTest-256070455 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129952) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 22 21:02:35.440494 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-76cc3e67-cc99-4d38-92c1-6d35796f535b tempest-LiveMigrationTest-256070455 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de8d8cc8-3adc-4f65-b06c-2f0ce96419f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-01-22T21:02:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-LiveMigrationTest-volume-1634919595',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=ce68f69a-0548-4980-9511-4b7d28d8afda,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b277338cf6c4478e8e35cf79b34caaf6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-01-22T21:02:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-01-22T21:02:35Z,use_quota=True,user_id='b07a1bb09ad44501925664aa61ac3e6d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6dacb05b-a7ea-4056-85ff-98f0ea5c54eb),volume_type_id=6dacb05b-a7ea-4056-85ff-98f0ea5c54eb)' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:02:35.450621 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-76cc3e67-cc99-4d38-92c1-6d35796f535b tempest-LiveMigrationTest-256070455 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea7a7fe5-68d4-43a7-8bf5-a6572c368412) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:02:35.455921 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-76cc3e67-cc99-4d38-92c1-6d35796f535b tempest-LiveMigrationTest-256070455 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea7a7fe5-68d4-43a7-8bf5-a6572c368412) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:02:35.463368 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-76cc3e67-cc99-4d38-92c1-6d35796f535b tempest-LiveMigrationTest-256070455 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e09f2259-f783-49bd-b853-c2b4f98f0fdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:02:35.468753 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-76cc3e67-cc99-4d38-92c1-6d35796f535b tempest-LiveMigrationTest-256070455 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e09f2259-f783-49bd-b853-c2b4f98f0fdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ce68f69a-0548-4980-9511-4b7d28d8afda', 'volume_name': 'volume-ce68f69a-0548-4980-9511-4b7d28d8afda', 'volume_size': 1}' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:02:35.475693 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-76cc3e67-cc99-4d38-92c1-6d35796f535b tempest-LiveMigrationTest-256070455 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a81aa506-01bc-44b8-b022-5f1ff3dfa25c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:02:35.479829 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-76cc3e67-cc99-4d38-92c1-6d35796f535b tempest-LiveMigrationTest-256070455 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a81aa506-01bc-44b8-b022-5f1ff3dfa25c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:02:35.484833 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-76cc3e67-cc99-4d38-92c1-6d35796f535b tempest-LiveMigrationTest-256070455 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5b10a67-71eb-42f6-a4b2-939e5f739e54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:02:35.487467 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.flows.manager.create_volume [None req-76cc3e67-cc99-4d38-92c1-6d35796f535b tempest-LiveMigrationTest-256070455 None] Volume ce68f69a-0548-4980-9511-4b7d28d8afda: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ce68f69a-0548-4980-9511-4b7d28d8afda', 'volume_size': 1} Jan 22 21:02:35.487867 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-76cc3e67-cc99-4d38-92c1-6d35796f535b tempest-LiveMigrationTest-256070455 None] creating volume 'volume-ce68f69a-0548-4980-9511-4b7d28d8afda' {{(pid=129952) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Jan 22 21:02:35.489050 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-76cc3e67-cc99-4d38-92c1-6d35796f535b tempest-LiveMigrationTest-256070455 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:02:36.048745 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-76cc3e67-cc99-4d38-92c1-6d35796f535b tempest-LiveMigrationTest-256070455 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129952) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 22 21:02:36.049288 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-76cc3e67-cc99-4d38-92c1-6d35796f535b tempest-LiveMigrationTest-256070455 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129952) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 22 21:02:36.053237 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-76cc3e67-cc99-4d38-92c1-6d35796f535b tempest-LiveMigrationTest-256070455 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5b10a67-71eb-42f6-a4b2-939e5f739e54) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ce68f69a-0548-4980-9511-4b7d28d8afda', 'volume_size': 1}' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:02:36.064114 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-76cc3e67-cc99-4d38-92c1-6d35796f535b tempest-LiveMigrationTest-256070455 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dca364a3-4505-4248-a552-d4dfc680c1c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:02:36.201117 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.flows.manager.create_volume [None req-76cc3e67-cc99-4d38-92c1-6d35796f535b tempest-LiveMigrationTest-256070455 None] Volume volume-ce68f69a-0548-4980-9511-4b7d28d8afda (ce68f69a-0548-4980-9511-4b7d28d8afda): created successfully Jan 22 21:02:36.216933 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-76cc3e67-cc99-4d38-92c1-6d35796f535b tempest-LiveMigrationTest-256070455 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dca364a3-4505-4248-a552-d4dfc680c1c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:02:36.216933 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-76cc3e67-cc99-4d38-92c1-6d35796f535b tempest-LiveMigrationTest-256070455 None] Flow 'volume_create_manager' (832e0978-92e6-42fc-ad3f-eb58f7cce3d4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129952) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 22 21:02:36.303336 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-76cc3e67-cc99-4d38-92c1-6d35796f535b tempest-LiveMigrationTest-256070455 None] Created volume successfully. Jan 22 21:02:38.841822 ncdv-master-1 cinder-volume[129952]: DEBUG oslo_concurrency.processutils [req-4a065e28-9efa-4bc5-b4b6-e65898407306 req-0a77b8eb-3a3b-45e1-9c67-84be88137f72 tempest-LiveMigrationTest-256070455 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129952) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jan 22 21:02:40.301982 ncdv-master-1 cinder-volume[129952]: DEBUG oslo_concurrency.processutils [req-4a065e28-9efa-4bc5-b4b6-e65898407306 req-0a77b8eb-3a3b-45e1-9c67-84be88137f72 tempest-LiveMigrationTest-256070455 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.459s {{(pid=129952) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jan 22 21:02:40.302913 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [req-4a065e28-9efa-4bc5-b4b6-e65898407306 req-0a77b8eb-3a3b-45e1-9c67-84be88137f72 tempest-LiveMigrationTest-256070455 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-ce68f69a-0548-4980-9511-4b7d28d8afda', 'hosts': ['10.222.0.100'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'c7ee930a-3b87-450e-91f6-d4eef70cb484', 'volume_id': 'ce68f69a-0548-4980-9511-4b7d28d8afda', 'discard': True}} {{(pid=129952) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Jan 22 21:02:40.523511 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [req-4a065e28-9efa-4bc5-b4b6-e65898407306 req-0a77b8eb-3a3b-45e1-9c67-84be88137f72 tempest-LiveMigrationTest-256070455 None] Connection info returned from driver {'name': 'volumes/volume-ce68f69a-0548-4980-9511-4b7d28d8afda', 'hosts': ['10.222.0.100'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'ce68f69a-0548-4980-9511-4b7d28d8afda', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '4befa725-ce9b-45df-ba23-543537512076'} {{(pid=129952) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4811}} Jan 22 21:02:40.695854 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [req-4a065e28-9efa-4bc5-b4b6-e65898407306 req-0a77b8eb-3a3b-45e1-9c67-84be88137f72 tempest-LiveMigrationTest-256070455 None] attachment_update completed successfully. Jan 22 21:02:44.108410 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.flows.manager.create_volume [None req-44eb869a-cbf4-4bce-b31b-312baf35114b tempest-LiveAutoBlockMigrationV225Test-176555791 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129952) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Jan 22 21:02:44.116314 ncdv-master-1 cinder-volume[129952]: WARNING stevedore.named [None req-44eb869a-cbf4-4bce-b31b-312baf35114b tempest-LiveAutoBlockMigrationV225Test-176555791 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jan 22 21:02:44.118498 ncdv-master-1 cinder-volume[129952]: WARNING castellan.key_manager [None req-44eb869a-cbf4-4bce-b31b-312baf35114b tempest-LiveAutoBlockMigrationV225Test-176555791 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 22 21:02:44.154001 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-44eb869a-cbf4-4bce-b31b-312baf35114b tempest-LiveAutoBlockMigrationV225Test-176555791 None] Flow 'volume_create_manager' (91f48de9-d128-4493-bd9b-de242b60d3ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 22 21:02:44.162036 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-44eb869a-cbf4-4bce-b31b-312baf35114b tempest-LiveAutoBlockMigrationV225Test-176555791 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8fb78512-7c13-4fb0-b796-f507bd94b4dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:02:44.193524 ncdv-master-1 cinder-volume[129952]: DEBUG oslo_db.sqlalchemy.engines [None req-44eb869a-cbf4-4bce-b31b-312baf35114b tempest-LiveAutoBlockMigrationV225Test-176555791 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129952) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 22 21:02:44.235935 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-44eb869a-cbf4-4bce-b31b-312baf35114b tempest-LiveAutoBlockMigrationV225Test-176555791 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8fb78512-7c13-4fb0-b796-f507bd94b4dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-01-22T21:02:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-LiveAutoBlockMigrationV225Test-volume-820609693',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=135c98ab-cd95-4a5b-baa2-e72e4414fe5b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4aa958f703204cbca5fd08472e45909f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-01-22T21:02:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-01-22T21:02:44Z,use_quota=True,user_id='c8fa58b4de634969ba8dcaf054e0b8b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6dacb05b-a7ea-4056-85ff-98f0ea5c54eb),volume_type_id=6dacb05b-a7ea-4056-85ff-98f0ea5c54eb)' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:02:44.254787 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-44eb869a-cbf4-4bce-b31b-312baf35114b tempest-LiveAutoBlockMigrationV225Test-176555791 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce25bde4-0449-482e-8775-caf069971ee5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:02:44.268617 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-44eb869a-cbf4-4bce-b31b-312baf35114b tempest-LiveAutoBlockMigrationV225Test-176555791 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce25bde4-0449-482e-8775-caf069971ee5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:02:44.275397 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-44eb869a-cbf4-4bce-b31b-312baf35114b tempest-LiveAutoBlockMigrationV225Test-176555791 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43851b49-70cb-4d6f-9a11-1274b1eac569) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:02:44.285047 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-44eb869a-cbf4-4bce-b31b-312baf35114b tempest-LiveAutoBlockMigrationV225Test-176555791 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43851b49-70cb-4d6f-9a11-1274b1eac569) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '135c98ab-cd95-4a5b-baa2-e72e4414fe5b', 'volume_name': 'volume-135c98ab-cd95-4a5b-baa2-e72e4414fe5b', 'volume_size': 1}' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:02:44.294686 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-44eb869a-cbf4-4bce-b31b-312baf35114b tempest-LiveAutoBlockMigrationV225Test-176555791 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79399f34-45ad-47be-9a07-f325944c1f50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:02:44.310110 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-44eb869a-cbf4-4bce-b31b-312baf35114b tempest-LiveAutoBlockMigrationV225Test-176555791 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79399f34-45ad-47be-9a07-f325944c1f50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:02:44.318734 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-44eb869a-cbf4-4bce-b31b-312baf35114b tempest-LiveAutoBlockMigrationV225Test-176555791 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fef64ac3-b177-482c-bcde-b8a502688650) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:02:44.320251 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.flows.manager.create_volume [None req-44eb869a-cbf4-4bce-b31b-312baf35114b tempest-LiveAutoBlockMigrationV225Test-176555791 None] Volume 135c98ab-cd95-4a5b-baa2-e72e4414fe5b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-135c98ab-cd95-4a5b-baa2-e72e4414fe5b', 'volume_size': 1} Jan 22 21:02:44.321000 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-44eb869a-cbf4-4bce-b31b-312baf35114b tempest-LiveAutoBlockMigrationV225Test-176555791 None] creating volume 'volume-135c98ab-cd95-4a5b-baa2-e72e4414fe5b' {{(pid=129952) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Jan 22 21:02:44.322403 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-44eb869a-cbf4-4bce-b31b-312baf35114b tempest-LiveAutoBlockMigrationV225Test-176555791 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:02:45.305332 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-44eb869a-cbf4-4bce-b31b-312baf35114b tempest-LiveAutoBlockMigrationV225Test-176555791 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129952) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 22 21:02:45.306028 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-44eb869a-cbf4-4bce-b31b-312baf35114b tempest-LiveAutoBlockMigrationV225Test-176555791 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129952) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 22 21:02:45.309490 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-44eb869a-cbf4-4bce-b31b-312baf35114b tempest-LiveAutoBlockMigrationV225Test-176555791 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fef64ac3-b177-482c-bcde-b8a502688650) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-135c98ab-cd95-4a5b-baa2-e72e4414fe5b', 'volume_size': 1}' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:02:45.331414 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-44eb869a-cbf4-4bce-b31b-312baf35114b tempest-LiveAutoBlockMigrationV225Test-176555791 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09adb49c-5ffb-4430-88dd-419f5290b1f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:02:45.482371 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.flows.manager.create_volume [None req-44eb869a-cbf4-4bce-b31b-312baf35114b tempest-LiveAutoBlockMigrationV225Test-176555791 None] Volume volume-135c98ab-cd95-4a5b-baa2-e72e4414fe5b (135c98ab-cd95-4a5b-baa2-e72e4414fe5b): created successfully Jan 22 21:02:45.486516 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-44eb869a-cbf4-4bce-b31b-312baf35114b tempest-LiveAutoBlockMigrationV225Test-176555791 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09adb49c-5ffb-4430-88dd-419f5290b1f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:02:45.492484 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-44eb869a-cbf4-4bce-b31b-312baf35114b tempest-LiveAutoBlockMigrationV225Test-176555791 None] Flow 'volume_create_manager' (91f48de9-d128-4493-bd9b-de242b60d3ad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129952) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 22 21:02:45.601784 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-44eb869a-cbf4-4bce-b31b-312baf35114b tempest-LiveAutoBlockMigrationV225Test-176555791 None] Created volume successfully. Jan 22 21:02:47.430401 ncdv-master-1 cinder-volume[129952]: DEBUG oslo_concurrency.processutils [req-538de347-8935-4869-8969-62d837e9ea09 req-d4f63966-8ddf-45a0-a0d2-50843cf44397 tempest-LiveAutoBlockMigrationV225Test-176555791 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129952) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jan 22 21:02:48.865649 ncdv-master-1 cinder-volume[129952]: DEBUG oslo_concurrency.processutils [req-538de347-8935-4869-8969-62d837e9ea09 req-d4f63966-8ddf-45a0-a0d2-50843cf44397 tempest-LiveAutoBlockMigrationV225Test-176555791 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.435s {{(pid=129952) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jan 22 21:02:48.866446 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [req-538de347-8935-4869-8969-62d837e9ea09 req-d4f63966-8ddf-45a0-a0d2-50843cf44397 tempest-LiveAutoBlockMigrationV225Test-176555791 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-135c98ab-cd95-4a5b-baa2-e72e4414fe5b', 'hosts': ['10.222.0.100'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'c7ee930a-3b87-450e-91f6-d4eef70cb484', 'volume_id': '135c98ab-cd95-4a5b-baa2-e72e4414fe5b', 'discard': True}} {{(pid=129952) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Jan 22 21:02:49.018164 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [req-538de347-8935-4869-8969-62d837e9ea09 req-d4f63966-8ddf-45a0-a0d2-50843cf44397 tempest-LiveAutoBlockMigrationV225Test-176555791 None] Connection info returned from driver {'name': 'volumes/volume-135c98ab-cd95-4a5b-baa2-e72e4414fe5b', 'hosts': ['10.222.0.100'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '135c98ab-cd95-4a5b-baa2-e72e4414fe5b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '8c6c17aa-698a-4784-951b-a5bb8ef32c3e'} {{(pid=129952) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4811}} Jan 22 21:02:49.167125 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [req-538de347-8935-4869-8969-62d837e9ea09 req-d4f63966-8ddf-45a0-a0d2-50843cf44397 tempest-LiveAutoBlockMigrationV225Test-176555791 None] attachment_update completed successfully. Jan 22 21:02:53.169078 ncdv-master-1 cinder-volume[129952]: DEBUG oslo_concurrency.processutils [req-e4a3b68b-cd43-424d-9ca1-517e2a2e3bbc req-172da8e7-405b-4955-9bd6-3ab34fca8ffa tempest-LiveMigrationTest-26529045 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129952) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jan 22 21:02:54.271093 ncdv-master-1 cinder-volume[129952]: DEBUG oslo_concurrency.processutils [req-e4a3b68b-cd43-424d-9ca1-517e2a2e3bbc req-172da8e7-405b-4955-9bd6-3ab34fca8ffa tempest-LiveMigrationTest-26529045 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.102s {{(pid=129952) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jan 22 21:02:54.271972 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [req-e4a3b68b-cd43-424d-9ca1-517e2a2e3bbc req-172da8e7-405b-4955-9bd6-3ab34fca8ffa tempest-LiveMigrationTest-26529045 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-ce68f69a-0548-4980-9511-4b7d28d8afda', 'hosts': ['10.222.0.100'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'c7ee930a-3b87-450e-91f6-d4eef70cb484', 'volume_id': 'ce68f69a-0548-4980-9511-4b7d28d8afda', 'discard': True}} {{(pid=129952) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Jan 22 21:02:54.435153 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [req-e4a3b68b-cd43-424d-9ca1-517e2a2e3bbc req-172da8e7-405b-4955-9bd6-3ab34fca8ffa tempest-LiveMigrationTest-26529045 None] Connection info returned from driver {'name': 'volumes/volume-ce68f69a-0548-4980-9511-4b7d28d8afda', 'hosts': ['10.222.0.100'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'ce68f69a-0548-4980-9511-4b7d28d8afda', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'd392d6fa-2495-4f8a-a19d-77e005a407e1'} {{(pid=129952) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4811}} Jan 22 21:02:54.599973 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [req-e4a3b68b-cd43-424d-9ca1-517e2a2e3bbc req-172da8e7-405b-4955-9bd6-3ab34fca8ffa tempest-LiveMigrationTest-26529045 None] attachment_update completed successfully. Jan 22 21:03:05.740043 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [req-e4a3b68b-cd43-424d-9ca1-517e2a2e3bbc req-e6bae6a6-8a55-4ffb-883f-5374911a9876 tempest-LiveMigrationTest-26529045 None] Terminate volume connection completed successfully. Jan 22 21:03:05.740651 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [req-e4a3b68b-cd43-424d-9ca1-517e2a2e3bbc req-e6bae6a6-8a55-4ffb-883f-5374911a9876 tempest-LiveMigrationTest-26529045 None] Deleting attachment 4befa725-ce9b-45df-ba23-543537512076. {{(pid=129952) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4947}} Jan 22 21:03:09.659189 ncdv-master-1 cinder-volume[129952]: DEBUG oslo_service.periodic_task [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129952) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jan 22 21:03:09.663646 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:03:09.750890 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:03:09.830192 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.manager [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] Notifying Schedulers of capabilities ... {{(pid=129952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 22 21:03:12.299281 ncdv-master-1 cinder-volume[129952]: DEBUG oslo_concurrency.processutils [req-2678ce67-4798-4264-913b-22928daa06ca req-3e769959-1ad2-48de-9b51-9d42122f5a2a tempest-LiveAutoBlockMigrationV225Test-830537647 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129952) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jan 22 21:03:12.508704 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [req-e420916e-63ff-4d7b-85f5-0eca63aa5174 req-f320b2be-de9d-4d18-b648-c9b987c04535 tempest-LiveMigrationTest-256070455 None] Terminate volume connection completed successfully. Jan 22 21:03:12.509158 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [req-e420916e-63ff-4d7b-85f5-0eca63aa5174 req-f320b2be-de9d-4d18-b648-c9b987c04535 tempest-LiveMigrationTest-256070455 None] Deleting attachment d392d6fa-2495-4f8a-a19d-77e005a407e1. {{(pid=129952) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4947}} Jan 22 21:03:13.416381 ncdv-master-1 cinder-volume[129952]: DEBUG oslo_concurrency.processutils [req-2678ce67-4798-4264-913b-22928daa06ca req-3e769959-1ad2-48de-9b51-9d42122f5a2a tempest-LiveAutoBlockMigrationV225Test-830537647 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.117s {{(pid=129952) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jan 22 21:03:13.418750 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [req-2678ce67-4798-4264-913b-22928daa06ca req-3e769959-1ad2-48de-9b51-9d42122f5a2a tempest-LiveAutoBlockMigrationV225Test-830537647 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-135c98ab-cd95-4a5b-baa2-e72e4414fe5b', 'hosts': ['10.222.0.100'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'c7ee930a-3b87-450e-91f6-d4eef70cb484', 'volume_id': '135c98ab-cd95-4a5b-baa2-e72e4414fe5b', 'discard': True}} {{(pid=129952) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Jan 22 21:03:13.709716 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [req-2678ce67-4798-4264-913b-22928daa06ca req-3e769959-1ad2-48de-9b51-9d42122f5a2a tempest-LiveAutoBlockMigrationV225Test-830537647 None] Connection info returned from driver {'name': 'volumes/volume-135c98ab-cd95-4a5b-baa2-e72e4414fe5b', 'hosts': ['10.222.0.100'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '135c98ab-cd95-4a5b-baa2-e72e4414fe5b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'b313dcce-056e-4098-8638-0604d234b5e2'} {{(pid=129952) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4811}} Jan 22 21:03:13.922668 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [req-2678ce67-4798-4264-913b-22928daa06ca req-3e769959-1ad2-48de-9b51-9d42122f5a2a tempest-LiveAutoBlockMigrationV225Test-830537647 None] attachment_update completed successfully. Jan 22 21:03:15.294234 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.flows.manager.create_volume [None req-d982720f-f14f-4f31-966a-145442123138 tempest-LiveMigrationTest-256070455 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129952) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Jan 22 21:03:15.299664 ncdv-master-1 cinder-volume[129952]: WARNING stevedore.named [None req-d982720f-f14f-4f31-966a-145442123138 tempest-LiveMigrationTest-256070455 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jan 22 21:03:15.300226 ncdv-master-1 cinder-volume[129952]: WARNING castellan.key_manager [None req-d982720f-f14f-4f31-966a-145442123138 tempest-LiveMigrationTest-256070455 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 22 21:03:15.325355 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-d982720f-f14f-4f31-966a-145442123138 tempest-LiveMigrationTest-256070455 None] Flow 'volume_create_manager' (59dc5ab6-a9fc-48b7-ad47-8bb555b48001) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 22 21:03:15.332763 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-d982720f-f14f-4f31-966a-145442123138 tempest-LiveMigrationTest-256070455 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70d31f2b-3b28-46d5-a397-46f1ccce712b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:03:15.341923 ncdv-master-1 cinder-volume[129952]: DEBUG oslo_db.sqlalchemy.engines [None req-f9a96bc2-89a0-4297-a5a4-44f92249617c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129952) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 22 21:03:15.368426 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-d982720f-f14f-4f31-966a-145442123138 tempest-LiveMigrationTest-256070455 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70d31f2b-3b28-46d5-a397-46f1ccce712b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-01-22T21:03:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-470479129',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=0b17e2f4-e149-4a4b-b525-3d029be2e6f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b277338cf6c4478e8e35cf79b34caaf6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-01-22T21:03:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-01-22T21:03:15Z,use_quota=True,user_id='b07a1bb09ad44501925664aa61ac3e6d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6dacb05b-a7ea-4056-85ff-98f0ea5c54eb),volume_type_id=6dacb05b-a7ea-4056-85ff-98f0ea5c54eb)' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:03:15.375239 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-d982720f-f14f-4f31-966a-145442123138 tempest-LiveMigrationTest-256070455 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (668e10df-b0fb-4a65-aecf-7d41eee94a9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:03:15.379783 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-d982720f-f14f-4f31-966a-145442123138 tempest-LiveMigrationTest-256070455 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (668e10df-b0fb-4a65-aecf-7d41eee94a9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:03:15.387017 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-d982720f-f14f-4f31-966a-145442123138 tempest-LiveMigrationTest-256070455 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c752c26-d4ee-4e98-b65e-cca8037459ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:03:15.565483 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-d982720f-f14f-4f31-966a-145442123138 tempest-LiveMigrationTest-256070455 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c752c26-d4ee-4e98-b65e-cca8037459ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '0b17e2f4-e149-4a4b-b525-3d029be2e6f6', 'volume_name': 'volume-0b17e2f4-e149-4a4b-b525-3d029be2e6f6', 'volume_size': 1, 'image_id': '373cb480-3bc4-4821-93e2-442b4e852b80', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '994e8f6963f04af3be3dbae11a73cdfd', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '373cb480-3bc4-4821-93e2-442b4e852b80', 'created_at': datetime.datetime(2022, 1, 22, 20, 50, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 1, 22, 20, 50, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/373cb480-3bc4-4821-93e2-442b4e852b80/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:03:15.581014 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-d982720f-f14f-4f31-966a-145442123138 tempest-LiveMigrationTest-256070455 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (263bc1b5-b1b6-4c2c-bd4d-744c4e2d5e8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:03:15.589335 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-d982720f-f14f-4f31-966a-145442123138 tempest-LiveMigrationTest-256070455 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (263bc1b5-b1b6-4c2c-bd4d-744c4e2d5e8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:03:15.596677 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-d982720f-f14f-4f31-966a-145442123138 tempest-LiveMigrationTest-256070455 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6bcdafc5-8e16-4a53-a4c0-1dc7c5c8409c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:03:15.598219 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.flows.manager.create_volume [None req-d982720f-f14f-4f31-966a-145442123138 tempest-LiveMigrationTest-256070455 None] Volume 0b17e2f4-e149-4a4b-b525-3d029be2e6f6: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-0b17e2f4-e149-4a4b-b525-3d029be2e6f6', 'volume_size': 1, 'image_id': '373cb480-3bc4-4821-93e2-442b4e852b80', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '994e8f6963f04af3be3dbae11a73cdfd', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '373cb480-3bc4-4821-93e2-442b4e852b80', 'created_at': datetime.datetime(2022, 1, 22, 20, 50, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 1, 22, 20, 50, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/373cb480-3bc4-4821-93e2-442b4e852b80/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jan 22 21:03:15.599784 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.flows.manager.create_volume [None req-d982720f-f14f-4f31-966a-145442123138 tempest-LiveMigrationTest-256070455 None] Cloning 0b17e2f4-e149-4a4b-b525-3d029be2e6f6 from image 373cb480-3bc4-4821-93e2-442b4e852b80 at location (None, None). {{(pid=129952) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1046}} Jan 22 21:03:15.615057 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.coordination [None req-d982720f-f14f-4f31-966a-145442123138 tempest-LiveMigrationTest-256070455 None] Lock "b'cinder-373cb480-3bc4-4821-93e2-442b4e852b80'" acquired by "_prepare_image_cache_entry" :: waited 0.014s {{(pid=129952) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 22 21:03:15.628422 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.flows.manager.create_volume [None req-d982720f-f14f-4f31-966a-145442123138 tempest-LiveMigrationTest-256070455 None] Preparing cache entry for image = 373cb480-3bc4-4821-93e2-442b4e852b80 on host ncdv-master-1@ceph#ceph. {{(pid=129952) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:874}} Jan 22 21:03:15.630366 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.flows.manager.create_volume [None req-d982720f-f14f-4f31-966a-145442123138 tempest-LiveMigrationTest-256070455 None] Attempting to retrieve cache entry for image = 373cb480-3bc4-4821-93e2-442b4e852b80 on host ncdv-master-1@ceph#ceph. {{(pid=129952) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:810}} Jan 22 21:03:25.028114 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [req-2678ce67-4798-4264-913b-22928daa06ca req-a9806aa8-cfa0-4cd7-89e6-76cb79c81723 tempest-LiveAutoBlockMigrationV225Test-830537647 None] Terminate volume connection completed successfully. Jan 22 21:03:25.029004 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [req-2678ce67-4798-4264-913b-22928daa06ca req-a9806aa8-cfa0-4cd7-89e6-76cb79c81723 tempest-LiveAutoBlockMigrationV225Test-830537647 None] Deleting attachment 8c6c17aa-698a-4784-951b-a5bb8ef32c3e. {{(pid=129952) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4947}} Jan 22 21:03:32.510435 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.image.image_utils [None req-d982720f-f14f-4f31-966a-145442123138 tempest-LiveMigrationTest-256070455 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_373cb480-3bc4-4821-93e2-442b4e852b80_ol51xczlncdv-master-1@ceph, size 616.00 MB, duration 16.87 sec {{(pid=129952) fetch /opt/stack/cinder/cinder/image/image_utils.py:580}} Jan 22 21:03:32.513772 ncdv-master-1 cinder-volume[129952]: INFO cinder.image.image_utils [None req-d982720f-f14f-4f31-966a-145442123138 tempest-LiveMigrationTest-256070455 None] Image download 616.00 MB at 36.51 MB/s Jan 22 21:03:32.567720 ncdv-master-1 cinder-volume[129952]: DEBUG oslo_concurrency.processutils [None req-d982720f-f14f-4f31-966a-145442123138 tempest-LiveMigrationTest-256070455 None] Running cmd (subprocess): /usr/bin/python3.8 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_373cb480-3bc4-4821-93e2-442b4e852b80_ol51xczlncdv-master-1@ceph {{(pid=129952) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jan 22 21:03:32.687759 ncdv-master-1 sudo[141033]: ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_373cb480-3bc4-4821-93e2-442b4e852b80_ol51xczlncdv-master-1@ceph Jan 22 21:03:32.688623 ncdv-master-1 sudo[141033]: pam_unix(sudo:session): session opened for user root by (uid=0) Jan 22 21:03:34.520251 ncdv-master-1 sudo[141033]: pam_unix(sudo:session): session closed for user root Jan 22 21:03:34.523519 ncdv-master-1 cinder-volume[129952]: DEBUG oslo_concurrency.processutils [None req-d982720f-f14f-4f31-966a-145442123138 tempest-LiveMigrationTest-256070455 None] CMD "/usr/bin/python3.8 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_373cb480-3bc4-4821-93e2-442b4e852b80_ol51xczlncdv-master-1@ceph" returned: 0 in 1.955s {{(pid=129952) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jan 22 21:03:34.528252 ncdv-master-1 cinder-volume[129952]: WARNING py.warnings [None req-d982720f-f14f-4f31-966a-145442123138 tempest-LiveMigrationTest-256070455 None] /usr/local/lib/python3.8/dist-packages/oslo_utils/imageutils.py:71: FutureWarning: The human format is deprecated and the format parameter will be removed. Use explicitly json instead in version 'xena' Jan 22 21:03:34.528252 ncdv-master-1 cinder-volume[129952]: debtcollector.deprecate( Jan 22 21:03:34.528252 ncdv-master-1 cinder-volume[129952]: Jan 22 21:03:34.532253 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.image.image_utils [None req-d982720f-f14f-4f31-966a-145442123138 tempest-LiveMigrationTest-256070455 None] Temporary image 373cb480-3bc4-4821-93e2-442b4e852b80 is fetched for user b07a1bb09ad44501925664aa61ac3e6d. {{(pid=129952) fetch /opt/stack/cinder/cinder/image/image_utils.py:1088}} Jan 22 21:03:34.754026 ncdv-master-1 cinder-volume[129952]: DEBUG oslo_concurrency.processutils [None req-d982720f-f14f-4f31-966a-145442123138 tempest-LiveMigrationTest-256070455 None] Running cmd (subprocess): /usr/bin/python3.8 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_373cb480-3bc4-4821-93e2-442b4e852b80_ol51xczlncdv-master-1@ceph {{(pid=129952) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jan 22 21:03:34.846492 ncdv-master-1 sudo[141039]: ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_373cb480-3bc4-4821-93e2-442b4e852b80_ol51xczlncdv-master-1@ceph Jan 22 21:03:34.848166 ncdv-master-1 sudo[141039]: pam_unix(sudo:session): session opened for user root by (uid=0) Jan 22 21:03:35.550694 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [req-f80aa2c5-5cef-4814-aa3d-a9351a56f4b5 req-974538df-43cc-4f73-b916-046f0242f870 tempest-LiveAutoBlockMigrationV225Test-176555791 None] Terminate volume connection completed successfully. Jan 22 21:03:35.552961 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [req-f80aa2c5-5cef-4814-aa3d-a9351a56f4b5 req-974538df-43cc-4f73-b916-046f0242f870 tempest-LiveAutoBlockMigrationV225Test-176555791 None] Deleting attachment b313dcce-056e-4098-8638-0604d234b5e2. {{(pid=129952) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4947}} Jan 22 21:03:36.528018 ncdv-master-1 sudo[141039]: pam_unix(sudo:session): session closed for user root Jan 22 21:03:36.530199 ncdv-master-1 cinder-volume[129952]: DEBUG oslo_concurrency.processutils [None req-d982720f-f14f-4f31-966a-145442123138 tempest-LiveMigrationTest-256070455 None] CMD "/usr/bin/python3.8 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_373cb480-3bc4-4821-93e2-442b4e852b80_ol51xczlncdv-master-1@ceph" returned: 0 in 1.776s {{(pid=129952) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jan 22 21:03:36.530899 ncdv-master-1 cinder-volume[129952]: WARNING py.warnings [None req-d982720f-f14f-4f31-966a-145442123138 tempest-LiveMigrationTest-256070455 None] /usr/local/lib/python3.8/dist-packages/oslo_utils/imageutils.py:71: FutureWarning: The human format is deprecated and the format parameter will be removed. Use explicitly json instead in version 'xena' Jan 22 21:03:36.530899 ncdv-master-1 cinder-volume[129952]: debtcollector.deprecate( Jan 22 21:03:36.530899 ncdv-master-1 cinder-volume[129952]: Jan 22 21:03:36.531618 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-d982720f-f14f-4f31-966a-145442123138 tempest-LiveMigrationTest-256070455 None] creating volume 'volume-0b17e2f4-e149-4a4b-b525-3d029be2e6f6' {{(pid=129952) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Jan 22 21:03:36.538159 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-d982720f-f14f-4f31-966a-145442123138 tempest-LiveMigrationTest-256070455 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:03:37.546812 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-d982720f-f14f-4f31-966a-145442123138 tempest-LiveMigrationTest-256070455 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129952) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 22 21:03:37.547801 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-d982720f-f14f-4f31-966a-145442123138 tempest-LiveMigrationTest-256070455 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129952) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 22 21:03:37.691604 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.volume_utils [None req-d982720f-f14f-4f31-966a-145442123138 tempest-LiveMigrationTest-256070455 None] Attempting download of 373cb480-3bc4-4821-93e2-442b4e852b80 ((None, None)) to volume 0b17e2f4-e149-4a4b-b525-3d029be2e6f6. {{(pid=129952) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1228}} Jan 22 21:03:37.760733 ncdv-master-1 cinder-volume[129952]: DEBUG oslo_concurrency.processutils [None req-d982720f-f14f-4f31-966a-145442123138 tempest-LiveMigrationTest-256070455 None] Running cmd (subprocess): /usr/bin/python3.8 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_download_373cb480-3bc4-4821-93e2-442b4e852b80_ih8rsg4e {{(pid=129952) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jan 22 21:03:37.922982 ncdv-master-1 sudo[141060]: ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_download_373cb480-3bc4-4821-93e2-442b4e852b80_ih8rsg4e Jan 22 21:03:37.924246 ncdv-master-1 sudo[141060]: pam_unix(sudo:session): session opened for user root by (uid=0) Jan 22 21:03:38.599378 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.flows.manager.create_volume [None req-a61dd4c0-d6c1-4e04-8003-f14b95798005 tempest-LiveAutoBlockMigrationV225Test-176555791 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129952) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Jan 22 21:03:38.604937 ncdv-master-1 cinder-volume[129952]: WARNING stevedore.named [None req-a61dd4c0-d6c1-4e04-8003-f14b95798005 tempest-LiveAutoBlockMigrationV225Test-176555791 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jan 22 21:03:38.605443 ncdv-master-1 cinder-volume[129952]: WARNING castellan.key_manager [None req-a61dd4c0-d6c1-4e04-8003-f14b95798005 tempest-LiveAutoBlockMigrationV225Test-176555791 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 22 21:03:38.656215 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-a61dd4c0-d6c1-4e04-8003-f14b95798005 tempest-LiveAutoBlockMigrationV225Test-176555791 None] Flow 'volume_create_manager' (76097aa5-1e08-4867-aec0-697312bd8330) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 22 21:03:38.667047 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-a61dd4c0-d6c1-4e04-8003-f14b95798005 tempest-LiveAutoBlockMigrationV225Test-176555791 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96ea9481-123d-4b3f-89fe-03f2afc08148) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:03:38.676852 ncdv-master-1 cinder-volume[129952]: DEBUG oslo_db.sqlalchemy.engines [None req-a61dd4c0-d6c1-4e04-8003-f14b95798005 tempest-LiveAutoBlockMigrationV225Test-176555791 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129952) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 22 21:03:38.695393 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-a61dd4c0-d6c1-4e04-8003-f14b95798005 tempest-LiveAutoBlockMigrationV225Test-176555791 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96ea9481-123d-4b3f-89fe-03f2afc08148) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-01-22T21:03:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-2004289976',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=77269952-ab3c-402f-ad65-b6254782bbb8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4aa958f703204cbca5fd08472e45909f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-01-22T21:03:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-01-22T21:03:38Z,use_quota=True,user_id='c8fa58b4de634969ba8dcaf054e0b8b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6dacb05b-a7ea-4056-85ff-98f0ea5c54eb),volume_type_id=6dacb05b-a7ea-4056-85ff-98f0ea5c54eb)' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:03:38.702859 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-a61dd4c0-d6c1-4e04-8003-f14b95798005 tempest-LiveAutoBlockMigrationV225Test-176555791 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1160408c-39bb-4e60-bb36-5e2c5ef7dd07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:03:38.707157 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-a61dd4c0-d6c1-4e04-8003-f14b95798005 tempest-LiveAutoBlockMigrationV225Test-176555791 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1160408c-39bb-4e60-bb36-5e2c5ef7dd07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:03:38.712432 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-a61dd4c0-d6c1-4e04-8003-f14b95798005 tempest-LiveAutoBlockMigrationV225Test-176555791 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46e6eb97-5d81-4a18-b5c7-8c6763127667) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:03:38.805457 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-a61dd4c0-d6c1-4e04-8003-f14b95798005 tempest-LiveAutoBlockMigrationV225Test-176555791 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46e6eb97-5d81-4a18-b5c7-8c6763127667) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '77269952-ab3c-402f-ad65-b6254782bbb8', 'volume_name': 'volume-77269952-ab3c-402f-ad65-b6254782bbb8', 'volume_size': 1, 'image_id': '373cb480-3bc4-4821-93e2-442b4e852b80', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '994e8f6963f04af3be3dbae11a73cdfd', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '373cb480-3bc4-4821-93e2-442b4e852b80', 'created_at': datetime.datetime(2022, 1, 22, 20, 50, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 1, 22, 20, 50, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/373cb480-3bc4-4821-93e2-442b4e852b80/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:03:38.813579 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-a61dd4c0-d6c1-4e04-8003-f14b95798005 tempest-LiveAutoBlockMigrationV225Test-176555791 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58d7b753-5366-4a69-86c5-a36e77a090fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:03:38.818726 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-a61dd4c0-d6c1-4e04-8003-f14b95798005 tempest-LiveAutoBlockMigrationV225Test-176555791 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58d7b753-5366-4a69-86c5-a36e77a090fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:03:38.823870 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-a61dd4c0-d6c1-4e04-8003-f14b95798005 tempest-LiveAutoBlockMigrationV225Test-176555791 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11de0b2d-8d44-4e0f-afe2-48baa8ca2b4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:03:38.825183 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.flows.manager.create_volume [None req-a61dd4c0-d6c1-4e04-8003-f14b95798005 tempest-LiveAutoBlockMigrationV225Test-176555791 None] Volume 77269952-ab3c-402f-ad65-b6254782bbb8: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-77269952-ab3c-402f-ad65-b6254782bbb8', 'volume_size': 1, 'image_id': '373cb480-3bc4-4821-93e2-442b4e852b80', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '994e8f6963f04af3be3dbae11a73cdfd', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '373cb480-3bc4-4821-93e2-442b4e852b80', 'created_at': datetime.datetime(2022, 1, 22, 20, 50, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 1, 22, 20, 50, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/373cb480-3bc4-4821-93e2-442b4e852b80/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jan 22 21:03:38.825757 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.flows.manager.create_volume [None req-a61dd4c0-d6c1-4e04-8003-f14b95798005 tempest-LiveAutoBlockMigrationV225Test-176555791 None] Cloning 77269952-ab3c-402f-ad65-b6254782bbb8 from image 373cb480-3bc4-4821-93e2-442b4e852b80 at location (None, None). {{(pid=129952) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1046}} Jan 22 21:03:39.118627 ncdv-master-1 sudo[141060]: pam_unix(sudo:session): session closed for user root Jan 22 21:03:39.121638 ncdv-master-1 cinder-volume[129952]: DEBUG oslo_concurrency.processutils [None req-d982720f-f14f-4f31-966a-145442123138 tempest-LiveMigrationTest-256070455 None] CMD "/usr/bin/python3.8 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_download_373cb480-3bc4-4821-93e2-442b4e852b80_ih8rsg4e" returned: 0 in 1.361s {{(pid=129952) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jan 22 21:03:39.122904 ncdv-master-1 cinder-volume[129952]: WARNING py.warnings [None req-d982720f-f14f-4f31-966a-145442123138 tempest-LiveMigrationTest-256070455 None] /usr/local/lib/python3.8/dist-packages/oslo_utils/imageutils.py:71: FutureWarning: The human format is deprecated and the format parameter will be removed. Use explicitly json instead in version 'xena' Jan 22 21:03:39.122904 ncdv-master-1 cinder-volume[129952]: debtcollector.deprecate( Jan 22 21:03:39.122904 ncdv-master-1 cinder-volume[129952]: Jan 22 21:03:39.125161 ncdv-master-1 cinder-volume[129952]: DEBUG oslo_concurrency.processutils [None req-d982720f-f14f-4f31-966a-145442123138 tempest-LiveMigrationTest-256070455 None] Running cmd (subprocess): /usr/bin/python3.8 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_373cb480-3bc4-4821-93e2-442b4e852b80_ol51xczlncdv-master-1@ceph {{(pid=129952) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jan 22 21:03:39.316569 ncdv-master-1 sudo[141067]: ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_373cb480-3bc4-4821-93e2-442b4e852b80_ol51xczlncdv-master-1@ceph Jan 22 21:03:39.317383 ncdv-master-1 sudo[141067]: pam_unix(sudo:session): session opened for user root by (uid=0) Jan 22 21:03:40.663917 ncdv-master-1 sudo[141067]: pam_unix(sudo:session): session closed for user root Jan 22 21:03:40.666589 ncdv-master-1 cinder-volume[129952]: DEBUG oslo_concurrency.processutils [None req-d982720f-f14f-4f31-966a-145442123138 tempest-LiveMigrationTest-256070455 None] CMD "/usr/bin/python3.8 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_373cb480-3bc4-4821-93e2-442b4e852b80_ol51xczlncdv-master-1@ceph" returned: 0 in 1.542s {{(pid=129952) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jan 22 21:03:40.669652 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.image.image_utils [None req-d982720f-f14f-4f31-966a-145442123138 tempest-LiveMigrationTest-256070455 None] 373cb480-3bc4-4821-93e2-442b4e852b80 was vhdx, converting to raw {{(pid=129952) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:793}} Jan 22 21:03:40.671455 ncdv-master-1 cinder-volume[129952]: DEBUG oslo_concurrency.processutils [None req-d982720f-f14f-4f31-966a-145442123138 tempest-LiveMigrationTest-256070455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f vhdx /opt/stack/data/cinder/conversion/image_fetch_373cb480-3bc4-4821-93e2-442b4e852b80_ol51xczlncdv-master-1@ceph /opt/stack/data/cinder/conversion/tmp66b12co6 {{(pid=129952) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jan 22 21:03:40.713732 ncdv-master-1 sudo[141109]: ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f vhdx /opt/stack/data/cinder/conversion/image_fetch_373cb480-3bc4-4821-93e2-442b4e852b80_ol51xczlncdv-master-1@ceph /opt/stack/data/cinder/conversion/tmp66b12co6 Jan 22 21:03:40.715507 ncdv-master-1 sudo[141109]: pam_unix(sudo:session): session opened for user root by (uid=0) Jan 22 21:03:42.926770 ncdv-master-1 sudo[141109]: pam_unix(sudo:session): session closed for user root Jan 22 21:03:42.928859 ncdv-master-1 cinder-volume[129952]: DEBUG oslo_concurrency.processutils [None req-d982720f-f14f-4f31-966a-145442123138 tempest-LiveMigrationTest-256070455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f vhdx /opt/stack/data/cinder/conversion/image_fetch_373cb480-3bc4-4821-93e2-442b4e852b80_ol51xczlncdv-master-1@ceph /opt/stack/data/cinder/conversion/tmp66b12co6" returned: 0 in 2.257s {{(pid=129952) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jan 22 21:03:42.929896 ncdv-master-1 cinder-volume[129952]: DEBUG oslo_concurrency.processutils [None req-d982720f-f14f-4f31-966a-145442123138 tempest-LiveMigrationTest-256070455 None] Running cmd (subprocess): /usr/bin/python3.8 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_373cb480-3bc4-4821-93e2-442b4e852b80_ol51xczlncdv-master-1@ceph {{(pid=129952) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jan 22 21:03:43.025633 ncdv-master-1 sudo[141138]: ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_373cb480-3bc4-4821-93e2-442b4e852b80_ol51xczlncdv-master-1@ceph Jan 22 21:03:43.026631 ncdv-master-1 sudo[141138]: pam_unix(sudo:session): session opened for user root by (uid=0) Jan 22 21:03:44.076998 ncdv-master-1 sudo[141138]: pam_unix(sudo:session): session closed for user root Jan 22 21:03:44.079280 ncdv-master-1 cinder-volume[129952]: DEBUG oslo_concurrency.processutils [None req-d982720f-f14f-4f31-966a-145442123138 tempest-LiveMigrationTest-256070455 None] CMD "/usr/bin/python3.8 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_373cb480-3bc4-4821-93e2-442b4e852b80_ol51xczlncdv-master-1@ceph" returned: 0 in 1.149s {{(pid=129952) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jan 22 21:03:44.080128 ncdv-master-1 cinder-volume[129952]: WARNING py.warnings [None req-d982720f-f14f-4f31-966a-145442123138 tempest-LiveMigrationTest-256070455 None] /usr/local/lib/python3.8/dist-packages/oslo_utils/imageutils.py:71: FutureWarning: The human format is deprecated and the format parameter will be removed. Use explicitly json instead in version 'xena' Jan 22 21:03:44.080128 ncdv-master-1 cinder-volume[129952]: debtcollector.deprecate( Jan 22 21:03:44.080128 ncdv-master-1 cinder-volume[129952]: Jan 22 21:03:44.080884 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.image.image_utils [None req-d982720f-f14f-4f31-966a-145442123138 tempest-LiveMigrationTest-256070455 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_373cb480-3bc4-4821-93e2-442b4e852b80_ol51xczlncdv-master-1@ceph, size 700.00 MB, duration 2.26 sec, destination /opt/stack/data/cinder/conversion/tmp66b12co6 {{(pid=129952) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:412}} Jan 22 21:03:44.081366 ncdv-master-1 cinder-volume[129952]: INFO cinder.image.image_utils [None req-d982720f-f14f-4f31-966a-145442123138 tempest-LiveMigrationTest-256070455 None] Converted 700.00 MB image at 309.94 MB/s Jan 22 21:03:44.083603 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-d982720f-f14f-4f31-966a-145442123138 tempest-LiveMigrationTest-256070455 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:03:44.657671 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-d982720f-f14f-4f31-966a-145442123138 tempest-LiveMigrationTest-256070455 None] volume has no backup snaps {{(pid=129952) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Jan 22 21:03:44.657671 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-d982720f-f14f-4f31-966a-145442123138 tempest-LiveMigrationTest-256070455 None] Volume volume-0b17e2f4-e149-4a4b-b525-3d029be2e6f6 is not a clone. {{(pid=129952) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Jan 22 21:03:44.847782 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-d982720f-f14f-4f31-966a-145442123138 tempest-LiveMigrationTest-256070455 None] deleting rbd volume volume-0b17e2f4-e149-4a4b-b525-3d029be2e6f6 {{(pid=129952) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Jan 22 21:03:48.668734 ncdv-master-1 cinder-volume[129952]: DEBUG oslo_concurrency.processutils [None req-d982720f-f14f-4f31-966a-145442123138 tempest-LiveMigrationTest-256070455 None] Running cmd (subprocess): rbd import --pool volumes --order 22 /opt/stack/data/cinder/conversion/tmp66b12co6 volume-0b17e2f4-e149-4a4b-b525-3d029be2e6f6 --new-format --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129952) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jan 22 21:04:09.656725 ncdv-master-1 cinder-volume[129952]: DEBUG oslo_service.periodic_task [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129952) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jan 22 21:04:09.658412 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:04:09.706885 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:04:09.770583 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.manager [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] Notifying Schedulers of capabilities ... {{(pid=129952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 22 21:04:43.476680 ncdv-master-1 cinder-volume[129952]: DEBUG oslo_concurrency.processutils [None req-d982720f-f14f-4f31-966a-145442123138 tempest-LiveMigrationTest-256070455 None] CMD "rbd import --pool volumes --order 22 /opt/stack/data/cinder/conversion/tmp66b12co6 volume-0b17e2f4-e149-4a4b-b525-3d029be2e6f6 --new-format --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 54.809s {{(pid=129952) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jan 22 21:04:43.597785 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-d982720f-f14f-4f31-966a-145442123138 tempest-LiveMigrationTest-256070455 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:04:44.524522 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-d982720f-f14f-4f31-966a-145442123138 tempest-LiveMigrationTest-256070455 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129952) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 22 21:04:44.525213 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-d982720f-f14f-4f31-966a-145442123138 tempest-LiveMigrationTest-256070455 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129952) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 22 21:04:44.525975 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.volume_utils [None req-d982720f-f14f-4f31-966a-145442123138 tempest-LiveMigrationTest-256070455 None] Downloaded image 373cb480-3bc4-4821-93e2-442b4e852b80 ((None, None)) to volume 0b17e2f4-e149-4a4b-b525-3d029be2e6f6 successfully. {{(pid=129952) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1268}} Jan 22 21:04:44.576616 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.image.image_utils [None req-d982720f-f14f-4f31-966a-145442123138 tempest-LiveMigrationTest-256070455 None] Temporary image 373cb480-3bc4-4821-93e2-442b4e852b80 for user b07a1bb09ad44501925664aa61ac3e6d is deleted. {{(pid=129952) fetch /opt/stack/cinder/cinder/image/image_utils.py:1092}} Jan 22 21:04:44.850207 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.quota [None req-d982720f-f14f-4f31-966a-145442123138 tempest-LiveMigrationTest-256070455 None] Created reservations ['021b291e-3666-4a3e-b656-d7f0b576e7a2', '7b578ae0-1b57-486d-a49c-797a031ed869', '52407f1d-e0db-4f6c-8f60-6733ec5afe06', '1d271b46-c1de-46d3-8bd7-6322ce591b0b'] {{(pid=129952) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 22 21:04:44.862442 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-d982720f-f14f-4f31-966a-145442123138 tempest-LiveMigrationTest-256070455 None] Creating image volume entry: {'provider_geometry': None, 'project_id': '98c62088157141ffa8ace45b5c19d03f', 'volume_type_id': '6dacb05b-a7ea-4056-85ff-98f0ea5c54eb', 'encryption_key_id': None, 'user_id': 'b07a1bb09ad44501925664aa61ac3e6d', 'created_at': datetime.datetime(2022, 1, 22, 21, 3, 15, tzinfo=datetime.timezone.utc), 'display_description': None, 'ec2_id': None, 'service_uuid': None, 'replication_extended_status': None, 'cluster_name': None, 'launched_at': None, 'group_id': None, 'provider_location': None, 'shared_targets': True, 'terminated_at': None, 'scheduled_at': datetime.datetime(2022, 1, 22, 21, 3, 15, tzinfo=datetime.timezone.utc), 'bootable': False, 'replication_driver_data': None, 'volume_glance_metadata': [{'key': 'signature_verified', 'value': 'False'}], 'availability_zone': 'nova', 'deleted': False, 'previous_status': None, 'metadata': {}, 'updated_at': datetime.datetime(2022, 1, 22, 21, 3, 15, tzinfo=datetime.timezone.utc), 'multiattach': False, 'replication_status': None, 'display_name': 'image-373cb480-3bc4-4821-93e2-442b4e852b80', 'size': 1, 'host': 'ncdv-master-1@ceph#ceph', 'volume_admin_metadata': [], 'provider_auth': None, 'deleted_at': None, 'volume_metadata': [], 'provider_id': None, 'consistencygroup_id': None, 'attach_status': 'detached', 'status': 'creating', 'source_volid': '0b17e2f4-e149-4a4b-b525-3d029be2e6f6'}. {{(pid=129952) _clone_image_volume /opt/stack/cinder/cinder/volume/manager.py:1615}} Jan 22 21:04:45.131092 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.flows.manager.create_volume [None req-d982720f-f14f-4f31-966a-145442123138 tempest-LiveMigrationTest-256070455 None] Volume reschedule parameters: False retry: None {{(pid=129952) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Jan 22 21:04:45.134866 ncdv-master-1 cinder-volume[129952]: WARNING stevedore.named [None req-d982720f-f14f-4f31-966a-145442123138 tempest-LiveMigrationTest-256070455 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jan 22 21:04:45.135356 ncdv-master-1 cinder-volume[129952]: WARNING castellan.key_manager [None req-d982720f-f14f-4f31-966a-145442123138 tempest-LiveMigrationTest-256070455 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 22 21:04:45.157178 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-d982720f-f14f-4f31-966a-145442123138 tempest-LiveMigrationTest-256070455 None] Flow 'volume_create_manager' (e4214987-c2e7-430d-9156-2cc9a4e796b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 22 21:04:45.163981 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-d982720f-f14f-4f31-966a-145442123138 tempest-LiveMigrationTest-256070455 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9de76ef9-cdea-4f50-ab1a-b8138355a0e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:04:45.171823 ncdv-master-1 cinder-volume[129952]: DEBUG oslo_db.sqlalchemy.engines [None req-d982720f-f14f-4f31-966a-145442123138 tempest-LiveMigrationTest-256070455 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129952) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 22 21:04:45.186883 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-d982720f-f14f-4f31-966a-145442123138 tempest-LiveMigrationTest-256070455 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9de76ef9-cdea-4f50-ab1a-b8138355a0e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-01-22T21:03:15Z,deleted=False,deleted_at=None,display_description=None,display_name='image-373cb480-3bc4-4821-93e2-442b4e852b80',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=f39c1078-cff4-40dd-93df-4ce49cd873b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='98c62088157141ffa8ace45b5c19d03f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-01-22T21:03:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=0b17e2f4-e149-4a4b-b525-3d029be2e6f6,status='creating',terminated_at=None,updated_at=2022-01-22T21:03:15Z,use_quota=True,user_id='b07a1bb09ad44501925664aa61ac3e6d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6dacb05b-a7ea-4056-85ff-98f0ea5c54eb),volume_type_id=6dacb05b-a7ea-4056-85ff-98f0ea5c54eb)' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:04:45.192534 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-d982720f-f14f-4f31-966a-145442123138 tempest-LiveMigrationTest-256070455 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77c1238e-39fb-4066-b214-52fcb895b8cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:04:45.196802 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-d982720f-f14f-4f31-966a-145442123138 tempest-LiveMigrationTest-256070455 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77c1238e-39fb-4066-b214-52fcb895b8cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:04:45.202836 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-d982720f-f14f-4f31-966a-145442123138 tempest-LiveMigrationTest-256070455 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8766933c-0d71-4825-8ac9-525a477a87ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:04:45.218681 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-d982720f-f14f-4f31-966a-145442123138 tempest-LiveMigrationTest-256070455 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8766933c-0d71-4825-8ac9-525a477a87ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'f39c1078-cff4-40dd-93df-4ce49cd873b4', 'volume_name': 'volume-f39c1078-cff4-40dd-93df-4ce49cd873b4', 'volume_size': 1, 'source_volid': '0b17e2f4-e149-4a4b-b525-3d029be2e6f6', 'source_volstatus': 'downloading'}' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:04:45.223897 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-d982720f-f14f-4f31-966a-145442123138 tempest-LiveMigrationTest-256070455 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d62cf37-0880-4ed6-8a72-34394916ae5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:04:45.228137 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-d982720f-f14f-4f31-966a-145442123138 tempest-LiveMigrationTest-256070455 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d62cf37-0880-4ed6-8a72-34394916ae5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:04:45.234304 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-d982720f-f14f-4f31-966a-145442123138 tempest-LiveMigrationTest-256070455 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb4974aa-c662-495a-9b26-1bb97b0966ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:04:45.237381 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.flows.manager.create_volume [None req-d982720f-f14f-4f31-966a-145442123138 tempest-LiveMigrationTest-256070455 None] Volume f39c1078-cff4-40dd-93df-4ce49cd873b4: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-f39c1078-cff4-40dd-93df-4ce49cd873b4', 'volume_size': 1, 'source_volid': '0b17e2f4-e149-4a4b-b525-3d029be2e6f6', 'source_volstatus': 'downloading'} Jan 22 21:04:45.248866 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-d982720f-f14f-4f31-966a-145442123138 tempest-LiveMigrationTest-256070455 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:04:45.455839 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-d982720f-f14f-4f31-966a-145442123138 tempest-LiveMigrationTest-256070455 None] creating snapshot='volume-f39c1078-cff4-40dd-93df-4ce49cd873b4.clone_snap' {{(pid=129952) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:725}} Jan 22 21:04:46.772341 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-d982720f-f14f-4f31-966a-145442123138 tempest-LiveMigrationTest-256070455 None] cloning 'volume-0b17e2f4-e149-4a4b-b525-3d029be2e6f6@volume-f39c1078-cff4-40dd-93df-4ce49cd873b4.clone_snap' to 'volume-f39c1078-cff4-40dd-93df-4ce49cd873b4' {{(pid=129952) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:731}} Jan 22 21:04:48.125866 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-d982720f-f14f-4f31-966a-145442123138 tempest-LiveMigrationTest-256070455 None] Volume volume-0b17e2f4-e149-4a4b-b525-3d029be2e6f6 is not a clone. {{(pid=129952) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Jan 22 21:04:48.127010 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-d982720f-f14f-4f31-966a-145442123138 tempest-LiveMigrationTest-256070455 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129952) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 22 21:04:48.127455 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-d982720f-f14f-4f31-966a-145442123138 tempest-LiveMigrationTest-256070455 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129952) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 22 21:04:48.401557 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-d982720f-f14f-4f31-966a-145442123138 tempest-LiveMigrationTest-256070455 None] clone created successfully {{(pid=129952) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:803}} Jan 22 21:04:48.406775 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-d982720f-f14f-4f31-966a-145442123138 tempest-LiveMigrationTest-256070455 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb4974aa-c662-495a-9b26-1bb97b0966ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f39c1078-cff4-40dd-93df-4ce49cd873b4', 'volume_size': 1, 'source_volid': '0b17e2f4-e149-4a4b-b525-3d029be2e6f6', 'source_volstatus': 'downloading'}' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:04:48.412102 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-d982720f-f14f-4f31-966a-145442123138 tempest-LiveMigrationTest-256070455 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7611265-543f-415d-8eee-90463c864946) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:04:48.497784 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.flows.manager.create_volume [None req-d982720f-f14f-4f31-966a-145442123138 tempest-LiveMigrationTest-256070455 None] Volume volume-f39c1078-cff4-40dd-93df-4ce49cd873b4 (f39c1078-cff4-40dd-93df-4ce49cd873b4): created successfully Jan 22 21:04:48.501618 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-d982720f-f14f-4f31-966a-145442123138 tempest-LiveMigrationTest-256070455 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7611265-543f-415d-8eee-90463c864946) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:04:48.507026 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-d982720f-f14f-4f31-966a-145442123138 tempest-LiveMigrationTest-256070455 None] Flow 'volume_create_manager' (e4214987-c2e7-430d-9156-2cc9a4e796b2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129952) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 22 21:04:48.577923 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-d982720f-f14f-4f31-966a-145442123138 tempest-LiveMigrationTest-256070455 None] Created volume successfully. Jan 22 21:04:48.772164 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.image.cache [None req-d982720f-f14f-4f31-966a-145442123138 tempest-LiveMigrationTest-256070455 None] Creating new image-volume cache entry for image 373cb480-3bc4-4821-93e2-442b4e852b80 on ncdv-master-1@ceph#ceph {{(pid=129952) create_cache_entry /opt/stack/cinder/cinder/image/cache.py:104}} Jan 22 21:04:48.878407 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.image.cache [None req-d982720f-f14f-4f31-966a-145442123138 tempest-LiveMigrationTest-256070455 None] New image-volume cache entry created: {'id': 1, 'image_id': '373cb480-3bc4-4821-93e2-442b4e852b80', 'volume_id': 'f39c1078-cff4-40dd-93df-4ce49cd873b4', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 1, 22, 20, 50, 57), 'last_used': datetime.datetime(2022, 1, 22, 21, 4, 48, 775047)}. {{(pid=129952) create_cache_entry /opt/stack/cinder/cinder/image/cache.py:129}} Jan 22 21:04:48.884220 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.coordination [None req-d982720f-f14f-4f31-966a-145442123138 tempest-LiveMigrationTest-256070455 None] Lock "b'cinder-373cb480-3bc4-4821-93e2-442b4e852b80'" released by "_prepare_image_cache_entry" :: held 93.269s {{(pid=129952) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 22 21:04:48.885122 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.volume_utils [None req-d982720f-f14f-4f31-966a-145442123138 tempest-LiveMigrationTest-256070455 None] Marking volume 0b17e2f4-e149-4a4b-b525-3d029be2e6f6 as bootable. {{(pid=129952) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1178}} Jan 22 21:04:48.964094 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.flows.manager.create_volume [None req-d982720f-f14f-4f31-966a-145442123138 tempest-LiveMigrationTest-256070455 None] Copying metadata from image 373cb480-3bc4-4821-93e2-442b4e852b80 to 0b17e2f4-e149-4a4b-b525-3d029be2e6f6. {{(pid=129952) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:443}} Jan 22 21:04:48.968095 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.flows.manager.create_volume [None req-d982720f-f14f-4f31-966a-145442123138 tempest-LiveMigrationTest-256070455 None] Creating volume glance metadata for volume 0b17e2f4-e149-4a4b-b525-3d029be2e6f6 backed by image 373cb480-3bc4-4821-93e2-442b4e852b80 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '373cb480-3bc4-4821-93e2-442b4e852b80', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=129952) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:666}} Jan 22 21:04:49.128359 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-d982720f-f14f-4f31-966a-145442123138 tempest-LiveMigrationTest-256070455 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6bcdafc5-8e16-4a53-a4c0-1dc7c5c8409c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0b17e2f4-e149-4a4b-b525-3d029be2e6f6', 'volume_size': 1, 'image_id': '373cb480-3bc4-4821-93e2-442b4e852b80', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '994e8f6963f04af3be3dbae11a73cdfd', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '373cb480-3bc4-4821-93e2-442b4e852b80', 'created_at': datetime.datetime(2022, 1, 22, 20, 50, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 1, 22, 20, 50, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/373cb480-3bc4-4821-93e2-442b4e852b80/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:04:49.142036 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-d982720f-f14f-4f31-966a-145442123138 tempest-LiveMigrationTest-256070455 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (623e9334-b40f-4ffa-bec9-26a5a61f4731) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:04:49.229051 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.flows.manager.create_volume [None req-d982720f-f14f-4f31-966a-145442123138 tempest-LiveMigrationTest-256070455 None] Volume volume-0b17e2f4-e149-4a4b-b525-3d029be2e6f6 (0b17e2f4-e149-4a4b-b525-3d029be2e6f6): created successfully Jan 22 21:04:49.234099 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-d982720f-f14f-4f31-966a-145442123138 tempest-LiveMigrationTest-256070455 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (623e9334-b40f-4ffa-bec9-26a5a61f4731) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:04:49.240094 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-d982720f-f14f-4f31-966a-145442123138 tempest-LiveMigrationTest-256070455 None] Flow 'volume_create_manager' (59dc5ab6-a9fc-48b7-ad47-8bb555b48001) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129952) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 22 21:04:49.311315 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-d982720f-f14f-4f31-966a-145442123138 tempest-LiveMigrationTest-256070455 None] Created volume successfully. Jan 22 21:04:49.816078 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.coordination [None req-a61dd4c0-d6c1-4e04-8003-f14b95798005 tempest-LiveAutoBlockMigrationV225Test-176555791 None] Lock "b'cinder-373cb480-3bc4-4821-93e2-442b4e852b80'" acquired by "_prepare_image_cache_entry" :: waited 70.989s {{(pid=129952) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 22 21:04:49.886016 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.image.cache [None req-a61dd4c0-d6c1-4e04-8003-f14b95798005 tempest-LiveAutoBlockMigrationV225Test-176555791 None] Found image-volume cache entry: {'id': 1, 'image_id': '373cb480-3bc4-4821-93e2-442b4e852b80', 'volume_id': 'f39c1078-cff4-40dd-93df-4ce49cd873b4', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 1, 22, 20, 50, 57), 'last_used': datetime.datetime(2022, 1, 22, 21, 4, 49, 819747)}. {{(pid=129952) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Jan 22 21:04:49.890143 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.image.cache [None req-a61dd4c0-d6c1-4e04-8003-f14b95798005 tempest-LiveAutoBlockMigrationV225Test-176555791 None] Image-volume cache entry image_update_at = 2022-01-22 20:50:57+00:00, requested image updated_at = 2022-01-22 20:50:57+00:00. {{(pid=129952) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Jan 22 21:04:49.890143 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.flows.manager.create_volume [None req-a61dd4c0-d6c1-4e04-8003-f14b95798005 tempest-LiveAutoBlockMigrationV225Test-176555791 None] Found cache entry for image = 373cb480-3bc4-4821-93e2-442b4e852b80 on host ncdv-master-1@ceph#ceph. {{(pid=129952) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:869}} Jan 22 21:04:49.892828 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.coordination [None req-a61dd4c0-d6c1-4e04-8003-f14b95798005 tempest-LiveAutoBlockMigrationV225Test-176555791 None] Lock "b'cinder-373cb480-3bc4-4821-93e2-442b4e852b80'" released by "_prepare_image_cache_entry" :: held 0.077s {{(pid=129952) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 22 21:04:49.893781 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.flows.manager.create_volume [None req-a61dd4c0-d6c1-4e04-8003-f14b95798005 tempest-LiveAutoBlockMigrationV225Test-176555791 None] Attempting to retrieve cache entry for image = 373cb480-3bc4-4821-93e2-442b4e852b80 on host ncdv-master-1@ceph#ceph. {{(pid=129952) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:810}} Jan 22 21:04:49.899511 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.image.cache [None req-a61dd4c0-d6c1-4e04-8003-f14b95798005 tempest-LiveAutoBlockMigrationV225Test-176555791 None] Found image-volume cache entry: {'id': 1, 'image_id': '373cb480-3bc4-4821-93e2-442b4e852b80', 'volume_id': 'f39c1078-cff4-40dd-93df-4ce49cd873b4', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 1, 22, 20, 50, 57), 'last_used': datetime.datetime(2022, 1, 22, 21, 4, 49, 897261)}. {{(pid=129952) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Jan 22 21:04:49.899925 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.image.cache [None req-a61dd4c0-d6c1-4e04-8003-f14b95798005 tempest-LiveAutoBlockMigrationV225Test-176555791 None] Image-volume cache entry image_update_at = 2022-01-22 20:50:57+00:00, requested image updated_at = 2022-01-22 20:50:57+00:00. {{(pid=129952) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Jan 22 21:04:49.900317 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.flows.manager.create_volume [None req-a61dd4c0-d6c1-4e04-8003-f14b95798005 tempest-LiveAutoBlockMigrationV225Test-176555791 None] Creating from source image-volume f39c1078-cff4-40dd-93df-4ce49cd873b4 {{(pid=129952) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:824}} Jan 22 21:04:49.911807 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-a61dd4c0-d6c1-4e04-8003-f14b95798005 tempest-LiveAutoBlockMigrationV225Test-176555791 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:04:50.154608 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-a61dd4c0-d6c1-4e04-8003-f14b95798005 tempest-LiveAutoBlockMigrationV225Test-176555791 None] creating snapshot='volume-77269952-ab3c-402f-ad65-b6254782bbb8.clone_snap' {{(pid=129952) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:725}} Jan 22 21:04:52.438539 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-a61dd4c0-d6c1-4e04-8003-f14b95798005 tempest-LiveAutoBlockMigrationV225Test-176555791 None] cloning 'volume-f39c1078-cff4-40dd-93df-4ce49cd873b4@volume-77269952-ab3c-402f-ad65-b6254782bbb8.clone_snap' to 'volume-77269952-ab3c-402f-ad65-b6254782bbb8' {{(pid=129952) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:731}} Jan 22 21:04:53.486192 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-a61dd4c0-d6c1-4e04-8003-f14b95798005 tempest-LiveAutoBlockMigrationV225Test-176555791 None] Volume volume-0b17e2f4-e149-4a4b-b525-3d029be2e6f6 is not a clone. {{(pid=129952) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Jan 22 21:04:53.487407 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-a61dd4c0-d6c1-4e04-8003-f14b95798005 tempest-LiveAutoBlockMigrationV225Test-176555791 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129952) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 22 21:04:53.487789 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-a61dd4c0-d6c1-4e04-8003-f14b95798005 tempest-LiveAutoBlockMigrationV225Test-176555791 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129952) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 22 21:04:53.845384 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-a61dd4c0-d6c1-4e04-8003-f14b95798005 tempest-LiveAutoBlockMigrationV225Test-176555791 None] clone created successfully {{(pid=129952) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:803}} Jan 22 21:04:53.846042 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.volume_utils [None req-a61dd4c0-d6c1-4e04-8003-f14b95798005 tempest-LiveAutoBlockMigrationV225Test-176555791 None] Marking volume 77269952-ab3c-402f-ad65-b6254782bbb8 as bootable. {{(pid=129952) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1178}} Jan 22 21:04:53.909206 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.flows.manager.create_volume [None req-a61dd4c0-d6c1-4e04-8003-f14b95798005 tempest-LiveAutoBlockMigrationV225Test-176555791 None] Copying metadata from image 373cb480-3bc4-4821-93e2-442b4e852b80 to 77269952-ab3c-402f-ad65-b6254782bbb8. {{(pid=129952) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:443}} Jan 22 21:04:53.909756 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.flows.manager.create_volume [None req-a61dd4c0-d6c1-4e04-8003-f14b95798005 tempest-LiveAutoBlockMigrationV225Test-176555791 None] Creating volume glance metadata for volume 77269952-ab3c-402f-ad65-b6254782bbb8 backed by image 373cb480-3bc4-4821-93e2-442b4e852b80 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '373cb480-3bc4-4821-93e2-442b4e852b80', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=129952) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:666}} Jan 22 21:04:54.064197 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-a61dd4c0-d6c1-4e04-8003-f14b95798005 tempest-LiveAutoBlockMigrationV225Test-176555791 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11de0b2d-8d44-4e0f-afe2-48baa8ca2b4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-77269952-ab3c-402f-ad65-b6254782bbb8', 'volume_size': 1, 'image_id': '373cb480-3bc4-4821-93e2-442b4e852b80', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '994e8f6963f04af3be3dbae11a73cdfd', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '373cb480-3bc4-4821-93e2-442b4e852b80', 'created_at': datetime.datetime(2022, 1, 22, 20, 50, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 1, 22, 20, 50, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/373cb480-3bc4-4821-93e2-442b4e852b80/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:04:54.069021 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-a61dd4c0-d6c1-4e04-8003-f14b95798005 tempest-LiveAutoBlockMigrationV225Test-176555791 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f57549f-468e-440f-af82-579e47e642b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:04:54.158149 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.flows.manager.create_volume [None req-a61dd4c0-d6c1-4e04-8003-f14b95798005 tempest-LiveAutoBlockMigrationV225Test-176555791 None] Volume volume-77269952-ab3c-402f-ad65-b6254782bbb8 (77269952-ab3c-402f-ad65-b6254782bbb8): created successfully Jan 22 21:04:54.161888 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-a61dd4c0-d6c1-4e04-8003-f14b95798005 tempest-LiveAutoBlockMigrationV225Test-176555791 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f57549f-468e-440f-af82-579e47e642b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:04:54.167501 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-a61dd4c0-d6c1-4e04-8003-f14b95798005 tempest-LiveAutoBlockMigrationV225Test-176555791 None] Flow 'volume_create_manager' (76097aa5-1e08-4867-aec0-697312bd8330) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129952) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 22 21:04:54.260904 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-a61dd4c0-d6c1-4e04-8003-f14b95798005 tempest-LiveAutoBlockMigrationV225Test-176555791 None] Created volume successfully. Jan 22 21:04:54.539759 ncdv-master-1 cinder-volume[129952]: DEBUG oslo_concurrency.processutils [req-c6d7789f-4acb-4550-a015-409a8463dfb2 req-53e06449-b213-4afc-98cd-b84ba4825715 tempest-LiveMigrationTest-256070455 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129952) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jan 22 21:04:55.469543 ncdv-master-1 cinder-volume[129952]: DEBUG oslo_concurrency.processutils [req-c6d7789f-4acb-4550-a015-409a8463dfb2 req-53e06449-b213-4afc-98cd-b84ba4825715 tempest-LiveMigrationTest-256070455 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.929s {{(pid=129952) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jan 22 21:04:55.471193 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [req-c6d7789f-4acb-4550-a015-409a8463dfb2 req-53e06449-b213-4afc-98cd-b84ba4825715 tempest-LiveMigrationTest-256070455 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-0b17e2f4-e149-4a4b-b525-3d029be2e6f6', 'hosts': ['10.222.0.100'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'c7ee930a-3b87-450e-91f6-d4eef70cb484', 'volume_id': '0b17e2f4-e149-4a4b-b525-3d029be2e6f6', 'discard': True}} {{(pid=129952) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Jan 22 21:04:55.593350 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [req-c6d7789f-4acb-4550-a015-409a8463dfb2 req-53e06449-b213-4afc-98cd-b84ba4825715 tempest-LiveMigrationTest-256070455 None] Connection info returned from driver {'name': 'volumes/volume-0b17e2f4-e149-4a4b-b525-3d029be2e6f6', 'hosts': ['10.222.0.100'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '0b17e2f4-e149-4a4b-b525-3d029be2e6f6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '2bcac6c6-ca62-4b9a-8f8a-967d8ae5d0a2'} {{(pid=129952) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4811}} Jan 22 21:04:55.745481 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [req-c6d7789f-4acb-4550-a015-409a8463dfb2 req-53e06449-b213-4afc-98cd-b84ba4825715 tempest-LiveMigrationTest-256070455 None] attachment_update completed successfully. Jan 22 21:04:58.765210 ncdv-master-1 cinder-volume[129952]: DEBUG oslo_concurrency.processutils [req-eae140b0-bb46-457c-90e3-78793dec45f6 req-ac2436ec-ed4b-4e78-9420-b7409e202c0f tempest-LiveAutoBlockMigrationV225Test-176555791 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129952) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jan 22 21:04:59.533978 ncdv-master-1 cinder-volume[129952]: DEBUG oslo_concurrency.processutils [req-eae140b0-bb46-457c-90e3-78793dec45f6 req-ac2436ec-ed4b-4e78-9420-b7409e202c0f tempest-LiveAutoBlockMigrationV225Test-176555791 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.768s {{(pid=129952) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jan 22 21:04:59.535884 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [req-eae140b0-bb46-457c-90e3-78793dec45f6 req-ac2436ec-ed4b-4e78-9420-b7409e202c0f tempest-LiveAutoBlockMigrationV225Test-176555791 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-77269952-ab3c-402f-ad65-b6254782bbb8', 'hosts': ['10.222.0.100'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'c7ee930a-3b87-450e-91f6-d4eef70cb484', 'volume_id': '77269952-ab3c-402f-ad65-b6254782bbb8', 'discard': True}} {{(pid=129952) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Jan 22 21:04:59.674409 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [req-eae140b0-bb46-457c-90e3-78793dec45f6 req-ac2436ec-ed4b-4e78-9420-b7409e202c0f tempest-LiveAutoBlockMigrationV225Test-176555791 None] Connection info returned from driver {'name': 'volumes/volume-77269952-ab3c-402f-ad65-b6254782bbb8', 'hosts': ['10.222.0.100'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '77269952-ab3c-402f-ad65-b6254782bbb8', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'c4f5fa1d-1e9a-4f58-a5e6-1ff3a0358c07'} {{(pid=129952) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4811}} Jan 22 21:04:59.883626 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [req-eae140b0-bb46-457c-90e3-78793dec45f6 req-ac2436ec-ed4b-4e78-9420-b7409e202c0f tempest-LiveAutoBlockMigrationV225Test-176555791 None] attachment_update completed successfully. Jan 22 21:05:09.658840 ncdv-master-1 cinder-volume[129952]: DEBUG oslo_service.periodic_task [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129952) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jan 22 21:05:09.661999 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:05:09.773134 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:05:09.844642 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.manager [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] Notifying Schedulers of capabilities ... {{(pid=129952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 22 21:05:15.951455 ncdv-master-1 cinder-volume[129952]: DEBUG oslo_concurrency.processutils [req-17d92b32-f3d8-4a96-975e-0adb389e4366 req-9e4a7292-7012-4fe6-88ec-728c8662f7a7 tempest-LiveMigrationTest-26529045 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129952) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jan 22 21:05:16.668149 ncdv-master-1 cinder-volume[129952]: DEBUG oslo_concurrency.processutils [req-17d92b32-f3d8-4a96-975e-0adb389e4366 req-9e4a7292-7012-4fe6-88ec-728c8662f7a7 tempest-LiveMigrationTest-26529045 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.716s {{(pid=129952) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jan 22 21:05:16.669094 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [req-17d92b32-f3d8-4a96-975e-0adb389e4366 req-9e4a7292-7012-4fe6-88ec-728c8662f7a7 tempest-LiveMigrationTest-26529045 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-0b17e2f4-e149-4a4b-b525-3d029be2e6f6', 'hosts': ['10.222.0.100'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'c7ee930a-3b87-450e-91f6-d4eef70cb484', 'volume_id': '0b17e2f4-e149-4a4b-b525-3d029be2e6f6', 'discard': True}} {{(pid=129952) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Jan 22 21:05:16.761452 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [req-17d92b32-f3d8-4a96-975e-0adb389e4366 req-9e4a7292-7012-4fe6-88ec-728c8662f7a7 tempest-LiveMigrationTest-26529045 None] Connection info returned from driver {'name': 'volumes/volume-0b17e2f4-e149-4a4b-b525-3d029be2e6f6', 'hosts': ['10.222.0.100'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '0b17e2f4-e149-4a4b-b525-3d029be2e6f6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'c83ba058-0b0d-42e0-b0d2-efae8488a640'} {{(pid=129952) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4811}} Jan 22 21:05:16.905816 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [req-17d92b32-f3d8-4a96-975e-0adb389e4366 req-9e4a7292-7012-4fe6-88ec-728c8662f7a7 tempest-LiveMigrationTest-26529045 None] attachment_update completed successfully. Jan 22 21:05:21.468692 ncdv-master-1 cinder-volume[129952]: DEBUG oslo_concurrency.processutils [req-f49ea54f-6119-4a3c-bf0b-9286bb78affc req-8890a0a2-9598-4020-804d-b319f361bf08 tempest-LiveAutoBlockMigrationV225Test-830537647 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129952) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jan 22 21:05:22.625069 ncdv-master-1 cinder-volume[129952]: DEBUG oslo_concurrency.processutils [req-f49ea54f-6119-4a3c-bf0b-9286bb78affc req-8890a0a2-9598-4020-804d-b319f361bf08 tempest-LiveAutoBlockMigrationV225Test-830537647 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.156s {{(pid=129952) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jan 22 21:05:22.625985 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [req-f49ea54f-6119-4a3c-bf0b-9286bb78affc req-8890a0a2-9598-4020-804d-b319f361bf08 tempest-LiveAutoBlockMigrationV225Test-830537647 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-77269952-ab3c-402f-ad65-b6254782bbb8', 'hosts': ['10.222.0.100'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'c7ee930a-3b87-450e-91f6-d4eef70cb484', 'volume_id': '77269952-ab3c-402f-ad65-b6254782bbb8', 'discard': True}} {{(pid=129952) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Jan 22 21:05:22.758694 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [req-f49ea54f-6119-4a3c-bf0b-9286bb78affc req-8890a0a2-9598-4020-804d-b319f361bf08 tempest-LiveAutoBlockMigrationV225Test-830537647 None] Connection info returned from driver {'name': 'volumes/volume-77269952-ab3c-402f-ad65-b6254782bbb8', 'hosts': ['10.222.0.100'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '77269952-ab3c-402f-ad65-b6254782bbb8', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'c7454feb-ee5d-41af-a31c-32a2546295ba'} {{(pid=129952) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4811}} Jan 22 21:05:22.965177 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [req-f49ea54f-6119-4a3c-bf0b-9286bb78affc req-8890a0a2-9598-4020-804d-b319f361bf08 tempest-LiveAutoBlockMigrationV225Test-830537647 None] attachment_update completed successfully. Jan 22 21:05:24.751405 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [req-f49ea54f-6119-4a3c-bf0b-9286bb78affc req-a402d618-4c3d-46a6-b546-99a9913b6cd3 tempest-LiveAutoBlockMigrationV225Test-830537647 None] Terminate volume connection completed successfully. Jan 22 21:05:24.752360 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [req-f49ea54f-6119-4a3c-bf0b-9286bb78affc req-a402d618-4c3d-46a6-b546-99a9913b6cd3 tempest-LiveAutoBlockMigrationV225Test-830537647 None] Deleting attachment c7454feb-ee5d-41af-a31c-32a2546295ba. {{(pid=129952) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4947}} Jan 22 21:05:25.155886 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [req-17d92b32-f3d8-4a96-975e-0adb389e4366 req-17eb2844-800b-446f-81c1-630fcf977391 tempest-LiveMigrationTest-26529045 None] Terminate volume connection completed successfully. Jan 22 21:05:25.157266 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [req-17d92b32-f3d8-4a96-975e-0adb389e4366 req-17eb2844-800b-446f-81c1-630fcf977391 tempest-LiveMigrationTest-26529045 None] Deleting attachment c83ba058-0b0d-42e0-b0d2-efae8488a640. {{(pid=129952) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4947}} Jan 22 21:05:32.805976 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [req-abf5c7ad-a21b-4ced-bd73-071445d47f00 req-a84176a6-982b-4dd2-8ed5-92f3d442642a tempest-LiveMigrationTest-256070455 None] Terminate volume connection completed successfully. Jan 22 21:05:32.811573 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [req-abf5c7ad-a21b-4ced-bd73-071445d47f00 req-a84176a6-982b-4dd2-8ed5-92f3d442642a tempest-LiveMigrationTest-256070455 None] Deleting attachment 2bcac6c6-ca62-4b9a-8f8a-967d8ae5d0a2. {{(pid=129952) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4947}} Jan 22 21:05:33.230065 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.coordination [req-abf5c7ad-a21b-4ced-bd73-071445d47f00 req-604b08e5-9ac4-4936-9b5e-fe6a9be8b8d8 tempest-LiveMigrationTest-256070455 None] Lock "b'cinder-0b17e2f4-e149-4a4b-b525-3d029be2e6f6-delete_volume'" acquired by "delete_volume" :: waited 0.050s {{(pid=129952) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 22 21:05:33.326024 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [req-abf5c7ad-a21b-4ced-bd73-071445d47f00 req-604b08e5-9ac4-4936-9b5e-fe6a9be8b8d8 tempest-LiveMigrationTest-256070455 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:05:33.504082 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [req-abf5c7ad-a21b-4ced-bd73-071445d47f00 req-604b08e5-9ac4-4936-9b5e-fe6a9be8b8d8 tempest-LiveMigrationTest-256070455 None] volume has no backup snaps {{(pid=129952) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Jan 22 21:05:33.506928 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [req-abf5c7ad-a21b-4ced-bd73-071445d47f00 req-604b08e5-9ac4-4936-9b5e-fe6a9be8b8d8 tempest-LiveMigrationTest-256070455 None] volume has clone snapshot(s) {{(pid=129952) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1208}} Jan 22 21:05:33.506928 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [req-abf5c7ad-a21b-4ced-bd73-071445d47f00 req-604b08e5-9ac4-4936-9b5e-fe6a9be8b8d8 tempest-LiveMigrationTest-256070455 None] Volume volume-0b17e2f4-e149-4a4b-b525-3d029be2e6f6 is not a clone. {{(pid=129952) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Jan 22 21:05:34.324069 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [req-3dfe91d6-589f-4387-8a31-cb7df84ffdf1 req-d5fe079d-33e7-410f-a9b4-9722d38a5af7 tempest-LiveAutoBlockMigrationV225Test-176555791 None] Terminate volume connection completed successfully. Jan 22 21:05:34.326052 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [req-3dfe91d6-589f-4387-8a31-cb7df84ffdf1 req-d5fe079d-33e7-410f-a9b4-9722d38a5af7 tempest-LiveAutoBlockMigrationV225Test-176555791 None] Deleting attachment c4f5fa1d-1e9a-4f58-a5e6-1ff3a0358c07. {{(pid=129952) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4947}} Jan 22 21:05:34.795536 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.coordination [req-3dfe91d6-589f-4387-8a31-cb7df84ffdf1 req-dfa0fadd-5e7f-44cc-8e64-22b64a484c79 tempest-LiveAutoBlockMigrationV225Test-176555791 None] Lock "b'cinder-77269952-ab3c-402f-ad65-b6254782bbb8-delete_volume'" acquired by "delete_volume" :: waited 0.016s {{(pid=129952) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 22 21:05:34.856071 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.quota [req-abf5c7ad-a21b-4ced-bd73-071445d47f00 req-604b08e5-9ac4-4936-9b5e-fe6a9be8b8d8 tempest-LiveMigrationTest-256070455 None] Created reservations ['078c9701-3f0e-4898-af71-168f2532f05c', '27985c1d-2329-46f0-88c4-3eaa3188945b', 'ff620e0c-fd88-401d-9c7f-ca54e6713f02', 'ae42f131-7fc0-4081-8c6b-065cd14fe1ba'] {{(pid=129952) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 22 21:05:34.916964 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [req-3dfe91d6-589f-4387-8a31-cb7df84ffdf1 req-dfa0fadd-5e7f-44cc-8e64-22b64a484c79 tempest-LiveAutoBlockMigrationV225Test-176555791 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:05:35.225797 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [req-3dfe91d6-589f-4387-8a31-cb7df84ffdf1 req-dfa0fadd-5e7f-44cc-8e64-22b64a484c79 tempest-LiveAutoBlockMigrationV225Test-176555791 None] volume has no backup snaps {{(pid=129952) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Jan 22 21:05:35.331421 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [req-3dfe91d6-589f-4387-8a31-cb7df84ffdf1 req-dfa0fadd-5e7f-44cc-8e64-22b64a484c79 tempest-LiveAutoBlockMigrationV225Test-176555791 None] deleting rbd volume volume-77269952-ab3c-402f-ad65-b6254782bbb8 {{(pid=129952) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Jan 22 21:05:35.432411 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.coordination [None req-6d4d90e8-aa18-4ae7-9f80-cbe3bde38a68 tempest-LiveMigrationTest-256070455 None] Lock "b'cinder-ce68f69a-0548-4980-9511-4b7d28d8afda-delete_volume'" acquired by "delete_volume" :: waited 0.063s {{(pid=129952) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 22 21:05:35.490652 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [req-abf5c7ad-a21b-4ced-bd73-071445d47f00 req-604b08e5-9ac4-4936-9b5e-fe6a9be8b8d8 tempest-LiveMigrationTest-256070455 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:05:35.614545 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [req-abf5c7ad-a21b-4ced-bd73-071445d47f00 req-604b08e5-9ac4-4936-9b5e-fe6a9be8b8d8 tempest-LiveMigrationTest-256070455 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:05:35.693647 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.manager [req-abf5c7ad-a21b-4ced-bd73-071445d47f00 req-604b08e5-9ac4-4936-9b5e-fe6a9be8b8d8 tempest-LiveMigrationTest-256070455 None] Notifying Schedulers of capabilities ... {{(pid=129952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 22 21:05:35.700159 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [req-abf5c7ad-a21b-4ced-bd73-071445d47f00 req-604b08e5-9ac4-4936-9b5e-fe6a9be8b8d8 tempest-LiveMigrationTest-256070455 None] Deleted volume successfully. Jan 22 21:05:35.723378 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-6d4d90e8-aa18-4ae7-9f80-cbe3bde38a68 tempest-LiveMigrationTest-256070455 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:05:35.964917 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-6d4d90e8-aa18-4ae7-9f80-cbe3bde38a68 tempest-LiveMigrationTest-256070455 None] volume has no backup snaps {{(pid=129952) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Jan 22 21:05:35.965274 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-6d4d90e8-aa18-4ae7-9f80-cbe3bde38a68 tempest-LiveMigrationTest-256070455 None] Volume volume-ce68f69a-0548-4980-9511-4b7d28d8afda is not a clone. {{(pid=129952) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Jan 22 21:05:36.266328 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-6d4d90e8-aa18-4ae7-9f80-cbe3bde38a68 tempest-LiveMigrationTest-256070455 None] deleting rbd volume volume-ce68f69a-0548-4980-9511-4b7d28d8afda {{(pid=129952) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Jan 22 21:05:36.274974 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.coordination [req-abf5c7ad-a21b-4ced-bd73-071445d47f00 req-604b08e5-9ac4-4936-9b5e-fe6a9be8b8d8 tempest-LiveMigrationTest-256070455 None] Lock "b'cinder-0b17e2f4-e149-4a4b-b525-3d029be2e6f6-delete_volume'" released by "delete_volume" :: held 3.045s {{(pid=129952) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 22 21:05:37.184616 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.coordination [None req-1754dea4-6fb0-4283-8583-5d9c02018406 tempest-LiveAutoBlockMigrationV225Test-176555791 None] Lock "b'cinder-135c98ab-cd95-4a5b-baa2-e72e4414fe5b-delete_volume'" acquired by "delete_volume" :: waited 0.035s {{(pid=129952) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 22 21:05:37.350982 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-1754dea4-6fb0-4283-8583-5d9c02018406 tempest-LiveAutoBlockMigrationV225Test-176555791 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:05:37.692317 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-1754dea4-6fb0-4283-8583-5d9c02018406 tempest-LiveAutoBlockMigrationV225Test-176555791 None] volume has no backup snaps {{(pid=129952) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Jan 22 21:05:37.693033 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-1754dea4-6fb0-4283-8583-5d9c02018406 tempest-LiveAutoBlockMigrationV225Test-176555791 None] Volume volume-135c98ab-cd95-4a5b-baa2-e72e4414fe5b is not a clone. {{(pid=129952) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Jan 22 21:05:37.908164 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-1754dea4-6fb0-4283-8583-5d9c02018406 tempest-LiveAutoBlockMigrationV225Test-176555791 None] deleting rbd volume volume-135c98ab-cd95-4a5b-baa2-e72e4414fe5b {{(pid=129952) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Jan 22 21:05:39.281540 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.flows.manager.create_volume [None req-c43bc28e-1d6b-4e12-af7e-214caab0b74b tempest-TaggedBootDevicesTest_v242-884103753 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129952) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Jan 22 21:05:39.286214 ncdv-master-1 cinder-volume[129952]: WARNING stevedore.named [None req-c43bc28e-1d6b-4e12-af7e-214caab0b74b tempest-TaggedBootDevicesTest_v242-884103753 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jan 22 21:05:39.286915 ncdv-master-1 cinder-volume[129952]: WARNING castellan.key_manager [None req-c43bc28e-1d6b-4e12-af7e-214caab0b74b tempest-TaggedBootDevicesTest_v242-884103753 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 22 21:05:39.311719 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-c43bc28e-1d6b-4e12-af7e-214caab0b74b tempest-TaggedBootDevicesTest_v242-884103753 None] Flow 'volume_create_manager' (60829bbf-818c-4def-a9ac-5ec51ba1c774) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 22 21:05:39.319236 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-c43bc28e-1d6b-4e12-af7e-214caab0b74b tempest-TaggedBootDevicesTest_v242-884103753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5adbc881-f9d0-4879-a352-143ebef30c5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:05:39.328871 ncdv-master-1 cinder-volume[129952]: DEBUG oslo_db.sqlalchemy.engines [None req-c43bc28e-1d6b-4e12-af7e-214caab0b74b tempest-TaggedBootDevicesTest_v242-884103753 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129952) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 22 21:05:39.344712 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-c43bc28e-1d6b-4e12-af7e-214caab0b74b tempest-TaggedBootDevicesTest_v242-884103753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5adbc881-f9d0-4879-a352-143ebef30c5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-01-22T21:05:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest_v242-volume-869742965',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=7175172a-4e03-45a2-96c6-13d0d8d19ff6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e437a5b9bd14e108f01a125645d62b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-01-22T21:05:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-01-22T21:05:39Z,use_quota=True,user_id='f6394c313d9a45a6b6ab718256a7b454',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6dacb05b-a7ea-4056-85ff-98f0ea5c54eb),volume_type_id=6dacb05b-a7ea-4056-85ff-98f0ea5c54eb)' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:05:39.351145 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-c43bc28e-1d6b-4e12-af7e-214caab0b74b tempest-TaggedBootDevicesTest_v242-884103753 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f395c8b0-9517-4dea-8f28-368344b47fe0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:05:39.358525 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-c43bc28e-1d6b-4e12-af7e-214caab0b74b tempest-TaggedBootDevicesTest_v242-884103753 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f395c8b0-9517-4dea-8f28-368344b47fe0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:05:39.364186 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-c43bc28e-1d6b-4e12-af7e-214caab0b74b tempest-TaggedBootDevicesTest_v242-884103753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e02b6607-ac58-47b3-8f7d-617808397f96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:05:39.469401 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-c43bc28e-1d6b-4e12-af7e-214caab0b74b tempest-TaggedBootDevicesTest_v242-884103753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e02b6607-ac58-47b3-8f7d-617808397f96) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '7175172a-4e03-45a2-96c6-13d0d8d19ff6', 'volume_name': 'volume-7175172a-4e03-45a2-96c6-13d0d8d19ff6', 'volume_size': 1, 'image_id': '373cb480-3bc4-4821-93e2-442b4e852b80', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '994e8f6963f04af3be3dbae11a73cdfd', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '373cb480-3bc4-4821-93e2-442b4e852b80', 'created_at': datetime.datetime(2022, 1, 22, 20, 50, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 1, 22, 20, 50, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/373cb480-3bc4-4821-93e2-442b4e852b80/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:05:39.475691 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-c43bc28e-1d6b-4e12-af7e-214caab0b74b tempest-TaggedBootDevicesTest_v242-884103753 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11d490d7-5070-4742-aaf7-928dc3f47a2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:05:39.480772 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-c43bc28e-1d6b-4e12-af7e-214caab0b74b tempest-TaggedBootDevicesTest_v242-884103753 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11d490d7-5070-4742-aaf7-928dc3f47a2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:05:39.491662 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-c43bc28e-1d6b-4e12-af7e-214caab0b74b tempest-TaggedBootDevicesTest_v242-884103753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3478b91b-8f38-424a-a027-afba8761477b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:05:39.492919 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.flows.manager.create_volume [None req-c43bc28e-1d6b-4e12-af7e-214caab0b74b tempest-TaggedBootDevicesTest_v242-884103753 None] Volume 7175172a-4e03-45a2-96c6-13d0d8d19ff6: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-7175172a-4e03-45a2-96c6-13d0d8d19ff6', 'volume_size': 1, 'image_id': '373cb480-3bc4-4821-93e2-442b4e852b80', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '994e8f6963f04af3be3dbae11a73cdfd', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '373cb480-3bc4-4821-93e2-442b4e852b80', 'created_at': datetime.datetime(2022, 1, 22, 20, 50, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 1, 22, 20, 50, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/373cb480-3bc4-4821-93e2-442b4e852b80/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jan 22 21:05:39.493521 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.flows.manager.create_volume [None req-c43bc28e-1d6b-4e12-af7e-214caab0b74b tempest-TaggedBootDevicesTest_v242-884103753 None] Cloning 7175172a-4e03-45a2-96c6-13d0d8d19ff6 from image 373cb480-3bc4-4821-93e2-442b4e852b80 at location (None, None). {{(pid=129952) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1046}} Jan 22 21:05:39.504266 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.coordination [None req-c43bc28e-1d6b-4e12-af7e-214caab0b74b tempest-TaggedBootDevicesTest_v242-884103753 None] Lock "b'cinder-373cb480-3bc4-4821-93e2-442b4e852b80'" acquired by "_prepare_image_cache_entry" :: waited 0.009s {{(pid=129952) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 22 21:05:39.633037 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.image.cache [None req-c43bc28e-1d6b-4e12-af7e-214caab0b74b tempest-TaggedBootDevicesTest_v242-884103753 None] Found image-volume cache entry: {'id': 1, 'image_id': '373cb480-3bc4-4821-93e2-442b4e852b80', 'volume_id': 'f39c1078-cff4-40dd-93df-4ce49cd873b4', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 1, 22, 20, 50, 57), 'last_used': datetime.datetime(2022, 1, 22, 21, 5, 39, 509298)}. {{(pid=129952) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Jan 22 21:05:39.637759 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.image.cache [None req-c43bc28e-1d6b-4e12-af7e-214caab0b74b tempest-TaggedBootDevicesTest_v242-884103753 None] Image-volume cache entry image_update_at = 2022-01-22 20:50:57+00:00, requested image updated_at = 2022-01-22 20:50:57+00:00. {{(pid=129952) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Jan 22 21:05:39.637759 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.flows.manager.create_volume [None req-c43bc28e-1d6b-4e12-af7e-214caab0b74b tempest-TaggedBootDevicesTest_v242-884103753 None] Found cache entry for image = 373cb480-3bc4-4821-93e2-442b4e852b80 on host ncdv-master-1@ceph#ceph. {{(pid=129952) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:869}} Jan 22 21:05:39.640475 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.coordination [None req-c43bc28e-1d6b-4e12-af7e-214caab0b74b tempest-TaggedBootDevicesTest_v242-884103753 None] Lock "b'cinder-373cb480-3bc4-4821-93e2-442b4e852b80'" released by "_prepare_image_cache_entry" :: held 0.136s {{(pid=129952) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 22 21:05:39.641591 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.flows.manager.create_volume [None req-c43bc28e-1d6b-4e12-af7e-214caab0b74b tempest-TaggedBootDevicesTest_v242-884103753 None] Attempting to retrieve cache entry for image = 373cb480-3bc4-4821-93e2-442b4e852b80 on host ncdv-master-1@ceph#ceph. {{(pid=129952) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:810}} Jan 22 21:05:39.647893 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.image.cache [None req-c43bc28e-1d6b-4e12-af7e-214caab0b74b tempest-TaggedBootDevicesTest_v242-884103753 None] Found image-volume cache entry: {'id': 1, 'image_id': '373cb480-3bc4-4821-93e2-442b4e852b80', 'volume_id': 'f39c1078-cff4-40dd-93df-4ce49cd873b4', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 1, 22, 20, 50, 57), 'last_used': datetime.datetime(2022, 1, 22, 21, 5, 39, 645143)}. {{(pid=129952) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Jan 22 21:05:39.648377 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.image.cache [None req-c43bc28e-1d6b-4e12-af7e-214caab0b74b tempest-TaggedBootDevicesTest_v242-884103753 None] Image-volume cache entry image_update_at = 2022-01-22 20:50:57+00:00, requested image updated_at = 2022-01-22 20:50:57+00:00. {{(pid=129952) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Jan 22 21:05:39.648979 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.flows.manager.create_volume [None req-c43bc28e-1d6b-4e12-af7e-214caab0b74b tempest-TaggedBootDevicesTest_v242-884103753 None] Creating from source image-volume f39c1078-cff4-40dd-93df-4ce49cd873b4 {{(pid=129952) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:824}} Jan 22 21:05:39.665191 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-c43bc28e-1d6b-4e12-af7e-214caab0b74b tempest-TaggedBootDevicesTest_v242-884103753 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:05:39.987354 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-c43bc28e-1d6b-4e12-af7e-214caab0b74b tempest-TaggedBootDevicesTest_v242-884103753 None] creating snapshot='volume-7175172a-4e03-45a2-96c6-13d0d8d19ff6.clone_snap' {{(pid=129952) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:725}} Jan 22 21:05:43.470102 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-c43bc28e-1d6b-4e12-af7e-214caab0b74b tempest-TaggedBootDevicesTest_v242-884103753 None] cloning 'volume-f39c1078-cff4-40dd-93df-4ce49cd873b4@volume-7175172a-4e03-45a2-96c6-13d0d8d19ff6.clone_snap' to 'volume-7175172a-4e03-45a2-96c6-13d0d8d19ff6' {{(pid=129952) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:731}} Jan 22 21:05:44.531102 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [req-3dfe91d6-589f-4387-8a31-cb7df84ffdf1 req-dfa0fadd-5e7f-44cc-8e64-22b64a484c79 tempest-LiveAutoBlockMigrationV225Test-176555791 None] volume is a clone so cleaning references {{(pid=129952) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1266}} Jan 22 21:05:44.878677 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [req-3dfe91d6-589f-4387-8a31-cb7df84ffdf1 req-dfa0fadd-5e7f-44cc-8e64-22b64a484c79 tempest-LiveAutoBlockMigrationV225Test-176555791 None] deleting parent snapshot volume-77269952-ab3c-402f-ad65-b6254782bbb8.clone_snap {{(pid=129952) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1158}} Jan 22 21:05:47.599483 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-c43bc28e-1d6b-4e12-af7e-214caab0b74b tempest-TaggedBootDevicesTest_v242-884103753 None] Volume volume-0b17e2f4-e149-4a4b-b525-3d029be2e6f6.deleted is not a clone. {{(pid=129952) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Jan 22 21:05:47.601918 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-c43bc28e-1d6b-4e12-af7e-214caab0b74b tempest-TaggedBootDevicesTest_v242-884103753 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129952) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 22 21:05:47.602352 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-c43bc28e-1d6b-4e12-af7e-214caab0b74b tempest-TaggedBootDevicesTest_v242-884103753 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129952) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 22 21:05:47.974114 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-c43bc28e-1d6b-4e12-af7e-214caab0b74b tempest-TaggedBootDevicesTest_v242-884103753 None] clone created successfully {{(pid=129952) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:803}} Jan 22 21:05:47.975104 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.volume_utils [None req-c43bc28e-1d6b-4e12-af7e-214caab0b74b tempest-TaggedBootDevicesTest_v242-884103753 None] Marking volume 7175172a-4e03-45a2-96c6-13d0d8d19ff6 as bootable. {{(pid=129952) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1178}} Jan 22 21:05:48.113945 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.flows.manager.create_volume [None req-c43bc28e-1d6b-4e12-af7e-214caab0b74b tempest-TaggedBootDevicesTest_v242-884103753 None] Copying metadata from image 373cb480-3bc4-4821-93e2-442b4e852b80 to 7175172a-4e03-45a2-96c6-13d0d8d19ff6. {{(pid=129952) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:443}} Jan 22 21:05:48.115482 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.flows.manager.create_volume [None req-c43bc28e-1d6b-4e12-af7e-214caab0b74b tempest-TaggedBootDevicesTest_v242-884103753 None] Creating volume glance metadata for volume 7175172a-4e03-45a2-96c6-13d0d8d19ff6 backed by image 373cb480-3bc4-4821-93e2-442b4e852b80 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '373cb480-3bc4-4821-93e2-442b4e852b80', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=129952) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:666}} Jan 22 21:05:48.209867 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.quota [None req-1754dea4-6fb0-4283-8583-5d9c02018406 tempest-LiveAutoBlockMigrationV225Test-176555791 None] Created reservations ['2e1ed1d2-0a1b-47f6-a17b-3fb397ef1e07', 'dd98d86f-bce4-440a-ab25-08964f540302', '526223b6-df16-4c0d-86ca-447a1c3d0753', '2cd1bb43-cc61-41e3-b8fd-39210be9a9c6'] {{(pid=129952) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 22 21:05:48.217468 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.quota [None req-6d4d90e8-aa18-4ae7-9f80-cbe3bde38a68 tempest-LiveMigrationTest-256070455 None] Created reservations ['a25f3d68-76ba-4e89-b708-c7a9822bd362', '1b85bd8c-4134-4861-9fad-61cb3fd5e2ae', '5771b79d-8b5d-419e-951c-a237109880b1', '6fa2d997-ebbb-41a0-8653-a87a66e0cf0d'] {{(pid=129952) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 22 21:05:48.351145 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.quota [req-3dfe91d6-589f-4387-8a31-cb7df84ffdf1 req-dfa0fadd-5e7f-44cc-8e64-22b64a484c79 tempest-LiveAutoBlockMigrationV225Test-176555791 None] Created reservations ['7516e81b-9136-4ed5-9544-c61cf8d2f22b', '763cd4e9-1a3f-4dfc-9b77-8d9584aebed9', 'e1301c94-bbf8-4ec7-a1b8-8a390b075842', 'c4f2a3f9-af84-4303-b163-2f1afb581930'] {{(pid=129952) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 22 21:05:48.359441 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-c43bc28e-1d6b-4e12-af7e-214caab0b74b tempest-TaggedBootDevicesTest_v242-884103753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3478b91b-8f38-424a-a027-afba8761477b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7175172a-4e03-45a2-96c6-13d0d8d19ff6', 'volume_size': 1, 'image_id': '373cb480-3bc4-4821-93e2-442b4e852b80', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '994e8f6963f04af3be3dbae11a73cdfd', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '373cb480-3bc4-4821-93e2-442b4e852b80', 'created_at': datetime.datetime(2022, 1, 22, 20, 50, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 1, 22, 20, 50, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/373cb480-3bc4-4821-93e2-442b4e852b80/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:05:48.364415 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-c43bc28e-1d6b-4e12-af7e-214caab0b74b tempest-TaggedBootDevicesTest_v242-884103753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (138b859f-391f-4316-ac58-252421172f72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:05:48.491774 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-6d4d90e8-aa18-4ae7-9f80-cbe3bde38a68 tempest-LiveMigrationTest-256070455 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:05:48.558158 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-6d4d90e8-aa18-4ae7-9f80-cbe3bde38a68 tempest-LiveMigrationTest-256070455 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:05:48.606218 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.manager [None req-6d4d90e8-aa18-4ae7-9f80-cbe3bde38a68 tempest-LiveMigrationTest-256070455 None] Notifying Schedulers of capabilities ... {{(pid=129952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 22 21:05:48.615626 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.flows.manager.create_volume [None req-c43bc28e-1d6b-4e12-af7e-214caab0b74b tempest-TaggedBootDevicesTest_v242-884103753 None] Volume volume-7175172a-4e03-45a2-96c6-13d0d8d19ff6 (7175172a-4e03-45a2-96c6-13d0d8d19ff6): created successfully Jan 22 21:05:48.620228 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-c43bc28e-1d6b-4e12-af7e-214caab0b74b tempest-TaggedBootDevicesTest_v242-884103753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (138b859f-391f-4316-ac58-252421172f72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:05:48.625951 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-c43bc28e-1d6b-4e12-af7e-214caab0b74b tempest-TaggedBootDevicesTest_v242-884103753 None] Flow 'volume_create_manager' (60829bbf-818c-4def-a9ac-5ec51ba1c774) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129952) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 22 21:05:48.630562 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-6d4d90e8-aa18-4ae7-9f80-cbe3bde38a68 tempest-LiveMigrationTest-256070455 None] Deleted volume successfully. Jan 22 21:05:48.706921 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-c43bc28e-1d6b-4e12-af7e-214caab0b74b tempest-TaggedBootDevicesTest_v242-884103753 None] Created volume successfully. Jan 22 21:05:48.751208 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-1754dea4-6fb0-4283-8583-5d9c02018406 tempest-LiveAutoBlockMigrationV225Test-176555791 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:05:48.833018 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-1754dea4-6fb0-4283-8583-5d9c02018406 tempest-LiveAutoBlockMigrationV225Test-176555791 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:05:48.905915 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.manager [None req-1754dea4-6fb0-4283-8583-5d9c02018406 tempest-LiveAutoBlockMigrationV225Test-176555791 None] Notifying Schedulers of capabilities ... {{(pid=129952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 22 21:05:48.914018 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-1754dea4-6fb0-4283-8583-5d9c02018406 tempest-LiveAutoBlockMigrationV225Test-176555791 None] Deleted volume successfully. Jan 22 21:05:48.927815 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.coordination [None req-6d4d90e8-aa18-4ae7-9f80-cbe3bde38a68 tempest-LiveMigrationTest-256070455 None] Lock "b'cinder-ce68f69a-0548-4980-9511-4b7d28d8afda-delete_volume'" released by "delete_volume" :: held 13.497s {{(pid=129952) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 22 21:05:49.075400 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [req-3dfe91d6-589f-4387-8a31-cb7df84ffdf1 req-dfa0fadd-5e7f-44cc-8e64-22b64a484c79 tempest-LiveAutoBlockMigrationV225Test-176555791 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:05:49.400206 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [req-3dfe91d6-589f-4387-8a31-cb7df84ffdf1 req-dfa0fadd-5e7f-44cc-8e64-22b64a484c79 tempest-LiveAutoBlockMigrationV225Test-176555791 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:05:49.425134 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.manager [req-3dfe91d6-589f-4387-8a31-cb7df84ffdf1 req-dfa0fadd-5e7f-44cc-8e64-22b64a484c79 tempest-LiveAutoBlockMigrationV225Test-176555791 None] Notifying Schedulers of capabilities ... {{(pid=129952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 22 21:05:49.429743 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [req-3dfe91d6-589f-4387-8a31-cb7df84ffdf1 req-dfa0fadd-5e7f-44cc-8e64-22b64a484c79 tempest-LiveAutoBlockMigrationV225Test-176555791 None] Deleted volume successfully. Jan 22 21:05:49.438482 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.coordination [None req-1754dea4-6fb0-4283-8583-5d9c02018406 tempest-LiveAutoBlockMigrationV225Test-176555791 None] Lock "b'cinder-135c98ab-cd95-4a5b-baa2-e72e4414fe5b-delete_volume'" released by "delete_volume" :: held 12.254s {{(pid=129952) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 22 21:05:49.563731 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.coordination [req-3dfe91d6-589f-4387-8a31-cb7df84ffdf1 req-dfa0fadd-5e7f-44cc-8e64-22b64a484c79 tempest-LiveAutoBlockMigrationV225Test-176555791 None] Lock "b'cinder-77269952-ab3c-402f-ad65-b6254782bbb8-delete_volume'" released by "delete_volume" :: held 14.771s {{(pid=129952) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 22 21:05:50.515145 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.flows.manager.create_volume [None req-728a165b-a63d-4d95-a9c7-7abf3b7cfb08 tempest-TaggedBootDevicesTest_v242-884103753 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129952) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Jan 22 21:05:50.521925 ncdv-master-1 cinder-volume[129952]: WARNING stevedore.named [None req-728a165b-a63d-4d95-a9c7-7abf3b7cfb08 tempest-TaggedBootDevicesTest_v242-884103753 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jan 22 21:05:50.522609 ncdv-master-1 cinder-volume[129952]: WARNING castellan.key_manager [None req-728a165b-a63d-4d95-a9c7-7abf3b7cfb08 tempest-TaggedBootDevicesTest_v242-884103753 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 22 21:05:50.542136 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-728a165b-a63d-4d95-a9c7-7abf3b7cfb08 tempest-TaggedBootDevicesTest_v242-884103753 None] Flow 'volume_create_manager' (87f4ce29-6b15-4683-aae9-5a0b41711fb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 22 21:05:50.550443 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-728a165b-a63d-4d95-a9c7-7abf3b7cfb08 tempest-TaggedBootDevicesTest_v242-884103753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (656750a8-f31f-4c5e-a848-e8d28cc0acd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:05:50.558801 ncdv-master-1 cinder-volume[129952]: DEBUG oslo_db.sqlalchemy.engines [None req-728a165b-a63d-4d95-a9c7-7abf3b7cfb08 tempest-TaggedBootDevicesTest_v242-884103753 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129952) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 22 21:05:50.579145 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-728a165b-a63d-4d95-a9c7-7abf3b7cfb08 tempest-TaggedBootDevicesTest_v242-884103753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (656750a8-f31f-4c5e-a848-e8d28cc0acd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-01-22T21:05:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest_v242-volume-1493249139',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=7ef1c996-ac87-48c1-a8c2-c58eed7d1c14,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e437a5b9bd14e108f01a125645d62b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-01-22T21:05:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-01-22T21:05:50Z,use_quota=True,user_id='f6394c313d9a45a6b6ab718256a7b454',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6dacb05b-a7ea-4056-85ff-98f0ea5c54eb),volume_type_id=6dacb05b-a7ea-4056-85ff-98f0ea5c54eb)' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:05:50.585753 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-728a165b-a63d-4d95-a9c7-7abf3b7cfb08 tempest-TaggedBootDevicesTest_v242-884103753 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (357ac614-3016-48ad-ad66-1c66f70a6fca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:05:50.592510 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-728a165b-a63d-4d95-a9c7-7abf3b7cfb08 tempest-TaggedBootDevicesTest_v242-884103753 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (357ac614-3016-48ad-ad66-1c66f70a6fca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:05:50.598295 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-728a165b-a63d-4d95-a9c7-7abf3b7cfb08 tempest-TaggedBootDevicesTest_v242-884103753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (582cab45-2245-4709-9a69-282e953c45d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:05:50.603386 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-728a165b-a63d-4d95-a9c7-7abf3b7cfb08 tempest-TaggedBootDevicesTest_v242-884103753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (582cab45-2245-4709-9a69-282e953c45d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7ef1c996-ac87-48c1-a8c2-c58eed7d1c14', 'volume_name': 'volume-7ef1c996-ac87-48c1-a8c2-c58eed7d1c14', 'volume_size': 1}' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:05:50.610019 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-728a165b-a63d-4d95-a9c7-7abf3b7cfb08 tempest-TaggedBootDevicesTest_v242-884103753 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59fa01fa-7d8c-4f72-968e-6ac4508b695c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:05:50.614679 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-728a165b-a63d-4d95-a9c7-7abf3b7cfb08 tempest-TaggedBootDevicesTest_v242-884103753 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59fa01fa-7d8c-4f72-968e-6ac4508b695c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:05:50.621029 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-728a165b-a63d-4d95-a9c7-7abf3b7cfb08 tempest-TaggedBootDevicesTest_v242-884103753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d02629c2-c5fb-49cd-8928-e97c5217b1db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:05:50.623755 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.flows.manager.create_volume [None req-728a165b-a63d-4d95-a9c7-7abf3b7cfb08 tempest-TaggedBootDevicesTest_v242-884103753 None] Volume 7ef1c996-ac87-48c1-a8c2-c58eed7d1c14: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7ef1c996-ac87-48c1-a8c2-c58eed7d1c14', 'volume_size': 1} Jan 22 21:05:50.623755 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-728a165b-a63d-4d95-a9c7-7abf3b7cfb08 tempest-TaggedBootDevicesTest_v242-884103753 None] creating volume 'volume-7ef1c996-ac87-48c1-a8c2-c58eed7d1c14' {{(pid=129952) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Jan 22 21:05:50.624694 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-728a165b-a63d-4d95-a9c7-7abf3b7cfb08 tempest-TaggedBootDevicesTest_v242-884103753 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:05:51.367278 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-728a165b-a63d-4d95-a9c7-7abf3b7cfb08 tempest-TaggedBootDevicesTest_v242-884103753 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129952) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 22 21:05:51.367278 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-728a165b-a63d-4d95-a9c7-7abf3b7cfb08 tempest-TaggedBootDevicesTest_v242-884103753 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129952) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 22 21:05:51.370070 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-728a165b-a63d-4d95-a9c7-7abf3b7cfb08 tempest-TaggedBootDevicesTest_v242-884103753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d02629c2-c5fb-49cd-8928-e97c5217b1db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7ef1c996-ac87-48c1-a8c2-c58eed7d1c14', 'volume_size': 1}' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:05:51.381072 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-728a165b-a63d-4d95-a9c7-7abf3b7cfb08 tempest-TaggedBootDevicesTest_v242-884103753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09b089bd-841c-4f35-a201-b5b8f73f0063) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:05:51.489677 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.flows.manager.create_volume [None req-728a165b-a63d-4d95-a9c7-7abf3b7cfb08 tempest-TaggedBootDevicesTest_v242-884103753 None] Volume volume-7ef1c996-ac87-48c1-a8c2-c58eed7d1c14 (7ef1c996-ac87-48c1-a8c2-c58eed7d1c14): created successfully Jan 22 21:05:51.497450 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-728a165b-a63d-4d95-a9c7-7abf3b7cfb08 tempest-TaggedBootDevicesTest_v242-884103753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09b089bd-841c-4f35-a201-b5b8f73f0063) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:05:51.507474 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-728a165b-a63d-4d95-a9c7-7abf3b7cfb08 tempest-TaggedBootDevicesTest_v242-884103753 None] Flow 'volume_create_manager' (87f4ce29-6b15-4683-aae9-5a0b41711fb1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129952) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 22 21:05:51.599040 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-728a165b-a63d-4d95-a9c7-7abf3b7cfb08 tempest-TaggedBootDevicesTest_v242-884103753 None] Created volume successfully. Jan 22 21:05:53.479969 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.flows.manager.create_volume [None req-a42a12b6-8565-471e-b31c-28f0e3903d34 tempest-TaggedBootDevicesTest_v242-884103753 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129952) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Jan 22 21:05:53.483963 ncdv-master-1 cinder-volume[129952]: WARNING stevedore.named [None req-a42a12b6-8565-471e-b31c-28f0e3903d34 tempest-TaggedBootDevicesTest_v242-884103753 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jan 22 21:05:53.484625 ncdv-master-1 cinder-volume[129952]: WARNING castellan.key_manager [None req-a42a12b6-8565-471e-b31c-28f0e3903d34 tempest-TaggedBootDevicesTest_v242-884103753 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 22 21:05:53.505367 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-a42a12b6-8565-471e-b31c-28f0e3903d34 tempest-TaggedBootDevicesTest_v242-884103753 None] Flow 'volume_create_manager' (a138bafc-a454-43ab-9fd9-fa09c8f75dd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 22 21:05:53.513060 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-a42a12b6-8565-471e-b31c-28f0e3903d34 tempest-TaggedBootDevicesTest_v242-884103753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0202c628-8cc7-4669-ae39-db44f9569658) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:05:53.520080 ncdv-master-1 cinder-volume[129952]: DEBUG oslo_db.sqlalchemy.engines [None req-a42a12b6-8565-471e-b31c-28f0e3903d34 tempest-TaggedBootDevicesTest_v242-884103753 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129952) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 22 21:05:53.536228 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-a42a12b6-8565-471e-b31c-28f0e3903d34 tempest-TaggedBootDevicesTest_v242-884103753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0202c628-8cc7-4669-ae39-db44f9569658) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-01-22T21:05:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest_v242-volume-1107712442',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=fdf5d208-3baf-45d3-9815-e2f0994a442c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e437a5b9bd14e108f01a125645d62b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-01-22T21:05:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-01-22T21:05:53Z,use_quota=True,user_id='f6394c313d9a45a6b6ab718256a7b454',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6dacb05b-a7ea-4056-85ff-98f0ea5c54eb),volume_type_id=6dacb05b-a7ea-4056-85ff-98f0ea5c54eb)' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:05:53.542815 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-a42a12b6-8565-471e-b31c-28f0e3903d34 tempest-TaggedBootDevicesTest_v242-884103753 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c59ec6f-0fb8-4f8e-84ef-08d8adb4f766) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:05:53.549249 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-a42a12b6-8565-471e-b31c-28f0e3903d34 tempest-TaggedBootDevicesTest_v242-884103753 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c59ec6f-0fb8-4f8e-84ef-08d8adb4f766) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:05:53.562537 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-a42a12b6-8565-471e-b31c-28f0e3903d34 tempest-TaggedBootDevicesTest_v242-884103753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cadedba3-1846-4c08-8872-f3cd8a2ff524) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:05:53.572384 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-a42a12b6-8565-471e-b31c-28f0e3903d34 tempest-TaggedBootDevicesTest_v242-884103753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cadedba3-1846-4c08-8872-f3cd8a2ff524) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fdf5d208-3baf-45d3-9815-e2f0994a442c', 'volume_name': 'volume-fdf5d208-3baf-45d3-9815-e2f0994a442c', 'volume_size': 1}' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:05:53.578289 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-a42a12b6-8565-471e-b31c-28f0e3903d34 tempest-TaggedBootDevicesTest_v242-884103753 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77084478-760b-4963-bbfd-4d953974d179) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:05:53.584513 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-a42a12b6-8565-471e-b31c-28f0e3903d34 tempest-TaggedBootDevicesTest_v242-884103753 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77084478-760b-4963-bbfd-4d953974d179) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:05:53.591570 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-a42a12b6-8565-471e-b31c-28f0e3903d34 tempest-TaggedBootDevicesTest_v242-884103753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cdc2e38d-a977-4a38-b03e-53186cc0f617) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:05:53.594826 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.flows.manager.create_volume [None req-a42a12b6-8565-471e-b31c-28f0e3903d34 tempest-TaggedBootDevicesTest_v242-884103753 None] Volume fdf5d208-3baf-45d3-9815-e2f0994a442c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fdf5d208-3baf-45d3-9815-e2f0994a442c', 'volume_size': 1} Jan 22 21:05:53.595429 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-a42a12b6-8565-471e-b31c-28f0e3903d34 tempest-TaggedBootDevicesTest_v242-884103753 None] creating volume 'volume-fdf5d208-3baf-45d3-9815-e2f0994a442c' {{(pid=129952) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Jan 22 21:05:53.596866 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-a42a12b6-8565-471e-b31c-28f0e3903d34 tempest-TaggedBootDevicesTest_v242-884103753 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:05:54.229265 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-a42a12b6-8565-471e-b31c-28f0e3903d34 tempest-TaggedBootDevicesTest_v242-884103753 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129952) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 22 21:05:54.230304 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-a42a12b6-8565-471e-b31c-28f0e3903d34 tempest-TaggedBootDevicesTest_v242-884103753 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129952) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 22 21:05:54.234875 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-a42a12b6-8565-471e-b31c-28f0e3903d34 tempest-TaggedBootDevicesTest_v242-884103753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cdc2e38d-a977-4a38-b03e-53186cc0f617) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fdf5d208-3baf-45d3-9815-e2f0994a442c', 'volume_size': 1}' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:05:54.243931 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-a42a12b6-8565-471e-b31c-28f0e3903d34 tempest-TaggedBootDevicesTest_v242-884103753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bccf3c49-6429-4d8f-9418-f5ab432a224f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:05:54.329382 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.flows.manager.create_volume [None req-a42a12b6-8565-471e-b31c-28f0e3903d34 tempest-TaggedBootDevicesTest_v242-884103753 None] Volume volume-fdf5d208-3baf-45d3-9815-e2f0994a442c (fdf5d208-3baf-45d3-9815-e2f0994a442c): created successfully Jan 22 21:05:54.333493 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-a42a12b6-8565-471e-b31c-28f0e3903d34 tempest-TaggedBootDevicesTest_v242-884103753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bccf3c49-6429-4d8f-9418-f5ab432a224f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:05:54.348817 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-a42a12b6-8565-471e-b31c-28f0e3903d34 tempest-TaggedBootDevicesTest_v242-884103753 None] Flow 'volume_create_manager' (a138bafc-a454-43ab-9fd9-fa09c8f75dd4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129952) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 22 21:05:54.414119 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-a42a12b6-8565-471e-b31c-28f0e3903d34 tempest-TaggedBootDevicesTest_v242-884103753 None] Created volume successfully. Jan 22 21:06:09.662497 ncdv-master-1 cinder-volume[129952]: DEBUG oslo_service.periodic_task [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129952) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jan 22 21:06:09.663272 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:06:09.699163 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:06:09.745777 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.manager [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] Notifying Schedulers of capabilities ... {{(pid=129952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 22 21:06:17.165557 ncdv-master-1 cinder-volume[129952]: DEBUG oslo_concurrency.processutils [req-61f17db8-c569-4de4-978d-158d71ae8b98 req-b0498f76-e620-4140-9a84-0a75ac870d2e tempest-TaggedBootDevicesTest_v242-884103753 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129952) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jan 22 21:06:18.073772 ncdv-master-1 cinder-volume[129952]: DEBUG oslo_concurrency.processutils [req-61f17db8-c569-4de4-978d-158d71ae8b98 req-b0498f76-e620-4140-9a84-0a75ac870d2e tempest-TaggedBootDevicesTest_v242-884103753 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.908s {{(pid=129952) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jan 22 21:06:18.074598 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [req-61f17db8-c569-4de4-978d-158d71ae8b98 req-b0498f76-e620-4140-9a84-0a75ac870d2e tempest-TaggedBootDevicesTest_v242-884103753 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-7175172a-4e03-45a2-96c6-13d0d8d19ff6', 'hosts': ['10.222.0.100'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'c7ee930a-3b87-450e-91f6-d4eef70cb484', 'volume_id': '7175172a-4e03-45a2-96c6-13d0d8d19ff6', 'discard': True}} {{(pid=129952) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Jan 22 21:06:18.181642 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [req-61f17db8-c569-4de4-978d-158d71ae8b98 req-b0498f76-e620-4140-9a84-0a75ac870d2e tempest-TaggedBootDevicesTest_v242-884103753 None] Connection info returned from driver {'name': 'volumes/volume-7175172a-4e03-45a2-96c6-13d0d8d19ff6', 'hosts': ['10.222.0.100'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '7175172a-4e03-45a2-96c6-13d0d8d19ff6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '41b68b21-157f-4d48-8947-4e14bb53e086'} {{(pid=129952) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4811}} Jan 22 21:06:18.363151 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [req-61f17db8-c569-4de4-978d-158d71ae8b98 req-b0498f76-e620-4140-9a84-0a75ac870d2e tempest-TaggedBootDevicesTest_v242-884103753 None] attachment_update completed successfully. Jan 22 21:06:19.150779 ncdv-master-1 cinder-volume[129952]: DEBUG oslo_concurrency.processutils [req-61f17db8-c569-4de4-978d-158d71ae8b98 req-afcf61fb-d5f2-4f0b-a987-62adca267d27 tempest-TaggedBootDevicesTest_v242-884103753 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129952) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jan 22 21:06:20.238987 ncdv-master-1 cinder-volume[129952]: DEBUG oslo_concurrency.processutils [req-61f17db8-c569-4de4-978d-158d71ae8b98 req-afcf61fb-d5f2-4f0b-a987-62adca267d27 tempest-TaggedBootDevicesTest_v242-884103753 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.088s {{(pid=129952) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jan 22 21:06:20.239796 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [req-61f17db8-c569-4de4-978d-158d71ae8b98 req-afcf61fb-d5f2-4f0b-a987-62adca267d27 tempest-TaggedBootDevicesTest_v242-884103753 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-7ef1c996-ac87-48c1-a8c2-c58eed7d1c14', 'hosts': ['10.222.0.100'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'c7ee930a-3b87-450e-91f6-d4eef70cb484', 'volume_id': '7ef1c996-ac87-48c1-a8c2-c58eed7d1c14', 'discard': True}} {{(pid=129952) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Jan 22 21:06:20.455612 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [req-61f17db8-c569-4de4-978d-158d71ae8b98 req-afcf61fb-d5f2-4f0b-a987-62adca267d27 tempest-TaggedBootDevicesTest_v242-884103753 None] Connection info returned from driver {'name': 'volumes/volume-7ef1c996-ac87-48c1-a8c2-c58eed7d1c14', 'hosts': ['10.222.0.100'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '7ef1c996-ac87-48c1-a8c2-c58eed7d1c14', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'f9c0e9e3-2a0f-41a5-adf6-da5e7e4d5bd8'} {{(pid=129952) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4811}} Jan 22 21:06:20.632691 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [req-61f17db8-c569-4de4-978d-158d71ae8b98 req-afcf61fb-d5f2-4f0b-a987-62adca267d27 tempest-TaggedBootDevicesTest_v242-884103753 None] attachment_update completed successfully. Jan 22 21:06:21.444462 ncdv-master-1 cinder-volume[129952]: DEBUG oslo_concurrency.processutils [req-61f17db8-c569-4de4-978d-158d71ae8b98 req-c38963fb-eb8b-4ae2-9ed5-f765837bfab9 tempest-TaggedBootDevicesTest_v242-884103753 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129952) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jan 22 21:06:22.234665 ncdv-master-1 cinder-volume[129952]: DEBUG oslo_concurrency.processutils [req-61f17db8-c569-4de4-978d-158d71ae8b98 req-c38963fb-eb8b-4ae2-9ed5-f765837bfab9 tempest-TaggedBootDevicesTest_v242-884103753 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.790s {{(pid=129952) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jan 22 21:06:22.235462 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [req-61f17db8-c569-4de4-978d-158d71ae8b98 req-c38963fb-eb8b-4ae2-9ed5-f765837bfab9 tempest-TaggedBootDevicesTest_v242-884103753 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-fdf5d208-3baf-45d3-9815-e2f0994a442c', 'hosts': ['10.222.0.100'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'c7ee930a-3b87-450e-91f6-d4eef70cb484', 'volume_id': 'fdf5d208-3baf-45d3-9815-e2f0994a442c', 'discard': True}} {{(pid=129952) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Jan 22 21:06:22.328456 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [req-61f17db8-c569-4de4-978d-158d71ae8b98 req-c38963fb-eb8b-4ae2-9ed5-f765837bfab9 tempest-TaggedBootDevicesTest_v242-884103753 None] Connection info returned from driver {'name': 'volumes/volume-fdf5d208-3baf-45d3-9815-e2f0994a442c', 'hosts': ['10.222.0.100'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'fdf5d208-3baf-45d3-9815-e2f0994a442c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '7e821802-f647-4c43-8312-7de33f43a48c'} {{(pid=129952) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4811}} Jan 22 21:06:22.456076 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [req-61f17db8-c569-4de4-978d-158d71ae8b98 req-c38963fb-eb8b-4ae2-9ed5-f765837bfab9 tempest-TaggedBootDevicesTest_v242-884103753 None] attachment_update completed successfully. Jan 22 21:06:57.275034 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.flows.manager.create_volume [req-c212028b-c37b-4679-a1ee-d508713d1ebf req-5c7d8181-4090-4c91-a6d4-a882612cc451 tempest-VolumesGetTestJSON-1722497660 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129952) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Jan 22 21:06:57.281738 ncdv-master-1 cinder-volume[129952]: WARNING stevedore.named [req-c212028b-c37b-4679-a1ee-d508713d1ebf req-5c7d8181-4090-4c91-a6d4-a882612cc451 tempest-VolumesGetTestJSON-1722497660 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jan 22 21:06:57.283565 ncdv-master-1 cinder-volume[129952]: WARNING castellan.key_manager [req-c212028b-c37b-4679-a1ee-d508713d1ebf req-5c7d8181-4090-4c91-a6d4-a882612cc451 tempest-VolumesGetTestJSON-1722497660 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 22 21:06:57.319333 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [req-c212028b-c37b-4679-a1ee-d508713d1ebf req-5c7d8181-4090-4c91-a6d4-a882612cc451 tempest-VolumesGetTestJSON-1722497660 None] Flow 'volume_create_manager' (ea7755c0-ed1b-4675-8bac-7ca07de2cf96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 22 21:06:57.328102 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [req-c212028b-c37b-4679-a1ee-d508713d1ebf req-5c7d8181-4090-4c91-a6d4-a882612cc451 tempest-VolumesGetTestJSON-1722497660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3b14313-797f-4a9a-bf40-ac473c7f845c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:06:57.336178 ncdv-master-1 cinder-volume[129952]: DEBUG oslo_db.sqlalchemy.engines [req-c212028b-c37b-4679-a1ee-d508713d1ebf req-5c7d8181-4090-4c91-a6d4-a882612cc451 tempest-VolumesGetTestJSON-1722497660 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129952) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 22 21:06:57.354185 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [req-c212028b-c37b-4679-a1ee-d508713d1ebf req-5c7d8181-4090-4c91-a6d4-a882612cc451 tempest-VolumesGetTestJSON-1722497660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3b14313-797f-4a9a-bf40-ac473c7f845c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-01-22T21:06:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1574487392',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=f01372a6-40b8-4270-ae61-0aae8cb983ce,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='158179566b3b40bf9a94100426b95549',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-01-22T21:06:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-01-22T21:06:57Z,use_quota=True,user_id='e66da4628b374a3cbe876d9503c60951',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6dacb05b-a7ea-4056-85ff-98f0ea5c54eb),volume_type_id=6dacb05b-a7ea-4056-85ff-98f0ea5c54eb)' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:06:57.361751 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [req-c212028b-c37b-4679-a1ee-d508713d1ebf req-5c7d8181-4090-4c91-a6d4-a882612cc451 tempest-VolumesGetTestJSON-1722497660 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08be9f61-a529-41bf-844e-d75e3c381610) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:06:57.367603 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [req-c212028b-c37b-4679-a1ee-d508713d1ebf req-5c7d8181-4090-4c91-a6d4-a882612cc451 tempest-VolumesGetTestJSON-1722497660 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08be9f61-a529-41bf-844e-d75e3c381610) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:06:57.373326 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [req-c212028b-c37b-4679-a1ee-d508713d1ebf req-5c7d8181-4090-4c91-a6d4-a882612cc451 tempest-VolumesGetTestJSON-1722497660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3cd46505-3490-4353-ad52-4866266676f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:06:57.377895 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [req-c212028b-c37b-4679-a1ee-d508713d1ebf req-5c7d8181-4090-4c91-a6d4-a882612cc451 tempest-VolumesGetTestJSON-1722497660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3cd46505-3490-4353-ad52-4866266676f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f01372a6-40b8-4270-ae61-0aae8cb983ce', 'volume_name': 'volume-f01372a6-40b8-4270-ae61-0aae8cb983ce', 'volume_size': 1}' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:06:57.385006 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [req-c212028b-c37b-4679-a1ee-d508713d1ebf req-5c7d8181-4090-4c91-a6d4-a882612cc451 tempest-VolumesGetTestJSON-1722497660 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33397990-7bd7-470c-a085-e6a86a0bf0be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:06:57.389612 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [req-c212028b-c37b-4679-a1ee-d508713d1ebf req-5c7d8181-4090-4c91-a6d4-a882612cc451 tempest-VolumesGetTestJSON-1722497660 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33397990-7bd7-470c-a085-e6a86a0bf0be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:06:57.398088 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [req-c212028b-c37b-4679-a1ee-d508713d1ebf req-5c7d8181-4090-4c91-a6d4-a882612cc451 tempest-VolumesGetTestJSON-1722497660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61e9fd66-8ab2-4ba5-a1bd-ac4b38996b34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:06:57.399512 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.flows.manager.create_volume [req-c212028b-c37b-4679-a1ee-d508713d1ebf req-5c7d8181-4090-4c91-a6d4-a882612cc451 tempest-VolumesGetTestJSON-1722497660 None] Volume f01372a6-40b8-4270-ae61-0aae8cb983ce: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f01372a6-40b8-4270-ae61-0aae8cb983ce', 'volume_size': 1} Jan 22 21:06:57.400170 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [req-c212028b-c37b-4679-a1ee-d508713d1ebf req-5c7d8181-4090-4c91-a6d4-a882612cc451 tempest-VolumesGetTestJSON-1722497660 None] creating volume 'volume-f01372a6-40b8-4270-ae61-0aae8cb983ce' {{(pid=129952) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Jan 22 21:06:57.401716 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [req-c212028b-c37b-4679-a1ee-d508713d1ebf req-5c7d8181-4090-4c91-a6d4-a882612cc451 tempest-VolumesGetTestJSON-1722497660 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:06:58.074353 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [req-c212028b-c37b-4679-a1ee-d508713d1ebf req-5c7d8181-4090-4c91-a6d4-a882612cc451 tempest-VolumesGetTestJSON-1722497660 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129952) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 22 21:06:58.075000 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [req-c212028b-c37b-4679-a1ee-d508713d1ebf req-5c7d8181-4090-4c91-a6d4-a882612cc451 tempest-VolumesGetTestJSON-1722497660 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129952) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 22 21:06:58.085683 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [req-c212028b-c37b-4679-a1ee-d508713d1ebf req-5c7d8181-4090-4c91-a6d4-a882612cc451 tempest-VolumesGetTestJSON-1722497660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61e9fd66-8ab2-4ba5-a1bd-ac4b38996b34) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f01372a6-40b8-4270-ae61-0aae8cb983ce', 'volume_size': 1}' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:06:58.092129 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [req-c212028b-c37b-4679-a1ee-d508713d1ebf req-5c7d8181-4090-4c91-a6d4-a882612cc451 tempest-VolumesGetTestJSON-1722497660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (189c0b8d-343e-49c6-8606-9c278ae95f74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:06:58.184784 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.flows.manager.create_volume [req-c212028b-c37b-4679-a1ee-d508713d1ebf req-5c7d8181-4090-4c91-a6d4-a882612cc451 tempest-VolumesGetTestJSON-1722497660 None] Volume volume-f01372a6-40b8-4270-ae61-0aae8cb983ce (f01372a6-40b8-4270-ae61-0aae8cb983ce): created successfully Jan 22 21:06:58.190021 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [req-c212028b-c37b-4679-a1ee-d508713d1ebf req-5c7d8181-4090-4c91-a6d4-a882612cc451 tempest-VolumesGetTestJSON-1722497660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (189c0b8d-343e-49c6-8606-9c278ae95f74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:06:58.212605 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [req-c212028b-c37b-4679-a1ee-d508713d1ebf req-5c7d8181-4090-4c91-a6d4-a882612cc451 tempest-VolumesGetTestJSON-1722497660 None] Flow 'volume_create_manager' (ea7755c0-ed1b-4675-8bac-7ca07de2cf96) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129952) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 22 21:06:58.267937 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [req-c212028b-c37b-4679-a1ee-d508713d1ebf req-5c7d8181-4090-4c91-a6d4-a882612cc451 tempest-VolumesGetTestJSON-1722497660 None] Created volume successfully. Jan 22 21:07:03.515901 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.coordination [req-bfdffa65-816c-4883-bc1b-849e011541bb req-1f5fe50c-6263-4f6e-bcd1-3d92a032a4a7 tempest-VolumesGetTestJSON-1722497660 None] Lock "b'cinder-f01372a6-40b8-4270-ae61-0aae8cb983ce-delete_volume'" acquired by "delete_volume" :: waited 0.028s {{(pid=129952) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 22 21:07:03.816550 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [req-bfdffa65-816c-4883-bc1b-849e011541bb req-1f5fe50c-6263-4f6e-bcd1-3d92a032a4a7 tempest-VolumesGetTestJSON-1722497660 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:07:03.978035 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [req-bfdffa65-816c-4883-bc1b-849e011541bb req-1f5fe50c-6263-4f6e-bcd1-3d92a032a4a7 tempest-VolumesGetTestJSON-1722497660 None] volume has no backup snaps {{(pid=129952) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Jan 22 21:07:03.978788 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [req-bfdffa65-816c-4883-bc1b-849e011541bb req-1f5fe50c-6263-4f6e-bcd1-3d92a032a4a7 tempest-VolumesGetTestJSON-1722497660 None] Volume volume-f01372a6-40b8-4270-ae61-0aae8cb983ce is not a clone. {{(pid=129952) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Jan 22 21:07:04.053661 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [req-bfdffa65-816c-4883-bc1b-849e011541bb req-1f5fe50c-6263-4f6e-bcd1-3d92a032a4a7 tempest-VolumesGetTestJSON-1722497660 None] deleting rbd volume volume-f01372a6-40b8-4270-ae61-0aae8cb983ce {{(pid=129952) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Jan 22 21:07:07.720934 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.quota [req-bfdffa65-816c-4883-bc1b-849e011541bb req-1f5fe50c-6263-4f6e-bcd1-3d92a032a4a7 tempest-VolumesGetTestJSON-1722497660 None] Created reservations ['35b2706c-8d3c-4ff7-b7fe-866e68041fbb', 'a083eee8-94fd-4f82-8621-eeef3b160711', '9d7e8404-fd39-4d82-a27e-00e3d24ffaa5', '23ee75d4-0043-479d-869d-4d83a65acd8e'] {{(pid=129952) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 22 21:07:07.973454 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [req-bfdffa65-816c-4883-bc1b-849e011541bb req-1f5fe50c-6263-4f6e-bcd1-3d92a032a4a7 tempest-VolumesGetTestJSON-1722497660 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:07:08.043591 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [req-bfdffa65-816c-4883-bc1b-849e011541bb req-1f5fe50c-6263-4f6e-bcd1-3d92a032a4a7 tempest-VolumesGetTestJSON-1722497660 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:07:08.118719 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.manager [req-bfdffa65-816c-4883-bc1b-849e011541bb req-1f5fe50c-6263-4f6e-bcd1-3d92a032a4a7 tempest-VolumesGetTestJSON-1722497660 None] Notifying Schedulers of capabilities ... {{(pid=129952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 22 21:07:08.124185 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [req-bfdffa65-816c-4883-bc1b-849e011541bb req-1f5fe50c-6263-4f6e-bcd1-3d92a032a4a7 tempest-VolumesGetTestJSON-1722497660 None] Deleted volume successfully. Jan 22 21:07:08.222166 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.coordination [req-bfdffa65-816c-4883-bc1b-849e011541bb req-1f5fe50c-6263-4f6e-bcd1-3d92a032a4a7 tempest-VolumesGetTestJSON-1722497660 None] Lock "b'cinder-f01372a6-40b8-4270-ae61-0aae8cb983ce-delete_volume'" released by "delete_volume" :: held 4.708s {{(pid=129952) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 22 21:07:09.666098 ncdv-master-1 cinder-volume[129952]: DEBUG oslo_service.periodic_task [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129952) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jan 22 21:07:09.668224 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:07:09.729931 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:07:09.823529 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.manager [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] Notifying Schedulers of capabilities ... {{(pid=129952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 22 21:07:46.759069 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.flows.manager.create_volume [None req-f96fadde-d376-4c80-b51e-e8dd9ef2b185 tempest-ServersTestBootFromVolume-1509582670 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129952) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Jan 22 21:07:46.767448 ncdv-master-1 cinder-volume[129952]: WARNING stevedore.named [None req-f96fadde-d376-4c80-b51e-e8dd9ef2b185 tempest-ServersTestBootFromVolume-1509582670 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jan 22 21:07:46.767930 ncdv-master-1 cinder-volume[129952]: WARNING castellan.key_manager [None req-f96fadde-d376-4c80-b51e-e8dd9ef2b185 tempest-ServersTestBootFromVolume-1509582670 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 22 21:07:46.823300 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-f96fadde-d376-4c80-b51e-e8dd9ef2b185 tempest-ServersTestBootFromVolume-1509582670 None] Flow 'volume_create_manager' (de52cd90-41e3-4fb0-ab06-2df8f6a3f4f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 22 21:07:46.844194 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-f96fadde-d376-4c80-b51e-e8dd9ef2b185 tempest-ServersTestBootFromVolume-1509582670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8fca6d3f-3335-440d-b734-76035bd4ebda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:07:46.859857 ncdv-master-1 cinder-volume[129952]: DEBUG oslo_db.sqlalchemy.engines [None req-f96fadde-d376-4c80-b51e-e8dd9ef2b185 tempest-ServersTestBootFromVolume-1509582670 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129952) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 22 21:07:46.893117 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-f96fadde-d376-4c80-b51e-e8dd9ef2b185 tempest-ServersTestBootFromVolume-1509582670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8fca6d3f-3335-440d-b734-76035bd4ebda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-01-22T21:07:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1490728246',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=6b81486c-e9f9-4b20-965d-ed0bac18454b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='56d86f3305fd4f6a89443ba40bf2778e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-01-22T21:07:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-01-22T21:07:47Z,use_quota=True,user_id='cb0f4bdcf5b6411aae7daba6bb727313',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6dacb05b-a7ea-4056-85ff-98f0ea5c54eb),volume_type_id=6dacb05b-a7ea-4056-85ff-98f0ea5c54eb)' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:07:46.909134 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-f96fadde-d376-4c80-b51e-e8dd9ef2b185 tempest-ServersTestBootFromVolume-1509582670 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28c3ca6c-ea34-43c9-8940-f08e575001bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:07:46.914198 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-f96fadde-d376-4c80-b51e-e8dd9ef2b185 tempest-ServersTestBootFromVolume-1509582670 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28c3ca6c-ea34-43c9-8940-f08e575001bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:07:46.929954 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-f96fadde-d376-4c80-b51e-e8dd9ef2b185 tempest-ServersTestBootFromVolume-1509582670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f284f5f-2d82-4aa8-937e-984996a5c202) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:07:47.069544 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-f96fadde-d376-4c80-b51e-e8dd9ef2b185 tempest-ServersTestBootFromVolume-1509582670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f284f5f-2d82-4aa8-937e-984996a5c202) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '6b81486c-e9f9-4b20-965d-ed0bac18454b', 'volume_name': 'volume-6b81486c-e9f9-4b20-965d-ed0bac18454b', 'volume_size': 1, 'image_id': '373cb480-3bc4-4821-93e2-442b4e852b80', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '994e8f6963f04af3be3dbae11a73cdfd', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '373cb480-3bc4-4821-93e2-442b4e852b80', 'created_at': datetime.datetime(2022, 1, 22, 20, 50, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 1, 22, 20, 50, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/373cb480-3bc4-4821-93e2-442b4e852b80/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:07:47.076113 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-f96fadde-d376-4c80-b51e-e8dd9ef2b185 tempest-ServersTestBootFromVolume-1509582670 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db1f3bd1-fb67-4d0d-85a0-02af4137b66c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:07:47.082904 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-f96fadde-d376-4c80-b51e-e8dd9ef2b185 tempest-ServersTestBootFromVolume-1509582670 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db1f3bd1-fb67-4d0d-85a0-02af4137b66c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:07:47.095663 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-f96fadde-d376-4c80-b51e-e8dd9ef2b185 tempest-ServersTestBootFromVolume-1509582670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2f19bb5-6659-4034-9f59-03f1b31fbe49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:07:47.096925 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.flows.manager.create_volume [None req-f96fadde-d376-4c80-b51e-e8dd9ef2b185 tempest-ServersTestBootFromVolume-1509582670 None] Volume 6b81486c-e9f9-4b20-965d-ed0bac18454b: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-6b81486c-e9f9-4b20-965d-ed0bac18454b', 'volume_size': 1, 'image_id': '373cb480-3bc4-4821-93e2-442b4e852b80', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '994e8f6963f04af3be3dbae11a73cdfd', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '373cb480-3bc4-4821-93e2-442b4e852b80', 'created_at': datetime.datetime(2022, 1, 22, 20, 50, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 1, 22, 20, 50, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/373cb480-3bc4-4821-93e2-442b4e852b80/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jan 22 21:07:47.102179 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.flows.manager.create_volume [None req-f96fadde-d376-4c80-b51e-e8dd9ef2b185 tempest-ServersTestBootFromVolume-1509582670 None] Cloning 6b81486c-e9f9-4b20-965d-ed0bac18454b from image 373cb480-3bc4-4821-93e2-442b4e852b80 at location (None, None). {{(pid=129952) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1046}} Jan 22 21:07:47.128037 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.coordination [None req-f96fadde-d376-4c80-b51e-e8dd9ef2b185 tempest-ServersTestBootFromVolume-1509582670 None] Lock "b'cinder-373cb480-3bc4-4821-93e2-442b4e852b80'" acquired by "_prepare_image_cache_entry" :: waited 0.023s {{(pid=129952) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 22 21:07:47.221966 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.image.cache [None req-f96fadde-d376-4c80-b51e-e8dd9ef2b185 tempest-ServersTestBootFromVolume-1509582670 None] Found image-volume cache entry: {'id': 1, 'image_id': '373cb480-3bc4-4821-93e2-442b4e852b80', 'volume_id': 'f39c1078-cff4-40dd-93df-4ce49cd873b4', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 1, 22, 20, 50, 57), 'last_used': datetime.datetime(2022, 1, 22, 21, 7, 47, 139099)}. {{(pid=129952) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Jan 22 21:07:47.226157 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.image.cache [None req-f96fadde-d376-4c80-b51e-e8dd9ef2b185 tempest-ServersTestBootFromVolume-1509582670 None] Image-volume cache entry image_update_at = 2022-01-22 20:50:57+00:00, requested image updated_at = 2022-01-22 20:50:57+00:00. {{(pid=129952) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Jan 22 21:07:47.226311 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.flows.manager.create_volume [None req-f96fadde-d376-4c80-b51e-e8dd9ef2b185 tempest-ServersTestBootFromVolume-1509582670 None] Found cache entry for image = 373cb480-3bc4-4821-93e2-442b4e852b80 on host ncdv-master-1@ceph#ceph. {{(pid=129952) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:869}} Jan 22 21:07:47.231908 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.coordination [None req-f96fadde-d376-4c80-b51e-e8dd9ef2b185 tempest-ServersTestBootFromVolume-1509582670 None] Lock "b'cinder-373cb480-3bc4-4821-93e2-442b4e852b80'" released by "_prepare_image_cache_entry" :: held 0.105s {{(pid=129952) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 22 21:07:47.232888 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.flows.manager.create_volume [None req-f96fadde-d376-4c80-b51e-e8dd9ef2b185 tempest-ServersTestBootFromVolume-1509582670 None] Attempting to retrieve cache entry for image = 373cb480-3bc4-4821-93e2-442b4e852b80 on host ncdv-master-1@ceph#ceph. {{(pid=129952) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:810}} Jan 22 21:07:47.242194 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.image.cache [None req-f96fadde-d376-4c80-b51e-e8dd9ef2b185 tempest-ServersTestBootFromVolume-1509582670 None] Found image-volume cache entry: {'id': 1, 'image_id': '373cb480-3bc4-4821-93e2-442b4e852b80', 'volume_id': 'f39c1078-cff4-40dd-93df-4ce49cd873b4', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 1, 22, 20, 50, 57), 'last_used': datetime.datetime(2022, 1, 22, 21, 7, 47, 239044)}. {{(pid=129952) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Jan 22 21:07:47.242977 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.image.cache [None req-f96fadde-d376-4c80-b51e-e8dd9ef2b185 tempest-ServersTestBootFromVolume-1509582670 None] Image-volume cache entry image_update_at = 2022-01-22 20:50:57+00:00, requested image updated_at = 2022-01-22 20:50:57+00:00. {{(pid=129952) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Jan 22 21:07:47.243582 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.flows.manager.create_volume [None req-f96fadde-d376-4c80-b51e-e8dd9ef2b185 tempest-ServersTestBootFromVolume-1509582670 None] Creating from source image-volume f39c1078-cff4-40dd-93df-4ce49cd873b4 {{(pid=129952) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:824}} Jan 22 21:07:47.280478 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-f96fadde-d376-4c80-b51e-e8dd9ef2b185 tempest-ServersTestBootFromVolume-1509582670 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:07:47.543694 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-f96fadde-d376-4c80-b51e-e8dd9ef2b185 tempest-ServersTestBootFromVolume-1509582670 None] creating snapshot='volume-6b81486c-e9f9-4b20-965d-ed0bac18454b.clone_snap' {{(pid=129952) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:725}} Jan 22 21:07:50.150593 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-f96fadde-d376-4c80-b51e-e8dd9ef2b185 tempest-ServersTestBootFromVolume-1509582670 None] cloning 'volume-f39c1078-cff4-40dd-93df-4ce49cd873b4@volume-6b81486c-e9f9-4b20-965d-ed0bac18454b.clone_snap' to 'volume-6b81486c-e9f9-4b20-965d-ed0bac18454b' {{(pid=129952) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:731}} Jan 22 21:07:53.747267 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-f96fadde-d376-4c80-b51e-e8dd9ef2b185 tempest-ServersTestBootFromVolume-1509582670 None] Volume volume-0b17e2f4-e149-4a4b-b525-3d029be2e6f6.deleted is not a clone. {{(pid=129952) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Jan 22 21:07:53.748568 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-f96fadde-d376-4c80-b51e-e8dd9ef2b185 tempest-ServersTestBootFromVolume-1509582670 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129952) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 22 21:07:53.748953 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-f96fadde-d376-4c80-b51e-e8dd9ef2b185 tempest-ServersTestBootFromVolume-1509582670 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129952) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 22 21:07:54.595051 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-f96fadde-d376-4c80-b51e-e8dd9ef2b185 tempest-ServersTestBootFromVolume-1509582670 None] clone created successfully {{(pid=129952) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:803}} Jan 22 21:07:54.596087 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.volume_utils [None req-f96fadde-d376-4c80-b51e-e8dd9ef2b185 tempest-ServersTestBootFromVolume-1509582670 None] Marking volume 6b81486c-e9f9-4b20-965d-ed0bac18454b as bootable. {{(pid=129952) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1178}} Jan 22 21:07:54.714457 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.flows.manager.create_volume [None req-f96fadde-d376-4c80-b51e-e8dd9ef2b185 tempest-ServersTestBootFromVolume-1509582670 None] Copying metadata from image 373cb480-3bc4-4821-93e2-442b4e852b80 to 6b81486c-e9f9-4b20-965d-ed0bac18454b. {{(pid=129952) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:443}} Jan 22 21:07:54.716065 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.flows.manager.create_volume [None req-f96fadde-d376-4c80-b51e-e8dd9ef2b185 tempest-ServersTestBootFromVolume-1509582670 None] Creating volume glance metadata for volume 6b81486c-e9f9-4b20-965d-ed0bac18454b backed by image 373cb480-3bc4-4821-93e2-442b4e852b80 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '373cb480-3bc4-4821-93e2-442b4e852b80', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=129952) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:666}} Jan 22 21:07:54.958033 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-f96fadde-d376-4c80-b51e-e8dd9ef2b185 tempest-ServersTestBootFromVolume-1509582670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2f19bb5-6659-4034-9f59-03f1b31fbe49) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6b81486c-e9f9-4b20-965d-ed0bac18454b', 'volume_size': 1, 'image_id': '373cb480-3bc4-4821-93e2-442b4e852b80', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '994e8f6963f04af3be3dbae11a73cdfd', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '373cb480-3bc4-4821-93e2-442b4e852b80', 'created_at': datetime.datetime(2022, 1, 22, 20, 50, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 1, 22, 20, 50, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/373cb480-3bc4-4821-93e2-442b4e852b80/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:07:54.966429 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-f96fadde-d376-4c80-b51e-e8dd9ef2b185 tempest-ServersTestBootFromVolume-1509582670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f30b31c5-1264-4b0c-b515-e1bc67d444ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:07:55.057659 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.flows.manager.create_volume [None req-f96fadde-d376-4c80-b51e-e8dd9ef2b185 tempest-ServersTestBootFromVolume-1509582670 None] Volume volume-6b81486c-e9f9-4b20-965d-ed0bac18454b (6b81486c-e9f9-4b20-965d-ed0bac18454b): created successfully Jan 22 21:07:55.062299 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-f96fadde-d376-4c80-b51e-e8dd9ef2b185 tempest-ServersTestBootFromVolume-1509582670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f30b31c5-1264-4b0c-b515-e1bc67d444ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:07:55.072091 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-f96fadde-d376-4c80-b51e-e8dd9ef2b185 tempest-ServersTestBootFromVolume-1509582670 None] Flow 'volume_create_manager' (de52cd90-41e3-4fb0-ab06-2df8f6a3f4f7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129952) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 22 21:07:55.167223 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-f96fadde-d376-4c80-b51e-e8dd9ef2b185 tempest-ServersTestBootFromVolume-1509582670 None] Created volume successfully. Jan 22 21:08:01.382034 ncdv-master-1 cinder-volume[129952]: DEBUG oslo_concurrency.processutils [req-d1864ba9-bd10-4c5a-9caf-838e9a3c8bc6 req-769bbfff-0b75-49d6-8bad-4a0dd84b144f tempest-ServersTestBootFromVolume-1509582670 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129952) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jan 22 21:08:02.125227 ncdv-master-1 cinder-volume[129952]: DEBUG oslo_concurrency.processutils [req-d1864ba9-bd10-4c5a-9caf-838e9a3c8bc6 req-769bbfff-0b75-49d6-8bad-4a0dd84b144f tempest-ServersTestBootFromVolume-1509582670 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.743s {{(pid=129952) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jan 22 21:08:02.126395 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [req-d1864ba9-bd10-4c5a-9caf-838e9a3c8bc6 req-769bbfff-0b75-49d6-8bad-4a0dd84b144f tempest-ServersTestBootFromVolume-1509582670 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-6b81486c-e9f9-4b20-965d-ed0bac18454b', 'hosts': ['10.222.0.100'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'c7ee930a-3b87-450e-91f6-d4eef70cb484', 'volume_id': '6b81486c-e9f9-4b20-965d-ed0bac18454b', 'discard': True}} {{(pid=129952) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Jan 22 21:08:02.228813 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [req-d1864ba9-bd10-4c5a-9caf-838e9a3c8bc6 req-769bbfff-0b75-49d6-8bad-4a0dd84b144f tempest-ServersTestBootFromVolume-1509582670 None] Connection info returned from driver {'name': 'volumes/volume-6b81486c-e9f9-4b20-965d-ed0bac18454b', 'hosts': ['10.222.0.100'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '6b81486c-e9f9-4b20-965d-ed0bac18454b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'cce443eb-89e9-4064-af67-6109889fd2e9'} {{(pid=129952) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4811}} Jan 22 21:08:02.420584 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [req-d1864ba9-bd10-4c5a-9caf-838e9a3c8bc6 req-769bbfff-0b75-49d6-8bad-4a0dd84b144f tempest-ServersTestBootFromVolume-1509582670 None] attachment_update completed successfully. Jan 22 21:08:09.671371 ncdv-master-1 cinder-volume[129952]: DEBUG oslo_service.periodic_task [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129952) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jan 22 21:08:09.672598 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:08:09.728879 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:08:09.787809 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.manager [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] Notifying Schedulers of capabilities ... {{(pid=129952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 22 21:09:09.675720 ncdv-master-1 cinder-volume[129952]: DEBUG oslo_service.periodic_task [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129952) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jan 22 21:09:09.680126 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:09:09.775005 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:09:09.832621 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.manager [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] Notifying Schedulers of capabilities ... {{(pid=129952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 22 21:09:22.525787 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.flows.manager.create_volume [None req-e67689cb-0eb5-4a47-b1df-7be59ec23c8e tempest-ServersNegativeTestJSON-1390801861 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129952) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Jan 22 21:09:22.529323 ncdv-master-1 cinder-volume[129952]: WARNING stevedore.named [None req-e67689cb-0eb5-4a47-b1df-7be59ec23c8e tempest-ServersNegativeTestJSON-1390801861 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jan 22 21:09:22.533938 ncdv-master-1 cinder-volume[129952]: WARNING castellan.key_manager [None req-e67689cb-0eb5-4a47-b1df-7be59ec23c8e tempest-ServersNegativeTestJSON-1390801861 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 22 21:09:22.557614 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-e67689cb-0eb5-4a47-b1df-7be59ec23c8e tempest-ServersNegativeTestJSON-1390801861 None] Flow 'volume_create_manager' (07c22b14-8918-4b3c-9df9-ed97684d6d4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 22 21:09:22.569969 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-e67689cb-0eb5-4a47-b1df-7be59ec23c8e tempest-ServersNegativeTestJSON-1390801861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69dd4804-075c-4a4e-87b5-63ce3b713099) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:09:22.579439 ncdv-master-1 cinder-volume[129952]: DEBUG oslo_db.sqlalchemy.engines [None req-e67689cb-0eb5-4a47-b1df-7be59ec23c8e tempest-ServersNegativeTestJSON-1390801861 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129952) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 22 21:09:22.597181 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-e67689cb-0eb5-4a47-b1df-7be59ec23c8e tempest-ServersNegativeTestJSON-1390801861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69dd4804-075c-4a4e-87b5-63ce3b713099) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-01-22T21:09:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1010825182',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=ed088a16-ed34-4067-87b2-bf64b154bbbc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f96634e81cc246f1ae4438f83a03ed79',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-01-22T21:09:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-01-22T21:09:22Z,use_quota=True,user_id='2391e0ef53e044aabb95c2563c931028',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6dacb05b-a7ea-4056-85ff-98f0ea5c54eb),volume_type_id=6dacb05b-a7ea-4056-85ff-98f0ea5c54eb)' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:09:22.602856 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-e67689cb-0eb5-4a47-b1df-7be59ec23c8e tempest-ServersNegativeTestJSON-1390801861 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc741387-127d-408f-adf0-bf439dad9b88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:09:22.607670 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-e67689cb-0eb5-4a47-b1df-7be59ec23c8e tempest-ServersNegativeTestJSON-1390801861 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc741387-127d-408f-adf0-bf439dad9b88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:09:22.613137 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-e67689cb-0eb5-4a47-b1df-7be59ec23c8e tempest-ServersNegativeTestJSON-1390801861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (808a3f5a-2065-401a-ae16-535fec56cb90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:09:22.617476 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-e67689cb-0eb5-4a47-b1df-7be59ec23c8e tempest-ServersNegativeTestJSON-1390801861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (808a3f5a-2065-401a-ae16-535fec56cb90) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ed088a16-ed34-4067-87b2-bf64b154bbbc', 'volume_name': 'volume-ed088a16-ed34-4067-87b2-bf64b154bbbc', 'volume_size': 1}' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:09:22.626110 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-e67689cb-0eb5-4a47-b1df-7be59ec23c8e tempest-ServersNegativeTestJSON-1390801861 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a61347bb-673c-4d37-b595-2d5eff0272d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:09:22.630367 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-e67689cb-0eb5-4a47-b1df-7be59ec23c8e tempest-ServersNegativeTestJSON-1390801861 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a61347bb-673c-4d37-b595-2d5eff0272d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:09:22.635602 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-e67689cb-0eb5-4a47-b1df-7be59ec23c8e tempest-ServersNegativeTestJSON-1390801861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70fcd178-7a9c-4914-9a4a-14bb0d648fc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:09:22.636712 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.flows.manager.create_volume [None req-e67689cb-0eb5-4a47-b1df-7be59ec23c8e tempest-ServersNegativeTestJSON-1390801861 None] Volume ed088a16-ed34-4067-87b2-bf64b154bbbc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ed088a16-ed34-4067-87b2-bf64b154bbbc', 'volume_size': 1} Jan 22 21:09:22.637127 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-e67689cb-0eb5-4a47-b1df-7be59ec23c8e tempest-ServersNegativeTestJSON-1390801861 None] creating volume 'volume-ed088a16-ed34-4067-87b2-bf64b154bbbc' {{(pid=129952) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Jan 22 21:09:22.638260 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-e67689cb-0eb5-4a47-b1df-7be59ec23c8e tempest-ServersNegativeTestJSON-1390801861 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:09:23.974915 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-e67689cb-0eb5-4a47-b1df-7be59ec23c8e tempest-ServersNegativeTestJSON-1390801861 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129952) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 22 21:09:23.975592 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-e67689cb-0eb5-4a47-b1df-7be59ec23c8e tempest-ServersNegativeTestJSON-1390801861 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129952) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 22 21:09:23.980115 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-e67689cb-0eb5-4a47-b1df-7be59ec23c8e tempest-ServersNegativeTestJSON-1390801861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70fcd178-7a9c-4914-9a4a-14bb0d648fc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ed088a16-ed34-4067-87b2-bf64b154bbbc', 'volume_size': 1}' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:09:23.985294 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-e67689cb-0eb5-4a47-b1df-7be59ec23c8e tempest-ServersNegativeTestJSON-1390801861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a7813e4-3ca4-4a0d-8afa-e9f6fe4be246) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:09:24.067033 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.flows.manager.create_volume [None req-e67689cb-0eb5-4a47-b1df-7be59ec23c8e tempest-ServersNegativeTestJSON-1390801861 None] Volume volume-ed088a16-ed34-4067-87b2-bf64b154bbbc (ed088a16-ed34-4067-87b2-bf64b154bbbc): created successfully Jan 22 21:09:24.071539 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-e67689cb-0eb5-4a47-b1df-7be59ec23c8e tempest-ServersNegativeTestJSON-1390801861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a7813e4-3ca4-4a0d-8afa-e9f6fe4be246) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:09:24.086901 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-e67689cb-0eb5-4a47-b1df-7be59ec23c8e tempest-ServersNegativeTestJSON-1390801861 None] Flow 'volume_create_manager' (07c22b14-8918-4b3c-9df9-ed97684d6d4b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129952) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 22 21:09:24.219117 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-e67689cb-0eb5-4a47-b1df-7be59ec23c8e tempest-ServersNegativeTestJSON-1390801861 None] Created volume successfully. Jan 22 21:09:26.840924 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.flows.manager.create_volume [None req-812254f2-5b4c-4f04-9caa-e876a0e62689 tempest-ServersNegativeTestJSON-1390801861 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129952) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Jan 22 21:09:26.843619 ncdv-master-1 cinder-volume[129952]: WARNING stevedore.named [None req-812254f2-5b4c-4f04-9caa-e876a0e62689 tempest-ServersNegativeTestJSON-1390801861 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jan 22 21:09:26.844286 ncdv-master-1 cinder-volume[129952]: WARNING castellan.key_manager [None req-812254f2-5b4c-4f04-9caa-e876a0e62689 tempest-ServersNegativeTestJSON-1390801861 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 22 21:09:26.868064 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-812254f2-5b4c-4f04-9caa-e876a0e62689 tempest-ServersNegativeTestJSON-1390801861 None] Flow 'volume_create_manager' (2a376028-dcbf-4fc4-9a26-9a4c4f46df8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 22 21:09:26.876893 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-812254f2-5b4c-4f04-9caa-e876a0e62689 tempest-ServersNegativeTestJSON-1390801861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96b16987-4636-4a80-a9e5-2f0113f61065) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:09:26.884549 ncdv-master-1 cinder-volume[129952]: DEBUG oslo_db.sqlalchemy.engines [None req-812254f2-5b4c-4f04-9caa-e876a0e62689 tempest-ServersNegativeTestJSON-1390801861 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129952) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 22 21:09:26.900296 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-812254f2-5b4c-4f04-9caa-e876a0e62689 tempest-ServersNegativeTestJSON-1390801861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96b16987-4636-4a80-a9e5-2f0113f61065) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-01-22T21:09:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-984095274',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=aa78ebda-5565-4d2f-8b29-26d1a3a00b33,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f96634e81cc246f1ae4438f83a03ed79',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-01-22T21:09:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-01-22T21:09:27Z,use_quota=True,user_id='2391e0ef53e044aabb95c2563c931028',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6dacb05b-a7ea-4056-85ff-98f0ea5c54eb),volume_type_id=6dacb05b-a7ea-4056-85ff-98f0ea5c54eb)' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:09:26.929195 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-812254f2-5b4c-4f04-9caa-e876a0e62689 tempest-ServersNegativeTestJSON-1390801861 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62a149f4-2f99-4a5b-87f2-b632d36113f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:09:26.935391 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-812254f2-5b4c-4f04-9caa-e876a0e62689 tempest-ServersNegativeTestJSON-1390801861 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62a149f4-2f99-4a5b-87f2-b632d36113f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:09:26.943264 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-812254f2-5b4c-4f04-9caa-e876a0e62689 tempest-ServersNegativeTestJSON-1390801861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5f4608d-100d-4196-a474-fde9be21f8ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:09:26.949910 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-812254f2-5b4c-4f04-9caa-e876a0e62689 tempest-ServersNegativeTestJSON-1390801861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5f4608d-100d-4196-a474-fde9be21f8ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aa78ebda-5565-4d2f-8b29-26d1a3a00b33', 'volume_name': 'volume-aa78ebda-5565-4d2f-8b29-26d1a3a00b33', 'volume_size': 1}' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:09:26.957395 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-812254f2-5b4c-4f04-9caa-e876a0e62689 tempest-ServersNegativeTestJSON-1390801861 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1bb004e3-9f1e-4f5c-bbe1-62ee69facd5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:09:26.962614 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-812254f2-5b4c-4f04-9caa-e876a0e62689 tempest-ServersNegativeTestJSON-1390801861 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1bb004e3-9f1e-4f5c-bbe1-62ee69facd5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:09:26.968278 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-812254f2-5b4c-4f04-9caa-e876a0e62689 tempest-ServersNegativeTestJSON-1390801861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab2a513e-f85d-4730-9a18-30906f89d562) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:09:26.969433 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.flows.manager.create_volume [None req-812254f2-5b4c-4f04-9caa-e876a0e62689 tempest-ServersNegativeTestJSON-1390801861 None] Volume aa78ebda-5565-4d2f-8b29-26d1a3a00b33: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aa78ebda-5565-4d2f-8b29-26d1a3a00b33', 'volume_size': 1} Jan 22 21:09:26.969882 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-812254f2-5b4c-4f04-9caa-e876a0e62689 tempest-ServersNegativeTestJSON-1390801861 None] creating volume 'volume-aa78ebda-5565-4d2f-8b29-26d1a3a00b33' {{(pid=129952) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Jan 22 21:09:26.970900 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-812254f2-5b4c-4f04-9caa-e876a0e62689 tempest-ServersNegativeTestJSON-1390801861 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:09:28.131197 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-812254f2-5b4c-4f04-9caa-e876a0e62689 tempest-ServersNegativeTestJSON-1390801861 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129952) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 22 21:09:28.133564 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-812254f2-5b4c-4f04-9caa-e876a0e62689 tempest-ServersNegativeTestJSON-1390801861 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129952) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 22 21:09:28.141663 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-812254f2-5b4c-4f04-9caa-e876a0e62689 tempest-ServersNegativeTestJSON-1390801861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab2a513e-f85d-4730-9a18-30906f89d562) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aa78ebda-5565-4d2f-8b29-26d1a3a00b33', 'volume_size': 1}' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:09:28.143208 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-812254f2-5b4c-4f04-9caa-e876a0e62689 tempest-ServersNegativeTestJSON-1390801861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a03ea4b-f768-4210-a10a-165880703e5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:09:28.223391 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.flows.manager.create_volume [None req-812254f2-5b4c-4f04-9caa-e876a0e62689 tempest-ServersNegativeTestJSON-1390801861 None] Volume volume-aa78ebda-5565-4d2f-8b29-26d1a3a00b33 (aa78ebda-5565-4d2f-8b29-26d1a3a00b33): created successfully Jan 22 21:09:28.227582 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-812254f2-5b4c-4f04-9caa-e876a0e62689 tempest-ServersNegativeTestJSON-1390801861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a03ea4b-f768-4210-a10a-165880703e5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:09:28.233373 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-812254f2-5b4c-4f04-9caa-e876a0e62689 tempest-ServersNegativeTestJSON-1390801861 None] Flow 'volume_create_manager' (2a376028-dcbf-4fc4-9a26-9a4c4f46df8e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129952) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 22 21:09:28.309018 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-812254f2-5b4c-4f04-9caa-e876a0e62689 tempest-ServersNegativeTestJSON-1390801861 None] Created volume successfully. Jan 22 21:10:09.678895 ncdv-master-1 cinder-volume[129952]: DEBUG oslo_service.periodic_task [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129952) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jan 22 21:10:09.680354 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:10:09.781387 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:10:09.845616 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.manager [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] Notifying Schedulers of capabilities ... {{(pid=129952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 22 21:11:09.679208 ncdv-master-1 cinder-volume[129952]: DEBUG oslo_service.periodic_task [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129952) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jan 22 21:11:09.679913 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:11:09.735928 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:11:09.802761 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.manager [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] Notifying Schedulers of capabilities ... {{(pid=129952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 22 21:11:45.115650 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.flows.manager.create_volume [None req-02e88342-6ff4-4085-b86e-967bca7f893d tempest-AttachSCSIVolumeTestJSON-1656487840 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129952) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Jan 22 21:11:45.121314 ncdv-master-1 cinder-volume[129952]: WARNING stevedore.named [None req-02e88342-6ff4-4085-b86e-967bca7f893d tempest-AttachSCSIVolumeTestJSON-1656487840 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jan 22 21:11:45.121788 ncdv-master-1 cinder-volume[129952]: WARNING castellan.key_manager [None req-02e88342-6ff4-4085-b86e-967bca7f893d tempest-AttachSCSIVolumeTestJSON-1656487840 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 22 21:11:45.157546 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-02e88342-6ff4-4085-b86e-967bca7f893d tempest-AttachSCSIVolumeTestJSON-1656487840 None] Flow 'volume_create_manager' (cd080bd2-92b1-45f8-ab71-cabc7c56a3ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 22 21:11:45.164248 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-02e88342-6ff4-4085-b86e-967bca7f893d tempest-AttachSCSIVolumeTestJSON-1656487840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d64e786-6af7-42c8-821d-3b201c68eccd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:11:45.171785 ncdv-master-1 cinder-volume[129952]: DEBUG oslo_db.sqlalchemy.engines [None req-02e88342-6ff4-4085-b86e-967bca7f893d tempest-AttachSCSIVolumeTestJSON-1656487840 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129952) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 22 21:11:45.190187 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-02e88342-6ff4-4085-b86e-967bca7f893d tempest-AttachSCSIVolumeTestJSON-1656487840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d64e786-6af7-42c8-821d-3b201c68eccd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-01-22T21:11:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachSCSIVolumeTestJSON-volume-1169615270',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=8d503e5d-13b7-4392-b749-17ade718b9e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4dfa8e2e09994a9d8746ab84c2cc6b6f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-01-22T21:11:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-01-22T21:11:45Z,use_quota=True,user_id='ead04bf776f146eabbe0f9f32319542b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6dacb05b-a7ea-4056-85ff-98f0ea5c54eb),volume_type_id=6dacb05b-a7ea-4056-85ff-98f0ea5c54eb)' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:11:45.196418 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-02e88342-6ff4-4085-b86e-967bca7f893d tempest-AttachSCSIVolumeTestJSON-1656487840 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ada29d0-e02b-4931-b48f-9c119699c977) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:11:45.201560 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-02e88342-6ff4-4085-b86e-967bca7f893d tempest-AttachSCSIVolumeTestJSON-1656487840 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ada29d0-e02b-4931-b48f-9c119699c977) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:11:45.207640 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-02e88342-6ff4-4085-b86e-967bca7f893d tempest-AttachSCSIVolumeTestJSON-1656487840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1866f45b-4bc5-4fa6-afa3-c8bf5cceea26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:11:45.213683 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-02e88342-6ff4-4085-b86e-967bca7f893d tempest-AttachSCSIVolumeTestJSON-1656487840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1866f45b-4bc5-4fa6-afa3-c8bf5cceea26) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8d503e5d-13b7-4392-b749-17ade718b9e5', 'volume_name': 'volume-8d503e5d-13b7-4392-b749-17ade718b9e5', 'volume_size': 1}' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:11:45.220185 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-02e88342-6ff4-4085-b86e-967bca7f893d tempest-AttachSCSIVolumeTestJSON-1656487840 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (874bf5d1-553d-4d4e-a9ed-b2479194b8cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:11:45.225133 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-02e88342-6ff4-4085-b86e-967bca7f893d tempest-AttachSCSIVolumeTestJSON-1656487840 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (874bf5d1-553d-4d4e-a9ed-b2479194b8cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:11:45.230845 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-02e88342-6ff4-4085-b86e-967bca7f893d tempest-AttachSCSIVolumeTestJSON-1656487840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c1c80cb-58ba-4b95-9c7f-75857a534e4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:11:45.232149 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.flows.manager.create_volume [None req-02e88342-6ff4-4085-b86e-967bca7f893d tempest-AttachSCSIVolumeTestJSON-1656487840 None] Volume 8d503e5d-13b7-4392-b749-17ade718b9e5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8d503e5d-13b7-4392-b749-17ade718b9e5', 'volume_size': 1} Jan 22 21:11:45.232693 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-02e88342-6ff4-4085-b86e-967bca7f893d tempest-AttachSCSIVolumeTestJSON-1656487840 None] creating volume 'volume-8d503e5d-13b7-4392-b749-17ade718b9e5' {{(pid=129952) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Jan 22 21:11:45.233877 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-02e88342-6ff4-4085-b86e-967bca7f893d tempest-AttachSCSIVolumeTestJSON-1656487840 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:11:45.896796 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.coordination [None req-740c6406-b12d-4400-8bbe-160af61e3f3c tempest-ServersNegativeTestJSON-1390801861 None] Lock "b'cinder-aa78ebda-5565-4d2f-8b29-26d1a3a00b33-delete_volume'" acquired by "delete_volume" :: waited 0.009s {{(pid=129952) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 22 21:11:46.004992 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-740c6406-b12d-4400-8bbe-160af61e3f3c tempest-ServersNegativeTestJSON-1390801861 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:11:46.388221 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-740c6406-b12d-4400-8bbe-160af61e3f3c tempest-ServersNegativeTestJSON-1390801861 None] volume has no backup snaps {{(pid=129952) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Jan 22 21:11:46.389335 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-740c6406-b12d-4400-8bbe-160af61e3f3c tempest-ServersNegativeTestJSON-1390801861 None] Volume volume-aa78ebda-5565-4d2f-8b29-26d1a3a00b33 is not a clone. {{(pid=129952) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Jan 22 21:11:46.640604 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-740c6406-b12d-4400-8bbe-160af61e3f3c tempest-ServersNegativeTestJSON-1390801861 None] deleting rbd volume volume-aa78ebda-5565-4d2f-8b29-26d1a3a00b33 {{(pid=129952) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Jan 22 21:11:46.647768 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-02e88342-6ff4-4085-b86e-967bca7f893d tempest-AttachSCSIVolumeTestJSON-1656487840 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129952) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 22 21:11:46.648716 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-02e88342-6ff4-4085-b86e-967bca7f893d tempest-AttachSCSIVolumeTestJSON-1656487840 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129952) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 22 21:11:46.653285 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-02e88342-6ff4-4085-b86e-967bca7f893d tempest-AttachSCSIVolumeTestJSON-1656487840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c1c80cb-58ba-4b95-9c7f-75857a534e4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8d503e5d-13b7-4392-b749-17ade718b9e5', 'volume_size': 1}' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:11:46.659973 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-02e88342-6ff4-4085-b86e-967bca7f893d tempest-AttachSCSIVolumeTestJSON-1656487840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d22d7d2-104e-42ad-8209-62e4fd790807) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:11:46.759582 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.flows.manager.create_volume [None req-02e88342-6ff4-4085-b86e-967bca7f893d tempest-AttachSCSIVolumeTestJSON-1656487840 None] Volume volume-8d503e5d-13b7-4392-b749-17ade718b9e5 (8d503e5d-13b7-4392-b749-17ade718b9e5): created successfully Jan 22 21:11:46.764299 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-02e88342-6ff4-4085-b86e-967bca7f893d tempest-AttachSCSIVolumeTestJSON-1656487840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d22d7d2-104e-42ad-8209-62e4fd790807) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:11:46.770769 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-02e88342-6ff4-4085-b86e-967bca7f893d tempest-AttachSCSIVolumeTestJSON-1656487840 None] Flow 'volume_create_manager' (cd080bd2-92b1-45f8-ab71-cabc7c56a3ae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129952) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 22 21:11:46.834228 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-02e88342-6ff4-4085-b86e-967bca7f893d tempest-AttachSCSIVolumeTestJSON-1656487840 None] Created volume successfully. Jan 22 21:11:47.900575 ncdv-master-1 cinder-volume[129952]: DEBUG oslo_concurrency.processutils [req-52cbf7fc-633a-480b-bed3-22028ac0804b req-ef48206d-2dd5-47a1-a925-a56b6b24bc6f tempest-AttachSCSIVolumeTestJSON-1656487840 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129952) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jan 22 21:11:48.657239 ncdv-master-1 cinder-volume[129952]: DEBUG oslo_concurrency.processutils [req-52cbf7fc-633a-480b-bed3-22028ac0804b req-ef48206d-2dd5-47a1-a925-a56b6b24bc6f tempest-AttachSCSIVolumeTestJSON-1656487840 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.756s {{(pid=129952) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jan 22 21:11:48.658140 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [req-52cbf7fc-633a-480b-bed3-22028ac0804b req-ef48206d-2dd5-47a1-a925-a56b6b24bc6f tempest-AttachSCSIVolumeTestJSON-1656487840 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-8d503e5d-13b7-4392-b749-17ade718b9e5', 'hosts': ['10.222.0.100'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'c7ee930a-3b87-450e-91f6-d4eef70cb484', 'volume_id': '8d503e5d-13b7-4392-b749-17ade718b9e5', 'discard': True}} {{(pid=129952) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Jan 22 21:11:48.748245 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [req-52cbf7fc-633a-480b-bed3-22028ac0804b req-ef48206d-2dd5-47a1-a925-a56b6b24bc6f tempest-AttachSCSIVolumeTestJSON-1656487840 None] Connection info returned from driver {'name': 'volumes/volume-8d503e5d-13b7-4392-b749-17ade718b9e5', 'hosts': ['10.222.0.100'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '8d503e5d-13b7-4392-b749-17ade718b9e5', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '33a3242a-3786-430f-a152-9b6462583ecb'} {{(pid=129952) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4811}} Jan 22 21:11:48.858659 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [req-52cbf7fc-633a-480b-bed3-22028ac0804b req-ef48206d-2dd5-47a1-a925-a56b6b24bc6f tempest-AttachSCSIVolumeTestJSON-1656487840 None] attachment_update completed successfully. Jan 22 21:11:49.403640 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-85647325-8c9b-424f-816b-3ecce97fde72 tempest-BackendsCapabilitiesAdminTestsJSON-932401554 None] Obtained capabilities list: {'vendor_name': 'Open Source', 'driver_version': '1.2.0', 'storage_protocol': 'ceph', 'total_capacity_gb': 19.94, 'free_capacity_gb': 19.94, 'reserved_percentage': 0, 'multiattach': True, 'thin_provisioning_support': True, 'max_over_subscription_ratio': '20.0', 'location_info': 'ceph:/etc/ceph/ceph.conf:dc14f9b8-31ee-4f67-aa49-9d166f822655:cinder:volumes', 'backend_state': 'up', 'volume_backend_name': 'ceph', 'replication_enabled': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=129952) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4732}} Jan 22 21:11:49.440568 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-69128614-39ca-4065-8723-9c243239cd07 tempest-BackendsCapabilitiesAdminTestsJSON-932401554 None] Obtained capabilities list: {'vendor_name': 'Open Source', 'driver_version': '1.2.0', 'storage_protocol': 'ceph', 'total_capacity_gb': 19.94, 'free_capacity_gb': 19.94, 'reserved_percentage': 0, 'multiattach': True, 'thin_provisioning_support': True, 'max_over_subscription_ratio': '20.0', 'location_info': 'ceph:/etc/ceph/ceph.conf:dc14f9b8-31ee-4f67-aa49-9d166f822655:cinder:volumes', 'backend_state': 'up', 'volume_backend_name': 'ceph', 'replication_enabled': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=129952) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4732}} Jan 22 21:11:53.498208 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.quota [None req-740c6406-b12d-4400-8bbe-160af61e3f3c tempest-ServersNegativeTestJSON-1390801861 None] Created reservations ['fdbee323-9ac9-4806-b135-698b3ab44309', '61b62cff-6957-46b7-9827-18111e9ec687', '816b78de-e789-424e-aba8-507b3c195291', '66c33204-b90f-4448-82ca-64413e540217'] {{(pid=129952) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 22 21:11:53.555210 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [req-654c8d07-276c-4489-af79-a3e7cec9c48f req-61befee7-b1da-49e6-b591-74acf89509e2 tempest-AttachSCSIVolumeTestJSON-1656487840 None] Terminate volume connection completed successfully. Jan 22 21:11:53.555835 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [req-654c8d07-276c-4489-af79-a3e7cec9c48f req-61befee7-b1da-49e6-b591-74acf89509e2 tempest-AttachSCSIVolumeTestJSON-1656487840 None] Deleting attachment 33a3242a-3786-430f-a152-9b6462583ecb. {{(pid=129952) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4947}} Jan 22 21:11:53.731894 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-740c6406-b12d-4400-8bbe-160af61e3f3c tempest-ServersNegativeTestJSON-1390801861 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:11:53.778600 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-740c6406-b12d-4400-8bbe-160af61e3f3c tempest-ServersNegativeTestJSON-1390801861 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:11:53.838663 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.manager [None req-740c6406-b12d-4400-8bbe-160af61e3f3c tempest-ServersNegativeTestJSON-1390801861 None] Notifying Schedulers of capabilities ... {{(pid=129952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 22 21:11:53.848880 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-740c6406-b12d-4400-8bbe-160af61e3f3c tempest-ServersNegativeTestJSON-1390801861 None] Deleted volume successfully. Jan 22 21:11:53.992365 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.coordination [None req-740c6406-b12d-4400-8bbe-160af61e3f3c tempest-ServersNegativeTestJSON-1390801861 None] Lock "b'cinder-aa78ebda-5565-4d2f-8b29-26d1a3a00b33-delete_volume'" released by "delete_volume" :: held 8.096s {{(pid=129952) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 22 21:11:54.531453 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.coordination [None req-19103841-b8dc-4d16-8ef4-0cfd28a44a96 tempest-ServersNegativeTestJSON-1390801861 None] Lock "b'cinder-ed088a16-ed34-4067-87b2-bf64b154bbbc-delete_volume'" acquired by "delete_volume" :: waited 0.011s {{(pid=129952) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 22 21:11:54.645416 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-19103841-b8dc-4d16-8ef4-0cfd28a44a96 tempest-ServersNegativeTestJSON-1390801861 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:11:55.085032 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-19103841-b8dc-4d16-8ef4-0cfd28a44a96 tempest-ServersNegativeTestJSON-1390801861 None] volume has no backup snaps {{(pid=129952) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Jan 22 21:11:55.085491 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-19103841-b8dc-4d16-8ef4-0cfd28a44a96 tempest-ServersNegativeTestJSON-1390801861 None] Volume volume-ed088a16-ed34-4067-87b2-bf64b154bbbc is not a clone. {{(pid=129952) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Jan 22 21:11:55.303570 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-19103841-b8dc-4d16-8ef4-0cfd28a44a96 tempest-ServersNegativeTestJSON-1390801861 None] deleting rbd volume volume-ed088a16-ed34-4067-87b2-bf64b154bbbc {{(pid=129952) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Jan 22 21:11:55.336861 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-37c120d0-7b54-4f8d-82f5-01723a86b906 tempest-GroupsTest-358396640 None] Group tempest-Group1-589190802: creating Jan 22 21:11:55.460739 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-37c120d0-7b54-4f8d-82f5-01723a86b906 tempest-GroupsTest-358396640 None] Group tempest-Group1-589190802: created successfully Jan 22 21:11:55.469873 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-37c120d0-7b54-4f8d-82f5-01723a86b906 tempest-GroupsTest-358396640 None] Create group completed successfully. Jan 22 21:11:56.202516 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-eb415fe6-4af7-435b-b6c9-2c2c134b0ef4 tempest-GroupsTest-358396640 None] Group tempest-Group2-633378241: creating Jan 22 21:11:56.297000 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-eb415fe6-4af7-435b-b6c9-2c2c134b0ef4 tempest-GroupsTest-358396640 None] Group tempest-Group2-633378241: created successfully Jan 22 21:11:56.305712 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-eb415fe6-4af7-435b-b6c9-2c2c134b0ef4 tempest-GroupsTest-358396640 None] Create group completed successfully. Jan 22 21:11:58.109994 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.flows.manager.create_volume [None req-e22717ad-472a-4c4c-afc0-88b873d29448 tempest-GroupsTest-358396640 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129952) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Jan 22 21:11:58.113720 ncdv-master-1 cinder-volume[129952]: WARNING stevedore.named [None req-e22717ad-472a-4c4c-afc0-88b873d29448 tempest-GroupsTest-358396640 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jan 22 21:11:58.118502 ncdv-master-1 cinder-volume[129952]: WARNING castellan.key_manager [None req-e22717ad-472a-4c4c-afc0-88b873d29448 tempest-GroupsTest-358396640 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 22 21:11:58.135942 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-e22717ad-472a-4c4c-afc0-88b873d29448 tempest-GroupsTest-358396640 None] Flow 'volume_create_manager' (a0fbda80-86c7-421b-aad5-d772a677baf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 22 21:11:58.142623 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-e22717ad-472a-4c4c-afc0-88b873d29448 tempest-GroupsTest-358396640 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01d199d6-fd6c-4a88-8478-c1ae2d42b32e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:11:58.149278 ncdv-master-1 cinder-volume[129952]: DEBUG oslo_db.sqlalchemy.engines [None req-e22717ad-472a-4c4c-afc0-88b873d29448 tempest-GroupsTest-358396640 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129952) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 22 21:11:58.166816 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-e22717ad-472a-4c4c-afc0-88b873d29448 tempest-GroupsTest-358396640 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01d199d6-fd6c-4a88-8478-c1ae2d42b32e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-01-22T21:11:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1079349839',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=20845862-b13b-40e9-b16d-40450c4a8566,host='ncdv-master-1@ceph#ceph',id=44ca4f44-83bf-4408-b157-b8b9f8e11415,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bea8dd8ad7674fa5bab573ce3de5fbaf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-01-22T21:11:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-01-22T21:11:58Z,use_quota=True,user_id='404faf24869b465b867c5d30bc852115',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(485bcf90-2411-40c5-8f8c-d2b0b5815c1f),volume_type_id=485bcf90-2411-40c5-8f8c-d2b0b5815c1f)' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:11:58.172661 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-e22717ad-472a-4c4c-afc0-88b873d29448 tempest-GroupsTest-358396640 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67a1928c-c482-42ec-aca1-4d4048feb26a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:11:58.176899 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-e22717ad-472a-4c4c-afc0-88b873d29448 tempest-GroupsTest-358396640 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67a1928c-c482-42ec-aca1-4d4048feb26a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:11:58.182899 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-e22717ad-472a-4c4c-afc0-88b873d29448 tempest-GroupsTest-358396640 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f382810a-14a9-4a3b-a106-06dd2ff42167) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:11:58.188508 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-e22717ad-472a-4c4c-afc0-88b873d29448 tempest-GroupsTest-358396640 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f382810a-14a9-4a3b-a106-06dd2ff42167) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '44ca4f44-83bf-4408-b157-b8b9f8e11415', 'volume_name': 'volume-44ca4f44-83bf-4408-b157-b8b9f8e11415', 'volume_size': 1}' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:11:58.192621 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-e22717ad-472a-4c4c-afc0-88b873d29448 tempest-GroupsTest-358396640 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6b3eca6-cb56-4a04-b0ad-88c1ad7fc3b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:11:58.197668 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-e22717ad-472a-4c4c-afc0-88b873d29448 tempest-GroupsTest-358396640 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6b3eca6-cb56-4a04-b0ad-88c1ad7fc3b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:11:58.202482 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-e22717ad-472a-4c4c-afc0-88b873d29448 tempest-GroupsTest-358396640 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44f76df4-d235-42ca-867e-20132b8be70f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:11:58.204338 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.flows.manager.create_volume [None req-e22717ad-472a-4c4c-afc0-88b873d29448 tempest-GroupsTest-358396640 None] Volume 44ca4f44-83bf-4408-b157-b8b9f8e11415: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-44ca4f44-83bf-4408-b157-b8b9f8e11415', 'volume_size': 1} Jan 22 21:11:58.204338 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-e22717ad-472a-4c4c-afc0-88b873d29448 tempest-GroupsTest-358396640 None] creating volume 'volume-44ca4f44-83bf-4408-b157-b8b9f8e11415' {{(pid=129952) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Jan 22 21:11:58.205285 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-e22717ad-472a-4c4c-afc0-88b873d29448 tempest-GroupsTest-358396640 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:11:59.082447 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-e22717ad-472a-4c4c-afc0-88b873d29448 tempest-GroupsTest-358396640 None] extra_specs: {} {{(pid=129952) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 22 21:11:59.082846 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-e22717ad-472a-4c4c-afc0-88b873d29448 tempest-GroupsTest-358396640 None] extra_specs: {} {{(pid=129952) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 22 21:11:59.086757 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-e22717ad-472a-4c4c-afc0-88b873d29448 tempest-GroupsTest-358396640 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44f76df4-d235-42ca-867e-20132b8be70f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-44ca4f44-83bf-4408-b157-b8b9f8e11415', 'volume_size': 1}' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:11:59.092171 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-e22717ad-472a-4c4c-afc0-88b873d29448 tempest-GroupsTest-358396640 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b22d07e9-588b-4d10-a0e0-9bf5e91284ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:11:59.229722 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.flows.manager.create_volume [None req-e22717ad-472a-4c4c-afc0-88b873d29448 tempest-GroupsTest-358396640 None] Volume volume-44ca4f44-83bf-4408-b157-b8b9f8e11415 (44ca4f44-83bf-4408-b157-b8b9f8e11415): created successfully Jan 22 21:11:59.233780 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-e22717ad-472a-4c4c-afc0-88b873d29448 tempest-GroupsTest-358396640 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b22d07e9-588b-4d10-a0e0-9bf5e91284ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:11:59.245255 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-e22717ad-472a-4c4c-afc0-88b873d29448 tempest-GroupsTest-358396640 None] Flow 'volume_create_manager' (a0fbda80-86c7-421b-aad5-d772a677baf0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129952) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 22 21:11:59.313445 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-e22717ad-472a-4c4c-afc0-88b873d29448 tempest-GroupsTest-358396640 None] Created volume successfully. Jan 22 21:12:00.622050 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-1a5ca8b2-d399-4ebb-bf68-e8d49f5363e1 tempest-GroupsTest-358396640 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:12:00.764503 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-1a5ca8b2-d399-4ebb-bf68-e8d49f5363e1 tempest-GroupsTest-358396640 None] volume has no backup snaps {{(pid=129952) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Jan 22 21:12:00.764971 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-1a5ca8b2-d399-4ebb-bf68-e8d49f5363e1 tempest-GroupsTest-358396640 None] Volume volume-44ca4f44-83bf-4408-b157-b8b9f8e11415 is not a clone. {{(pid=129952) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Jan 22 21:12:01.170696 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-1a5ca8b2-d399-4ebb-bf68-e8d49f5363e1 tempest-GroupsTest-358396640 None] deleting rbd volume volume-44ca4f44-83bf-4408-b157-b8b9f8e11415 {{(pid=129952) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Jan 22 21:12:01.479924 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.quota [None req-19103841-b8dc-4d16-8ef4-0cfd28a44a96 tempest-ServersNegativeTestJSON-1390801861 None] Created reservations ['e41cde4a-2627-4be0-b916-b2ba72a917f5', 'e1b0a567-cfed-48d9-99f9-2277e7141db7', 'de7f18e8-be62-475d-b7e4-86e12c4fa6a6', '8cd1ad2d-c547-4684-94c3-24d577904708'] {{(pid=129952) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 22 21:12:01.679907 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-19103841-b8dc-4d16-8ef4-0cfd28a44a96 tempest-ServersNegativeTestJSON-1390801861 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:12:01.709773 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-19103841-b8dc-4d16-8ef4-0cfd28a44a96 tempest-ServersNegativeTestJSON-1390801861 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:12:01.737433 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.manager [None req-19103841-b8dc-4d16-8ef4-0cfd28a44a96 tempest-ServersNegativeTestJSON-1390801861 None] Notifying Schedulers of capabilities ... {{(pid=129952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 22 21:12:01.741943 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-19103841-b8dc-4d16-8ef4-0cfd28a44a96 tempest-ServersNegativeTestJSON-1390801861 None] Deleted volume successfully. Jan 22 21:12:01.866497 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.coordination [None req-19103841-b8dc-4d16-8ef4-0cfd28a44a96 tempest-ServersNegativeTestJSON-1390801861 None] Lock "b'cinder-ed088a16-ed34-4067-87b2-bf64b154bbbc-delete_volume'" released by "delete_volume" :: held 7.335s {{(pid=129952) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 22 21:12:02.199607 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.coordination [None req-c01fc9b7-2894-47f9-9e88-ac8896b2f4ff tempest-AttachSCSIVolumeTestJSON-1656487840 None] Lock "b'cinder-8d503e5d-13b7-4392-b749-17ade718b9e5-delete_volume'" acquired by "delete_volume" :: waited 0.011s {{(pid=129952) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 22 21:12:02.314152 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-c01fc9b7-2894-47f9-9e88-ac8896b2f4ff tempest-AttachSCSIVolumeTestJSON-1656487840 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:12:02.484512 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-c01fc9b7-2894-47f9-9e88-ac8896b2f4ff tempest-AttachSCSIVolumeTestJSON-1656487840 None] volume has no backup snaps {{(pid=129952) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Jan 22 21:12:02.484942 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-c01fc9b7-2894-47f9-9e88-ac8896b2f4ff tempest-AttachSCSIVolumeTestJSON-1656487840 None] Volume volume-8d503e5d-13b7-4392-b749-17ade718b9e5 is not a clone. {{(pid=129952) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Jan 22 21:12:02.736796 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-c01fc9b7-2894-47f9-9e88-ac8896b2f4ff tempest-AttachSCSIVolumeTestJSON-1656487840 None] deleting rbd volume volume-8d503e5d-13b7-4392-b749-17ade718b9e5 {{(pid=129952) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Jan 22 21:12:08.319288 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.quota [None req-1a5ca8b2-d399-4ebb-bf68-e8d49f5363e1 tempest-GroupsTest-358396640 None] Created reservations ['fb913185-9d41-4e2b-b38e-af92bf7a919e'] {{(pid=129952) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 22 21:12:08.337303 ncdv-master-1 cinder-volume[129952]: WARNING cinder.quota [None req-1a5ca8b2-d399-4ebb-bf68-e8d49f5363e1 tempest-GroupsTest-358396640 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1065800623 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1065800623, it is now deprecated. Please use the default quota class for default quota. Jan 22 21:12:08.338948 ncdv-master-1 cinder-volume[129952]: WARNING cinder.quota [None req-1a5ca8b2-d399-4ebb-bf68-e8d49f5363e1 tempest-GroupsTest-358396640 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1065800623 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1065800623, it is now deprecated. Please use the default quota class for default quota. Jan 22 21:12:08.433442 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.quota [None req-1a5ca8b2-d399-4ebb-bf68-e8d49f5363e1 tempest-GroupsTest-358396640 None] Created reservations ['67dd064e-fd27-40f7-bf2c-786369b9df36', '19dffeaa-bde9-418e-a6e0-51df83f29bef', '91f82a37-efe9-44b8-ba82-0d1db812b441', '8b4e067c-e5bd-40f0-9bfc-7abe7b30ba00'] {{(pid=129952) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 22 21:12:08.805927 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-1a5ca8b2-d399-4ebb-bf68-e8d49f5363e1 tempest-GroupsTest-358396640 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:12:08.834558 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-1a5ca8b2-d399-4ebb-bf68-e8d49f5363e1 tempest-GroupsTest-358396640 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:12:08.867130 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.manager [None req-1a5ca8b2-d399-4ebb-bf68-e8d49f5363e1 tempest-GroupsTest-358396640 None] Notifying Schedulers of capabilities ... {{(pid=129952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 22 21:12:08.879371 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-1a5ca8b2-d399-4ebb-bf68-e8d49f5363e1 tempest-GroupsTest-358396640 None] Delete group completed successfully. Jan 22 21:12:09.397760 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.quota [None req-c01fc9b7-2894-47f9-9e88-ac8896b2f4ff tempest-AttachSCSIVolumeTestJSON-1656487840 None] Created reservations ['4dd620bb-f377-4afc-b876-4fbef423b241', '7f044e17-2a45-4b87-9e2d-47e9bcf9a0da', 'a603f4c8-2c68-411b-8dbc-013a57f1c044', '9d19287a-6520-4a23-89ee-d66d0e835236'] {{(pid=129952) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 22 21:12:09.551994 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.quota [None req-0dedc697-7cfa-4926-bccc-aa2746eed1d2 tempest-GroupsTest-358396640 None] Created reservations ['fd744d82-3843-4e99-b914-5df2e11b5310'] {{(pid=129952) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 22 21:12:09.619081 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-c01fc9b7-2894-47f9-9e88-ac8896b2f4ff tempest-AttachSCSIVolumeTestJSON-1656487840 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:12:09.654242 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-c01fc9b7-2894-47f9-9e88-ac8896b2f4ff tempest-AttachSCSIVolumeTestJSON-1656487840 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:12:09.692105 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.manager [None req-c01fc9b7-2894-47f9-9e88-ac8896b2f4ff tempest-AttachSCSIVolumeTestJSON-1656487840 None] Notifying Schedulers of capabilities ... {{(pid=129952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 22 21:12:09.695525 ncdv-master-1 cinder-volume[129952]: DEBUG oslo_service.periodic_task [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129952) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jan 22 21:12:09.699217 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:12:09.732029 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:12:09.772580 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.manager [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] Notifying Schedulers of capabilities ... {{(pid=129952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 22 21:12:09.785910 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-c01fc9b7-2894-47f9-9e88-ac8896b2f4ff tempest-AttachSCSIVolumeTestJSON-1656487840 None] Deleted volume successfully. Jan 22 21:12:09.872638 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.coordination [None req-c01fc9b7-2894-47f9-9e88-ac8896b2f4ff tempest-AttachSCSIVolumeTestJSON-1656487840 None] Lock "b'cinder-8d503e5d-13b7-4392-b749-17ade718b9e5-delete_volume'" released by "delete_volume" :: held 7.673s {{(pid=129952) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 22 21:12:09.929481 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-0dedc697-7cfa-4926-bccc-aa2746eed1d2 tempest-GroupsTest-358396640 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:12:09.960569 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-0dedc697-7cfa-4926-bccc-aa2746eed1d2 tempest-GroupsTest-358396640 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:12:09.994657 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.manager [None req-0dedc697-7cfa-4926-bccc-aa2746eed1d2 tempest-GroupsTest-358396640 None] Notifying Schedulers of capabilities ... {{(pid=129952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 22 21:12:09.999245 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-0dedc697-7cfa-4926-bccc-aa2746eed1d2 tempest-GroupsTest-358396640 None] Delete group completed successfully. Jan 22 21:12:11.545991 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-ac97ada6-73d3-4da4-832c-6496e1251648 tempest-GroupsTest-358396640 None] Group tempest-GroupsTest-Group-481898210: creating Jan 22 21:12:11.631203 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-ac97ada6-73d3-4da4-832c-6496e1251648 tempest-GroupsTest-358396640 None] Group tempest-GroupsTest-Group-481898210: created successfully Jan 22 21:12:11.642079 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-ac97ada6-73d3-4da4-832c-6496e1251648 tempest-GroupsTest-358396640 None] Create group completed successfully. Jan 22 21:12:13.720879 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.flows.manager.create_volume [None req-3a525faa-5a15-49cd-a500-b4565a5fefab tempest-GroupsTest-358396640 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129952) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Jan 22 21:12:13.725700 ncdv-master-1 cinder-volume[129952]: WARNING stevedore.named [None req-3a525faa-5a15-49cd-a500-b4565a5fefab tempest-GroupsTest-358396640 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jan 22 21:12:13.727160 ncdv-master-1 cinder-volume[129952]: WARNING castellan.key_manager [None req-3a525faa-5a15-49cd-a500-b4565a5fefab tempest-GroupsTest-358396640 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 22 21:12:13.756926 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-3a525faa-5a15-49cd-a500-b4565a5fefab tempest-GroupsTest-358396640 None] Flow 'volume_create_manager' (19501a6e-d82f-4d10-8f93-69f8d1e3c83b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 22 21:12:13.780544 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-3a525faa-5a15-49cd-a500-b4565a5fefab tempest-GroupsTest-358396640 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8fb65bd1-7617-42e9-bf99-612abfda622b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:12:13.789592 ncdv-master-1 cinder-volume[129952]: DEBUG oslo_db.sqlalchemy.engines [None req-3a525faa-5a15-49cd-a500-b4565a5fefab tempest-GroupsTest-358396640 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129952) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 22 21:12:13.822371 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-3a525faa-5a15-49cd-a500-b4565a5fefab tempest-GroupsTest-358396640 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8fb65bd1-7617-42e9-bf99-612abfda622b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-01-22T21:12:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-GroupsTest-Volume-830165717',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=016537e9-1dc2-4153-9303-6811a8c9ee36,host='ncdv-master-1@ceph#ceph',id=22fa14d2-a26b-483f-9dbc-ec5ba4df46cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bea8dd8ad7674fa5bab573ce3de5fbaf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-01-22T21:12:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-01-22T21:12:13Z,use_quota=True,user_id='404faf24869b465b867c5d30bc852115',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e7ed5eb-0394-4523-823b-ec041a0c4a27),volume_type_id=7e7ed5eb-0394-4523-823b-ec041a0c4a27)' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:12:13.834751 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-3a525faa-5a15-49cd-a500-b4565a5fefab tempest-GroupsTest-358396640 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e01c91ad-07ae-400b-9cae-4c4599454682) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:12:13.841012 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-3a525faa-5a15-49cd-a500-b4565a5fefab tempest-GroupsTest-358396640 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e01c91ad-07ae-400b-9cae-4c4599454682) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:12:13.846770 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-3a525faa-5a15-49cd-a500-b4565a5fefab tempest-GroupsTest-358396640 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0fd6a6b-2894-49a8-9b49-6054854107a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:12:13.852191 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-3a525faa-5a15-49cd-a500-b4565a5fefab tempest-GroupsTest-358396640 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0fd6a6b-2894-49a8-9b49-6054854107a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '22fa14d2-a26b-483f-9dbc-ec5ba4df46cd', 'volume_name': 'volume-22fa14d2-a26b-483f-9dbc-ec5ba4df46cd', 'volume_size': 1}' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:12:13.859853 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-3a525faa-5a15-49cd-a500-b4565a5fefab tempest-GroupsTest-358396640 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd56a4b4-7771-4ad1-ac7d-38b4fe9b6932) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:12:13.865808 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-3a525faa-5a15-49cd-a500-b4565a5fefab tempest-GroupsTest-358396640 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd56a4b4-7771-4ad1-ac7d-38b4fe9b6932) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:12:13.871229 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-3a525faa-5a15-49cd-a500-b4565a5fefab tempest-GroupsTest-358396640 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d11891c4-6f02-44ab-b81c-bdcba1aecee7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:12:13.872622 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.flows.manager.create_volume [None req-3a525faa-5a15-49cd-a500-b4565a5fefab tempest-GroupsTest-358396640 None] Volume 22fa14d2-a26b-483f-9dbc-ec5ba4df46cd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-22fa14d2-a26b-483f-9dbc-ec5ba4df46cd', 'volume_size': 1} Jan 22 21:12:13.873021 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-3a525faa-5a15-49cd-a500-b4565a5fefab tempest-GroupsTest-358396640 None] creating volume 'volume-22fa14d2-a26b-483f-9dbc-ec5ba4df46cd' {{(pid=129952) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Jan 22 21:12:13.874233 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-3a525faa-5a15-49cd-a500-b4565a5fefab tempest-GroupsTest-358396640 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:12:14.927673 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-3a525faa-5a15-49cd-a500-b4565a5fefab tempest-GroupsTest-358396640 None] extra_specs: {} {{(pid=129952) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 22 21:12:14.928774 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-3a525faa-5a15-49cd-a500-b4565a5fefab tempest-GroupsTest-358396640 None] extra_specs: {} {{(pid=129952) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 22 21:12:14.935582 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-3a525faa-5a15-49cd-a500-b4565a5fefab tempest-GroupsTest-358396640 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d11891c4-6f02-44ab-b81c-bdcba1aecee7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-22fa14d2-a26b-483f-9dbc-ec5ba4df46cd', 'volume_size': 1}' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:12:14.943839 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-3a525faa-5a15-49cd-a500-b4565a5fefab tempest-GroupsTest-358396640 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (653b59d3-9fd3-45eb-93e3-5dc18f4f234f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:12:15.004307 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.flows.manager.create_volume [None req-3a525faa-5a15-49cd-a500-b4565a5fefab tempest-GroupsTest-358396640 None] Volume volume-22fa14d2-a26b-483f-9dbc-ec5ba4df46cd (22fa14d2-a26b-483f-9dbc-ec5ba4df46cd): created successfully Jan 22 21:12:15.008098 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-3a525faa-5a15-49cd-a500-b4565a5fefab tempest-GroupsTest-358396640 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (653b59d3-9fd3-45eb-93e3-5dc18f4f234f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:12:15.020384 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-3a525faa-5a15-49cd-a500-b4565a5fefab tempest-GroupsTest-358396640 None] Flow 'volume_create_manager' (19501a6e-d82f-4d10-8f93-69f8d1e3c83b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129952) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 22 21:12:15.117722 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-3a525faa-5a15-49cd-a500-b4565a5fefab tempest-GroupsTest-358396640 None] Created volume successfully. Jan 22 21:12:16.835481 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.flows.manager.create_volume [None req-5fdf0d3b-e99d-461d-a070-06275e28dbd7 tempest-GroupsTest-358396640 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129952) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Jan 22 21:12:16.841978 ncdv-master-1 cinder-volume[129952]: WARNING stevedore.named [None req-5fdf0d3b-e99d-461d-a070-06275e28dbd7 tempest-GroupsTest-358396640 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jan 22 21:12:16.842646 ncdv-master-1 cinder-volume[129952]: WARNING castellan.key_manager [None req-5fdf0d3b-e99d-461d-a070-06275e28dbd7 tempest-GroupsTest-358396640 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 22 21:12:16.869568 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-5fdf0d3b-e99d-461d-a070-06275e28dbd7 tempest-GroupsTest-358396640 None] Flow 'volume_create_manager' (f19328da-35b7-431a-8f54-63d6f1d04e1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 22 21:12:16.878407 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-5fdf0d3b-e99d-461d-a070-06275e28dbd7 tempest-GroupsTest-358396640 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8db9fed-b567-4331-a64a-09e711bc89a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:12:16.886536 ncdv-master-1 cinder-volume[129952]: DEBUG oslo_db.sqlalchemy.engines [None req-5fdf0d3b-e99d-461d-a070-06275e28dbd7 tempest-GroupsTest-358396640 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129952) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 22 21:12:16.908530 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-5fdf0d3b-e99d-461d-a070-06275e28dbd7 tempest-GroupsTest-358396640 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8db9fed-b567-4331-a64a-09e711bc89a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-01-22T21:12:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-GroupsTest-Volume-917199205',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=016537e9-1dc2-4153-9303-6811a8c9ee36,host='ncdv-master-1@ceph#ceph',id=1e3f1f48-e921-4df1-814b-d11bffd199c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bea8dd8ad7674fa5bab573ce3de5fbaf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-01-22T21:12:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-01-22T21:12:17Z,use_quota=True,user_id='404faf24869b465b867c5d30bc852115',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e7ed5eb-0394-4523-823b-ec041a0c4a27),volume_type_id=7e7ed5eb-0394-4523-823b-ec041a0c4a27)' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:12:16.919464 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-5fdf0d3b-e99d-461d-a070-06275e28dbd7 tempest-GroupsTest-358396640 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c812d2f-4863-4f42-a475-05cb16d91d2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:12:16.924818 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-5fdf0d3b-e99d-461d-a070-06275e28dbd7 tempest-GroupsTest-358396640 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c812d2f-4863-4f42-a475-05cb16d91d2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:12:16.935521 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-5fdf0d3b-e99d-461d-a070-06275e28dbd7 tempest-GroupsTest-358396640 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fdf8fd37-4734-4713-a4d5-39afce40150d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:12:16.940089 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-5fdf0d3b-e99d-461d-a070-06275e28dbd7 tempest-GroupsTest-358396640 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fdf8fd37-4734-4713-a4d5-39afce40150d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1e3f1f48-e921-4df1-814b-d11bffd199c5', 'volume_name': 'volume-1e3f1f48-e921-4df1-814b-d11bffd199c5', 'volume_size': 1}' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:12:16.945376 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-5fdf0d3b-e99d-461d-a070-06275e28dbd7 tempest-GroupsTest-358396640 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (185d0327-673c-4778-80ce-4e04b9711558) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:12:16.950310 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-5fdf0d3b-e99d-461d-a070-06275e28dbd7 tempest-GroupsTest-358396640 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (185d0327-673c-4778-80ce-4e04b9711558) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:12:16.955471 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-5fdf0d3b-e99d-461d-a070-06275e28dbd7 tempest-GroupsTest-358396640 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb0154f0-b1be-4628-b7e6-f9eb839f9bb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:12:16.956680 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.flows.manager.create_volume [None req-5fdf0d3b-e99d-461d-a070-06275e28dbd7 tempest-GroupsTest-358396640 None] Volume 1e3f1f48-e921-4df1-814b-d11bffd199c5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1e3f1f48-e921-4df1-814b-d11bffd199c5', 'volume_size': 1} Jan 22 21:12:16.957086 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-5fdf0d3b-e99d-461d-a070-06275e28dbd7 tempest-GroupsTest-358396640 None] creating volume 'volume-1e3f1f48-e921-4df1-814b-d11bffd199c5' {{(pid=129952) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Jan 22 21:12:16.958159 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-5fdf0d3b-e99d-461d-a070-06275e28dbd7 tempest-GroupsTest-358396640 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:12:18.357224 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-5fdf0d3b-e99d-461d-a070-06275e28dbd7 tempest-GroupsTest-358396640 None] extra_specs: {} {{(pid=129952) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 22 21:12:18.358544 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-5fdf0d3b-e99d-461d-a070-06275e28dbd7 tempest-GroupsTest-358396640 None] extra_specs: {} {{(pid=129952) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 22 21:12:18.362796 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-5fdf0d3b-e99d-461d-a070-06275e28dbd7 tempest-GroupsTest-358396640 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb0154f0-b1be-4628-b7e6-f9eb839f9bb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1e3f1f48-e921-4df1-814b-d11bffd199c5', 'volume_size': 1}' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:12:18.368480 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-5fdf0d3b-e99d-461d-a070-06275e28dbd7 tempest-GroupsTest-358396640 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a29b9d5-9404-4b3b-8e1d-8f4f69f6537f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:12:18.450214 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.flows.manager.create_volume [None req-5fdf0d3b-e99d-461d-a070-06275e28dbd7 tempest-GroupsTest-358396640 None] Volume volume-1e3f1f48-e921-4df1-814b-d11bffd199c5 (1e3f1f48-e921-4df1-814b-d11bffd199c5): created successfully Jan 22 21:12:18.454557 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-5fdf0d3b-e99d-461d-a070-06275e28dbd7 tempest-GroupsTest-358396640 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a29b9d5-9404-4b3b-8e1d-8f4f69f6537f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:12:18.462149 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-5fdf0d3b-e99d-461d-a070-06275e28dbd7 tempest-GroupsTest-358396640 None] Flow 'volume_create_manager' (f19328da-35b7-431a-8f54-63d6f1d04e1c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129952) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 22 21:12:18.535494 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-5fdf0d3b-e99d-461d-a070-06275e28dbd7 tempest-GroupsTest-358396640 None] Created volume successfully. Jan 22 21:12:19.303053 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-4f72dd8c-4796-4f5a-a95c-db4723787570 tempest-GroupsTest-358396640 None] Update group completed successfully. Jan 22 21:12:21.010127 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-2be82878-7553-4e55-9f4d-c3dd67bf53b3 tempest-GroupsTest-358396640 None] Update group completed successfully. Jan 22 21:12:22.612845 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-a53b7b31-b457-4faf-8cbe-87da869e547b tempest-GroupsTest-358396640 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:12:22.976373 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-a53b7b31-b457-4faf-8cbe-87da869e547b tempest-GroupsTest-358396640 None] volume has no backup snaps {{(pid=129952) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Jan 22 21:12:22.976827 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-a53b7b31-b457-4faf-8cbe-87da869e547b tempest-GroupsTest-358396640 None] Volume volume-1e3f1f48-e921-4df1-814b-d11bffd199c5 is not a clone. {{(pid=129952) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Jan 22 21:12:23.347468 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-a53b7b31-b457-4faf-8cbe-87da869e547b tempest-GroupsTest-358396640 None] deleting rbd volume volume-1e3f1f48-e921-4df1-814b-d11bffd199c5 {{(pid=129952) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Jan 22 21:12:31.604947 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-a53b7b31-b457-4faf-8cbe-87da869e547b tempest-GroupsTest-358396640 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:12:32.312691 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-a53b7b31-b457-4faf-8cbe-87da869e547b tempest-GroupsTest-358396640 None] volume has no backup snaps {{(pid=129952) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Jan 22 21:12:32.318054 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-a53b7b31-b457-4faf-8cbe-87da869e547b tempest-GroupsTest-358396640 None] Volume volume-22fa14d2-a26b-483f-9dbc-ec5ba4df46cd is not a clone. {{(pid=129952) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Jan 22 21:12:32.700817 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-a53b7b31-b457-4faf-8cbe-87da869e547b tempest-GroupsTest-358396640 None] deleting rbd volume volume-22fa14d2-a26b-483f-9dbc-ec5ba4df46cd {{(pid=129952) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Jan 22 21:12:41.930242 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.quota [None req-a53b7b31-b457-4faf-8cbe-87da869e547b tempest-GroupsTest-358396640 None] Created reservations ['f659dd58-6e7f-4d89-a180-bb6cba136e9e'] {{(pid=129952) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 22 21:12:41.955452 ncdv-master-1 cinder-volume[129952]: WARNING cinder.quota [None req-a53b7b31-b457-4faf-8cbe-87da869e547b tempest-GroupsTest-358396640 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1551019467 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1551019467, it is now deprecated. Please use the default quota class for default quota. Jan 22 21:12:41.956454 ncdv-master-1 cinder-volume[129952]: WARNING cinder.quota [None req-a53b7b31-b457-4faf-8cbe-87da869e547b tempest-GroupsTest-358396640 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1551019467 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1551019467, it is now deprecated. Please use the default quota class for default quota. Jan 22 21:12:42.031784 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.quota [None req-a53b7b31-b457-4faf-8cbe-87da869e547b tempest-GroupsTest-358396640 None] Created reservations ['805be249-cbeb-4b90-b1cd-95d3f0a705e8', '90aa8087-a347-4d3a-a188-221221f4e56d', 'ea1d63ed-1608-4684-b61d-f36e4ff21834', '28706418-ebaa-4c3e-b477-a3bfa58c3fd4'] {{(pid=129952) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 22 21:12:42.576038 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.quota [None req-a53b7b31-b457-4faf-8cbe-87da869e547b tempest-GroupsTest-358396640 None] Created reservations ['484a40ca-380c-47d8-91c7-411657680644', '5250a500-7d80-4ffd-bc13-ed02c06199a4', 'b392c5fe-55e4-4785-a4a5-ec04ead1e613', 'b8867421-80b1-4391-bca3-2a4f30554070'] {{(pid=129952) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 22 21:12:42.952009 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-a53b7b31-b457-4faf-8cbe-87da869e547b tempest-GroupsTest-358396640 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:12:43.049420 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-a53b7b31-b457-4faf-8cbe-87da869e547b tempest-GroupsTest-358396640 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:12:43.204902 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.manager [None req-a53b7b31-b457-4faf-8cbe-87da869e547b tempest-GroupsTest-358396640 None] Notifying Schedulers of capabilities ... {{(pid=129952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 22 21:12:43.219962 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-a53b7b31-b457-4faf-8cbe-87da869e547b tempest-GroupsTest-358396640 None] Delete group completed successfully. Jan 22 21:13:09.695443 ncdv-master-1 cinder-volume[129952]: DEBUG oslo_service.periodic_task [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129952) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jan 22 21:13:09.696434 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:13:09.819076 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:13:09.842699 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.manager [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] Notifying Schedulers of capabilities ... {{(pid=129952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 22 21:13:20.593038 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.flows.manager.create_volume [None req-3e81a6be-cf0c-45a6-9bb8-e3dfb014c270 tempest-VolumesActionsTest-2008934241 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129952) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Jan 22 21:13:20.596820 ncdv-master-1 cinder-volume[129952]: WARNING stevedore.named [None req-3e81a6be-cf0c-45a6-9bb8-e3dfb014c270 tempest-VolumesActionsTest-2008934241 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jan 22 21:13:20.597300 ncdv-master-1 cinder-volume[129952]: WARNING castellan.key_manager [None req-3e81a6be-cf0c-45a6-9bb8-e3dfb014c270 tempest-VolumesActionsTest-2008934241 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 22 21:13:20.620751 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-3e81a6be-cf0c-45a6-9bb8-e3dfb014c270 tempest-VolumesActionsTest-2008934241 None] Flow 'volume_create_manager' (b0d28d2c-df6b-4afb-8635-08a0861ee69f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 22 21:13:20.630417 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-3e81a6be-cf0c-45a6-9bb8-e3dfb014c270 tempest-VolumesActionsTest-2008934241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (056810e0-3f06-4fb8-8115-bba546cd26b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:13:20.638417 ncdv-master-1 cinder-volume[129952]: DEBUG oslo_db.sqlalchemy.engines [None req-3e81a6be-cf0c-45a6-9bb8-e3dfb014c270 tempest-VolumesActionsTest-2008934241 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129952) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 22 21:13:20.661467 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-3e81a6be-cf0c-45a6-9bb8-e3dfb014c270 tempest-VolumesActionsTest-2008934241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (056810e0-3f06-4fb8-8115-bba546cd26b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-01-22T21:13:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1422828380',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=a2fc33fd-3b45-47a4-bde6-feaab56ed4a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cda1afcb57254df4b0dc8a26bd9d297c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-01-22T21:13:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-01-22T21:13:20Z,use_quota=True,user_id='08db8a972cc0443282eabcc89f0033d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6dacb05b-a7ea-4056-85ff-98f0ea5c54eb),volume_type_id=6dacb05b-a7ea-4056-85ff-98f0ea5c54eb)' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:13:20.669009 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-3e81a6be-cf0c-45a6-9bb8-e3dfb014c270 tempest-VolumesActionsTest-2008934241 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae0a1c69-9281-44b9-a639-185f644d0d23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:13:20.675613 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-3e81a6be-cf0c-45a6-9bb8-e3dfb014c270 tempest-VolumesActionsTest-2008934241 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae0a1c69-9281-44b9-a639-185f644d0d23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:13:20.682531 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-3e81a6be-cf0c-45a6-9bb8-e3dfb014c270 tempest-VolumesActionsTest-2008934241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5a3c9fa-d496-4ad1-90ae-1a3abf0bb318) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:13:20.687457 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-3e81a6be-cf0c-45a6-9bb8-e3dfb014c270 tempest-VolumesActionsTest-2008934241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5a3c9fa-d496-4ad1-90ae-1a3abf0bb318) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a2fc33fd-3b45-47a4-bde6-feaab56ed4a8', 'volume_name': 'volume-a2fc33fd-3b45-47a4-bde6-feaab56ed4a8', 'volume_size': 1}' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:13:20.694143 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-3e81a6be-cf0c-45a6-9bb8-e3dfb014c270 tempest-VolumesActionsTest-2008934241 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc25e1c4-6440-4595-ac80-074c644ddf03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:13:20.699295 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-3e81a6be-cf0c-45a6-9bb8-e3dfb014c270 tempest-VolumesActionsTest-2008934241 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc25e1c4-6440-4595-ac80-074c644ddf03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:13:20.710320 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-3e81a6be-cf0c-45a6-9bb8-e3dfb014c270 tempest-VolumesActionsTest-2008934241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5335c8d2-1f73-4765-b922-0266e9365357) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:13:20.710320 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.flows.manager.create_volume [None req-3e81a6be-cf0c-45a6-9bb8-e3dfb014c270 tempest-VolumesActionsTest-2008934241 None] Volume a2fc33fd-3b45-47a4-bde6-feaab56ed4a8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a2fc33fd-3b45-47a4-bde6-feaab56ed4a8', 'volume_size': 1} Jan 22 21:13:20.710320 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-3e81a6be-cf0c-45a6-9bb8-e3dfb014c270 tempest-VolumesActionsTest-2008934241 None] creating volume 'volume-a2fc33fd-3b45-47a4-bde6-feaab56ed4a8' {{(pid=129952) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Jan 22 21:13:20.710320 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-3e81a6be-cf0c-45a6-9bb8-e3dfb014c270 tempest-VolumesActionsTest-2008934241 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:13:21.700571 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-3e81a6be-cf0c-45a6-9bb8-e3dfb014c270 tempest-VolumesActionsTest-2008934241 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129952) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 22 21:13:21.701757 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-3e81a6be-cf0c-45a6-9bb8-e3dfb014c270 tempest-VolumesActionsTest-2008934241 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129952) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 22 21:13:21.706652 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-3e81a6be-cf0c-45a6-9bb8-e3dfb014c270 tempest-VolumesActionsTest-2008934241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5335c8d2-1f73-4765-b922-0266e9365357) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a2fc33fd-3b45-47a4-bde6-feaab56ed4a8', 'volume_size': 1}' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:13:21.712474 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-3e81a6be-cf0c-45a6-9bb8-e3dfb014c270 tempest-VolumesActionsTest-2008934241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67df5c48-8796-4451-94e0-51309a1acaa9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:13:21.821789 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.flows.manager.create_volume [None req-3e81a6be-cf0c-45a6-9bb8-e3dfb014c270 tempest-VolumesActionsTest-2008934241 None] Volume volume-a2fc33fd-3b45-47a4-bde6-feaab56ed4a8 (a2fc33fd-3b45-47a4-bde6-feaab56ed4a8): created successfully Jan 22 21:13:21.826200 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-3e81a6be-cf0c-45a6-9bb8-e3dfb014c270 tempest-VolumesActionsTest-2008934241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67df5c48-8796-4451-94e0-51309a1acaa9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:13:21.831741 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-3e81a6be-cf0c-45a6-9bb8-e3dfb014c270 tempest-VolumesActionsTest-2008934241 None] Flow 'volume_create_manager' (b0d28d2c-df6b-4afb-8635-08a0861ee69f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129952) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 22 21:13:21.950638 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-3e81a6be-cf0c-45a6-9bb8-e3dfb014c270 tempest-VolumesActionsTest-2008934241 None] Created volume successfully. Jan 22 21:13:22.594234 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.coordination [None req-cf6c6358-a689-499b-9160-60afb3ffd84e tempest-VolumesActionsTest-2008934241 None] Lock "b'cinder-a2fc33fd-3b45-47a4-bde6-feaab56ed4a8'" acquired by "attach_volume" :: waited 0.017s {{(pid=129952) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 22 21:13:22.854325 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-cf6c6358-a689-499b-9160-60afb3ffd84e tempest-VolumesActionsTest-2008934241 None] Attaching volume a2fc33fd-3b45-47a4-bde6-feaab56ed4a8 to instance bf9918df-8a8e-48ab-a9a2-05922a783d69 at mountpoint /dev/sdb on host None. Jan 22 21:13:22.962953 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-cf6c6358-a689-499b-9160-60afb3ffd84e tempest-VolumesActionsTest-2008934241 None] Attach volume completed successfully. Jan 22 21:13:22.967844 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.coordination [None req-cf6c6358-a689-499b-9160-60afb3ffd84e tempest-VolumesActionsTest-2008934241 None] Lock "b'cinder-a2fc33fd-3b45-47a4-bde6-feaab56ed4a8'" released by "attach_volume" :: held 0.374s {{(pid=129952) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 22 21:13:23.589317 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-4167d5f6-c860-43e1-b8dc-c288e16164d0 tempest-VolumesActionsTest-821574394 None] Terminate volume connection completed successfully. Jan 22 21:13:23.627770 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.coordination [None req-4167d5f6-c860-43e1-b8dc-c288e16164d0 tempest-VolumesActionsTest-821574394 None] Lock "b'cinder-a2fc33fd-3b45-47a4-bde6-feaab56ed4a8-detach_volume'" acquired by "detach_volume" :: waited 0.009s {{(pid=129952) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 22 21:13:23.639980 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-4167d5f6-c860-43e1-b8dc-c288e16164d0 tempest-VolumesActionsTest-821574394 None] Detaching volume a2fc33fd-3b45-47a4-bde6-feaab56ed4a8 from instance bf9918df-8a8e-48ab-a9a2-05922a783d69. Jan 22 21:13:23.865843 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-4167d5f6-c860-43e1-b8dc-c288e16164d0 tempest-VolumesActionsTest-821574394 None] Detach volume completed successfully. Jan 22 21:13:23.874578 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.coordination [None req-4167d5f6-c860-43e1-b8dc-c288e16164d0 tempest-VolumesActionsTest-821574394 None] Lock "b'cinder-a2fc33fd-3b45-47a4-bde6-feaab56ed4a8-detach_volume'" released by "detach_volume" :: held 0.243s {{(pid=129952) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 22 21:13:24.032155 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.coordination [None req-11ce4d78-76f9-44d1-b13a-4583dcb6cf40 tempest-VolumesActionsTest-2008934241 None] Lock "b'cinder-a2fc33fd-3b45-47a4-bde6-feaab56ed4a8-detach_volume'" acquired by "detach_volume" :: waited 0.009s {{(pid=129952) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 22 21:13:24.032573 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-11ce4d78-76f9-44d1-b13a-4583dcb6cf40 tempest-VolumesActionsTest-2008934241 None] Volume detach called, but volume not attached. Jan 22 21:13:24.044736 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.coordination [None req-11ce4d78-76f9-44d1-b13a-4583dcb6cf40 tempest-VolumesActionsTest-2008934241 None] Lock "b'cinder-a2fc33fd-3b45-47a4-bde6-feaab56ed4a8-detach_volume'" released by "detach_volume" :: held 0.011s {{(pid=129952) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 22 21:13:30.516065 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.flows.manager.create_volume [None req-83c3bab9-55ff-46da-888b-dd56768af4ef tempest-VolumesActionsTest-2008934241 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129952) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Jan 22 21:13:30.521887 ncdv-master-1 cinder-volume[129952]: WARNING stevedore.named [None req-83c3bab9-55ff-46da-888b-dd56768af4ef tempest-VolumesActionsTest-2008934241 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jan 22 21:13:30.523450 ncdv-master-1 cinder-volume[129952]: WARNING castellan.key_manager [None req-83c3bab9-55ff-46da-888b-dd56768af4ef tempest-VolumesActionsTest-2008934241 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 22 21:13:30.567506 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-83c3bab9-55ff-46da-888b-dd56768af4ef tempest-VolumesActionsTest-2008934241 None] Flow 'volume_create_manager' (e48ca538-753d-49a4-8671-943195739f64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 22 21:13:30.578274 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-83c3bab9-55ff-46da-888b-dd56768af4ef tempest-VolumesActionsTest-2008934241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fff6319f-7f5b-4309-ae87-89d59ca53aca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:13:30.590219 ncdv-master-1 cinder-volume[129952]: DEBUG oslo_db.sqlalchemy.engines [None req-83c3bab9-55ff-46da-888b-dd56768af4ef tempest-VolumesActionsTest-2008934241 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129952) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 22 21:13:30.612516 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-83c3bab9-55ff-46da-888b-dd56768af4ef tempest-VolumesActionsTest-2008934241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fff6319f-7f5b-4309-ae87-89d59ca53aca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-01-22T21:13:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1623766369',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=c04adb60-17ae-4c8d-ad78-41acc8544db4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cda1afcb57254df4b0dc8a26bd9d297c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-01-22T21:13:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-01-22T21:13:30Z,use_quota=True,user_id='08db8a972cc0443282eabcc89f0033d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6dacb05b-a7ea-4056-85ff-98f0ea5c54eb),volume_type_id=6dacb05b-a7ea-4056-85ff-98f0ea5c54eb)' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:13:30.618502 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-83c3bab9-55ff-46da-888b-dd56768af4ef tempest-VolumesActionsTest-2008934241 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2b0056a-6b1a-4560-933d-2f8617496ff5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:13:30.623650 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-83c3bab9-55ff-46da-888b-dd56768af4ef tempest-VolumesActionsTest-2008934241 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2b0056a-6b1a-4560-933d-2f8617496ff5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:13:30.629748 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-83c3bab9-55ff-46da-888b-dd56768af4ef tempest-VolumesActionsTest-2008934241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (469ef604-0a62-44d6-ae1a-995ebf46db7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:13:30.638231 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-83c3bab9-55ff-46da-888b-dd56768af4ef tempest-VolumesActionsTest-2008934241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (469ef604-0a62-44d6-ae1a-995ebf46db7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c04adb60-17ae-4c8d-ad78-41acc8544db4', 'volume_name': 'volume-c04adb60-17ae-4c8d-ad78-41acc8544db4', 'volume_size': 1}' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:13:30.645244 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-83c3bab9-55ff-46da-888b-dd56768af4ef tempest-VolumesActionsTest-2008934241 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25fed3e8-d32c-41a5-ae0b-3dcfc544d504) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:13:30.651523 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-83c3bab9-55ff-46da-888b-dd56768af4ef tempest-VolumesActionsTest-2008934241 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25fed3e8-d32c-41a5-ae0b-3dcfc544d504) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:13:30.657844 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-83c3bab9-55ff-46da-888b-dd56768af4ef tempest-VolumesActionsTest-2008934241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f0a62f0-55c0-4002-8808-c31c3a6df4cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:13:30.659131 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.flows.manager.create_volume [None req-83c3bab9-55ff-46da-888b-dd56768af4ef tempest-VolumesActionsTest-2008934241 None] Volume c04adb60-17ae-4c8d-ad78-41acc8544db4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c04adb60-17ae-4c8d-ad78-41acc8544db4', 'volume_size': 1} Jan 22 21:13:30.659651 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-83c3bab9-55ff-46da-888b-dd56768af4ef tempest-VolumesActionsTest-2008934241 None] creating volume 'volume-c04adb60-17ae-4c8d-ad78-41acc8544db4' {{(pid=129952) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Jan 22 21:13:30.661973 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-83c3bab9-55ff-46da-888b-dd56768af4ef tempest-VolumesActionsTest-2008934241 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:13:31.959047 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-83c3bab9-55ff-46da-888b-dd56768af4ef tempest-VolumesActionsTest-2008934241 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129952) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 22 21:13:31.959640 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-83c3bab9-55ff-46da-888b-dd56768af4ef tempest-VolumesActionsTest-2008934241 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129952) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 22 21:13:31.968059 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-83c3bab9-55ff-46da-888b-dd56768af4ef tempest-VolumesActionsTest-2008934241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f0a62f0-55c0-4002-8808-c31c3a6df4cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c04adb60-17ae-4c8d-ad78-41acc8544db4', 'volume_size': 1}' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:13:31.979271 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-83c3bab9-55ff-46da-888b-dd56768af4ef tempest-VolumesActionsTest-2008934241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04271298-bb4d-40f3-8371-70daf0d1da31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:13:32.080910 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.flows.manager.create_volume [None req-83c3bab9-55ff-46da-888b-dd56768af4ef tempest-VolumesActionsTest-2008934241 None] Volume volume-c04adb60-17ae-4c8d-ad78-41acc8544db4 (c04adb60-17ae-4c8d-ad78-41acc8544db4): created successfully Jan 22 21:13:32.086610 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-83c3bab9-55ff-46da-888b-dd56768af4ef tempest-VolumesActionsTest-2008934241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04271298-bb4d-40f3-8371-70daf0d1da31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:13:32.093074 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-83c3bab9-55ff-46da-888b-dd56768af4ef tempest-VolumesActionsTest-2008934241 None] Flow 'volume_create_manager' (e48ca538-753d-49a4-8671-943195739f64) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129952) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 22 21:13:32.179781 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-83c3bab9-55ff-46da-888b-dd56768af4ef tempest-VolumesActionsTest-2008934241 None] Created volume successfully. Jan 22 21:13:32.852425 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.coordination [None req-b4a8b314-c72a-4361-937f-378ea310c394 tempest-VolumesActionsTest-821574394 None] Lock "b'cinder-c04adb60-17ae-4c8d-ad78-41acc8544db4-delete_volume'" acquired by "delete_volume" :: waited 0.021s {{(pid=129952) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 22 21:13:32.941980 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-b4a8b314-c72a-4361-937f-378ea310c394 tempest-VolumesActionsTest-821574394 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:13:33.191014 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-b4a8b314-c72a-4361-937f-378ea310c394 tempest-VolumesActionsTest-821574394 None] volume has no backup snaps {{(pid=129952) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Jan 22 21:13:33.191595 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-b4a8b314-c72a-4361-937f-378ea310c394 tempest-VolumesActionsTest-821574394 None] Volume volume-c04adb60-17ae-4c8d-ad78-41acc8544db4 is not a clone. {{(pid=129952) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Jan 22 21:13:33.546255 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-b4a8b314-c72a-4361-937f-378ea310c394 tempest-VolumesActionsTest-821574394 None] deleting rbd volume volume-c04adb60-17ae-4c8d-ad78-41acc8544db4 {{(pid=129952) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Jan 22 21:13:42.206321 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.quota [None req-b4a8b314-c72a-4361-937f-378ea310c394 tempest-VolumesActionsTest-821574394 None] Created reservations ['e716e626-d084-4fcc-bf09-5009a3313096', '22897abe-d38c-4036-981c-69fc800ddccd', '4c20a2d7-b3bd-436e-8a72-9fdfe1d847c8', '6ded5e5e-efa7-4ee5-aae4-4d108c37be4a'] {{(pid=129952) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 22 21:13:42.481171 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-b4a8b314-c72a-4361-937f-378ea310c394 tempest-VolumesActionsTest-821574394 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:13:42.525767 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-b4a8b314-c72a-4361-937f-378ea310c394 tempest-VolumesActionsTest-821574394 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:13:42.562777 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.manager [None req-b4a8b314-c72a-4361-937f-378ea310c394 tempest-VolumesActionsTest-821574394 None] Notifying Schedulers of capabilities ... {{(pid=129952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 22 21:13:42.567283 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-b4a8b314-c72a-4361-937f-378ea310c394 tempest-VolumesActionsTest-821574394 None] Deleted volume successfully. Jan 22 21:13:42.675014 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.coordination [None req-b4a8b314-c72a-4361-937f-378ea310c394 tempest-VolumesActionsTest-821574394 None] Lock "b'cinder-c04adb60-17ae-4c8d-ad78-41acc8544db4-delete_volume'" released by "delete_volume" :: held 9.825s {{(pid=129952) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 22 21:13:43.392472 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.flows.manager.create_volume [None req-8315b79f-a2e4-42eb-a87c-f99e8c322872 tempest-VolumesActionsTest-2008934241 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129952) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Jan 22 21:13:43.398218 ncdv-master-1 cinder-volume[129952]: WARNING stevedore.named [None req-8315b79f-a2e4-42eb-a87c-f99e8c322872 tempest-VolumesActionsTest-2008934241 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jan 22 21:13:43.404989 ncdv-master-1 cinder-volume[129952]: WARNING castellan.key_manager [None req-8315b79f-a2e4-42eb-a87c-f99e8c322872 tempest-VolumesActionsTest-2008934241 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 22 21:13:43.424912 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-8315b79f-a2e4-42eb-a87c-f99e8c322872 tempest-VolumesActionsTest-2008934241 None] Flow 'volume_create_manager' (ea7eb2f5-9d95-4a96-b703-af493bd71446) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 22 21:13:43.432864 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-8315b79f-a2e4-42eb-a87c-f99e8c322872 tempest-VolumesActionsTest-2008934241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa935399-2306-413b-92a4-fcfd5f88983f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:13:43.448547 ncdv-master-1 cinder-volume[129952]: DEBUG oslo_db.sqlalchemy.engines [None req-8315b79f-a2e4-42eb-a87c-f99e8c322872 tempest-VolumesActionsTest-2008934241 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129952) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 22 21:13:43.454182 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-8315b79f-a2e4-42eb-a87c-f99e8c322872 tempest-VolumesActionsTest-2008934241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa935399-2306-413b-92a4-fcfd5f88983f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-01-22T21:13:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2033127254',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=33b5eb6b-0b0e-4ef2-a1d8-2def94798015,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cda1afcb57254df4b0dc8a26bd9d297c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-01-22T21:13:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-01-22T21:13:43Z,use_quota=True,user_id='08db8a972cc0443282eabcc89f0033d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6dacb05b-a7ea-4056-85ff-98f0ea5c54eb),volume_type_id=6dacb05b-a7ea-4056-85ff-98f0ea5c54eb)' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:13:43.460573 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-8315b79f-a2e4-42eb-a87c-f99e8c322872 tempest-VolumesActionsTest-2008934241 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a46db2f2-9118-4711-bd55-898013cbd4c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:13:43.464877 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-8315b79f-a2e4-42eb-a87c-f99e8c322872 tempest-VolumesActionsTest-2008934241 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a46db2f2-9118-4711-bd55-898013cbd4c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:13:43.470173 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-8315b79f-a2e4-42eb-a87c-f99e8c322872 tempest-VolumesActionsTest-2008934241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c500b5d3-df37-4573-a360-907c28a5329b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:13:43.474569 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-8315b79f-a2e4-42eb-a87c-f99e8c322872 tempest-VolumesActionsTest-2008934241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c500b5d3-df37-4573-a360-907c28a5329b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '33b5eb6b-0b0e-4ef2-a1d8-2def94798015', 'volume_name': 'volume-33b5eb6b-0b0e-4ef2-a1d8-2def94798015', 'volume_size': 1}' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:13:43.480241 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-8315b79f-a2e4-42eb-a87c-f99e8c322872 tempest-VolumesActionsTest-2008934241 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f4349cd-c29a-4c4a-aff0-39f7c151fa55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:13:43.484461 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-8315b79f-a2e4-42eb-a87c-f99e8c322872 tempest-VolumesActionsTest-2008934241 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f4349cd-c29a-4c4a-aff0-39f7c151fa55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:13:43.489321 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-8315b79f-a2e4-42eb-a87c-f99e8c322872 tempest-VolumesActionsTest-2008934241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (630ca859-3f19-4665-9717-aa05ab235077) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:13:43.490465 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.flows.manager.create_volume [None req-8315b79f-a2e4-42eb-a87c-f99e8c322872 tempest-VolumesActionsTest-2008934241 None] Volume 33b5eb6b-0b0e-4ef2-a1d8-2def94798015: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-33b5eb6b-0b0e-4ef2-a1d8-2def94798015', 'volume_size': 1} Jan 22 21:13:43.490871 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-8315b79f-a2e4-42eb-a87c-f99e8c322872 tempest-VolumesActionsTest-2008934241 None] creating volume 'volume-33b5eb6b-0b0e-4ef2-a1d8-2def94798015' {{(pid=129952) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Jan 22 21:13:43.492084 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-8315b79f-a2e4-42eb-a87c-f99e8c322872 tempest-VolumesActionsTest-2008934241 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:13:44.548048 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-8315b79f-a2e4-42eb-a87c-f99e8c322872 tempest-VolumesActionsTest-2008934241 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129952) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 22 21:13:44.548705 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-8315b79f-a2e4-42eb-a87c-f99e8c322872 tempest-VolumesActionsTest-2008934241 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129952) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 22 21:13:44.554497 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-8315b79f-a2e4-42eb-a87c-f99e8c322872 tempest-VolumesActionsTest-2008934241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (630ca859-3f19-4665-9717-aa05ab235077) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-33b5eb6b-0b0e-4ef2-a1d8-2def94798015', 'volume_size': 1}' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:13:44.559841 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-8315b79f-a2e4-42eb-a87c-f99e8c322872 tempest-VolumesActionsTest-2008934241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (307aee79-7572-40d5-a853-d35040c75231) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:13:44.640812 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.flows.manager.create_volume [None req-8315b79f-a2e4-42eb-a87c-f99e8c322872 tempest-VolumesActionsTest-2008934241 None] Volume volume-33b5eb6b-0b0e-4ef2-a1d8-2def94798015 (33b5eb6b-0b0e-4ef2-a1d8-2def94798015): created successfully Jan 22 21:13:44.644499 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-8315b79f-a2e4-42eb-a87c-f99e8c322872 tempest-VolumesActionsTest-2008934241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (307aee79-7572-40d5-a853-d35040c75231) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:13:44.653278 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-8315b79f-a2e4-42eb-a87c-f99e8c322872 tempest-VolumesActionsTest-2008934241 None] Flow 'volume_create_manager' (ea7eb2f5-9d95-4a96-b703-af493bd71446) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129952) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 22 21:13:44.750879 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-8315b79f-a2e4-42eb-a87c-f99e8c322872 tempest-VolumesActionsTest-2008934241 None] Created volume successfully. Jan 22 21:13:45.821366 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.coordination [None req-ac3f5f5a-a899-453f-8af7-67f26de17ffb tempest-VolumesActionsTest-821574394 None] Lock "b'cinder-33b5eb6b-0b0e-4ef2-a1d8-2def94798015-delete_volume'" acquired by "delete_volume" :: waited 0.013s {{(pid=129952) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 22 21:13:45.916043 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-ac3f5f5a-a899-453f-8af7-67f26de17ffb tempest-VolumesActionsTest-821574394 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:13:46.276822 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-ac3f5f5a-a899-453f-8af7-67f26de17ffb tempest-VolumesActionsTest-821574394 None] volume has no backup snaps {{(pid=129952) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Jan 22 21:13:46.279752 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-ac3f5f5a-a899-453f-8af7-67f26de17ffb tempest-VolumesActionsTest-821574394 None] Volume volume-33b5eb6b-0b0e-4ef2-a1d8-2def94798015 is not a clone. {{(pid=129952) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Jan 22 21:13:46.634587 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-ac3f5f5a-a899-453f-8af7-67f26de17ffb tempest-VolumesActionsTest-821574394 None] deleting rbd volume volume-33b5eb6b-0b0e-4ef2-a1d8-2def94798015 {{(pid=129952) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Jan 22 21:13:55.585829 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.quota [None req-ac3f5f5a-a899-453f-8af7-67f26de17ffb tempest-VolumesActionsTest-821574394 None] Created reservations ['6db659d5-fe0f-495a-bc7d-c4ca7b7d336f', '2df425a6-c633-4185-ae11-39b03adec10d', '9e96f38b-f3a3-4bc4-a476-a7992b61b2bb', '7f99d45b-a192-4c96-8c38-e62e111e0e12'] {{(pid=129952) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 22 21:13:55.762541 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-ac3f5f5a-a899-453f-8af7-67f26de17ffb tempest-VolumesActionsTest-821574394 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:13:55.786326 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-ac3f5f5a-a899-453f-8af7-67f26de17ffb tempest-VolumesActionsTest-821574394 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:13:55.812390 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.manager [None req-ac3f5f5a-a899-453f-8af7-67f26de17ffb tempest-VolumesActionsTest-821574394 None] Notifying Schedulers of capabilities ... {{(pid=129952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 22 21:13:55.817027 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-ac3f5f5a-a899-453f-8af7-67f26de17ffb tempest-VolumesActionsTest-821574394 None] Deleted volume successfully. Jan 22 21:13:55.922851 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.coordination [None req-ac3f5f5a-a899-453f-8af7-67f26de17ffb tempest-VolumesActionsTest-821574394 None] Lock "b'cinder-33b5eb6b-0b0e-4ef2-a1d8-2def94798015-delete_volume'" released by "delete_volume" :: held 10.093s {{(pid=129952) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 22 21:13:57.558056 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.flows.manager.create_volume [None req-ea60b93c-2ba5-43f0-b5bd-1252b352fc8d tempest-VolumesActionsTest-2008934241 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129952) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Jan 22 21:13:57.562233 ncdv-master-1 cinder-volume[129952]: WARNING stevedore.named [None req-ea60b93c-2ba5-43f0-b5bd-1252b352fc8d tempest-VolumesActionsTest-2008934241 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jan 22 21:13:57.562696 ncdv-master-1 cinder-volume[129952]: WARNING castellan.key_manager [None req-ea60b93c-2ba5-43f0-b5bd-1252b352fc8d tempest-VolumesActionsTest-2008934241 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 22 21:13:57.587257 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-ea60b93c-2ba5-43f0-b5bd-1252b352fc8d tempest-VolumesActionsTest-2008934241 None] Flow 'volume_create_manager' (504966ee-db6e-4fe5-91aa-12fb387eb1dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 22 21:13:57.598189 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-ea60b93c-2ba5-43f0-b5bd-1252b352fc8d tempest-VolumesActionsTest-2008934241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (695b334a-afce-464e-976c-d5db0aa051a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:13:57.608759 ncdv-master-1 cinder-volume[129952]: DEBUG oslo_db.sqlalchemy.engines [None req-ea60b93c-2ba5-43f0-b5bd-1252b352fc8d tempest-VolumesActionsTest-2008934241 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129952) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 22 21:13:57.628571 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-ea60b93c-2ba5-43f0-b5bd-1252b352fc8d tempest-VolumesActionsTest-2008934241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (695b334a-afce-464e-976c-d5db0aa051a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-01-22T21:13:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-543476974',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=5608c2b7-6e33-48bf-892f-597e4d6c66a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cda1afcb57254df4b0dc8a26bd9d297c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-01-22T21:13:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-01-22T21:13:57Z,use_quota=True,user_id='08db8a972cc0443282eabcc89f0033d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6dacb05b-a7ea-4056-85ff-98f0ea5c54eb),volume_type_id=6dacb05b-a7ea-4056-85ff-98f0ea5c54eb)' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:13:57.634965 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-ea60b93c-2ba5-43f0-b5bd-1252b352fc8d tempest-VolumesActionsTest-2008934241 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35663875-ea4f-4af4-b30b-3b2529475a75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:13:57.639496 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-ea60b93c-2ba5-43f0-b5bd-1252b352fc8d tempest-VolumesActionsTest-2008934241 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35663875-ea4f-4af4-b30b-3b2529475a75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:13:57.645112 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-ea60b93c-2ba5-43f0-b5bd-1252b352fc8d tempest-VolumesActionsTest-2008934241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6a2daeb-d2a4-4eca-ac0e-d4ff5e11ed51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:13:57.650498 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-ea60b93c-2ba5-43f0-b5bd-1252b352fc8d tempest-VolumesActionsTest-2008934241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6a2daeb-d2a4-4eca-ac0e-d4ff5e11ed51) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5608c2b7-6e33-48bf-892f-597e4d6c66a6', 'volume_name': 'volume-5608c2b7-6e33-48bf-892f-597e4d6c66a6', 'volume_size': 1}' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:13:57.655952 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-ea60b93c-2ba5-43f0-b5bd-1252b352fc8d tempest-VolumesActionsTest-2008934241 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b1d5351-1098-4170-ab6f-f5a90c8f0563) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:13:57.660319 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-ea60b93c-2ba5-43f0-b5bd-1252b352fc8d tempest-VolumesActionsTest-2008934241 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b1d5351-1098-4170-ab6f-f5a90c8f0563) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:13:57.666107 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-ea60b93c-2ba5-43f0-b5bd-1252b352fc8d tempest-VolumesActionsTest-2008934241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c9c6ef0-3eb5-48b6-8e8a-c37ad652cacb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:13:57.667467 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.flows.manager.create_volume [None req-ea60b93c-2ba5-43f0-b5bd-1252b352fc8d tempest-VolumesActionsTest-2008934241 None] Volume 5608c2b7-6e33-48bf-892f-597e4d6c66a6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5608c2b7-6e33-48bf-892f-597e4d6c66a6', 'volume_size': 1} Jan 22 21:13:57.667871 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-ea60b93c-2ba5-43f0-b5bd-1252b352fc8d tempest-VolumesActionsTest-2008934241 None] creating volume 'volume-5608c2b7-6e33-48bf-892f-597e4d6c66a6' {{(pid=129952) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Jan 22 21:13:57.668889 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-ea60b93c-2ba5-43f0-b5bd-1252b352fc8d tempest-VolumesActionsTest-2008934241 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:13:58.679241 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-ea60b93c-2ba5-43f0-b5bd-1252b352fc8d tempest-VolumesActionsTest-2008934241 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129952) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 22 21:13:58.685191 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-ea60b93c-2ba5-43f0-b5bd-1252b352fc8d tempest-VolumesActionsTest-2008934241 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129952) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 22 21:13:58.685191 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-ea60b93c-2ba5-43f0-b5bd-1252b352fc8d tempest-VolumesActionsTest-2008934241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c9c6ef0-3eb5-48b6-8e8a-c37ad652cacb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5608c2b7-6e33-48bf-892f-597e4d6c66a6', 'volume_size': 1}' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:13:58.689600 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-ea60b93c-2ba5-43f0-b5bd-1252b352fc8d tempest-VolumesActionsTest-2008934241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29839113-d054-4ed7-a936-37dbae088d06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:13:58.761665 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.flows.manager.create_volume [None req-ea60b93c-2ba5-43f0-b5bd-1252b352fc8d tempest-VolumesActionsTest-2008934241 None] Volume volume-5608c2b7-6e33-48bf-892f-597e4d6c66a6 (5608c2b7-6e33-48bf-892f-597e4d6c66a6): created successfully Jan 22 21:13:58.767095 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-ea60b93c-2ba5-43f0-b5bd-1252b352fc8d tempest-VolumesActionsTest-2008934241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29839113-d054-4ed7-a936-37dbae088d06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:13:58.773715 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-ea60b93c-2ba5-43f0-b5bd-1252b352fc8d tempest-VolumesActionsTest-2008934241 None] Flow 'volume_create_manager' (504966ee-db6e-4fe5-91aa-12fb387eb1dd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129952) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 22 21:13:58.870127 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-ea60b93c-2ba5-43f0-b5bd-1252b352fc8d tempest-VolumesActionsTest-2008934241 None] Created volume successfully. Jan 22 21:13:59.806699 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.coordination [None req-3537e302-f212-4911-8e3f-f00badb78006 tempest-VolumesActionsTest-821574394 None] Lock "b'cinder-5608c2b7-6e33-48bf-892f-597e4d6c66a6-delete_volume'" acquired by "delete_volume" :: waited 0.010s {{(pid=129952) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 22 21:13:59.911106 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-3537e302-f212-4911-8e3f-f00badb78006 tempest-VolumesActionsTest-821574394 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:14:00.073610 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-3537e302-f212-4911-8e3f-f00badb78006 tempest-VolumesActionsTest-821574394 None] volume has no backup snaps {{(pid=129952) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Jan 22 21:14:00.074123 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-3537e302-f212-4911-8e3f-f00badb78006 tempest-VolumesActionsTest-821574394 None] Volume volume-5608c2b7-6e33-48bf-892f-597e4d6c66a6 is not a clone. {{(pid=129952) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Jan 22 21:14:00.360251 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-3537e302-f212-4911-8e3f-f00badb78006 tempest-VolumesActionsTest-821574394 None] deleting rbd volume volume-5608c2b7-6e33-48bf-892f-597e4d6c66a6 {{(pid=129952) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Jan 22 21:14:08.721250 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.quota [None req-3537e302-f212-4911-8e3f-f00badb78006 tempest-VolumesActionsTest-821574394 None] Created reservations ['f8fec8d6-7069-4754-933f-2bdb5141644b', 'b8902a10-03a5-4eaa-9430-67d258c597e8', 'efea6c4b-4d8b-4b00-8e1a-733d3b5634d3', '4874b33d-7426-4d06-b5a8-70eb3f237ae9'] {{(pid=129952) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 22 21:14:08.933137 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-3537e302-f212-4911-8e3f-f00badb78006 tempest-VolumesActionsTest-821574394 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:14:08.956027 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-3537e302-f212-4911-8e3f-f00badb78006 tempest-VolumesActionsTest-821574394 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:14:08.986067 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.manager [None req-3537e302-f212-4911-8e3f-f00badb78006 tempest-VolumesActionsTest-821574394 None] Notifying Schedulers of capabilities ... {{(pid=129952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 22 21:14:08.990339 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-3537e302-f212-4911-8e3f-f00badb78006 tempest-VolumesActionsTest-821574394 None] Deleted volume successfully. Jan 22 21:14:09.088398 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.coordination [None req-3537e302-f212-4911-8e3f-f00badb78006 tempest-VolumesActionsTest-821574394 None] Lock "b'cinder-5608c2b7-6e33-48bf-892f-597e4d6c66a6-delete_volume'" released by "delete_volume" :: held 9.282s {{(pid=129952) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 22 21:14:09.698044 ncdv-master-1 cinder-volume[129952]: DEBUG oslo_service.periodic_task [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129952) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jan 22 21:14:09.698707 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:14:09.826444 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:14:09.887966 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.manager [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] Notifying Schedulers of capabilities ... {{(pid=129952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 22 21:14:10.269200 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.flows.manager.create_volume [None req-ae5b486c-fc34-4424-bfa1-420ad22f6611 tempest-VolumesActionsTest-2008934241 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129952) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Jan 22 21:14:10.272610 ncdv-master-1 cinder-volume[129952]: WARNING stevedore.named [None req-ae5b486c-fc34-4424-bfa1-420ad22f6611 tempest-VolumesActionsTest-2008934241 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jan 22 21:14:10.273440 ncdv-master-1 cinder-volume[129952]: WARNING castellan.key_manager [None req-ae5b486c-fc34-4424-bfa1-420ad22f6611 tempest-VolumesActionsTest-2008934241 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 22 21:14:10.294485 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-ae5b486c-fc34-4424-bfa1-420ad22f6611 tempest-VolumesActionsTest-2008934241 None] Flow 'volume_create_manager' (45fdf7ec-4e73-429c-ab3f-679bc8c0ee00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 22 21:14:10.301675 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-ae5b486c-fc34-4424-bfa1-420ad22f6611 tempest-VolumesActionsTest-2008934241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10945608-d2a5-40bb-8518-7aac43d93530) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:14:10.309916 ncdv-master-1 cinder-volume[129952]: DEBUG oslo_db.sqlalchemy.engines [None req-ae5b486c-fc34-4424-bfa1-420ad22f6611 tempest-VolumesActionsTest-2008934241 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129952) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 22 21:14:10.326434 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-ae5b486c-fc34-4424-bfa1-420ad22f6611 tempest-VolumesActionsTest-2008934241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10945608-d2a5-40bb-8518-7aac43d93530) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-01-22T21:14:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1087013848',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=e0536b33-7d64-48f9-aa5e-99773bd28bd3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cda1afcb57254df4b0dc8a26bd9d297c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-01-22T21:14:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-01-22T21:14:10Z,use_quota=True,user_id='08db8a972cc0443282eabcc89f0033d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6dacb05b-a7ea-4056-85ff-98f0ea5c54eb),volume_type_id=6dacb05b-a7ea-4056-85ff-98f0ea5c54eb)' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:14:10.333117 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-ae5b486c-fc34-4424-bfa1-420ad22f6611 tempest-VolumesActionsTest-2008934241 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69f9fcbb-7f89-495b-ba25-9286d3b311ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:14:10.337738 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-ae5b486c-fc34-4424-bfa1-420ad22f6611 tempest-VolumesActionsTest-2008934241 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69f9fcbb-7f89-495b-ba25-9286d3b311ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:14:10.343326 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-ae5b486c-fc34-4424-bfa1-420ad22f6611 tempest-VolumesActionsTest-2008934241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2f89632-0236-4c86-b56b-1dce126058e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:14:10.348224 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-ae5b486c-fc34-4424-bfa1-420ad22f6611 tempest-VolumesActionsTest-2008934241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2f89632-0236-4c86-b56b-1dce126058e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e0536b33-7d64-48f9-aa5e-99773bd28bd3', 'volume_name': 'volume-e0536b33-7d64-48f9-aa5e-99773bd28bd3', 'volume_size': 1}' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:14:10.353698 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-ae5b486c-fc34-4424-bfa1-420ad22f6611 tempest-VolumesActionsTest-2008934241 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e4aa51c-2b02-4e58-8a5b-ebbfa50d98b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:14:10.357856 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-ae5b486c-fc34-4424-bfa1-420ad22f6611 tempest-VolumesActionsTest-2008934241 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e4aa51c-2b02-4e58-8a5b-ebbfa50d98b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:14:10.363230 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-ae5b486c-fc34-4424-bfa1-420ad22f6611 tempest-VolumesActionsTest-2008934241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59a67fc0-bb73-437c-8e6a-39b01dd80967) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:14:10.364361 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.flows.manager.create_volume [None req-ae5b486c-fc34-4424-bfa1-420ad22f6611 tempest-VolumesActionsTest-2008934241 None] Volume e0536b33-7d64-48f9-aa5e-99773bd28bd3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e0536b33-7d64-48f9-aa5e-99773bd28bd3', 'volume_size': 1} Jan 22 21:14:10.364757 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-ae5b486c-fc34-4424-bfa1-420ad22f6611 tempest-VolumesActionsTest-2008934241 None] creating volume 'volume-e0536b33-7d64-48f9-aa5e-99773bd28bd3' {{(pid=129952) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Jan 22 21:14:10.366405 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-ae5b486c-fc34-4424-bfa1-420ad22f6611 tempest-VolumesActionsTest-2008934241 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:14:11.579707 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-ae5b486c-fc34-4424-bfa1-420ad22f6611 tempest-VolumesActionsTest-2008934241 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129952) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 22 21:14:11.580879 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-ae5b486c-fc34-4424-bfa1-420ad22f6611 tempest-VolumesActionsTest-2008934241 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129952) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 22 21:14:11.590151 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-ae5b486c-fc34-4424-bfa1-420ad22f6611 tempest-VolumesActionsTest-2008934241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59a67fc0-bb73-437c-8e6a-39b01dd80967) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e0536b33-7d64-48f9-aa5e-99773bd28bd3', 'volume_size': 1}' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:14:11.590602 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-ae5b486c-fc34-4424-bfa1-420ad22f6611 tempest-VolumesActionsTest-2008934241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c2f9acc-fd0a-436a-9497-86f76389e1f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:14:11.733887 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.flows.manager.create_volume [None req-ae5b486c-fc34-4424-bfa1-420ad22f6611 tempest-VolumesActionsTest-2008934241 None] Volume volume-e0536b33-7d64-48f9-aa5e-99773bd28bd3 (e0536b33-7d64-48f9-aa5e-99773bd28bd3): created successfully Jan 22 21:14:11.746136 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-ae5b486c-fc34-4424-bfa1-420ad22f6611 tempest-VolumesActionsTest-2008934241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c2f9acc-fd0a-436a-9497-86f76389e1f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:14:11.754322 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-ae5b486c-fc34-4424-bfa1-420ad22f6611 tempest-VolumesActionsTest-2008934241 None] Flow 'volume_create_manager' (45fdf7ec-4e73-429c-ab3f-679bc8c0ee00) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129952) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 22 21:14:11.853079 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-ae5b486c-fc34-4424-bfa1-420ad22f6611 tempest-VolumesActionsTest-2008934241 None] Created volume successfully. Jan 22 21:14:12.561405 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.coordination [None req-5b237e67-eb58-4d0f-a47a-53718ed4c0b5 tempest-VolumesActionsTest-821574394 None] Lock "b'cinder-e0536b33-7d64-48f9-aa5e-99773bd28bd3-delete_volume'" acquired by "delete_volume" :: waited 0.023s {{(pid=129952) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 22 21:14:12.736843 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-5b237e67-eb58-4d0f-a47a-53718ed4c0b5 tempest-VolumesActionsTest-821574394 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:14:13.008166 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-5b237e67-eb58-4d0f-a47a-53718ed4c0b5 tempest-VolumesActionsTest-821574394 None] volume has no backup snaps {{(pid=129952) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Jan 22 21:14:13.010442 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-5b237e67-eb58-4d0f-a47a-53718ed4c0b5 tempest-VolumesActionsTest-821574394 None] Volume volume-e0536b33-7d64-48f9-aa5e-99773bd28bd3 is not a clone. {{(pid=129952) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Jan 22 21:14:13.265327 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-5b237e67-eb58-4d0f-a47a-53718ed4c0b5 tempest-VolumesActionsTest-821574394 None] deleting rbd volume volume-e0536b33-7d64-48f9-aa5e-99773bd28bd3 {{(pid=129952) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Jan 22 21:14:22.988239 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.quota [None req-5b237e67-eb58-4d0f-a47a-53718ed4c0b5 tempest-VolumesActionsTest-821574394 None] Created reservations ['72a11cbb-a345-454d-a28b-5fa3cb1a71bb', '005a5fa3-4639-4f8c-878f-6d6e5d009286', 'b9509208-f6d3-4c12-b37a-5caa09753aec', 'a4182ebf-a671-4c53-adf3-c08833b38707'] {{(pid=129952) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 22 21:14:23.216132 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-5b237e67-eb58-4d0f-a47a-53718ed4c0b5 tempest-VolumesActionsTest-821574394 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:14:23.265980 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-5b237e67-eb58-4d0f-a47a-53718ed4c0b5 tempest-VolumesActionsTest-821574394 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:14:23.296744 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.manager [None req-5b237e67-eb58-4d0f-a47a-53718ed4c0b5 tempest-VolumesActionsTest-821574394 None] Notifying Schedulers of capabilities ... {{(pid=129952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 22 21:14:23.302183 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-5b237e67-eb58-4d0f-a47a-53718ed4c0b5 tempest-VolumesActionsTest-821574394 None] Deleted volume successfully. Jan 22 21:14:23.377703 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.coordination [None req-5b237e67-eb58-4d0f-a47a-53718ed4c0b5 tempest-VolumesActionsTest-821574394 None] Lock "b'cinder-e0536b33-7d64-48f9-aa5e-99773bd28bd3-delete_volume'" released by "delete_volume" :: held 10.816s {{(pid=129952) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 22 21:14:24.673907 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.flows.manager.create_volume [None req-7655b405-f213-4f66-a34e-28e25cf8225d tempest-VolumesActionsTest-2008934241 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129952) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Jan 22 21:14:24.679141 ncdv-master-1 cinder-volume[129952]: WARNING stevedore.named [None req-7655b405-f213-4f66-a34e-28e25cf8225d tempest-VolumesActionsTest-2008934241 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jan 22 21:14:24.679799 ncdv-master-1 cinder-volume[129952]: WARNING castellan.key_manager [None req-7655b405-f213-4f66-a34e-28e25cf8225d tempest-VolumesActionsTest-2008934241 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 22 21:14:24.701402 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-7655b405-f213-4f66-a34e-28e25cf8225d tempest-VolumesActionsTest-2008934241 None] Flow 'volume_create_manager' (abed9ca3-7c2b-4c19-a2a8-7ed95cc54185) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 22 21:14:24.709180 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-7655b405-f213-4f66-a34e-28e25cf8225d tempest-VolumesActionsTest-2008934241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f57ddae4-e956-4fc4-ae22-60e34f7b44ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:14:24.716866 ncdv-master-1 cinder-volume[129952]: DEBUG oslo_db.sqlalchemy.engines [None req-7655b405-f213-4f66-a34e-28e25cf8225d tempest-VolumesActionsTest-2008934241 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129952) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 22 21:14:24.732318 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-7655b405-f213-4f66-a34e-28e25cf8225d tempest-VolumesActionsTest-2008934241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f57ddae4-e956-4fc4-ae22-60e34f7b44ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-01-22T21:14:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1570979696',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=db301ea6-7bc7-46b1-8647-1091b4c99ccd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cda1afcb57254df4b0dc8a26bd9d297c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-01-22T21:14:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-01-22T21:14:24Z,use_quota=True,user_id='08db8a972cc0443282eabcc89f0033d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6dacb05b-a7ea-4056-85ff-98f0ea5c54eb),volume_type_id=6dacb05b-a7ea-4056-85ff-98f0ea5c54eb)' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:14:24.738896 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-7655b405-f213-4f66-a34e-28e25cf8225d tempest-VolumesActionsTest-2008934241 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f999ae00-a12c-441a-a45c-f6d7df8d574e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:14:24.744490 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-7655b405-f213-4f66-a34e-28e25cf8225d tempest-VolumesActionsTest-2008934241 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f999ae00-a12c-441a-a45c-f6d7df8d574e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:14:24.750465 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-7655b405-f213-4f66-a34e-28e25cf8225d tempest-VolumesActionsTest-2008934241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a58022b-b0be-4f14-81f2-d4428d567f75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:14:24.755047 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-7655b405-f213-4f66-a34e-28e25cf8225d tempest-VolumesActionsTest-2008934241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a58022b-b0be-4f14-81f2-d4428d567f75) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'db301ea6-7bc7-46b1-8647-1091b4c99ccd', 'volume_name': 'volume-db301ea6-7bc7-46b1-8647-1091b4c99ccd', 'volume_size': 1}' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:14:24.761301 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-7655b405-f213-4f66-a34e-28e25cf8225d tempest-VolumesActionsTest-2008934241 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee6cdee0-78af-438b-8198-c43ffab60f9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:14:24.766971 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-7655b405-f213-4f66-a34e-28e25cf8225d tempest-VolumesActionsTest-2008934241 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee6cdee0-78af-438b-8198-c43ffab60f9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:14:24.779612 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-7655b405-f213-4f66-a34e-28e25cf8225d tempest-VolumesActionsTest-2008934241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ac88302-ba31-440f-8deb-8b2bd93c59bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:14:24.780898 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.flows.manager.create_volume [None req-7655b405-f213-4f66-a34e-28e25cf8225d tempest-VolumesActionsTest-2008934241 None] Volume db301ea6-7bc7-46b1-8647-1091b4c99ccd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-db301ea6-7bc7-46b1-8647-1091b4c99ccd', 'volume_size': 1} Jan 22 21:14:24.781479 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-7655b405-f213-4f66-a34e-28e25cf8225d tempest-VolumesActionsTest-2008934241 None] creating volume 'volume-db301ea6-7bc7-46b1-8647-1091b4c99ccd' {{(pid=129952) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Jan 22 21:14:24.782655 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-7655b405-f213-4f66-a34e-28e25cf8225d tempest-VolumesActionsTest-2008934241 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:14:26.021011 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-7655b405-f213-4f66-a34e-28e25cf8225d tempest-VolumesActionsTest-2008934241 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129952) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 22 21:14:26.025633 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-7655b405-f213-4f66-a34e-28e25cf8225d tempest-VolumesActionsTest-2008934241 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129952) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 22 21:14:26.026107 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-7655b405-f213-4f66-a34e-28e25cf8225d tempest-VolumesActionsTest-2008934241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ac88302-ba31-440f-8deb-8b2bd93c59bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-db301ea6-7bc7-46b1-8647-1091b4c99ccd', 'volume_size': 1}' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:14:26.030848 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-7655b405-f213-4f66-a34e-28e25cf8225d tempest-VolumesActionsTest-2008934241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16d863c0-82d7-4c67-b3af-e1a014be5550) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:14:26.092422 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.flows.manager.create_volume [None req-7655b405-f213-4f66-a34e-28e25cf8225d tempest-VolumesActionsTest-2008934241 None] Volume volume-db301ea6-7bc7-46b1-8647-1091b4c99ccd (db301ea6-7bc7-46b1-8647-1091b4c99ccd): created successfully Jan 22 21:14:26.096276 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-7655b405-f213-4f66-a34e-28e25cf8225d tempest-VolumesActionsTest-2008934241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16d863c0-82d7-4c67-b3af-e1a014be5550) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:14:26.101976 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-7655b405-f213-4f66-a34e-28e25cf8225d tempest-VolumesActionsTest-2008934241 None] Flow 'volume_create_manager' (abed9ca3-7c2b-4c19-a2a8-7ed95cc54185) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129952) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 22 21:14:26.244290 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-7655b405-f213-4f66-a34e-28e25cf8225d tempest-VolumesActionsTest-2008934241 None] Created volume successfully. Jan 22 21:14:27.497735 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.coordination [None req-66e3d00b-0792-4931-8a5c-d9adddf432b8 tempest-VolumesActionsTest-2008934241 None] Lock "b'cinder-db301ea6-7bc7-46b1-8647-1091b4c99ccd-delete_volume'" acquired by "delete_volume" :: waited 0.014s {{(pid=129952) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 22 21:14:27.637036 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-66e3d00b-0792-4931-8a5c-d9adddf432b8 tempest-VolumesActionsTest-2008934241 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:14:28.006564 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-66e3d00b-0792-4931-8a5c-d9adddf432b8 tempest-VolumesActionsTest-2008934241 None] volume has no backup snaps {{(pid=129952) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Jan 22 21:14:28.006990 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-66e3d00b-0792-4931-8a5c-d9adddf432b8 tempest-VolumesActionsTest-2008934241 None] Volume volume-db301ea6-7bc7-46b1-8647-1091b4c99ccd is not a clone. {{(pid=129952) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Jan 22 21:14:28.316298 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-66e3d00b-0792-4931-8a5c-d9adddf432b8 tempest-VolumesActionsTest-2008934241 None] deleting rbd volume volume-db301ea6-7bc7-46b1-8647-1091b4c99ccd {{(pid=129952) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Jan 22 21:14:29.517012 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.flows.manager.create_volume [None req-47fddd74-705a-46d1-9a4d-563f3a6f452d tempest-AttachVolumeTestJSON-815334161 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129952) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Jan 22 21:14:29.522054 ncdv-master-1 cinder-volume[129952]: WARNING stevedore.named [None req-47fddd74-705a-46d1-9a4d-563f3a6f452d tempest-AttachVolumeTestJSON-815334161 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jan 22 21:14:29.522669 ncdv-master-1 cinder-volume[129952]: WARNING castellan.key_manager [None req-47fddd74-705a-46d1-9a4d-563f3a6f452d tempest-AttachVolumeTestJSON-815334161 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 22 21:14:29.542946 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-47fddd74-705a-46d1-9a4d-563f3a6f452d tempest-AttachVolumeTestJSON-815334161 None] Flow 'volume_create_manager' (ba0a9d75-2e61-4258-8b73-41f8b694d47d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 22 21:14:29.550232 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-47fddd74-705a-46d1-9a4d-563f3a6f452d tempest-AttachVolumeTestJSON-815334161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90989a39-96d5-403c-b9af-086a1d4bc974) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:14:29.557214 ncdv-master-1 cinder-volume[129952]: DEBUG oslo_db.sqlalchemy.engines [None req-47fddd74-705a-46d1-9a4d-563f3a6f452d tempest-AttachVolumeTestJSON-815334161 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129952) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 22 21:14:29.573272 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-47fddd74-705a-46d1-9a4d-563f3a6f452d tempest-AttachVolumeTestJSON-815334161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90989a39-96d5-403c-b9af-086a1d4bc974) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-01-22T21:14:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-577849622',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=2b554aa9-05f4-43e4-9e7d-76a8b52309ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='25a102ec3753465793d2bd70ee845e09',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-01-22T21:14:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-01-22T21:14:29Z,use_quota=True,user_id='05463958163742cb8907fff532940f11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6dacb05b-a7ea-4056-85ff-98f0ea5c54eb),volume_type_id=6dacb05b-a7ea-4056-85ff-98f0ea5c54eb)' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:14:29.579871 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-47fddd74-705a-46d1-9a4d-563f3a6f452d tempest-AttachVolumeTestJSON-815334161 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52a09d31-21e9-49d9-9123-2bf594e99664) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:14:29.585191 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-47fddd74-705a-46d1-9a4d-563f3a6f452d tempest-AttachVolumeTestJSON-815334161 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52a09d31-21e9-49d9-9123-2bf594e99664) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:14:29.592873 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-47fddd74-705a-46d1-9a4d-563f3a6f452d tempest-AttachVolumeTestJSON-815334161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd22b043-31e9-40bc-8c2a-36867fe09573) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:14:29.597680 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-47fddd74-705a-46d1-9a4d-563f3a6f452d tempest-AttachVolumeTestJSON-815334161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd22b043-31e9-40bc-8c2a-36867fe09573) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2b554aa9-05f4-43e4-9e7d-76a8b52309ae', 'volume_name': 'volume-2b554aa9-05f4-43e4-9e7d-76a8b52309ae', 'volume_size': 1}' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:14:29.603408 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-47fddd74-705a-46d1-9a4d-563f3a6f452d tempest-AttachVolumeTestJSON-815334161 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a00d2c4-a29e-4f0a-ba51-36ab798ac8b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:14:29.607714 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-47fddd74-705a-46d1-9a4d-563f3a6f452d tempest-AttachVolumeTestJSON-815334161 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a00d2c4-a29e-4f0a-ba51-36ab798ac8b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:14:29.612612 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-47fddd74-705a-46d1-9a4d-563f3a6f452d tempest-AttachVolumeTestJSON-815334161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dcef3ec9-25e7-414c-92a8-fb1cafe9f15c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:14:29.614490 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.flows.manager.create_volume [None req-47fddd74-705a-46d1-9a4d-563f3a6f452d tempest-AttachVolumeTestJSON-815334161 None] Volume 2b554aa9-05f4-43e4-9e7d-76a8b52309ae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2b554aa9-05f4-43e4-9e7d-76a8b52309ae', 'volume_size': 1} Jan 22 21:14:29.615630 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-47fddd74-705a-46d1-9a4d-563f3a6f452d tempest-AttachVolumeTestJSON-815334161 None] creating volume 'volume-2b554aa9-05f4-43e4-9e7d-76a8b52309ae' {{(pid=129952) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Jan 22 21:14:29.617901 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-47fddd74-705a-46d1-9a4d-563f3a6f452d tempest-AttachVolumeTestJSON-815334161 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:14:30.798790 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-47fddd74-705a-46d1-9a4d-563f3a6f452d tempest-AttachVolumeTestJSON-815334161 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129952) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 22 21:14:30.799929 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-47fddd74-705a-46d1-9a4d-563f3a6f452d tempest-AttachVolumeTestJSON-815334161 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129952) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 22 21:14:30.806096 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-47fddd74-705a-46d1-9a4d-563f3a6f452d tempest-AttachVolumeTestJSON-815334161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dcef3ec9-25e7-414c-92a8-fb1cafe9f15c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2b554aa9-05f4-43e4-9e7d-76a8b52309ae', 'volume_size': 1}' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:14:30.814030 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-47fddd74-705a-46d1-9a4d-563f3a6f452d tempest-AttachVolumeTestJSON-815334161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18d65240-0452-4e5a-bf8d-a08acff3af11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:14:30.884177 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.flows.manager.create_volume [None req-47fddd74-705a-46d1-9a4d-563f3a6f452d tempest-AttachVolumeTestJSON-815334161 None] Volume volume-2b554aa9-05f4-43e4-9e7d-76a8b52309ae (2b554aa9-05f4-43e4-9e7d-76a8b52309ae): created successfully Jan 22 21:14:30.887975 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-47fddd74-705a-46d1-9a4d-563f3a6f452d tempest-AttachVolumeTestJSON-815334161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18d65240-0452-4e5a-bf8d-a08acff3af11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:14:30.893814 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-47fddd74-705a-46d1-9a4d-563f3a6f452d tempest-AttachVolumeTestJSON-815334161 None] Flow 'volume_create_manager' (ba0a9d75-2e61-4258-8b73-41f8b694d47d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129952) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 22 21:14:30.986651 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-47fddd74-705a-46d1-9a4d-563f3a6f452d tempest-AttachVolumeTestJSON-815334161 None] Created volume successfully. Jan 22 21:14:32.556259 ncdv-master-1 cinder-volume[129952]: DEBUG oslo_concurrency.processutils [req-2036b40d-b69e-4a63-8c07-faa1eb6eac5e req-405b7d4f-66cd-4b0e-bc8d-6bac420dfbf5 tempest-AttachVolumeTestJSON-815334161 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129952) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jan 22 21:14:33.266091 ncdv-master-1 cinder-volume[129952]: DEBUG oslo_concurrency.processutils [req-2036b40d-b69e-4a63-8c07-faa1eb6eac5e req-405b7d4f-66cd-4b0e-bc8d-6bac420dfbf5 tempest-AttachVolumeTestJSON-815334161 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.710s {{(pid=129952) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jan 22 21:14:33.267133 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [req-2036b40d-b69e-4a63-8c07-faa1eb6eac5e req-405b7d4f-66cd-4b0e-bc8d-6bac420dfbf5 tempest-AttachVolumeTestJSON-815334161 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-2b554aa9-05f4-43e4-9e7d-76a8b52309ae', 'hosts': ['10.222.0.100'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'c7ee930a-3b87-450e-91f6-d4eef70cb484', 'volume_id': '2b554aa9-05f4-43e4-9e7d-76a8b52309ae', 'discard': True}} {{(pid=129952) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Jan 22 21:14:33.404900 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [req-2036b40d-b69e-4a63-8c07-faa1eb6eac5e req-405b7d4f-66cd-4b0e-bc8d-6bac420dfbf5 tempest-AttachVolumeTestJSON-815334161 None] Connection info returned from driver {'name': 'volumes/volume-2b554aa9-05f4-43e4-9e7d-76a8b52309ae', 'hosts': ['10.222.0.100'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '2b554aa9-05f4-43e4-9e7d-76a8b52309ae', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'fca2fe29-0e7e-4255-a13a-9b3bf8c1b4db'} {{(pid=129952) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4811}} Jan 22 21:14:33.528735 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [req-2036b40d-b69e-4a63-8c07-faa1eb6eac5e req-405b7d4f-66cd-4b0e-bc8d-6bac420dfbf5 tempest-AttachVolumeTestJSON-815334161 None] attachment_update completed successfully. Jan 22 21:14:36.966678 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.quota [None req-66e3d00b-0792-4931-8a5c-d9adddf432b8 tempest-VolumesActionsTest-2008934241 None] Created reservations ['5c98072c-b4ff-452b-a0eb-f922e8dcbeb8', 'f780d1e0-bf00-4740-a8ef-9f3fd080a52f', '52982ce4-dd8f-47b3-875b-8b8cfe23f0b4', 'c638432d-d389-4160-91d2-939d25d0d99b'] {{(pid=129952) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 22 21:14:37.213196 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-66e3d00b-0792-4931-8a5c-d9adddf432b8 tempest-VolumesActionsTest-2008934241 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:14:37.249562 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-66e3d00b-0792-4931-8a5c-d9adddf432b8 tempest-VolumesActionsTest-2008934241 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:14:37.275555 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.manager [None req-66e3d00b-0792-4931-8a5c-d9adddf432b8 tempest-VolumesActionsTest-2008934241 None] Notifying Schedulers of capabilities ... {{(pid=129952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 22 21:14:37.280427 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-66e3d00b-0792-4931-8a5c-d9adddf432b8 tempest-VolumesActionsTest-2008934241 None] Deleted volume successfully. Jan 22 21:14:37.374151 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.coordination [None req-66e3d00b-0792-4931-8a5c-d9adddf432b8 tempest-VolumesActionsTest-2008934241 None] Lock "b'cinder-db301ea6-7bc7-46b1-8647-1091b4c99ccd-delete_volume'" released by "delete_volume" :: held 9.876s {{(pid=129952) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 22 21:14:38.543488 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.coordination [None req-a29b7006-1c64-413c-a8a1-80cd45b9aa6d tempest-VolumesActionsTest-2008934241 None] Lock "b'cinder-a2fc33fd-3b45-47a4-bde6-feaab56ed4a8-delete_volume'" acquired by "delete_volume" :: waited 0.016s {{(pid=129952) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 22 21:14:38.686220 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-a29b7006-1c64-413c-a8a1-80cd45b9aa6d tempest-VolumesActionsTest-2008934241 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:14:39.029987 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-a29b7006-1c64-413c-a8a1-80cd45b9aa6d tempest-VolumesActionsTest-2008934241 None] volume has no backup snaps {{(pid=129952) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Jan 22 21:14:39.032534 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-a29b7006-1c64-413c-a8a1-80cd45b9aa6d tempest-VolumesActionsTest-2008934241 None] Volume volume-a2fc33fd-3b45-47a4-bde6-feaab56ed4a8 is not a clone. {{(pid=129952) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Jan 22 21:14:39.483916 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-a29b7006-1c64-413c-a8a1-80cd45b9aa6d tempest-VolumesActionsTest-2008934241 None] deleting rbd volume volume-a2fc33fd-3b45-47a4-bde6-feaab56ed4a8 {{(pid=129952) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Jan 22 21:14:47.914854 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.quota [None req-a29b7006-1c64-413c-a8a1-80cd45b9aa6d tempest-VolumesActionsTest-2008934241 None] Created reservations ['3341bb1b-7b90-48f1-bd2d-1c9d33bdc572', '46551d19-2cb3-4d0c-874b-3ef76bd90ff2', 'f0875912-ecaf-49d6-bbdc-e57a31690475', '6bee4f18-99e7-4065-9c44-c56c72960c65'] {{(pid=129952) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 22 21:14:48.147907 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-a29b7006-1c64-413c-a8a1-80cd45b9aa6d tempest-VolumesActionsTest-2008934241 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:14:48.196364 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-a29b7006-1c64-413c-a8a1-80cd45b9aa6d tempest-VolumesActionsTest-2008934241 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:14:48.267916 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.manager [None req-a29b7006-1c64-413c-a8a1-80cd45b9aa6d tempest-VolumesActionsTest-2008934241 None] Notifying Schedulers of capabilities ... {{(pid=129952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 22 21:14:48.271768 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-a29b7006-1c64-413c-a8a1-80cd45b9aa6d tempest-VolumesActionsTest-2008934241 None] Deleted volume successfully. Jan 22 21:14:48.433316 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.coordination [None req-a29b7006-1c64-413c-a8a1-80cd45b9aa6d tempest-VolumesActionsTest-2008934241 None] Lock "b'cinder-a2fc33fd-3b45-47a4-bde6-feaab56ed4a8-delete_volume'" released by "delete_volume" :: held 9.888s {{(pid=129952) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 22 21:14:58.603867 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.flows.manager.create_volume [None req-b37bfc29-b001-441f-8158-cc9e16ecdbc9 tempest-VolumesTransfersTest-370099354 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129952) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Jan 22 21:14:58.607620 ncdv-master-1 cinder-volume[129952]: WARNING stevedore.named [None req-b37bfc29-b001-441f-8158-cc9e16ecdbc9 tempest-VolumesTransfersTest-370099354 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jan 22 21:14:58.612308 ncdv-master-1 cinder-volume[129952]: WARNING castellan.key_manager [None req-b37bfc29-b001-441f-8158-cc9e16ecdbc9 tempest-VolumesTransfersTest-370099354 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 22 21:14:58.648319 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-b37bfc29-b001-441f-8158-cc9e16ecdbc9 tempest-VolumesTransfersTest-370099354 None] Flow 'volume_create_manager' (a78948f2-e82d-4eae-89dd-7503f0b53210) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 22 21:14:58.655188 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-b37bfc29-b001-441f-8158-cc9e16ecdbc9 tempest-VolumesTransfersTest-370099354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4530ffb-4aa0-4541-99c6-82022790b28d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:14:58.673117 ncdv-master-1 cinder-volume[129952]: DEBUG oslo_db.sqlalchemy.engines [None req-b37bfc29-b001-441f-8158-cc9e16ecdbc9 tempest-VolumesTransfersTest-370099354 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129952) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 22 21:14:58.696601 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-b37bfc29-b001-441f-8158-cc9e16ecdbc9 tempest-VolumesTransfersTest-370099354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4530ffb-4aa0-4541-99c6-82022790b28d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-01-22T21:14:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-2126818282',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=80961129-526f-4094-af87-60410f84a8c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e68ef5e1f49d40f58d9a83585d787ea5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-01-22T21:14:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-01-22T21:14:58Z,use_quota=True,user_id='f579ded754dd43ac81d8f558cd5b8faf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6dacb05b-a7ea-4056-85ff-98f0ea5c54eb),volume_type_id=6dacb05b-a7ea-4056-85ff-98f0ea5c54eb)' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:14:58.702539 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-b37bfc29-b001-441f-8158-cc9e16ecdbc9 tempest-VolumesTransfersTest-370099354 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1775a479-2e96-46de-b396-cd2c523da474) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:14:58.707725 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-b37bfc29-b001-441f-8158-cc9e16ecdbc9 tempest-VolumesTransfersTest-370099354 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1775a479-2e96-46de-b396-cd2c523da474) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:14:58.714489 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-b37bfc29-b001-441f-8158-cc9e16ecdbc9 tempest-VolumesTransfersTest-370099354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9fd9cfb-de57-45a8-97dc-ad759a20586d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:14:58.719463 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-b37bfc29-b001-441f-8158-cc9e16ecdbc9 tempest-VolumesTransfersTest-370099354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9fd9cfb-de57-45a8-97dc-ad759a20586d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '80961129-526f-4094-af87-60410f84a8c1', 'volume_name': 'volume-80961129-526f-4094-af87-60410f84a8c1', 'volume_size': 1}' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:14:58.726250 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-b37bfc29-b001-441f-8158-cc9e16ecdbc9 tempest-VolumesTransfersTest-370099354 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39a2c6df-21e9-48f4-a16a-2f8954258bee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:14:58.730895 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-b37bfc29-b001-441f-8158-cc9e16ecdbc9 tempest-VolumesTransfersTest-370099354 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39a2c6df-21e9-48f4-a16a-2f8954258bee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:14:58.736453 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-b37bfc29-b001-441f-8158-cc9e16ecdbc9 tempest-VolumesTransfersTest-370099354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c78b03e5-4067-4884-9352-0977f258039b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:14:58.737847 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.flows.manager.create_volume [None req-b37bfc29-b001-441f-8158-cc9e16ecdbc9 tempest-VolumesTransfersTest-370099354 None] Volume 80961129-526f-4094-af87-60410f84a8c1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-80961129-526f-4094-af87-60410f84a8c1', 'volume_size': 1} Jan 22 21:14:58.738248 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-b37bfc29-b001-441f-8158-cc9e16ecdbc9 tempest-VolumesTransfersTest-370099354 None] creating volume 'volume-80961129-526f-4094-af87-60410f84a8c1' {{(pid=129952) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Jan 22 21:14:58.740618 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-b37bfc29-b001-441f-8158-cc9e16ecdbc9 tempest-VolumesTransfersTest-370099354 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:14:59.885536 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-b37bfc29-b001-441f-8158-cc9e16ecdbc9 tempest-VolumesTransfersTest-370099354 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129952) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 22 21:14:59.886161 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-b37bfc29-b001-441f-8158-cc9e16ecdbc9 tempest-VolumesTransfersTest-370099354 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129952) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 22 21:14:59.892174 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-b37bfc29-b001-441f-8158-cc9e16ecdbc9 tempest-VolumesTransfersTest-370099354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c78b03e5-4067-4884-9352-0977f258039b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-80961129-526f-4094-af87-60410f84a8c1', 'volume_size': 1}' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:14:59.899794 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-b37bfc29-b001-441f-8158-cc9e16ecdbc9 tempest-VolumesTransfersTest-370099354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02c8777c-b00a-47a3-a543-6a7b16b6f698) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:14:59.997531 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.flows.manager.create_volume [None req-b37bfc29-b001-441f-8158-cc9e16ecdbc9 tempest-VolumesTransfersTest-370099354 None] Volume volume-80961129-526f-4094-af87-60410f84a8c1 (80961129-526f-4094-af87-60410f84a8c1): created successfully Jan 22 21:15:00.005816 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-b37bfc29-b001-441f-8158-cc9e16ecdbc9 tempest-VolumesTransfersTest-370099354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02c8777c-b00a-47a3-a543-6a7b16b6f698) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:15:00.008702 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-b37bfc29-b001-441f-8158-cc9e16ecdbc9 tempest-VolumesTransfersTest-370099354 None] Flow 'volume_create_manager' (a78948f2-e82d-4eae-89dd-7503f0b53210) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129952) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 22 21:15:00.074331 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-b37bfc29-b001-441f-8158-cc9e16ecdbc9 tempest-VolumesTransfersTest-370099354 None] Created volume successfully. Jan 22 21:15:02.077308 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-b2cebd84-1545-44f6-8e57-e280c60b6098 tempest-VolumesTransfersTest-1495281417 None] Transfer volume completed successfully. Jan 22 21:15:03.265378 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.coordination [None req-46dc8dbc-4567-47aa-8855-0471817ce544 tempest-VolumesTransfersTest-2090240900 None] Lock "b'cinder-80961129-526f-4094-af87-60410f84a8c1-delete_volume'" acquired by "delete_volume" :: waited 0.016s {{(pid=129952) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 22 21:15:03.381147 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-46dc8dbc-4567-47aa-8855-0471817ce544 tempest-VolumesTransfersTest-2090240900 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:15:03.721703 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-46dc8dbc-4567-47aa-8855-0471817ce544 tempest-VolumesTransfersTest-2090240900 None] volume has no backup snaps {{(pid=129952) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Jan 22 21:15:03.722322 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-46dc8dbc-4567-47aa-8855-0471817ce544 tempest-VolumesTransfersTest-2090240900 None] Volume volume-80961129-526f-4094-af87-60410f84a8c1 is not a clone. {{(pid=129952) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Jan 22 21:15:03.971993 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-46dc8dbc-4567-47aa-8855-0471817ce544 tempest-VolumesTransfersTest-2090240900 None] deleting rbd volume volume-80961129-526f-4094-af87-60410f84a8c1 {{(pid=129952) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Jan 22 21:15:09.703545 ncdv-master-1 cinder-volume[129952]: DEBUG oslo_service.periodic_task [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129952) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jan 22 21:15:09.704282 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:15:09.779751 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:15:09.814082 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.manager [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] Notifying Schedulers of capabilities ... {{(pid=129952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 22 21:15:12.310647 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.quota [None req-46dc8dbc-4567-47aa-8855-0471817ce544 tempest-VolumesTransfersTest-2090240900 None] Created reservations ['426244dc-83ee-4f1b-9f5e-fc736d8a9c7c', '837055f7-1a23-4afe-b74d-cdc24f9a81bf', '9d59da39-04b9-4e82-a7d1-610faff1ce02', '6f473dca-52c3-485c-bd6d-93a15e3f2e68'] {{(pid=129952) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 22 21:15:12.572299 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-46dc8dbc-4567-47aa-8855-0471817ce544 tempest-VolumesTransfersTest-2090240900 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:15:12.662501 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-46dc8dbc-4567-47aa-8855-0471817ce544 tempest-VolumesTransfersTest-2090240900 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:15:12.714372 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.manager [None req-46dc8dbc-4567-47aa-8855-0471817ce544 tempest-VolumesTransfersTest-2090240900 None] Notifying Schedulers of capabilities ... {{(pid=129952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 22 21:15:12.725942 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-46dc8dbc-4567-47aa-8855-0471817ce544 tempest-VolumesTransfersTest-2090240900 None] Deleted volume successfully. Jan 22 21:15:12.833432 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.coordination [None req-46dc8dbc-4567-47aa-8855-0471817ce544 tempest-VolumesTransfersTest-2090240900 None] Lock "b'cinder-80961129-526f-4094-af87-60410f84a8c1-delete_volume'" released by "delete_volume" :: held 9.568s {{(pid=129952) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 22 21:15:14.058581 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.flows.manager.create_volume [None req-b715043d-bc44-4326-9225-cde1c73e5477 tempest-VolumesTransfersTest-370099354 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129952) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Jan 22 21:15:14.062688 ncdv-master-1 cinder-volume[129952]: WARNING stevedore.named [None req-b715043d-bc44-4326-9225-cde1c73e5477 tempest-VolumesTransfersTest-370099354 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jan 22 21:15:14.067161 ncdv-master-1 cinder-volume[129952]: WARNING castellan.key_manager [None req-b715043d-bc44-4326-9225-cde1c73e5477 tempest-VolumesTransfersTest-370099354 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 22 21:15:14.107531 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-b715043d-bc44-4326-9225-cde1c73e5477 tempest-VolumesTransfersTest-370099354 None] Flow 'volume_create_manager' (bd089327-c02a-4fd3-966f-ce22a7a90ae2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 22 21:15:14.115184 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-b715043d-bc44-4326-9225-cde1c73e5477 tempest-VolumesTransfersTest-370099354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a7a50ff-a525-4931-aa48-20c45de8572a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:15:14.122179 ncdv-master-1 cinder-volume[129952]: DEBUG oslo_db.sqlalchemy.engines [None req-b715043d-bc44-4326-9225-cde1c73e5477 tempest-VolumesTransfersTest-370099354 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129952) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 22 21:15:14.138586 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-b715043d-bc44-4326-9225-cde1c73e5477 tempest-VolumesTransfersTest-370099354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a7a50ff-a525-4931-aa48-20c45de8572a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-01-22T21:15:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1582457710',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=a92f8436-01ad-4939-98a6-7e9c5d65769c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e68ef5e1f49d40f58d9a83585d787ea5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-01-22T21:15:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-01-22T21:15:14Z,use_quota=True,user_id='f579ded754dd43ac81d8f558cd5b8faf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6dacb05b-a7ea-4056-85ff-98f0ea5c54eb),volume_type_id=6dacb05b-a7ea-4056-85ff-98f0ea5c54eb)' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:15:14.144627 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-b715043d-bc44-4326-9225-cde1c73e5477 tempest-VolumesTransfersTest-370099354 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3989d0b4-71f3-4979-b347-6502c5ec1596) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:15:14.151387 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-b715043d-bc44-4326-9225-cde1c73e5477 tempest-VolumesTransfersTest-370099354 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3989d0b4-71f3-4979-b347-6502c5ec1596) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:15:14.156545 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-b715043d-bc44-4326-9225-cde1c73e5477 tempest-VolumesTransfersTest-370099354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (164026ac-0812-49a9-a861-9343e800d261) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:15:14.161991 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-b715043d-bc44-4326-9225-cde1c73e5477 tempest-VolumesTransfersTest-370099354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (164026ac-0812-49a9-a861-9343e800d261) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a92f8436-01ad-4939-98a6-7e9c5d65769c', 'volume_name': 'volume-a92f8436-01ad-4939-98a6-7e9c5d65769c', 'volume_size': 1}' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:15:14.167590 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-b715043d-bc44-4326-9225-cde1c73e5477 tempest-VolumesTransfersTest-370099354 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8d514fd-511c-4198-a211-c1b2545d044d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:15:14.171992 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-b715043d-bc44-4326-9225-cde1c73e5477 tempest-VolumesTransfersTest-370099354 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8d514fd-511c-4198-a211-c1b2545d044d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:15:14.177965 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-b715043d-bc44-4326-9225-cde1c73e5477 tempest-VolumesTransfersTest-370099354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28321316-6dd3-4021-acc6-0457de5a3abd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:15:14.180017 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.flows.manager.create_volume [None req-b715043d-bc44-4326-9225-cde1c73e5477 tempest-VolumesTransfersTest-370099354 None] Volume a92f8436-01ad-4939-98a6-7e9c5d65769c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a92f8436-01ad-4939-98a6-7e9c5d65769c', 'volume_size': 1} Jan 22 21:15:14.180395 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-b715043d-bc44-4326-9225-cde1c73e5477 tempest-VolumesTransfersTest-370099354 None] creating volume 'volume-a92f8436-01ad-4939-98a6-7e9c5d65769c' {{(pid=129952) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Jan 22 21:15:14.181668 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-b715043d-bc44-4326-9225-cde1c73e5477 tempest-VolumesTransfersTest-370099354 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:15:15.312878 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-b715043d-bc44-4326-9225-cde1c73e5477 tempest-VolumesTransfersTest-370099354 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129952) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 22 21:15:15.313598 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-b715043d-bc44-4326-9225-cde1c73e5477 tempest-VolumesTransfersTest-370099354 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129952) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 22 21:15:15.323772 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-b715043d-bc44-4326-9225-cde1c73e5477 tempest-VolumesTransfersTest-370099354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28321316-6dd3-4021-acc6-0457de5a3abd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a92f8436-01ad-4939-98a6-7e9c5d65769c', 'volume_size': 1}' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:15:15.332707 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-b715043d-bc44-4326-9225-cde1c73e5477 tempest-VolumesTransfersTest-370099354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76111ee6-0754-43c0-9c4f-2e33b19aeecd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:15:15.425079 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.flows.manager.create_volume [None req-b715043d-bc44-4326-9225-cde1c73e5477 tempest-VolumesTransfersTest-370099354 None] Volume volume-a92f8436-01ad-4939-98a6-7e9c5d65769c (a92f8436-01ad-4939-98a6-7e9c5d65769c): created successfully Jan 22 21:15:15.432959 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-b715043d-bc44-4326-9225-cde1c73e5477 tempest-VolumesTransfersTest-370099354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76111ee6-0754-43c0-9c4f-2e33b19aeecd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:15:15.440604 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-b715043d-bc44-4326-9225-cde1c73e5477 tempest-VolumesTransfersTest-370099354 None] Flow 'volume_create_manager' (bd089327-c02a-4fd3-966f-ce22a7a90ae2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129952) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 22 21:15:15.852665 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-b715043d-bc44-4326-9225-cde1c73e5477 tempest-VolumesTransfersTest-370099354 None] Created volume successfully. Jan 22 21:15:16.762187 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.coordination [None req-036909c4-29a0-4a05-a9ad-d4d6ac48cdc7 tempest-VolumesTransfersTest-2090240900 None] Lock "b'cinder-a92f8436-01ad-4939-98a6-7e9c5d65769c-delete_volume'" acquired by "delete_volume" :: waited 0.028s {{(pid=129952) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 22 21:15:16.853231 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-036909c4-29a0-4a05-a9ad-d4d6ac48cdc7 tempest-VolumesTransfersTest-2090240900 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:15:17.233631 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-036909c4-29a0-4a05-a9ad-d4d6ac48cdc7 tempest-VolumesTransfersTest-2090240900 None] volume has no backup snaps {{(pid=129952) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Jan 22 21:15:17.234007 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-036909c4-29a0-4a05-a9ad-d4d6ac48cdc7 tempest-VolumesTransfersTest-2090240900 None] Volume volume-a92f8436-01ad-4939-98a6-7e9c5d65769c is not a clone. {{(pid=129952) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Jan 22 21:15:17.573326 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-036909c4-29a0-4a05-a9ad-d4d6ac48cdc7 tempest-VolumesTransfersTest-2090240900 None] deleting rbd volume volume-a92f8436-01ad-4939-98a6-7e9c5d65769c {{(pid=129952) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Jan 22 21:15:26.461869 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.quota [None req-036909c4-29a0-4a05-a9ad-d4d6ac48cdc7 tempest-VolumesTransfersTest-2090240900 None] Created reservations ['aa20c69b-229d-4724-bcee-c7779c817834', '6b06de4a-ed44-45d2-acdf-0e29a2755263', 'cef6fe35-194b-4315-aaf8-64eade1d1b6e', 'b5069a85-00e4-47b3-ba04-a9210d29fe38'] {{(pid=129952) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 22 21:15:26.678445 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-036909c4-29a0-4a05-a9ad-d4d6ac48cdc7 tempest-VolumesTransfersTest-2090240900 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:15:26.697104 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-036909c4-29a0-4a05-a9ad-d4d6ac48cdc7 tempest-VolumesTransfersTest-2090240900 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:15:26.727969 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.manager [None req-036909c4-29a0-4a05-a9ad-d4d6ac48cdc7 tempest-VolumesTransfersTest-2090240900 None] Notifying Schedulers of capabilities ... {{(pid=129952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 22 21:15:26.732714 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-036909c4-29a0-4a05-a9ad-d4d6ac48cdc7 tempest-VolumesTransfersTest-2090240900 None] Deleted volume successfully. Jan 22 21:15:26.862294 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.coordination [None req-036909c4-29a0-4a05-a9ad-d4d6ac48cdc7 tempest-VolumesTransfersTest-2090240900 None] Lock "b'cinder-a92f8436-01ad-4939-98a6-7e9c5d65769c-delete_volume'" released by "delete_volume" :: held 10.100s {{(pid=129952) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 22 21:15:32.863977 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [req-0bf4c971-83c3-444d-8dde-7fd844d7510c req-b7a26d2c-5929-48b0-9452-645546035b5a tempest-AttachVolumeTestJSON-815334161 None] Terminate volume connection completed successfully. Jan 22 21:15:32.865301 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [req-0bf4c971-83c3-444d-8dde-7fd844d7510c req-b7a26d2c-5929-48b0-9452-645546035b5a tempest-AttachVolumeTestJSON-815334161 None] Deleting attachment fca2fe29-0e7e-4255-a13a-9b3bf8c1b4db. {{(pid=129952) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4947}} Jan 22 21:15:40.431276 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.flows.manager.create_volume [None req-40a8d20f-3816-4bc6-8c5e-79eb7cd7a56f tempest-DeleteServersTestJSON-1162998405 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129952) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Jan 22 21:15:40.434678 ncdv-master-1 cinder-volume[129952]: WARNING stevedore.named [None req-40a8d20f-3816-4bc6-8c5e-79eb7cd7a56f tempest-DeleteServersTestJSON-1162998405 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jan 22 21:15:40.435181 ncdv-master-1 cinder-volume[129952]: WARNING castellan.key_manager [None req-40a8d20f-3816-4bc6-8c5e-79eb7cd7a56f tempest-DeleteServersTestJSON-1162998405 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 22 21:15:40.475079 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-40a8d20f-3816-4bc6-8c5e-79eb7cd7a56f tempest-DeleteServersTestJSON-1162998405 None] Flow 'volume_create_manager' (4360b689-8d75-4d8b-941a-2ee015c1cecb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 22 21:15:40.486760 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-40a8d20f-3816-4bc6-8c5e-79eb7cd7a56f tempest-DeleteServersTestJSON-1162998405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f314a6d-9133-40bf-98df-b92b4d9927a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:15:40.494959 ncdv-master-1 cinder-volume[129952]: DEBUG oslo_db.sqlalchemy.engines [None req-40a8d20f-3816-4bc6-8c5e-79eb7cd7a56f tempest-DeleteServersTestJSON-1162998405 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129952) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 22 21:15:40.515861 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-40a8d20f-3816-4bc6-8c5e-79eb7cd7a56f tempest-DeleteServersTestJSON-1162998405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f314a6d-9133-40bf-98df-b92b4d9927a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-01-22T21:15:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-324089345',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=17dd6a14-8c30-4a4b-8cea-30088ada2948,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b1c3aa9e1ae4cc8a5a021434ad4a59c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-01-22T21:15:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-01-22T21:15:40Z,use_quota=True,user_id='b93108a71872461ea979735a490694a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6dacb05b-a7ea-4056-85ff-98f0ea5c54eb),volume_type_id=6dacb05b-a7ea-4056-85ff-98f0ea5c54eb)' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:15:40.545925 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-40a8d20f-3816-4bc6-8c5e-79eb7cd7a56f tempest-DeleteServersTestJSON-1162998405 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f66eb1b5-0098-4242-8280-6a2fe4a26ec8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:15:40.566081 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-40a8d20f-3816-4bc6-8c5e-79eb7cd7a56f tempest-DeleteServersTestJSON-1162998405 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f66eb1b5-0098-4242-8280-6a2fe4a26ec8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:15:40.572713 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-40a8d20f-3816-4bc6-8c5e-79eb7cd7a56f tempest-DeleteServersTestJSON-1162998405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e318fbd7-a05f-4d53-a0c2-e7f15d5e33e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:15:40.587788 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-40a8d20f-3816-4bc6-8c5e-79eb7cd7a56f tempest-DeleteServersTestJSON-1162998405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e318fbd7-a05f-4d53-a0c2-e7f15d5e33e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '17dd6a14-8c30-4a4b-8cea-30088ada2948', 'volume_name': 'volume-17dd6a14-8c30-4a4b-8cea-30088ada2948', 'volume_size': 1}' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:15:40.601002 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-40a8d20f-3816-4bc6-8c5e-79eb7cd7a56f tempest-DeleteServersTestJSON-1162998405 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4540f870-45fb-45e1-be33-995f48711c83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:15:40.605524 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-40a8d20f-3816-4bc6-8c5e-79eb7cd7a56f tempest-DeleteServersTestJSON-1162998405 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4540f870-45fb-45e1-be33-995f48711c83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:15:40.612628 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-40a8d20f-3816-4bc6-8c5e-79eb7cd7a56f tempest-DeleteServersTestJSON-1162998405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea42c7c9-84ee-43ec-94ff-c9cca4901e64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:15:40.613805 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.flows.manager.create_volume [None req-40a8d20f-3816-4bc6-8c5e-79eb7cd7a56f tempest-DeleteServersTestJSON-1162998405 None] Volume 17dd6a14-8c30-4a4b-8cea-30088ada2948: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-17dd6a14-8c30-4a4b-8cea-30088ada2948', 'volume_size': 1} Jan 22 21:15:40.614832 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-40a8d20f-3816-4bc6-8c5e-79eb7cd7a56f tempest-DeleteServersTestJSON-1162998405 None] creating volume 'volume-17dd6a14-8c30-4a4b-8cea-30088ada2948' {{(pid=129952) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Jan 22 21:15:40.617889 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-40a8d20f-3816-4bc6-8c5e-79eb7cd7a56f tempest-DeleteServersTestJSON-1162998405 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:15:41.848257 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-40a8d20f-3816-4bc6-8c5e-79eb7cd7a56f tempest-DeleteServersTestJSON-1162998405 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129952) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 22 21:15:41.857294 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-40a8d20f-3816-4bc6-8c5e-79eb7cd7a56f tempest-DeleteServersTestJSON-1162998405 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129952) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 22 21:15:41.857294 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-40a8d20f-3816-4bc6-8c5e-79eb7cd7a56f tempest-DeleteServersTestJSON-1162998405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea42c7c9-84ee-43ec-94ff-c9cca4901e64) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-17dd6a14-8c30-4a4b-8cea-30088ada2948', 'volume_size': 1}' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:15:41.869144 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-40a8d20f-3816-4bc6-8c5e-79eb7cd7a56f tempest-DeleteServersTestJSON-1162998405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ead9c525-b842-4d4f-9ce3-aa7152248886) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:15:41.977287 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.flows.manager.create_volume [None req-40a8d20f-3816-4bc6-8c5e-79eb7cd7a56f tempest-DeleteServersTestJSON-1162998405 None] Volume volume-17dd6a14-8c30-4a4b-8cea-30088ada2948 (17dd6a14-8c30-4a4b-8cea-30088ada2948): created successfully Jan 22 21:15:41.981583 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-40a8d20f-3816-4bc6-8c5e-79eb7cd7a56f tempest-DeleteServersTestJSON-1162998405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ead9c525-b842-4d4f-9ce3-aa7152248886) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:15:41.990065 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-40a8d20f-3816-4bc6-8c5e-79eb7cd7a56f tempest-DeleteServersTestJSON-1162998405 None] Flow 'volume_create_manager' (4360b689-8d75-4d8b-941a-2ee015c1cecb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129952) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 22 21:15:42.070480 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-40a8d20f-3816-4bc6-8c5e-79eb7cd7a56f tempest-DeleteServersTestJSON-1162998405 None] Created volume successfully. Jan 22 21:15:44.569235 ncdv-master-1 cinder-volume[129952]: DEBUG oslo_concurrency.processutils [req-dcf5f1a6-5bf0-4811-b425-b98e5b81c67c req-beaddfd8-3873-4740-8190-3cd1c3dd8cbe tempest-DeleteServersTestJSON-1162998405 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129952) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jan 22 21:15:45.610343 ncdv-master-1 cinder-volume[129952]: DEBUG oslo_concurrency.processutils [req-dcf5f1a6-5bf0-4811-b425-b98e5b81c67c req-beaddfd8-3873-4740-8190-3cd1c3dd8cbe tempest-DeleteServersTestJSON-1162998405 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.041s {{(pid=129952) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jan 22 21:15:45.611217 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [req-dcf5f1a6-5bf0-4811-b425-b98e5b81c67c req-beaddfd8-3873-4740-8190-3cd1c3dd8cbe tempest-DeleteServersTestJSON-1162998405 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-17dd6a14-8c30-4a4b-8cea-30088ada2948', 'hosts': ['10.222.0.100'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'c7ee930a-3b87-450e-91f6-d4eef70cb484', 'volume_id': '17dd6a14-8c30-4a4b-8cea-30088ada2948', 'discard': True}} {{(pid=129952) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Jan 22 21:15:45.788372 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [req-dcf5f1a6-5bf0-4811-b425-b98e5b81c67c req-beaddfd8-3873-4740-8190-3cd1c3dd8cbe tempest-DeleteServersTestJSON-1162998405 None] Connection info returned from driver {'name': 'volumes/volume-17dd6a14-8c30-4a4b-8cea-30088ada2948', 'hosts': ['10.222.0.100'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '17dd6a14-8c30-4a4b-8cea-30088ada2948', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'a1866c3a-9d04-4f4e-8b06-22ff44493d5e'} {{(pid=129952) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4811}} Jan 22 21:15:46.003805 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [req-dcf5f1a6-5bf0-4811-b425-b98e5b81c67c req-beaddfd8-3873-4740-8190-3cd1c3dd8cbe tempest-DeleteServersTestJSON-1162998405 None] attachment_update completed successfully. Jan 22 21:15:53.256298 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [req-fc768a90-9674-4853-bb6c-5e83a164edb1 req-9693fafa-b5c9-4d09-bfa8-2b1534d5baad tempest-DeleteServersTestJSON-1162998405 None] Terminate volume connection completed successfully. Jan 22 21:15:53.256977 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [req-fc768a90-9674-4853-bb6c-5e83a164edb1 req-9693fafa-b5c9-4d09-bfa8-2b1534d5baad tempest-DeleteServersTestJSON-1162998405 None] Deleting attachment a1866c3a-9d04-4f4e-8b06-22ff44493d5e. {{(pid=129952) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4947}} Jan 22 21:15:54.334820 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.flows.manager.create_volume [None req-51f84cba-47d0-4e47-a453-f088b3d32cb5 tempest-AttachVolumeShelveTestJSON-1245575078 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129952) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Jan 22 21:15:54.345355 ncdv-master-1 cinder-volume[129952]: WARNING stevedore.named [None req-51f84cba-47d0-4e47-a453-f088b3d32cb5 tempest-AttachVolumeShelveTestJSON-1245575078 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jan 22 21:15:54.346252 ncdv-master-1 cinder-volume[129952]: WARNING castellan.key_manager [None req-51f84cba-47d0-4e47-a453-f088b3d32cb5 tempest-AttachVolumeShelveTestJSON-1245575078 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 22 21:15:54.374689 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-51f84cba-47d0-4e47-a453-f088b3d32cb5 tempest-AttachVolumeShelveTestJSON-1245575078 None] Flow 'volume_create_manager' (0e35530f-2944-4ff2-a128-35e90919be39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 22 21:15:54.382727 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-51f84cba-47d0-4e47-a453-f088b3d32cb5 tempest-AttachVolumeShelveTestJSON-1245575078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d85bf32-d955-40c2-af34-b55f84b54d50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:15:54.389769 ncdv-master-1 cinder-volume[129952]: DEBUG oslo_db.sqlalchemy.engines [None req-51f84cba-47d0-4e47-a453-f088b3d32cb5 tempest-AttachVolumeShelveTestJSON-1245575078 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129952) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 22 21:15:54.408252 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-51f84cba-47d0-4e47-a453-f088b3d32cb5 tempest-AttachVolumeShelveTestJSON-1245575078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d85bf32-d955-40c2-af34-b55f84b54d50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-01-22T21:15:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-445116677',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=df46cbf4-ba70-4e61-b51d-9f2a257ff669,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='76ecd70d0be147b59ffbda6d93f73aa6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-01-22T21:15:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-01-22T21:15:54Z,use_quota=True,user_id='c0be514b27f14d8a9e4fd71b31a6d2e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6dacb05b-a7ea-4056-85ff-98f0ea5c54eb),volume_type_id=6dacb05b-a7ea-4056-85ff-98f0ea5c54eb)' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:15:54.427951 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-51f84cba-47d0-4e47-a453-f088b3d32cb5 tempest-AttachVolumeShelveTestJSON-1245575078 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a257f63d-d7fd-4ee3-84f6-aefae72bbc13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:15:54.434121 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-51f84cba-47d0-4e47-a453-f088b3d32cb5 tempest-AttachVolumeShelveTestJSON-1245575078 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a257f63d-d7fd-4ee3-84f6-aefae72bbc13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:15:54.439692 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-51f84cba-47d0-4e47-a453-f088b3d32cb5 tempest-AttachVolumeShelveTestJSON-1245575078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d9853b9-9bcf-4a23-b0e5-16002d7711a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:15:54.460552 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-51f84cba-47d0-4e47-a453-f088b3d32cb5 tempest-AttachVolumeShelveTestJSON-1245575078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d9853b9-9bcf-4a23-b0e5-16002d7711a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'df46cbf4-ba70-4e61-b51d-9f2a257ff669', 'volume_name': 'volume-df46cbf4-ba70-4e61-b51d-9f2a257ff669', 'volume_size': 1}' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:15:54.519076 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-51f84cba-47d0-4e47-a453-f088b3d32cb5 tempest-AttachVolumeShelveTestJSON-1245575078 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f971ab7-593d-4f72-bf20-ad07b5b97376) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:15:54.535294 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-51f84cba-47d0-4e47-a453-f088b3d32cb5 tempest-AttachVolumeShelveTestJSON-1245575078 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f971ab7-593d-4f72-bf20-ad07b5b97376) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:15:54.556334 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-51f84cba-47d0-4e47-a453-f088b3d32cb5 tempest-AttachVolumeShelveTestJSON-1245575078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42ef2485-1514-4801-a7da-fa906a6023fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:15:54.563393 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.flows.manager.create_volume [None req-51f84cba-47d0-4e47-a453-f088b3d32cb5 tempest-AttachVolumeShelveTestJSON-1245575078 None] Volume df46cbf4-ba70-4e61-b51d-9f2a257ff669: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-df46cbf4-ba70-4e61-b51d-9f2a257ff669', 'volume_size': 1} Jan 22 21:15:54.566203 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-51f84cba-47d0-4e47-a453-f088b3d32cb5 tempest-AttachVolumeShelveTestJSON-1245575078 None] creating volume 'volume-df46cbf4-ba70-4e61-b51d-9f2a257ff669' {{(pid=129952) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Jan 22 21:15:54.572020 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-51f84cba-47d0-4e47-a453-f088b3d32cb5 tempest-AttachVolumeShelveTestJSON-1245575078 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:15:55.918296 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-51f84cba-47d0-4e47-a453-f088b3d32cb5 tempest-AttachVolumeShelveTestJSON-1245575078 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129952) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 22 21:15:55.925229 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-51f84cba-47d0-4e47-a453-f088b3d32cb5 tempest-AttachVolumeShelveTestJSON-1245575078 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129952) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 22 21:15:55.932298 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-51f84cba-47d0-4e47-a453-f088b3d32cb5 tempest-AttachVolumeShelveTestJSON-1245575078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42ef2485-1514-4801-a7da-fa906a6023fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-df46cbf4-ba70-4e61-b51d-9f2a257ff669', 'volume_size': 1}' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:15:55.964121 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-51f84cba-47d0-4e47-a453-f088b3d32cb5 tempest-AttachVolumeShelveTestJSON-1245575078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae59548e-532f-4780-8662-3255fb42530d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:15:56.096689 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.flows.manager.create_volume [None req-51f84cba-47d0-4e47-a453-f088b3d32cb5 tempest-AttachVolumeShelveTestJSON-1245575078 None] Volume volume-df46cbf4-ba70-4e61-b51d-9f2a257ff669 (df46cbf4-ba70-4e61-b51d-9f2a257ff669): created successfully Jan 22 21:15:56.101796 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-51f84cba-47d0-4e47-a453-f088b3d32cb5 tempest-AttachVolumeShelveTestJSON-1245575078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae59548e-532f-4780-8662-3255fb42530d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:15:56.118351 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-51f84cba-47d0-4e47-a453-f088b3d32cb5 tempest-AttachVolumeShelveTestJSON-1245575078 None] Flow 'volume_create_manager' (0e35530f-2944-4ff2-a128-35e90919be39) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129952) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 22 21:15:56.211015 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-51f84cba-47d0-4e47-a453-f088b3d32cb5 tempest-AttachVolumeShelveTestJSON-1245575078 None] Created volume successfully. Jan 22 21:16:09.702887 ncdv-master-1 cinder-volume[129952]: DEBUG oslo_service.periodic_task [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129952) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jan 22 21:16:09.707159 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:16:09.782721 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:16:09.881641 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.manager [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] Notifying Schedulers of capabilities ... {{(pid=129952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 22 21:16:45.473973 ncdv-master-1 cinder-volume[129952]: DEBUG oslo_concurrency.processutils [req-a4a9bc29-e2b9-4df0-8394-91b45c842dd4 req-f257d410-cf9d-4afd-b818-0523bef24fcd tempest-AttachVolumeShelveTestJSON-1245575078 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129952) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jan 22 21:16:46.858333 ncdv-master-1 cinder-volume[129952]: DEBUG oslo_concurrency.processutils [req-a4a9bc29-e2b9-4df0-8394-91b45c842dd4 req-f257d410-cf9d-4afd-b818-0523bef24fcd tempest-AttachVolumeShelveTestJSON-1245575078 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.382s {{(pid=129952) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jan 22 21:16:46.860489 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [req-a4a9bc29-e2b9-4df0-8394-91b45c842dd4 req-f257d410-cf9d-4afd-b818-0523bef24fcd tempest-AttachVolumeShelveTestJSON-1245575078 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-df46cbf4-ba70-4e61-b51d-9f2a257ff669', 'hosts': ['10.222.0.100'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'c7ee930a-3b87-450e-91f6-d4eef70cb484', 'volume_id': 'df46cbf4-ba70-4e61-b51d-9f2a257ff669', 'discard': True}} {{(pid=129952) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Jan 22 21:16:47.010204 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [req-a4a9bc29-e2b9-4df0-8394-91b45c842dd4 req-f257d410-cf9d-4afd-b818-0523bef24fcd tempest-AttachVolumeShelveTestJSON-1245575078 None] Connection info returned from driver {'name': 'volumes/volume-df46cbf4-ba70-4e61-b51d-9f2a257ff669', 'hosts': ['10.222.0.100'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'df46cbf4-ba70-4e61-b51d-9f2a257ff669', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'c2694f88-e90b-4f17-a4db-0416c6c00921'} {{(pid=129952) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4811}} Jan 22 21:16:47.205292 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [req-a4a9bc29-e2b9-4df0-8394-91b45c842dd4 req-f257d410-cf9d-4afd-b818-0523bef24fcd tempest-AttachVolumeShelveTestJSON-1245575078 None] attachment_update completed successfully. Jan 22 21:16:49.662206 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [req-46f29bdf-7464-48a8-9c50-0e87ba87bf9d req-89c664e4-3f01-4f54-a9bf-506e2b30fb92 tempest-TaggedBootDevicesTest_v242-884103753 None] Terminate volume connection completed successfully. Jan 22 21:16:49.662781 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [req-46f29bdf-7464-48a8-9c50-0e87ba87bf9d req-89c664e4-3f01-4f54-a9bf-506e2b30fb92 tempest-TaggedBootDevicesTest_v242-884103753 None] Deleting attachment 41b68b21-157f-4d48-8947-4e14bb53e086. {{(pid=129952) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4947}} Jan 22 21:16:49.896796 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [req-46f29bdf-7464-48a8-9c50-0e87ba87bf9d req-df222b63-57e7-476c-8ec2-8bd6b3b8f278 tempest-TaggedBootDevicesTest_v242-884103753 None] Terminate volume connection completed successfully. Jan 22 21:16:49.897278 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [req-46f29bdf-7464-48a8-9c50-0e87ba87bf9d req-df222b63-57e7-476c-8ec2-8bd6b3b8f278 tempest-TaggedBootDevicesTest_v242-884103753 None] Deleting attachment f9c0e9e3-2a0f-41a5-adf6-da5e7e4d5bd8. {{(pid=129952) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4947}} Jan 22 21:16:50.109210 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [req-46f29bdf-7464-48a8-9c50-0e87ba87bf9d req-1b67672d-70e4-4146-a99a-9c815f0a3842 tempest-TaggedBootDevicesTest_v242-884103753 None] Terminate volume connection completed successfully. Jan 22 21:16:50.109657 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [req-46f29bdf-7464-48a8-9c50-0e87ba87bf9d req-1b67672d-70e4-4146-a99a-9c815f0a3842 tempest-TaggedBootDevicesTest_v242-884103753 None] Deleting attachment 7e821802-f647-4c43-8312-7de33f43a48c. {{(pid=129952) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4947}} Jan 22 21:17:03.930846 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.coordination [None req-d406d785-f401-4a2f-a1d3-c863d8b7a9fa tempest-TaggedBootDevicesTest_v242-884103753 None] Lock "b'cinder-fdf5d208-3baf-45d3-9815-e2f0994a442c-delete_volume'" acquired by "delete_volume" :: waited 0.011s {{(pid=129952) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 22 21:17:04.224103 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-d406d785-f401-4a2f-a1d3-c863d8b7a9fa tempest-TaggedBootDevicesTest_v242-884103753 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:17:04.601773 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-d406d785-f401-4a2f-a1d3-c863d8b7a9fa tempest-TaggedBootDevicesTest_v242-884103753 None] volume has no backup snaps {{(pid=129952) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Jan 22 21:17:04.602528 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-d406d785-f401-4a2f-a1d3-c863d8b7a9fa tempest-TaggedBootDevicesTest_v242-884103753 None] Volume volume-fdf5d208-3baf-45d3-9815-e2f0994a442c is not a clone. {{(pid=129952) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Jan 22 21:17:04.848664 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-d406d785-f401-4a2f-a1d3-c863d8b7a9fa tempest-TaggedBootDevicesTest_v242-884103753 None] deleting rbd volume volume-fdf5d208-3baf-45d3-9815-e2f0994a442c {{(pid=129952) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Jan 22 21:17:09.704761 ncdv-master-1 cinder-volume[129952]: DEBUG oslo_service.periodic_task [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129952) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jan 22 21:17:09.705640 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:17:09.763209 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:17:09.835378 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.manager [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] Notifying Schedulers of capabilities ... {{(pid=129952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 22 21:17:12.958430 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.flows.manager.create_volume [None req-b0bebaa0-fd81-4508-96f3-b86667e5b2aa tempest-TaggedBootDevicesTest-807480544 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129952) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Jan 22 21:17:12.967043 ncdv-master-1 cinder-volume[129952]: WARNING stevedore.named [None req-b0bebaa0-fd81-4508-96f3-b86667e5b2aa tempest-TaggedBootDevicesTest-807480544 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jan 22 21:17:12.968522 ncdv-master-1 cinder-volume[129952]: WARNING castellan.key_manager [None req-b0bebaa0-fd81-4508-96f3-b86667e5b2aa tempest-TaggedBootDevicesTest-807480544 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 22 21:17:13.000621 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-b0bebaa0-fd81-4508-96f3-b86667e5b2aa tempest-TaggedBootDevicesTest-807480544 None] Flow 'volume_create_manager' (39e0087f-ed4a-49d1-a279-a4f47fa75e2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 22 21:17:13.009074 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-b0bebaa0-fd81-4508-96f3-b86667e5b2aa tempest-TaggedBootDevicesTest-807480544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77f38da1-8e0a-46b7-83fb-0816eebb9063) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:17:13.031884 ncdv-master-1 cinder-volume[129952]: DEBUG oslo_db.sqlalchemy.engines [None req-b0bebaa0-fd81-4508-96f3-b86667e5b2aa tempest-TaggedBootDevicesTest-807480544 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129952) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 22 21:17:13.048547 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-b0bebaa0-fd81-4508-96f3-b86667e5b2aa tempest-TaggedBootDevicesTest-807480544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77f38da1-8e0a-46b7-83fb-0816eebb9063) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-01-22T21:17:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-768017558',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=fe1f8ef9-19a5-4687-8faf-0666021816d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d9480b0ab9b5461c953e555cb140b8f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-01-22T21:17:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-01-22T21:17:13Z,use_quota=True,user_id='a5f940a48ba74abeaca28109a6bf6f69',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6dacb05b-a7ea-4056-85ff-98f0ea5c54eb),volume_type_id=6dacb05b-a7ea-4056-85ff-98f0ea5c54eb)' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:17:13.055189 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-b0bebaa0-fd81-4508-96f3-b86667e5b2aa tempest-TaggedBootDevicesTest-807480544 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (218e32ff-3f67-448f-aced-23bc62b87868) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:17:13.059965 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-b0bebaa0-fd81-4508-96f3-b86667e5b2aa tempest-TaggedBootDevicesTest-807480544 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (218e32ff-3f67-448f-aced-23bc62b87868) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:17:13.067117 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-b0bebaa0-fd81-4508-96f3-b86667e5b2aa tempest-TaggedBootDevicesTest-807480544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56e5cfb5-7cf9-4310-8b87-2016f4f50227) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:17:13.232865 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-b0bebaa0-fd81-4508-96f3-b86667e5b2aa tempest-TaggedBootDevicesTest-807480544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56e5cfb5-7cf9-4310-8b87-2016f4f50227) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'fe1f8ef9-19a5-4687-8faf-0666021816d4', 'volume_name': 'volume-fe1f8ef9-19a5-4687-8faf-0666021816d4', 'volume_size': 1, 'image_id': '373cb480-3bc4-4821-93e2-442b4e852b80', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '994e8f6963f04af3be3dbae11a73cdfd', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '373cb480-3bc4-4821-93e2-442b4e852b80', 'created_at': datetime.datetime(2022, 1, 22, 20, 50, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 1, 22, 20, 50, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/373cb480-3bc4-4821-93e2-442b4e852b80/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:17:13.240905 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-b0bebaa0-fd81-4508-96f3-b86667e5b2aa tempest-TaggedBootDevicesTest-807480544 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd20ec5a-8052-47fe-b041-ba9f6cc3bcd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:17:13.245797 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-b0bebaa0-fd81-4508-96f3-b86667e5b2aa tempest-TaggedBootDevicesTest-807480544 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd20ec5a-8052-47fe-b041-ba9f6cc3bcd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:17:13.263196 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-b0bebaa0-fd81-4508-96f3-b86667e5b2aa tempest-TaggedBootDevicesTest-807480544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d119a03-bfac-4372-88a7-3b606ca5582b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:17:13.264843 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.flows.manager.create_volume [None req-b0bebaa0-fd81-4508-96f3-b86667e5b2aa tempest-TaggedBootDevicesTest-807480544 None] Volume fe1f8ef9-19a5-4687-8faf-0666021816d4: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-fe1f8ef9-19a5-4687-8faf-0666021816d4', 'volume_size': 1, 'image_id': '373cb480-3bc4-4821-93e2-442b4e852b80', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '994e8f6963f04af3be3dbae11a73cdfd', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '373cb480-3bc4-4821-93e2-442b4e852b80', 'created_at': datetime.datetime(2022, 1, 22, 20, 50, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 1, 22, 20, 50, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/373cb480-3bc4-4821-93e2-442b4e852b80/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jan 22 21:17:13.265725 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.flows.manager.create_volume [None req-b0bebaa0-fd81-4508-96f3-b86667e5b2aa tempest-TaggedBootDevicesTest-807480544 None] Cloning fe1f8ef9-19a5-4687-8faf-0666021816d4 from image 373cb480-3bc4-4821-93e2-442b4e852b80 at location (None, None). {{(pid=129952) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1046}} Jan 22 21:17:13.280250 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.coordination [None req-b0bebaa0-fd81-4508-96f3-b86667e5b2aa tempest-TaggedBootDevicesTest-807480544 None] Lock "b'cinder-373cb480-3bc4-4821-93e2-442b4e852b80'" acquired by "_prepare_image_cache_entry" :: waited 0.013s {{(pid=129952) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 22 21:17:13.409178 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.image.cache [None req-b0bebaa0-fd81-4508-96f3-b86667e5b2aa tempest-TaggedBootDevicesTest-807480544 None] Found image-volume cache entry: {'id': 1, 'image_id': '373cb480-3bc4-4821-93e2-442b4e852b80', 'volume_id': 'f39c1078-cff4-40dd-93df-4ce49cd873b4', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 1, 22, 20, 50, 57), 'last_used': datetime.datetime(2022, 1, 22, 21, 17, 13, 290017)}. {{(pid=129952) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Jan 22 21:17:13.409953 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.image.cache [None req-b0bebaa0-fd81-4508-96f3-b86667e5b2aa tempest-TaggedBootDevicesTest-807480544 None] Image-volume cache entry image_update_at = 2022-01-22 20:50:57+00:00, requested image updated_at = 2022-01-22 20:50:57+00:00. {{(pid=129952) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Jan 22 21:17:13.411282 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.flows.manager.create_volume [None req-b0bebaa0-fd81-4508-96f3-b86667e5b2aa tempest-TaggedBootDevicesTest-807480544 None] Found cache entry for image = 373cb480-3bc4-4821-93e2-442b4e852b80 on host ncdv-master-1@ceph#ceph. {{(pid=129952) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:869}} Jan 22 21:17:13.415869 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.coordination [None req-b0bebaa0-fd81-4508-96f3-b86667e5b2aa tempest-TaggedBootDevicesTest-807480544 None] Lock "b'cinder-373cb480-3bc4-4821-93e2-442b4e852b80'" released by "_prepare_image_cache_entry" :: held 0.136s {{(pid=129952) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 22 21:17:13.416906 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.flows.manager.create_volume [None req-b0bebaa0-fd81-4508-96f3-b86667e5b2aa tempest-TaggedBootDevicesTest-807480544 None] Attempting to retrieve cache entry for image = 373cb480-3bc4-4821-93e2-442b4e852b80 on host ncdv-master-1@ceph#ceph. {{(pid=129952) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:810}} Jan 22 21:17:13.428156 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.image.cache [None req-b0bebaa0-fd81-4508-96f3-b86667e5b2aa tempest-TaggedBootDevicesTest-807480544 None] Found image-volume cache entry: {'id': 1, 'image_id': '373cb480-3bc4-4821-93e2-442b4e852b80', 'volume_id': 'f39c1078-cff4-40dd-93df-4ce49cd873b4', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 1, 22, 20, 50, 57), 'last_used': datetime.datetime(2022, 1, 22, 21, 17, 13, 424772)}. {{(pid=129952) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Jan 22 21:17:13.428709 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.image.cache [None req-b0bebaa0-fd81-4508-96f3-b86667e5b2aa tempest-TaggedBootDevicesTest-807480544 None] Image-volume cache entry image_update_at = 2022-01-22 20:50:57+00:00, requested image updated_at = 2022-01-22 20:50:57+00:00. {{(pid=129952) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Jan 22 21:17:13.431005 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.flows.manager.create_volume [None req-b0bebaa0-fd81-4508-96f3-b86667e5b2aa tempest-TaggedBootDevicesTest-807480544 None] Creating from source image-volume f39c1078-cff4-40dd-93df-4ce49cd873b4 {{(pid=129952) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:824}} Jan 22 21:17:13.448855 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-b0bebaa0-fd81-4508-96f3-b86667e5b2aa tempest-TaggedBootDevicesTest-807480544 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:17:14.316316 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-b0bebaa0-fd81-4508-96f3-b86667e5b2aa tempest-TaggedBootDevicesTest-807480544 None] creating snapshot='volume-fe1f8ef9-19a5-4687-8faf-0666021816d4.clone_snap' {{(pid=129952) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:725}} Jan 22 21:17:17.134766 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-b0bebaa0-fd81-4508-96f3-b86667e5b2aa tempest-TaggedBootDevicesTest-807480544 None] cloning 'volume-f39c1078-cff4-40dd-93df-4ce49cd873b4@volume-fe1f8ef9-19a5-4687-8faf-0666021816d4.clone_snap' to 'volume-fe1f8ef9-19a5-4687-8faf-0666021816d4' {{(pid=129952) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:731}} Jan 22 21:17:17.482067 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.quota [None req-d406d785-f401-4a2f-a1d3-c863d8b7a9fa tempest-TaggedBootDevicesTest_v242-884103753 None] Created reservations ['bb5dd6fe-5ba8-4c6a-b852-dd751f57522e', '1af02c9d-fcf7-4dc7-9aec-3d34bda32bef', 'a9030a6d-3096-444b-89df-b4f898dfd26b', '19954425-2564-494b-9a20-e5152053f292'] {{(pid=129952) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 22 21:17:17.739532 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-d406d785-f401-4a2f-a1d3-c863d8b7a9fa tempest-TaggedBootDevicesTest_v242-884103753 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:17:17.801247 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-d406d785-f401-4a2f-a1d3-c863d8b7a9fa tempest-TaggedBootDevicesTest_v242-884103753 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:17:17.929246 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.manager [None req-d406d785-f401-4a2f-a1d3-c863d8b7a9fa tempest-TaggedBootDevicesTest_v242-884103753 None] Notifying Schedulers of capabilities ... {{(pid=129952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 22 21:17:17.934630 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-d406d785-f401-4a2f-a1d3-c863d8b7a9fa tempest-TaggedBootDevicesTest_v242-884103753 None] Deleted volume successfully. Jan 22 21:17:18.012508 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.coordination [None req-d406d785-f401-4a2f-a1d3-c863d8b7a9fa tempest-TaggedBootDevicesTest_v242-884103753 None] Lock "b'cinder-fdf5d208-3baf-45d3-9815-e2f0994a442c-delete_volume'" released by "delete_volume" :: held 14.081s {{(pid=129952) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 22 21:17:18.602336 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.coordination [None req-fc31e02b-431c-42c8-bfd4-92fc4e9616fa tempest-TaggedBootDevicesTest_v242-884103753 None] Lock "b'cinder-7ef1c996-ac87-48c1-a8c2-c58eed7d1c14-delete_volume'" acquired by "delete_volume" :: waited 0.011s {{(pid=129952) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 22 21:17:18.755524 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-fc31e02b-431c-42c8-bfd4-92fc4e9616fa tempest-TaggedBootDevicesTest_v242-884103753 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:17:19.065783 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-fc31e02b-431c-42c8-bfd4-92fc4e9616fa tempest-TaggedBootDevicesTest_v242-884103753 None] volume has no backup snaps {{(pid=129952) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Jan 22 21:17:19.066216 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-fc31e02b-431c-42c8-bfd4-92fc4e9616fa tempest-TaggedBootDevicesTest_v242-884103753 None] Volume volume-7ef1c996-ac87-48c1-a8c2-c58eed7d1c14 is not a clone. {{(pid=129952) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Jan 22 21:17:19.385403 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-fc31e02b-431c-42c8-bfd4-92fc4e9616fa tempest-TaggedBootDevicesTest_v242-884103753 None] deleting rbd volume volume-7ef1c996-ac87-48c1-a8c2-c58eed7d1c14 {{(pid=129952) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Jan 22 21:17:19.809081 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-b0bebaa0-fd81-4508-96f3-b86667e5b2aa tempest-TaggedBootDevicesTest-807480544 None] Volume volume-0b17e2f4-e149-4a4b-b525-3d029be2e6f6.deleted is not a clone. {{(pid=129952) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Jan 22 21:17:19.811094 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-b0bebaa0-fd81-4508-96f3-b86667e5b2aa tempest-TaggedBootDevicesTest-807480544 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129952) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 22 21:17:19.811720 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-b0bebaa0-fd81-4508-96f3-b86667e5b2aa tempest-TaggedBootDevicesTest-807480544 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129952) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 22 21:17:20.647127 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-b0bebaa0-fd81-4508-96f3-b86667e5b2aa tempest-TaggedBootDevicesTest-807480544 None] clone created successfully {{(pid=129952) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:803}} Jan 22 21:17:20.647750 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.volume_utils [None req-b0bebaa0-fd81-4508-96f3-b86667e5b2aa tempest-TaggedBootDevicesTest-807480544 None] Marking volume fe1f8ef9-19a5-4687-8faf-0666021816d4 as bootable. {{(pid=129952) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1178}} Jan 22 21:17:20.715957 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.flows.manager.create_volume [None req-b0bebaa0-fd81-4508-96f3-b86667e5b2aa tempest-TaggedBootDevicesTest-807480544 None] Copying metadata from image 373cb480-3bc4-4821-93e2-442b4e852b80 to fe1f8ef9-19a5-4687-8faf-0666021816d4. {{(pid=129952) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:443}} Jan 22 21:17:20.716519 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.flows.manager.create_volume [None req-b0bebaa0-fd81-4508-96f3-b86667e5b2aa tempest-TaggedBootDevicesTest-807480544 None] Creating volume glance metadata for volume fe1f8ef9-19a5-4687-8faf-0666021816d4 backed by image 373cb480-3bc4-4821-93e2-442b4e852b80 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '373cb480-3bc4-4821-93e2-442b4e852b80', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=129952) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:666}} Jan 22 21:17:20.910095 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-b0bebaa0-fd81-4508-96f3-b86667e5b2aa tempest-TaggedBootDevicesTest-807480544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d119a03-bfac-4372-88a7-3b606ca5582b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fe1f8ef9-19a5-4687-8faf-0666021816d4', 'volume_size': 1, 'image_id': '373cb480-3bc4-4821-93e2-442b4e852b80', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '994e8f6963f04af3be3dbae11a73cdfd', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '373cb480-3bc4-4821-93e2-442b4e852b80', 'created_at': datetime.datetime(2022, 1, 22, 20, 50, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 1, 22, 20, 50, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/373cb480-3bc4-4821-93e2-442b4e852b80/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:17:20.914888 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-b0bebaa0-fd81-4508-96f3-b86667e5b2aa tempest-TaggedBootDevicesTest-807480544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96252917-2b3d-4151-aba8-f4728b174eaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:17:21.013882 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.flows.manager.create_volume [None req-b0bebaa0-fd81-4508-96f3-b86667e5b2aa tempest-TaggedBootDevicesTest-807480544 None] Volume volume-fe1f8ef9-19a5-4687-8faf-0666021816d4 (fe1f8ef9-19a5-4687-8faf-0666021816d4): created successfully Jan 22 21:17:21.022512 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-b0bebaa0-fd81-4508-96f3-b86667e5b2aa tempest-TaggedBootDevicesTest-807480544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96252917-2b3d-4151-aba8-f4728b174eaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:17:21.029251 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-b0bebaa0-fd81-4508-96f3-b86667e5b2aa tempest-TaggedBootDevicesTest-807480544 None] Flow 'volume_create_manager' (39e0087f-ed4a-49d1-a279-a4f47fa75e2d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129952) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 22 21:17:21.075782 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-b0bebaa0-fd81-4508-96f3-b86667e5b2aa tempest-TaggedBootDevicesTest-807480544 None] Created volume successfully. Jan 22 21:17:22.488720 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.flows.manager.create_volume [None req-26c506c1-546b-4a09-a22b-749b94c01a60 tempest-TaggedBootDevicesTest-807480544 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129952) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Jan 22 21:17:22.492758 ncdv-master-1 cinder-volume[129952]: WARNING stevedore.named [None req-26c506c1-546b-4a09-a22b-749b94c01a60 tempest-TaggedBootDevicesTest-807480544 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jan 22 21:17:22.502083 ncdv-master-1 cinder-volume[129952]: WARNING castellan.key_manager [None req-26c506c1-546b-4a09-a22b-749b94c01a60 tempest-TaggedBootDevicesTest-807480544 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 22 21:17:22.518086 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-26c506c1-546b-4a09-a22b-749b94c01a60 tempest-TaggedBootDevicesTest-807480544 None] Flow 'volume_create_manager' (0e18fdb8-42ca-46c1-82fd-3ec9266425bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 22 21:17:22.534172 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-26c506c1-546b-4a09-a22b-749b94c01a60 tempest-TaggedBootDevicesTest-807480544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4fe162f5-026a-4874-83cf-7f777bb100fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:17:22.544304 ncdv-master-1 cinder-volume[129952]: DEBUG oslo_db.sqlalchemy.engines [None req-26c506c1-546b-4a09-a22b-749b94c01a60 tempest-TaggedBootDevicesTest-807480544 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129952) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 22 21:17:22.561491 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-26c506c1-546b-4a09-a22b-749b94c01a60 tempest-TaggedBootDevicesTest-807480544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4fe162f5-026a-4874-83cf-7f777bb100fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-01-22T21:17:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-363694978',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=c8294219-e877-4aee-abe6-451466fa194f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d9480b0ab9b5461c953e555cb140b8f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-01-22T21:17:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-01-22T21:17:22Z,use_quota=True,user_id='a5f940a48ba74abeaca28109a6bf6f69',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6dacb05b-a7ea-4056-85ff-98f0ea5c54eb),volume_type_id=6dacb05b-a7ea-4056-85ff-98f0ea5c54eb)' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:17:22.568519 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-26c506c1-546b-4a09-a22b-749b94c01a60 tempest-TaggedBootDevicesTest-807480544 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd5210a2-0266-4fc7-a481-fcefc8c769d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:17:22.574737 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-26c506c1-546b-4a09-a22b-749b94c01a60 tempest-TaggedBootDevicesTest-807480544 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd5210a2-0266-4fc7-a481-fcefc8c769d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:17:22.582150 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-26c506c1-546b-4a09-a22b-749b94c01a60 tempest-TaggedBootDevicesTest-807480544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ad80a7f-dfa0-48e5-99a9-f064e653c5e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:17:22.586946 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-26c506c1-546b-4a09-a22b-749b94c01a60 tempest-TaggedBootDevicesTest-807480544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ad80a7f-dfa0-48e5-99a9-f064e653c5e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c8294219-e877-4aee-abe6-451466fa194f', 'volume_name': 'volume-c8294219-e877-4aee-abe6-451466fa194f', 'volume_size': 1}' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:17:22.592574 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-26c506c1-546b-4a09-a22b-749b94c01a60 tempest-TaggedBootDevicesTest-807480544 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e57e2e0d-8516-47d0-8b23-5ceb43effb55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:17:22.597859 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-26c506c1-546b-4a09-a22b-749b94c01a60 tempest-TaggedBootDevicesTest-807480544 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e57e2e0d-8516-47d0-8b23-5ceb43effb55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:17:22.605695 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-26c506c1-546b-4a09-a22b-749b94c01a60 tempest-TaggedBootDevicesTest-807480544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d5c55cd-9d17-4768-b655-180fcc564f74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:17:22.607016 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.flows.manager.create_volume [None req-26c506c1-546b-4a09-a22b-749b94c01a60 tempest-TaggedBootDevicesTest-807480544 None] Volume c8294219-e877-4aee-abe6-451466fa194f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c8294219-e877-4aee-abe6-451466fa194f', 'volume_size': 1} Jan 22 21:17:22.607758 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-26c506c1-546b-4a09-a22b-749b94c01a60 tempest-TaggedBootDevicesTest-807480544 None] creating volume 'volume-c8294219-e877-4aee-abe6-451466fa194f' {{(pid=129952) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Jan 22 21:17:22.608962 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-26c506c1-546b-4a09-a22b-749b94c01a60 tempest-TaggedBootDevicesTest-807480544 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:17:23.898502 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-26c506c1-546b-4a09-a22b-749b94c01a60 tempest-TaggedBootDevicesTest-807480544 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129952) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 22 21:17:23.900789 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-26c506c1-546b-4a09-a22b-749b94c01a60 tempest-TaggedBootDevicesTest-807480544 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129952) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 22 21:17:23.912509 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-26c506c1-546b-4a09-a22b-749b94c01a60 tempest-TaggedBootDevicesTest-807480544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d5c55cd-9d17-4768-b655-180fcc564f74) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c8294219-e877-4aee-abe6-451466fa194f', 'volume_size': 1}' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:17:23.923020 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-26c506c1-546b-4a09-a22b-749b94c01a60 tempest-TaggedBootDevicesTest-807480544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8254ec80-6b18-4318-bfa4-ba1387357eb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:17:24.001905 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.flows.manager.create_volume [None req-26c506c1-546b-4a09-a22b-749b94c01a60 tempest-TaggedBootDevicesTest-807480544 None] Volume volume-c8294219-e877-4aee-abe6-451466fa194f (c8294219-e877-4aee-abe6-451466fa194f): created successfully Jan 22 21:17:24.006841 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-26c506c1-546b-4a09-a22b-749b94c01a60 tempest-TaggedBootDevicesTest-807480544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8254ec80-6b18-4318-bfa4-ba1387357eb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:17:24.016857 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-26c506c1-546b-4a09-a22b-749b94c01a60 tempest-TaggedBootDevicesTest-807480544 None] Flow 'volume_create_manager' (0e18fdb8-42ca-46c1-82fd-3ec9266425bf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129952) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 22 21:17:24.095847 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-26c506c1-546b-4a09-a22b-749b94c01a60 tempest-TaggedBootDevicesTest-807480544 None] Created volume successfully. Jan 22 21:17:25.403667 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.flows.manager.create_volume [None req-253b0a85-62e1-44a8-abb9-d13b42137dd5 tempest-TaggedBootDevicesTest-807480544 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129952) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Jan 22 21:17:25.409328 ncdv-master-1 cinder-volume[129952]: WARNING stevedore.named [None req-253b0a85-62e1-44a8-abb9-d13b42137dd5 tempest-TaggedBootDevicesTest-807480544 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jan 22 21:17:25.409798 ncdv-master-1 cinder-volume[129952]: WARNING castellan.key_manager [None req-253b0a85-62e1-44a8-abb9-d13b42137dd5 tempest-TaggedBootDevicesTest-807480544 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 22 21:17:25.457575 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-253b0a85-62e1-44a8-abb9-d13b42137dd5 tempest-TaggedBootDevicesTest-807480544 None] Flow 'volume_create_manager' (47a5c1cc-2d78-45d2-aafe-9e97318de322) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 22 21:17:25.478020 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-253b0a85-62e1-44a8-abb9-d13b42137dd5 tempest-TaggedBootDevicesTest-807480544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cbc0bdb3-f48a-4b6c-9723-f43291dd4034) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:17:25.482432 ncdv-master-1 cinder-volume[129952]: DEBUG oslo_db.sqlalchemy.engines [None req-253b0a85-62e1-44a8-abb9-d13b42137dd5 tempest-TaggedBootDevicesTest-807480544 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129952) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 22 21:17:25.502984 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-253b0a85-62e1-44a8-abb9-d13b42137dd5 tempest-TaggedBootDevicesTest-807480544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cbc0bdb3-f48a-4b6c-9723-f43291dd4034) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-01-22T21:17:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-2086526246',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=0a4a89b1-bfa5-41ab-9b69-2aa9236eafba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d9480b0ab9b5461c953e555cb140b8f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-01-22T21:17:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-01-22T21:17:25Z,use_quota=True,user_id='a5f940a48ba74abeaca28109a6bf6f69',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6dacb05b-a7ea-4056-85ff-98f0ea5c54eb),volume_type_id=6dacb05b-a7ea-4056-85ff-98f0ea5c54eb)' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:17:25.510139 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-253b0a85-62e1-44a8-abb9-d13b42137dd5 tempest-TaggedBootDevicesTest-807480544 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ca71689-b38b-4995-a586-bd18c645a4ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:17:25.515812 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-253b0a85-62e1-44a8-abb9-d13b42137dd5 tempest-TaggedBootDevicesTest-807480544 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ca71689-b38b-4995-a586-bd18c645a4ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:17:25.522431 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-253b0a85-62e1-44a8-abb9-d13b42137dd5 tempest-TaggedBootDevicesTest-807480544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60924cd2-a411-4478-b199-22ddb6434fe5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:17:25.528255 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-253b0a85-62e1-44a8-abb9-d13b42137dd5 tempest-TaggedBootDevicesTest-807480544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60924cd2-a411-4478-b199-22ddb6434fe5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0a4a89b1-bfa5-41ab-9b69-2aa9236eafba', 'volume_name': 'volume-0a4a89b1-bfa5-41ab-9b69-2aa9236eafba', 'volume_size': 1}' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:17:25.534107 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-253b0a85-62e1-44a8-abb9-d13b42137dd5 tempest-TaggedBootDevicesTest-807480544 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c91ff896-fafb-48bc-8360-008e3a9693e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:17:25.539064 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-253b0a85-62e1-44a8-abb9-d13b42137dd5 tempest-TaggedBootDevicesTest-807480544 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c91ff896-fafb-48bc-8360-008e3a9693e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:17:25.545738 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-253b0a85-62e1-44a8-abb9-d13b42137dd5 tempest-TaggedBootDevicesTest-807480544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (408380e0-6a95-4e2c-b416-5408231b95ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:17:25.549824 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.flows.manager.create_volume [None req-253b0a85-62e1-44a8-abb9-d13b42137dd5 tempest-TaggedBootDevicesTest-807480544 None] Volume 0a4a89b1-bfa5-41ab-9b69-2aa9236eafba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0a4a89b1-bfa5-41ab-9b69-2aa9236eafba', 'volume_size': 1} Jan 22 21:17:25.550440 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-253b0a85-62e1-44a8-abb9-d13b42137dd5 tempest-TaggedBootDevicesTest-807480544 None] creating volume 'volume-0a4a89b1-bfa5-41ab-9b69-2aa9236eafba' {{(pid=129952) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Jan 22 21:17:25.552255 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-253b0a85-62e1-44a8-abb9-d13b42137dd5 tempest-TaggedBootDevicesTest-807480544 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:17:27.254138 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-253b0a85-62e1-44a8-abb9-d13b42137dd5 tempest-TaggedBootDevicesTest-807480544 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129952) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 22 21:17:27.255822 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-253b0a85-62e1-44a8-abb9-d13b42137dd5 tempest-TaggedBootDevicesTest-807480544 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129952) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 22 21:17:27.260584 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-253b0a85-62e1-44a8-abb9-d13b42137dd5 tempest-TaggedBootDevicesTest-807480544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (408380e0-6a95-4e2c-b416-5408231b95ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0a4a89b1-bfa5-41ab-9b69-2aa9236eafba', 'volume_size': 1}' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:17:27.270775 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-253b0a85-62e1-44a8-abb9-d13b42137dd5 tempest-TaggedBootDevicesTest-807480544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d059a95-91ee-4546-b92e-907861a26d1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:17:27.358157 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.flows.manager.create_volume [None req-253b0a85-62e1-44a8-abb9-d13b42137dd5 tempest-TaggedBootDevicesTest-807480544 None] Volume volume-0a4a89b1-bfa5-41ab-9b69-2aa9236eafba (0a4a89b1-bfa5-41ab-9b69-2aa9236eafba): created successfully Jan 22 21:17:27.363408 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-253b0a85-62e1-44a8-abb9-d13b42137dd5 tempest-TaggedBootDevicesTest-807480544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d059a95-91ee-4546-b92e-907861a26d1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:17:27.369014 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-253b0a85-62e1-44a8-abb9-d13b42137dd5 tempest-TaggedBootDevicesTest-807480544 None] Flow 'volume_create_manager' (47a5c1cc-2d78-45d2-aafe-9e97318de322) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129952) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 22 21:17:27.458689 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-253b0a85-62e1-44a8-abb9-d13b42137dd5 tempest-TaggedBootDevicesTest-807480544 None] Created volume successfully. Jan 22 21:17:27.550060 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.quota [None req-fc31e02b-431c-42c8-bfd4-92fc4e9616fa tempest-TaggedBootDevicesTest_v242-884103753 None] Created reservations ['8daf275d-ee09-4fd1-892c-9a0c327f2d19', 'ee019a50-888c-4700-9023-72fa7eda9f57', '661824bb-ee58-4588-b7c3-45e6876ec46f', '87385b76-f8c5-4285-ba64-10c44f5f27e2'] {{(pid=129952) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 22 21:17:27.717527 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-fc31e02b-431c-42c8-bfd4-92fc4e9616fa tempest-TaggedBootDevicesTest_v242-884103753 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:17:27.763440 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-fc31e02b-431c-42c8-bfd4-92fc4e9616fa tempest-TaggedBootDevicesTest_v242-884103753 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:17:27.797210 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.manager [None req-fc31e02b-431c-42c8-bfd4-92fc4e9616fa tempest-TaggedBootDevicesTest_v242-884103753 None] Notifying Schedulers of capabilities ... {{(pid=129952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 22 21:17:27.801616 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-fc31e02b-431c-42c8-bfd4-92fc4e9616fa tempest-TaggedBootDevicesTest_v242-884103753 None] Deleted volume successfully. Jan 22 21:17:27.919461 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.coordination [None req-fc31e02b-431c-42c8-bfd4-92fc4e9616fa tempest-TaggedBootDevicesTest_v242-884103753 None] Lock "b'cinder-7ef1c996-ac87-48c1-a8c2-c58eed7d1c14-delete_volume'" released by "delete_volume" :: held 9.320s {{(pid=129952) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 22 21:17:28.580477 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.coordination [None req-e77672ab-6b95-4cef-8c86-4b470ea021b1 tempest-TaggedBootDevicesTest_v242-884103753 None] Lock "b'cinder-7175172a-4e03-45a2-96c6-13d0d8d19ff6-delete_volume'" acquired by "delete_volume" :: waited 0.009s {{(pid=129952) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 22 21:17:28.711205 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-e77672ab-6b95-4cef-8c86-4b470ea021b1 tempest-TaggedBootDevicesTest_v242-884103753 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:17:28.989919 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-e77672ab-6b95-4cef-8c86-4b470ea021b1 tempest-TaggedBootDevicesTest_v242-884103753 None] volume has no backup snaps {{(pid=129952) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Jan 22 21:17:29.248666 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-e77672ab-6b95-4cef-8c86-4b470ea021b1 tempest-TaggedBootDevicesTest_v242-884103753 None] deleting rbd volume volume-7175172a-4e03-45a2-96c6-13d0d8d19ff6 {{(pid=129952) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Jan 22 21:17:37.796327 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-e77672ab-6b95-4cef-8c86-4b470ea021b1 tempest-TaggedBootDevicesTest_v242-884103753 None] volume is a clone so cleaning references {{(pid=129952) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1266}} Jan 22 21:17:38.066269 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-e77672ab-6b95-4cef-8c86-4b470ea021b1 tempest-TaggedBootDevicesTest_v242-884103753 None] deleting parent snapshot volume-7175172a-4e03-45a2-96c6-13d0d8d19ff6.clone_snap {{(pid=129952) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1158}} Jan 22 21:17:42.270003 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.quota [None req-e77672ab-6b95-4cef-8c86-4b470ea021b1 tempest-TaggedBootDevicesTest_v242-884103753 None] Created reservations ['3b84b274-adde-430e-8eab-be8ef5d0a40d', '1ae3477b-4c52-4d56-b30c-838a54539026', '0337255b-c8f7-4fa7-a4df-5cd9335d7366', '02328682-e348-4a86-8509-c042fd51ed3c'] {{(pid=129952) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 22 21:17:42.561495 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-e77672ab-6b95-4cef-8c86-4b470ea021b1 tempest-TaggedBootDevicesTest_v242-884103753 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:17:42.598149 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-e77672ab-6b95-4cef-8c86-4b470ea021b1 tempest-TaggedBootDevicesTest_v242-884103753 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:17:42.640830 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.manager [None req-e77672ab-6b95-4cef-8c86-4b470ea021b1 tempest-TaggedBootDevicesTest_v242-884103753 None] Notifying Schedulers of capabilities ... {{(pid=129952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 22 21:17:42.647231 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-e77672ab-6b95-4cef-8c86-4b470ea021b1 tempest-TaggedBootDevicesTest_v242-884103753 None] Deleted volume successfully. Jan 22 21:17:42.832515 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.coordination [None req-e77672ab-6b95-4cef-8c86-4b470ea021b1 tempest-TaggedBootDevicesTest_v242-884103753 None] Lock "b'cinder-7175172a-4e03-45a2-96c6-13d0d8d19ff6-delete_volume'" released by "delete_volume" :: held 14.250s {{(pid=129952) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 22 21:17:49.357754 ncdv-master-1 cinder-volume[129952]: DEBUG oslo_concurrency.processutils [req-29aae5f5-d137-48dd-ba11-0b8520f3d314 req-4018a945-69a5-49c8-a03c-52ac1fcdc696 tempest-TaggedBootDevicesTest-807480544 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129952) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jan 22 21:17:50.290604 ncdv-master-1 cinder-volume[129952]: DEBUG oslo_concurrency.processutils [req-29aae5f5-d137-48dd-ba11-0b8520f3d314 req-4018a945-69a5-49c8-a03c-52ac1fcdc696 tempest-TaggedBootDevicesTest-807480544 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.932s {{(pid=129952) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jan 22 21:17:50.291732 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [req-29aae5f5-d137-48dd-ba11-0b8520f3d314 req-4018a945-69a5-49c8-a03c-52ac1fcdc696 tempest-TaggedBootDevicesTest-807480544 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-fe1f8ef9-19a5-4687-8faf-0666021816d4', 'hosts': ['10.222.0.100'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'c7ee930a-3b87-450e-91f6-d4eef70cb484', 'volume_id': 'fe1f8ef9-19a5-4687-8faf-0666021816d4', 'discard': True}} {{(pid=129952) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Jan 22 21:17:50.470395 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [req-29aae5f5-d137-48dd-ba11-0b8520f3d314 req-4018a945-69a5-49c8-a03c-52ac1fcdc696 tempest-TaggedBootDevicesTest-807480544 None] Connection info returned from driver {'name': 'volumes/volume-fe1f8ef9-19a5-4687-8faf-0666021816d4', 'hosts': ['10.222.0.100'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'fe1f8ef9-19a5-4687-8faf-0666021816d4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '44c39bcf-48a3-4406-b713-ad7cf0271b08'} {{(pid=129952) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4811}} Jan 22 21:17:50.636139 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [req-29aae5f5-d137-48dd-ba11-0b8520f3d314 req-4018a945-69a5-49c8-a03c-52ac1fcdc696 tempest-TaggedBootDevicesTest-807480544 None] attachment_update completed successfully. Jan 22 21:17:51.342400 ncdv-master-1 cinder-volume[129952]: DEBUG oslo_concurrency.processutils [req-29aae5f5-d137-48dd-ba11-0b8520f3d314 req-3d3946e1-ee30-43f3-936c-567865f6a08f tempest-TaggedBootDevicesTest-807480544 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129952) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jan 22 21:17:52.210335 ncdv-master-1 cinder-volume[129952]: DEBUG oslo_concurrency.processutils [req-29aae5f5-d137-48dd-ba11-0b8520f3d314 req-3d3946e1-ee30-43f3-936c-567865f6a08f tempest-TaggedBootDevicesTest-807480544 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.868s {{(pid=129952) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jan 22 21:17:52.211306 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [req-29aae5f5-d137-48dd-ba11-0b8520f3d314 req-3d3946e1-ee30-43f3-936c-567865f6a08f tempest-TaggedBootDevicesTest-807480544 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-c8294219-e877-4aee-abe6-451466fa194f', 'hosts': ['10.222.0.100'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'c7ee930a-3b87-450e-91f6-d4eef70cb484', 'volume_id': 'c8294219-e877-4aee-abe6-451466fa194f', 'discard': True}} {{(pid=129952) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Jan 22 21:17:52.309163 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [req-29aae5f5-d137-48dd-ba11-0b8520f3d314 req-3d3946e1-ee30-43f3-936c-567865f6a08f tempest-TaggedBootDevicesTest-807480544 None] Connection info returned from driver {'name': 'volumes/volume-c8294219-e877-4aee-abe6-451466fa194f', 'hosts': ['10.222.0.100'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'c8294219-e877-4aee-abe6-451466fa194f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'd9204f3f-fdcf-4737-ae80-1f10f8007757'} {{(pid=129952) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4811}} Jan 22 21:17:52.549393 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [req-29aae5f5-d137-48dd-ba11-0b8520f3d314 req-3d3946e1-ee30-43f3-936c-567865f6a08f tempest-TaggedBootDevicesTest-807480544 None] attachment_update completed successfully. Jan 22 21:17:53.263953 ncdv-master-1 cinder-volume[129952]: DEBUG oslo_concurrency.processutils [req-29aae5f5-d137-48dd-ba11-0b8520f3d314 req-2fcc602d-cbfc-4a1b-8359-b8cdca109466 tempest-TaggedBootDevicesTest-807480544 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129952) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jan 22 21:17:54.103199 ncdv-master-1 cinder-volume[129952]: DEBUG oslo_concurrency.processutils [req-29aae5f5-d137-48dd-ba11-0b8520f3d314 req-2fcc602d-cbfc-4a1b-8359-b8cdca109466 tempest-TaggedBootDevicesTest-807480544 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.839s {{(pid=129952) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jan 22 21:17:54.104010 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [req-29aae5f5-d137-48dd-ba11-0b8520f3d314 req-2fcc602d-cbfc-4a1b-8359-b8cdca109466 tempest-TaggedBootDevicesTest-807480544 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-0a4a89b1-bfa5-41ab-9b69-2aa9236eafba', 'hosts': ['10.222.0.100'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'c7ee930a-3b87-450e-91f6-d4eef70cb484', 'volume_id': '0a4a89b1-bfa5-41ab-9b69-2aa9236eafba', 'discard': True}} {{(pid=129952) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Jan 22 21:17:54.213814 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [req-29aae5f5-d137-48dd-ba11-0b8520f3d314 req-2fcc602d-cbfc-4a1b-8359-b8cdca109466 tempest-TaggedBootDevicesTest-807480544 None] Connection info returned from driver {'name': 'volumes/volume-0a4a89b1-bfa5-41ab-9b69-2aa9236eafba', 'hosts': ['10.222.0.100'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '0a4a89b1-bfa5-41ab-9b69-2aa9236eafba', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'bf46059a-c3df-449e-b06a-329e97a7a79f'} {{(pid=129952) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4811}} Jan 22 21:17:54.387156 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [req-29aae5f5-d137-48dd-ba11-0b8520f3d314 req-2fcc602d-cbfc-4a1b-8359-b8cdca109466 tempest-TaggedBootDevicesTest-807480544 None] attachment_update completed successfully. Jan 22 21:17:59.272801 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [req-0c0fd4f2-b199-4cd9-a205-9ea569286a31 req-19257ce2-314c-4457-9dc2-72deb53f8964 tempest-AttachVolumeShelveTestJSON-1245575078 None] Terminate volume connection completed successfully. Jan 22 21:17:59.276198 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [req-0c0fd4f2-b199-4cd9-a205-9ea569286a31 req-19257ce2-314c-4457-9dc2-72deb53f8964 tempest-AttachVolumeShelveTestJSON-1245575078 None] Deleting attachment c2694f88-e90b-4f17-a4db-0416c6c00921. {{(pid=129952) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4947}} Jan 22 21:18:03.854161 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [req-39d6ea96-4cfd-44a7-a4b9-712bc8f446fe req-65c95941-85f9-4c37-a511-3dd99db2c67f tempest-ServersTestBootFromVolume-1509582670 None] Terminate volume connection completed successfully. Jan 22 21:18:03.855361 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [req-39d6ea96-4cfd-44a7-a4b9-712bc8f446fe req-65c95941-85f9-4c37-a511-3dd99db2c67f tempest-ServersTestBootFromVolume-1509582670 None] Deleting attachment cce443eb-89e9-4064-af67-6109889fd2e9. {{(pid=129952) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4947}} Jan 22 21:18:04.352782 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.coordination [req-39d6ea96-4cfd-44a7-a4b9-712bc8f446fe req-a5eac4c2-7b20-4561-b274-fcfa9d8ff065 tempest-ServersTestBootFromVolume-1509582670 None] Lock "b'cinder-6b81486c-e9f9-4b20-965d-ed0bac18454b-delete_volume'" acquired by "delete_volume" :: waited 0.017s {{(pid=129952) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 22 21:18:04.494297 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [req-39d6ea96-4cfd-44a7-a4b9-712bc8f446fe req-a5eac4c2-7b20-4561-b274-fcfa9d8ff065 tempest-ServersTestBootFromVolume-1509582670 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:18:04.771228 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [req-39d6ea96-4cfd-44a7-a4b9-712bc8f446fe req-a5eac4c2-7b20-4561-b274-fcfa9d8ff065 tempest-ServersTestBootFromVolume-1509582670 None] volume has no backup snaps {{(pid=129952) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Jan 22 21:18:04.977928 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [req-39d6ea96-4cfd-44a7-a4b9-712bc8f446fe req-a5eac4c2-7b20-4561-b274-fcfa9d8ff065 tempest-ServersTestBootFromVolume-1509582670 None] deleting rbd volume volume-6b81486c-e9f9-4b20-965d-ed0bac18454b {{(pid=129952) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Jan 22 21:18:09.702374 ncdv-master-1 cinder-volume[129952]: DEBUG oslo_service.periodic_task [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129952) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jan 22 21:18:09.704700 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:18:09.816918 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:18:09.902206 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.manager [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] Notifying Schedulers of capabilities ... {{(pid=129952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 22 21:18:10.040937 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [req-39d6ea96-4cfd-44a7-a4b9-712bc8f446fe req-a5eac4c2-7b20-4561-b274-fcfa9d8ff065 tempest-ServersTestBootFromVolume-1509582670 None] volume is a clone so cleaning references {{(pid=129952) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1266}} Jan 22 21:18:10.173255 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [req-39d6ea96-4cfd-44a7-a4b9-712bc8f446fe req-a5eac4c2-7b20-4561-b274-fcfa9d8ff065 tempest-ServersTestBootFromVolume-1509582670 None] deleting parent snapshot volume-6b81486c-e9f9-4b20-965d-ed0bac18454b.clone_snap {{(pid=129952) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1158}} Jan 22 21:18:13.759184 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.quota [req-39d6ea96-4cfd-44a7-a4b9-712bc8f446fe req-a5eac4c2-7b20-4561-b274-fcfa9d8ff065 tempest-ServersTestBootFromVolume-1509582670 None] Created reservations ['54aae2ea-4bfc-4dee-9d4e-acb23032a27c', 'c28f0966-b56e-41e1-a07f-2114849ce052', '1d3fa798-9927-4e57-8030-39d08bbd2971', 'e5daf993-565c-43b5-882c-fb40e7912fff'] {{(pid=129952) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 22 21:18:14.000202 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [req-39d6ea96-4cfd-44a7-a4b9-712bc8f446fe req-a5eac4c2-7b20-4561-b274-fcfa9d8ff065 tempest-ServersTestBootFromVolume-1509582670 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:18:14.083158 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [req-39d6ea96-4cfd-44a7-a4b9-712bc8f446fe req-a5eac4c2-7b20-4561-b274-fcfa9d8ff065 tempest-ServersTestBootFromVolume-1509582670 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:18:14.170618 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.manager [req-39d6ea96-4cfd-44a7-a4b9-712bc8f446fe req-a5eac4c2-7b20-4561-b274-fcfa9d8ff065 tempest-ServersTestBootFromVolume-1509582670 None] Notifying Schedulers of capabilities ... {{(pid=129952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 22 21:18:14.175127 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [req-39d6ea96-4cfd-44a7-a4b9-712bc8f446fe req-a5eac4c2-7b20-4561-b274-fcfa9d8ff065 tempest-ServersTestBootFromVolume-1509582670 None] Deleted volume successfully. Jan 22 21:18:14.316121 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.coordination [req-39d6ea96-4cfd-44a7-a4b9-712bc8f446fe req-a5eac4c2-7b20-4561-b274-fcfa9d8ff065 tempest-ServersTestBootFromVolume-1509582670 None] Lock "b'cinder-6b81486c-e9f9-4b20-965d-ed0bac18454b-delete_volume'" released by "delete_volume" :: held 9.969s {{(pid=129952) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 22 21:18:55.025270 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.flows.manager.create_volume [None req-95138119-0706-48f9-aa17-35bce97a537b tempest-AttachVolumeTestJSON-815334161 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129952) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Jan 22 21:18:55.025270 ncdv-master-1 cinder-volume[129952]: WARNING stevedore.named [None req-95138119-0706-48f9-aa17-35bce97a537b tempest-AttachVolumeTestJSON-815334161 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jan 22 21:18:55.025270 ncdv-master-1 cinder-volume[129952]: WARNING castellan.key_manager [None req-95138119-0706-48f9-aa17-35bce97a537b tempest-AttachVolumeTestJSON-815334161 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 22 21:18:55.077564 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-95138119-0706-48f9-aa17-35bce97a537b tempest-AttachVolumeTestJSON-815334161 None] Flow 'volume_create_manager' (e0f6c8b7-4db6-4555-a72d-d1a17d2f3f11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 22 21:18:55.084564 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-95138119-0706-48f9-aa17-35bce97a537b tempest-AttachVolumeTestJSON-815334161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69a5cc6c-9b08-4ba5-93e0-01ba49ae3b2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:18:55.094925 ncdv-master-1 cinder-volume[129952]: DEBUG oslo_db.sqlalchemy.engines [None req-95138119-0706-48f9-aa17-35bce97a537b tempest-AttachVolumeTestJSON-815334161 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129952) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 22 21:18:55.111026 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-95138119-0706-48f9-aa17-35bce97a537b tempest-AttachVolumeTestJSON-815334161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69a5cc6c-9b08-4ba5-93e0-01ba49ae3b2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-01-22T21:18:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1905543994',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=502df3ac-dfa4-4ae0-a658-85716a8e4faf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='25a102ec3753465793d2bd70ee845e09',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-01-22T21:18:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-01-22T21:18:55Z,use_quota=True,user_id='05463958163742cb8907fff532940f11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6dacb05b-a7ea-4056-85ff-98f0ea5c54eb),volume_type_id=6dacb05b-a7ea-4056-85ff-98f0ea5c54eb)' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:18:55.116848 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-95138119-0706-48f9-aa17-35bce97a537b tempest-AttachVolumeTestJSON-815334161 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8fca0b01-8230-4baf-97c7-eb562d1968d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:18:55.122431 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-95138119-0706-48f9-aa17-35bce97a537b tempest-AttachVolumeTestJSON-815334161 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8fca0b01-8230-4baf-97c7-eb562d1968d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:18:55.129733 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-95138119-0706-48f9-aa17-35bce97a537b tempest-AttachVolumeTestJSON-815334161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (791499e8-3574-434d-992c-8e6f4f252f8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:18:55.135176 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-95138119-0706-48f9-aa17-35bce97a537b tempest-AttachVolumeTestJSON-815334161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (791499e8-3574-434d-992c-8e6f4f252f8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '502df3ac-dfa4-4ae0-a658-85716a8e4faf', 'volume_name': 'volume-502df3ac-dfa4-4ae0-a658-85716a8e4faf', 'volume_size': 1}' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:18:55.141333 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-95138119-0706-48f9-aa17-35bce97a537b tempest-AttachVolumeTestJSON-815334161 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61e25f28-2d01-42c0-8147-f1929b55cce4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:18:55.154908 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-95138119-0706-48f9-aa17-35bce97a537b tempest-AttachVolumeTestJSON-815334161 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61e25f28-2d01-42c0-8147-f1929b55cce4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:18:55.163570 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-95138119-0706-48f9-aa17-35bce97a537b tempest-AttachVolumeTestJSON-815334161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (538fb97d-a602-4321-8742-d88dfc0c88ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:18:55.168901 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.flows.manager.create_volume [None req-95138119-0706-48f9-aa17-35bce97a537b tempest-AttachVolumeTestJSON-815334161 None] Volume 502df3ac-dfa4-4ae0-a658-85716a8e4faf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-502df3ac-dfa4-4ae0-a658-85716a8e4faf', 'volume_size': 1} Jan 22 21:18:55.168901 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-95138119-0706-48f9-aa17-35bce97a537b tempest-AttachVolumeTestJSON-815334161 None] creating volume 'volume-502df3ac-dfa4-4ae0-a658-85716a8e4faf' {{(pid=129952) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Jan 22 21:18:55.168901 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-95138119-0706-48f9-aa17-35bce97a537b tempest-AttachVolumeTestJSON-815334161 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:18:55.944768 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-95138119-0706-48f9-aa17-35bce97a537b tempest-AttachVolumeTestJSON-815334161 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129952) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 22 21:18:55.945410 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-95138119-0706-48f9-aa17-35bce97a537b tempest-AttachVolumeTestJSON-815334161 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129952) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 22 21:18:55.949822 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-95138119-0706-48f9-aa17-35bce97a537b tempest-AttachVolumeTestJSON-815334161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (538fb97d-a602-4321-8742-d88dfc0c88ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-502df3ac-dfa4-4ae0-a658-85716a8e4faf', 'volume_size': 1}' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:18:55.960943 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-95138119-0706-48f9-aa17-35bce97a537b tempest-AttachVolumeTestJSON-815334161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (319d23db-dc34-4862-8a26-e85fea8856fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:18:56.073043 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.flows.manager.create_volume [None req-95138119-0706-48f9-aa17-35bce97a537b tempest-AttachVolumeTestJSON-815334161 None] Volume volume-502df3ac-dfa4-4ae0-a658-85716a8e4faf (502df3ac-dfa4-4ae0-a658-85716a8e4faf): created successfully Jan 22 21:18:56.079120 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-95138119-0706-48f9-aa17-35bce97a537b tempest-AttachVolumeTestJSON-815334161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (319d23db-dc34-4862-8a26-e85fea8856fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:18:56.095665 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-95138119-0706-48f9-aa17-35bce97a537b tempest-AttachVolumeTestJSON-815334161 None] Flow 'volume_create_manager' (e0f6c8b7-4db6-4555-a72d-d1a17d2f3f11) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129952) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 22 21:18:56.199583 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-95138119-0706-48f9-aa17-35bce97a537b tempest-AttachVolumeTestJSON-815334161 None] Created volume successfully. Jan 22 21:18:58.475700 ncdv-master-1 cinder-volume[129952]: DEBUG oslo_concurrency.processutils [req-76750aa2-3478-409a-8493-b1b01bad1734 req-8d82b491-a823-48fe-ab7f-1313c4159613 tempest-AttachVolumeTestJSON-815334161 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129952) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jan 22 21:18:59.616726 ncdv-master-1 cinder-volume[129952]: DEBUG oslo_concurrency.processutils [req-76750aa2-3478-409a-8493-b1b01bad1734 req-8d82b491-a823-48fe-ab7f-1313c4159613 tempest-AttachVolumeTestJSON-815334161 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.141s {{(pid=129952) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jan 22 21:18:59.618837 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [req-76750aa2-3478-409a-8493-b1b01bad1734 req-8d82b491-a823-48fe-ab7f-1313c4159613 tempest-AttachVolumeTestJSON-815334161 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-502df3ac-dfa4-4ae0-a658-85716a8e4faf', 'hosts': ['10.222.0.100'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'c7ee930a-3b87-450e-91f6-d4eef70cb484', 'volume_id': '502df3ac-dfa4-4ae0-a658-85716a8e4faf', 'discard': True}} {{(pid=129952) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Jan 22 21:18:59.730925 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [req-76750aa2-3478-409a-8493-b1b01bad1734 req-8d82b491-a823-48fe-ab7f-1313c4159613 tempest-AttachVolumeTestJSON-815334161 None] Connection info returned from driver {'name': 'volumes/volume-502df3ac-dfa4-4ae0-a658-85716a8e4faf', 'hosts': ['10.222.0.100'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '502df3ac-dfa4-4ae0-a658-85716a8e4faf', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'dcfb336f-520c-4a50-8eff-e096330ee01d'} {{(pid=129952) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4811}} Jan 22 21:18:59.931055 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [req-76750aa2-3478-409a-8493-b1b01bad1734 req-8d82b491-a823-48fe-ab7f-1313c4159613 tempest-AttachVolumeTestJSON-815334161 None] attachment_update completed successfully. Jan 22 21:19:04.017842 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.flows.manager.create_volume [None req-484d8896-18e5-437f-9af4-918ea9230c59 tempest-AttachVolumeTestJSON-815334161 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129952) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Jan 22 21:19:04.023556 ncdv-master-1 cinder-volume[129952]: WARNING stevedore.named [None req-484d8896-18e5-437f-9af4-918ea9230c59 tempest-AttachVolumeTestJSON-815334161 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jan 22 21:19:04.024511 ncdv-master-1 cinder-volume[129952]: WARNING castellan.key_manager [None req-484d8896-18e5-437f-9af4-918ea9230c59 tempest-AttachVolumeTestJSON-815334161 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 22 21:19:04.080611 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-484d8896-18e5-437f-9af4-918ea9230c59 tempest-AttachVolumeTestJSON-815334161 None] Flow 'volume_create_manager' (6852f98b-18d1-460a-9aa3-9b948550f582) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 22 21:19:04.099634 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-484d8896-18e5-437f-9af4-918ea9230c59 tempest-AttachVolumeTestJSON-815334161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34e48014-cbad-4b12-a088-c3a8365c2511) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:19:04.116982 ncdv-master-1 cinder-volume[129952]: DEBUG oslo_db.sqlalchemy.engines [None req-484d8896-18e5-437f-9af4-918ea9230c59 tempest-AttachVolumeTestJSON-815334161 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129952) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 22 21:19:04.154270 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-484d8896-18e5-437f-9af4-918ea9230c59 tempest-AttachVolumeTestJSON-815334161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34e48014-cbad-4b12-a088-c3a8365c2511) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-01-22T21:19:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-238776207',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=b4056312-c961-4634-aeac-24ae28be351c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='25a102ec3753465793d2bd70ee845e09',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-01-22T21:19:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-01-22T21:19:04Z,use_quota=True,user_id='05463958163742cb8907fff532940f11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6dacb05b-a7ea-4056-85ff-98f0ea5c54eb),volume_type_id=6dacb05b-a7ea-4056-85ff-98f0ea5c54eb)' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:19:04.172067 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-484d8896-18e5-437f-9af4-918ea9230c59 tempest-AttachVolumeTestJSON-815334161 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5711fe4b-b267-4216-b908-82e41ea7ff4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:19:04.183349 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-484d8896-18e5-437f-9af4-918ea9230c59 tempest-AttachVolumeTestJSON-815334161 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5711fe4b-b267-4216-b908-82e41ea7ff4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:19:04.198879 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-484d8896-18e5-437f-9af4-918ea9230c59 tempest-AttachVolumeTestJSON-815334161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94f28b27-33ae-4e98-b280-b2582bdd87f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:19:04.211414 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-484d8896-18e5-437f-9af4-918ea9230c59 tempest-AttachVolumeTestJSON-815334161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94f28b27-33ae-4e98-b280-b2582bdd87f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b4056312-c961-4634-aeac-24ae28be351c', 'volume_name': 'volume-b4056312-c961-4634-aeac-24ae28be351c', 'volume_size': 1}' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:19:04.233853 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-484d8896-18e5-437f-9af4-918ea9230c59 tempest-AttachVolumeTestJSON-815334161 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7eaa2919-f695-4a72-8516-3701f541c4d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:19:04.239906 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-484d8896-18e5-437f-9af4-918ea9230c59 tempest-AttachVolumeTestJSON-815334161 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7eaa2919-f695-4a72-8516-3701f541c4d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:19:04.245807 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-484d8896-18e5-437f-9af4-918ea9230c59 tempest-AttachVolumeTestJSON-815334161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8498e81-b382-4c6b-ba12-9cf37ba38e9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:19:04.248513 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.flows.manager.create_volume [None req-484d8896-18e5-437f-9af4-918ea9230c59 tempest-AttachVolumeTestJSON-815334161 None] Volume b4056312-c961-4634-aeac-24ae28be351c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b4056312-c961-4634-aeac-24ae28be351c', 'volume_size': 1} Jan 22 21:19:04.249204 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-484d8896-18e5-437f-9af4-918ea9230c59 tempest-AttachVolumeTestJSON-815334161 None] creating volume 'volume-b4056312-c961-4634-aeac-24ae28be351c' {{(pid=129952) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Jan 22 21:19:04.250435 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-484d8896-18e5-437f-9af4-918ea9230c59 tempest-AttachVolumeTestJSON-815334161 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:19:05.002444 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-484d8896-18e5-437f-9af4-918ea9230c59 tempest-AttachVolumeTestJSON-815334161 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129952) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 22 21:19:05.002839 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-484d8896-18e5-437f-9af4-918ea9230c59 tempest-AttachVolumeTestJSON-815334161 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129952) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 22 21:19:05.006638 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-484d8896-18e5-437f-9af4-918ea9230c59 tempest-AttachVolumeTestJSON-815334161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8498e81-b382-4c6b-ba12-9cf37ba38e9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b4056312-c961-4634-aeac-24ae28be351c', 'volume_size': 1}' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:19:05.015583 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-484d8896-18e5-437f-9af4-918ea9230c59 tempest-AttachVolumeTestJSON-815334161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05e714f3-5b5f-49a5-8295-0492587713cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:19:05.103004 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.flows.manager.create_volume [None req-484d8896-18e5-437f-9af4-918ea9230c59 tempest-AttachVolumeTestJSON-815334161 None] Volume volume-b4056312-c961-4634-aeac-24ae28be351c (b4056312-c961-4634-aeac-24ae28be351c): created successfully Jan 22 21:19:05.109484 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-484d8896-18e5-437f-9af4-918ea9230c59 tempest-AttachVolumeTestJSON-815334161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05e714f3-5b5f-49a5-8295-0492587713cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:19:05.134523 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-484d8896-18e5-437f-9af4-918ea9230c59 tempest-AttachVolumeTestJSON-815334161 None] Flow 'volume_create_manager' (6852f98b-18d1-460a-9aa3-9b948550f582) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129952) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 22 21:19:05.307155 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-484d8896-18e5-437f-9af4-918ea9230c59 tempest-AttachVolumeTestJSON-815334161 None] Created volume successfully. Jan 22 21:19:07.488535 ncdv-master-1 cinder-volume[129952]: DEBUG oslo_concurrency.processutils [req-145e5a24-3afc-4b8b-902b-54fac034c745 req-670304a0-f55e-4218-84ee-4067d35c78d6 tempest-AttachVolumeTestJSON-815334161 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129952) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jan 22 21:19:08.466439 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.coordination [None req-fc92739b-5659-4686-8f41-e2363e51833c tempest-DeleteServersTestJSON-1162998405 None] Lock "b'cinder-17dd6a14-8c30-4a4b-8cea-30088ada2948-delete_volume'" acquired by "delete_volume" :: waited 0.024s {{(pid=129952) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 22 21:19:08.635970 ncdv-master-1 cinder-volume[129952]: DEBUG oslo_concurrency.processutils [req-145e5a24-3afc-4b8b-902b-54fac034c745 req-670304a0-f55e-4218-84ee-4067d35c78d6 tempest-AttachVolumeTestJSON-815334161 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.148s {{(pid=129952) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jan 22 21:19:08.637043 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [req-145e5a24-3afc-4b8b-902b-54fac034c745 req-670304a0-f55e-4218-84ee-4067d35c78d6 tempest-AttachVolumeTestJSON-815334161 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-b4056312-c961-4634-aeac-24ae28be351c', 'hosts': ['10.222.0.100'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'c7ee930a-3b87-450e-91f6-d4eef70cb484', 'volume_id': 'b4056312-c961-4634-aeac-24ae28be351c', 'discard': True}} {{(pid=129952) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Jan 22 21:19:08.675018 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-fc92739b-5659-4686-8f41-e2363e51833c tempest-DeleteServersTestJSON-1162998405 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:19:08.939029 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-fc92739b-5659-4686-8f41-e2363e51833c tempest-DeleteServersTestJSON-1162998405 None] volume has no backup snaps {{(pid=129952) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Jan 22 21:19:08.939490 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-fc92739b-5659-4686-8f41-e2363e51833c tempest-DeleteServersTestJSON-1162998405 None] Volume volume-17dd6a14-8c30-4a4b-8cea-30088ada2948 is not a clone. {{(pid=129952) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Jan 22 21:19:09.033861 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-fc92739b-5659-4686-8f41-e2363e51833c tempest-DeleteServersTestJSON-1162998405 None] deleting rbd volume volume-17dd6a14-8c30-4a4b-8cea-30088ada2948 {{(pid=129952) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Jan 22 21:19:09.037675 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [req-145e5a24-3afc-4b8b-902b-54fac034c745 req-670304a0-f55e-4218-84ee-4067d35c78d6 tempest-AttachVolumeTestJSON-815334161 None] Connection info returned from driver {'name': 'volumes/volume-b4056312-c961-4634-aeac-24ae28be351c', 'hosts': ['10.222.0.100'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'b4056312-c961-4634-aeac-24ae28be351c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '61f64766-b0d2-4fd0-bf61-32ba34c1e15b'} {{(pid=129952) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4811}} Jan 22 21:19:09.228731 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [req-145e5a24-3afc-4b8b-902b-54fac034c745 req-670304a0-f55e-4218-84ee-4067d35c78d6 tempest-AttachVolumeTestJSON-815334161 None] attachment_update completed successfully. Jan 22 21:19:09.701372 ncdv-master-1 cinder-volume[129952]: DEBUG oslo_service.periodic_task [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129952) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jan 22 21:19:09.702296 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:19:09.786809 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:19:09.853270 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.manager [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] Notifying Schedulers of capabilities ... {{(pid=129952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 22 21:19:13.853258 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.quota [None req-fc92739b-5659-4686-8f41-e2363e51833c tempest-DeleteServersTestJSON-1162998405 None] Created reservations ['5d4722b9-e491-460c-95d1-ccd13f6be778', 'c83e9ec5-6051-4951-924f-5e2ed43d5b04', 'cde4e5a9-4446-46af-b137-e218a088fb84', '5e2b0f47-f78a-454a-8197-8bf5295c31ba'] {{(pid=129952) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 22 21:19:14.037758 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-fc92739b-5659-4686-8f41-e2363e51833c tempest-DeleteServersTestJSON-1162998405 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:19:14.084861 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-fc92739b-5659-4686-8f41-e2363e51833c tempest-DeleteServersTestJSON-1162998405 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:19:14.139523 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.manager [None req-fc92739b-5659-4686-8f41-e2363e51833c tempest-DeleteServersTestJSON-1162998405 None] Notifying Schedulers of capabilities ... {{(pid=129952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 22 21:19:14.151523 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-fc92739b-5659-4686-8f41-e2363e51833c tempest-DeleteServersTestJSON-1162998405 None] Deleted volume successfully. Jan 22 21:19:14.253379 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.coordination [None req-fc92739b-5659-4686-8f41-e2363e51833c tempest-DeleteServersTestJSON-1162998405 None] Lock "b'cinder-17dd6a14-8c30-4a4b-8cea-30088ada2948-delete_volume'" released by "delete_volume" :: held 5.790s {{(pid=129952) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 22 21:19:14.384179 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [req-108b67ed-b2a5-40ac-977f-06a4a1ea54d7 req-50db1805-5610-4d87-8f5a-8cd41017e206 tempest-AttachVolumeTestJSON-815334161 None] Terminate volume connection completed successfully. Jan 22 21:19:14.384887 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [req-108b67ed-b2a5-40ac-977f-06a4a1ea54d7 req-50db1805-5610-4d87-8f5a-8cd41017e206 tempest-AttachVolumeTestJSON-815334161 None] Deleting attachment dcfb336f-520c-4a50-8eff-e096330ee01d. {{(pid=129952) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4947}} Jan 22 21:19:16.161618 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [req-c1c6f743-2a76-473f-8da2-15c41021d477 req-1ea69c16-12fe-4d40-a6eb-3f2b3c8b235e tempest-AttachVolumeTestJSON-815334161 None] Terminate volume connection completed successfully. Jan 22 21:19:16.162777 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [req-c1c6f743-2a76-473f-8da2-15c41021d477 req-1ea69c16-12fe-4d40-a6eb-3f2b3c8b235e tempest-AttachVolumeTestJSON-815334161 None] Deleting attachment 61f64766-b0d2-4fd0-bf61-32ba34c1e15b. {{(pid=129952) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4947}} Jan 22 21:19:22.059616 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.flows.manager.create_volume [None req-5d2ce412-9fbb-4bcb-9fb2-93e220a91f64 tempest-VolumesTestJSON-1122461044 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129952) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Jan 22 21:19:22.069794 ncdv-master-1 cinder-volume[129952]: WARNING stevedore.named [None req-5d2ce412-9fbb-4bcb-9fb2-93e220a91f64 tempest-VolumesTestJSON-1122461044 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jan 22 21:19:22.070693 ncdv-master-1 cinder-volume[129952]: WARNING castellan.key_manager [None req-5d2ce412-9fbb-4bcb-9fb2-93e220a91f64 tempest-VolumesTestJSON-1122461044 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 22 21:19:22.103967 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-5d2ce412-9fbb-4bcb-9fb2-93e220a91f64 tempest-VolumesTestJSON-1122461044 None] Flow 'volume_create_manager' (6b5c82f8-7e6f-415d-9616-8ea4a9b9e317) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 22 21:19:22.117002 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-5d2ce412-9fbb-4bcb-9fb2-93e220a91f64 tempest-VolumesTestJSON-1122461044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c619a7b8-3baa-4e86-b808-78ea5b2c3388) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:19:22.128436 ncdv-master-1 cinder-volume[129952]: DEBUG oslo_db.sqlalchemy.engines [None req-5d2ce412-9fbb-4bcb-9fb2-93e220a91f64 tempest-VolumesTestJSON-1122461044 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129952) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 22 21:19:22.164824 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-5d2ce412-9fbb-4bcb-9fb2-93e220a91f64 tempest-VolumesTestJSON-1122461044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c619a7b8-3baa-4e86-b808-78ea5b2c3388) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-01-22T21:19:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1732673341',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=67cf73cc-3775-43c7-8d2e-5adf11338c15,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='4101bc3eb08847179125c96310438925',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-01-22T21:19:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-01-22T21:19:22Z,use_quota=True,user_id='0f3df818b3c942fa88a0ed8bd7f39c04',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6dacb05b-a7ea-4056-85ff-98f0ea5c54eb),volume_type_id=6dacb05b-a7ea-4056-85ff-98f0ea5c54eb)' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:19:22.194434 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-5d2ce412-9fbb-4bcb-9fb2-93e220a91f64 tempest-VolumesTestJSON-1122461044 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a003b4d5-01ef-4718-8182-1b4593a1f8fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:19:22.198858 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-5d2ce412-9fbb-4bcb-9fb2-93e220a91f64 tempest-VolumesTestJSON-1122461044 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a003b4d5-01ef-4718-8182-1b4593a1f8fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:19:22.205700 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-5d2ce412-9fbb-4bcb-9fb2-93e220a91f64 tempest-VolumesTestJSON-1122461044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48b82da2-25b7-4dd4-9e90-d22726416124) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:19:22.211298 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-5d2ce412-9fbb-4bcb-9fb2-93e220a91f64 tempest-VolumesTestJSON-1122461044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48b82da2-25b7-4dd4-9e90-d22726416124) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '67cf73cc-3775-43c7-8d2e-5adf11338c15', 'volume_name': 'volume-67cf73cc-3775-43c7-8d2e-5adf11338c15', 'volume_size': 1}' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:19:22.217304 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-5d2ce412-9fbb-4bcb-9fb2-93e220a91f64 tempest-VolumesTestJSON-1122461044 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a348bb1f-66c3-4c68-8f97-4488f0824a21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:19:22.221794 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-5d2ce412-9fbb-4bcb-9fb2-93e220a91f64 tempest-VolumesTestJSON-1122461044 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a348bb1f-66c3-4c68-8f97-4488f0824a21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:19:22.227038 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-5d2ce412-9fbb-4bcb-9fb2-93e220a91f64 tempest-VolumesTestJSON-1122461044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36cd4a5a-f89a-4b06-91cd-87a755cb80ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:19:22.228648 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.flows.manager.create_volume [None req-5d2ce412-9fbb-4bcb-9fb2-93e220a91f64 tempest-VolumesTestJSON-1122461044 None] Volume 67cf73cc-3775-43c7-8d2e-5adf11338c15: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-67cf73cc-3775-43c7-8d2e-5adf11338c15', 'volume_size': 1} Jan 22 21:19:22.229261 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-5d2ce412-9fbb-4bcb-9fb2-93e220a91f64 tempest-VolumesTestJSON-1122461044 None] creating volume 'volume-67cf73cc-3775-43c7-8d2e-5adf11338c15' {{(pid=129952) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Jan 22 21:19:22.230487 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-5d2ce412-9fbb-4bcb-9fb2-93e220a91f64 tempest-VolumesTestJSON-1122461044 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:19:23.087690 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-5d2ce412-9fbb-4bcb-9fb2-93e220a91f64 tempest-VolumesTestJSON-1122461044 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129952) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 22 21:19:23.088418 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-5d2ce412-9fbb-4bcb-9fb2-93e220a91f64 tempest-VolumesTestJSON-1122461044 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129952) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 22 21:19:23.098923 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-5d2ce412-9fbb-4bcb-9fb2-93e220a91f64 tempest-VolumesTestJSON-1122461044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36cd4a5a-f89a-4b06-91cd-87a755cb80ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-67cf73cc-3775-43c7-8d2e-5adf11338c15', 'volume_size': 1}' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:19:23.122186 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-5d2ce412-9fbb-4bcb-9fb2-93e220a91f64 tempest-VolumesTestJSON-1122461044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d2193dc-b45f-46c0-a6ec-b1920fd8624c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:19:23.255549 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.flows.manager.create_volume [None req-5d2ce412-9fbb-4bcb-9fb2-93e220a91f64 tempest-VolumesTestJSON-1122461044 None] Volume volume-67cf73cc-3775-43c7-8d2e-5adf11338c15 (67cf73cc-3775-43c7-8d2e-5adf11338c15): created successfully Jan 22 21:19:23.259909 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-5d2ce412-9fbb-4bcb-9fb2-93e220a91f64 tempest-VolumesTestJSON-1122461044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d2193dc-b45f-46c0-a6ec-b1920fd8624c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:19:23.267091 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-5d2ce412-9fbb-4bcb-9fb2-93e220a91f64 tempest-VolumesTestJSON-1122461044 None] Flow 'volume_create_manager' (6b5c82f8-7e6f-415d-9616-8ea4a9b9e317) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129952) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 22 21:19:23.379359 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-5d2ce412-9fbb-4bcb-9fb2-93e220a91f64 tempest-VolumesTestJSON-1122461044 None] Created volume successfully. Jan 22 21:19:25.627471 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.coordination [None req-1c22b18a-416a-4075-9eb6-f611bb2cdeeb tempest-AttachVolumeTestJSON-815334161 None] Lock "b'cinder-b4056312-c961-4634-aeac-24ae28be351c-delete_volume'" acquired by "delete_volume" :: waited 0.018s {{(pid=129952) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 22 21:19:25.860501 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-1c22b18a-416a-4075-9eb6-f611bb2cdeeb tempest-AttachVolumeTestJSON-815334161 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:19:26.540614 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-1c22b18a-416a-4075-9eb6-f611bb2cdeeb tempest-AttachVolumeTestJSON-815334161 None] volume has no backup snaps {{(pid=129952) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Jan 22 21:19:26.541238 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-1c22b18a-416a-4075-9eb6-f611bb2cdeeb tempest-AttachVolumeTestJSON-815334161 None] Volume volume-b4056312-c961-4634-aeac-24ae28be351c is not a clone. {{(pid=129952) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Jan 22 21:19:26.941555 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-1c22b18a-416a-4075-9eb6-f611bb2cdeeb tempest-AttachVolumeTestJSON-815334161 None] deleting rbd volume volume-b4056312-c961-4634-aeac-24ae28be351c {{(pid=129952) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Jan 22 21:19:26.956497 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.flows.manager.create_volume [None req-d4586572-d201-45a3-9935-d0974c62d2d3 tempest-VolumesTestJSON-1122461044 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129952) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Jan 22 21:19:26.965885 ncdv-master-1 cinder-volume[129952]: WARNING stevedore.named [None req-d4586572-d201-45a3-9935-d0974c62d2d3 tempest-VolumesTestJSON-1122461044 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jan 22 21:19:26.974168 ncdv-master-1 cinder-volume[129952]: WARNING castellan.key_manager [None req-d4586572-d201-45a3-9935-d0974c62d2d3 tempest-VolumesTestJSON-1122461044 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 22 21:19:27.018801 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-d4586572-d201-45a3-9935-d0974c62d2d3 tempest-VolumesTestJSON-1122461044 None] Flow 'volume_create_manager' (5f4b7389-5c47-4f8d-9660-998bb18e6186) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 22 21:19:27.026993 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-d4586572-d201-45a3-9935-d0974c62d2d3 tempest-VolumesTestJSON-1122461044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d75f9ab4-03bb-4482-b3be-4e42651b78dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:19:27.034022 ncdv-master-1 cinder-volume[129952]: DEBUG oslo_db.sqlalchemy.engines [None req-d4586572-d201-45a3-9935-d0974c62d2d3 tempest-VolumesTestJSON-1122461044 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129952) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 22 21:19:27.049854 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-d4586572-d201-45a3-9935-d0974c62d2d3 tempest-VolumesTestJSON-1122461044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d75f9ab4-03bb-4482-b3be-4e42651b78dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-01-22T21:19:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-639623372',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=32a061d7-dc07-4f80-9b18-9d349eb2f208,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='4101bc3eb08847179125c96310438925',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-01-22T21:19:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-01-22T21:19:26Z,use_quota=True,user_id='0f3df818b3c942fa88a0ed8bd7f39c04',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6dacb05b-a7ea-4056-85ff-98f0ea5c54eb),volume_type_id=6dacb05b-a7ea-4056-85ff-98f0ea5c54eb)' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:19:27.055764 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-d4586572-d201-45a3-9935-d0974c62d2d3 tempest-VolumesTestJSON-1122461044 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a08347b-0f87-45c4-a34b-fa215080d63e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:19:27.061742 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-d4586572-d201-45a3-9935-d0974c62d2d3 tempest-VolumesTestJSON-1122461044 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a08347b-0f87-45c4-a34b-fa215080d63e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:19:27.067278 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-d4586572-d201-45a3-9935-d0974c62d2d3 tempest-VolumesTestJSON-1122461044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de53877e-6934-4255-ab6c-c3da6d43a286) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:19:27.071797 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-d4586572-d201-45a3-9935-d0974c62d2d3 tempest-VolumesTestJSON-1122461044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de53877e-6934-4255-ab6c-c3da6d43a286) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '32a061d7-dc07-4f80-9b18-9d349eb2f208', 'volume_name': 'volume-32a061d7-dc07-4f80-9b18-9d349eb2f208', 'volume_size': 1}' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:19:27.079917 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-d4586572-d201-45a3-9935-d0974c62d2d3 tempest-VolumesTestJSON-1122461044 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0a9b07f-5ad5-4787-90f3-e9176251233b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:19:27.091320 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-d4586572-d201-45a3-9935-d0974c62d2d3 tempest-VolumesTestJSON-1122461044 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0a9b07f-5ad5-4787-90f3-e9176251233b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:19:27.095754 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-d4586572-d201-45a3-9935-d0974c62d2d3 tempest-VolumesTestJSON-1122461044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e8c56ce-b1cb-4adf-8523-7b65b6c80bb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:19:27.097133 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.flows.manager.create_volume [None req-d4586572-d201-45a3-9935-d0974c62d2d3 tempest-VolumesTestJSON-1122461044 None] Volume 32a061d7-dc07-4f80-9b18-9d349eb2f208: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-32a061d7-dc07-4f80-9b18-9d349eb2f208', 'volume_size': 1} Jan 22 21:19:27.097731 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-d4586572-d201-45a3-9935-d0974c62d2d3 tempest-VolumesTestJSON-1122461044 None] creating volume 'volume-32a061d7-dc07-4f80-9b18-9d349eb2f208' {{(pid=129952) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Jan 22 21:19:27.098986 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-d4586572-d201-45a3-9935-d0974c62d2d3 tempest-VolumesTestJSON-1122461044 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:19:28.526605 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-d4586572-d201-45a3-9935-d0974c62d2d3 tempest-VolumesTestJSON-1122461044 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129952) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 22 21:19:28.527923 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-d4586572-d201-45a3-9935-d0974c62d2d3 tempest-VolumesTestJSON-1122461044 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129952) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 22 21:19:28.531838 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-d4586572-d201-45a3-9935-d0974c62d2d3 tempest-VolumesTestJSON-1122461044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e8c56ce-b1cb-4adf-8523-7b65b6c80bb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-32a061d7-dc07-4f80-9b18-9d349eb2f208', 'volume_size': 1}' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:19:28.536848 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-d4586572-d201-45a3-9935-d0974c62d2d3 tempest-VolumesTestJSON-1122461044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73180af7-65c1-43e0-8879-00367435a21a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:19:28.724421 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.flows.manager.create_volume [None req-d4586572-d201-45a3-9935-d0974c62d2d3 tempest-VolumesTestJSON-1122461044 None] Volume volume-32a061d7-dc07-4f80-9b18-9d349eb2f208 (32a061d7-dc07-4f80-9b18-9d349eb2f208): created successfully Jan 22 21:19:28.728812 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-d4586572-d201-45a3-9935-d0974c62d2d3 tempest-VolumesTestJSON-1122461044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73180af7-65c1-43e0-8879-00367435a21a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:19:28.738200 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-d4586572-d201-45a3-9935-d0974c62d2d3 tempest-VolumesTestJSON-1122461044 None] Flow 'volume_create_manager' (5f4b7389-5c47-4f8d-9660-998bb18e6186) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129952) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 22 21:19:28.838658 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-d4586572-d201-45a3-9935-d0974c62d2d3 tempest-VolumesTestJSON-1122461044 None] Created volume successfully. Jan 22 21:19:31.476951 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.flows.manager.create_volume [None req-0e45cb6d-a2b7-4194-ba86-01f04acd934f tempest-VolumesTestJSON-1122461044 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129952) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Jan 22 21:19:31.483107 ncdv-master-1 cinder-volume[129952]: WARNING stevedore.named [None req-0e45cb6d-a2b7-4194-ba86-01f04acd934f tempest-VolumesTestJSON-1122461044 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jan 22 21:19:31.483569 ncdv-master-1 cinder-volume[129952]: WARNING castellan.key_manager [None req-0e45cb6d-a2b7-4194-ba86-01f04acd934f tempest-VolumesTestJSON-1122461044 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 22 21:19:31.529853 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-0e45cb6d-a2b7-4194-ba86-01f04acd934f tempest-VolumesTestJSON-1122461044 None] Flow 'volume_create_manager' (442a63ef-9672-44a7-9291-221f4cb99c6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 22 21:19:31.557925 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-0e45cb6d-a2b7-4194-ba86-01f04acd934f tempest-VolumesTestJSON-1122461044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (805b2d89-8197-40bc-972c-74db9f29bd64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:19:31.570682 ncdv-master-1 cinder-volume[129952]: DEBUG oslo_db.sqlalchemy.engines [None req-0e45cb6d-a2b7-4194-ba86-01f04acd934f tempest-VolumesTestJSON-1122461044 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129952) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 22 21:19:31.587395 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-0e45cb6d-a2b7-4194-ba86-01f04acd934f tempest-VolumesTestJSON-1122461044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (805b2d89-8197-40bc-972c-74db9f29bd64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-01-22T21:19:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-119747611',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=1314a309-9a37-47c7-a3bc-ae925af497dd,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='4101bc3eb08847179125c96310438925',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-01-22T21:19:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-01-22T21:19:31Z,use_quota=True,user_id='0f3df818b3c942fa88a0ed8bd7f39c04',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6dacb05b-a7ea-4056-85ff-98f0ea5c54eb),volume_type_id=6dacb05b-a7ea-4056-85ff-98f0ea5c54eb)' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:19:31.595008 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-0e45cb6d-a2b7-4194-ba86-01f04acd934f tempest-VolumesTestJSON-1122461044 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02935186-bd13-4481-a4f0-c980f768396f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:19:31.599961 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-0e45cb6d-a2b7-4194-ba86-01f04acd934f tempest-VolumesTestJSON-1122461044 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02935186-bd13-4481-a4f0-c980f768396f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:19:31.607630 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-0e45cb6d-a2b7-4194-ba86-01f04acd934f tempest-VolumesTestJSON-1122461044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb7db7cf-e26a-4a47-bd2e-64a3ce675109) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:19:31.617067 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-0e45cb6d-a2b7-4194-ba86-01f04acd934f tempest-VolumesTestJSON-1122461044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb7db7cf-e26a-4a47-bd2e-64a3ce675109) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1314a309-9a37-47c7-a3bc-ae925af497dd', 'volume_name': 'volume-1314a309-9a37-47c7-a3bc-ae925af497dd', 'volume_size': 1}' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:19:31.624055 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-0e45cb6d-a2b7-4194-ba86-01f04acd934f tempest-VolumesTestJSON-1122461044 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c3639d6-380b-4843-918c-1d0a119c4811) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:19:31.630261 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-0e45cb6d-a2b7-4194-ba86-01f04acd934f tempest-VolumesTestJSON-1122461044 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c3639d6-380b-4843-918c-1d0a119c4811) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:19:31.639072 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-0e45cb6d-a2b7-4194-ba86-01f04acd934f tempest-VolumesTestJSON-1122461044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e69b825-fdb5-4165-af6e-4c5114dae029) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:19:31.640423 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.flows.manager.create_volume [None req-0e45cb6d-a2b7-4194-ba86-01f04acd934f tempest-VolumesTestJSON-1122461044 None] Volume 1314a309-9a37-47c7-a3bc-ae925af497dd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1314a309-9a37-47c7-a3bc-ae925af497dd', 'volume_size': 1} Jan 22 21:19:31.640818 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-0e45cb6d-a2b7-4194-ba86-01f04acd934f tempest-VolumesTestJSON-1122461044 None] creating volume 'volume-1314a309-9a37-47c7-a3bc-ae925af497dd' {{(pid=129952) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Jan 22 21:19:31.642102 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-0e45cb6d-a2b7-4194-ba86-01f04acd934f tempest-VolumesTestJSON-1122461044 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:19:32.818386 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-0e45cb6d-a2b7-4194-ba86-01f04acd934f tempest-VolumesTestJSON-1122461044 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129952) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 22 21:19:32.819778 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-0e45cb6d-a2b7-4194-ba86-01f04acd934f tempest-VolumesTestJSON-1122461044 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129952) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 22 21:19:32.825331 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-0e45cb6d-a2b7-4194-ba86-01f04acd934f tempest-VolumesTestJSON-1122461044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e69b825-fdb5-4165-af6e-4c5114dae029) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1314a309-9a37-47c7-a3bc-ae925af497dd', 'volume_size': 1}' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:19:32.831364 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-0e45cb6d-a2b7-4194-ba86-01f04acd934f tempest-VolumesTestJSON-1122461044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5801d21-ac12-4cb7-b77e-e9e594ddeea7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:19:32.930088 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.flows.manager.create_volume [None req-0e45cb6d-a2b7-4194-ba86-01f04acd934f tempest-VolumesTestJSON-1122461044 None] Volume volume-1314a309-9a37-47c7-a3bc-ae925af497dd (1314a309-9a37-47c7-a3bc-ae925af497dd): created successfully Jan 22 21:19:32.944474 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-0e45cb6d-a2b7-4194-ba86-01f04acd934f tempest-VolumesTestJSON-1122461044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5801d21-ac12-4cb7-b77e-e9e594ddeea7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:19:32.954243 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-0e45cb6d-a2b7-4194-ba86-01f04acd934f tempest-VolumesTestJSON-1122461044 None] Flow 'volume_create_manager' (442a63ef-9672-44a7-9291-221f4cb99c6d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129952) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 22 21:19:33.121486 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-0e45cb6d-a2b7-4194-ba86-01f04acd934f tempest-VolumesTestJSON-1122461044 None] Created volume successfully. Jan 22 21:19:34.742381 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.coordination [None req-101d256d-0c54-4ff4-bd70-9e45d4904bf1 tempest-VolumesTestJSON-1122461044 None] Lock "b'cinder-1314a309-9a37-47c7-a3bc-ae925af497dd-delete_volume'" acquired by "delete_volume" :: waited 0.013s {{(pid=129952) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 22 21:19:34.891179 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-101d256d-0c54-4ff4-bd70-9e45d4904bf1 tempest-VolumesTestJSON-1122461044 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:19:35.257667 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-101d256d-0c54-4ff4-bd70-9e45d4904bf1 tempest-VolumesTestJSON-1122461044 None] volume has no backup snaps {{(pid=129952) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Jan 22 21:19:35.258097 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-101d256d-0c54-4ff4-bd70-9e45d4904bf1 tempest-VolumesTestJSON-1122461044 None] Volume volume-1314a309-9a37-47c7-a3bc-ae925af497dd is not a clone. {{(pid=129952) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Jan 22 21:19:35.504035 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-101d256d-0c54-4ff4-bd70-9e45d4904bf1 tempest-VolumesTestJSON-1122461044 None] deleting rbd volume volume-1314a309-9a37-47c7-a3bc-ae925af497dd {{(pid=129952) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Jan 22 21:19:35.636599 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.quota [None req-1c22b18a-416a-4075-9eb6-f611bb2cdeeb tempest-AttachVolumeTestJSON-815334161 None] Created reservations ['eb541013-7e19-426a-b143-cc71cb78d3f1', 'b68faa46-0a5b-4768-bb7a-d349efb17c7e', '90c3483c-a26c-4a6a-9c93-8fab75834bcc', 'a29da85f-a028-4f5f-8106-30d3805f40ae'] {{(pid=129952) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 22 21:19:35.912916 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-1c22b18a-416a-4075-9eb6-f611bb2cdeeb tempest-AttachVolumeTestJSON-815334161 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:19:35.937062 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-1c22b18a-416a-4075-9eb6-f611bb2cdeeb tempest-AttachVolumeTestJSON-815334161 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:19:35.965835 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.manager [None req-1c22b18a-416a-4075-9eb6-f611bb2cdeeb tempest-AttachVolumeTestJSON-815334161 None] Notifying Schedulers of capabilities ... {{(pid=129952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 22 21:19:35.970173 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-1c22b18a-416a-4075-9eb6-f611bb2cdeeb tempest-AttachVolumeTestJSON-815334161 None] Deleted volume successfully. Jan 22 21:19:36.081042 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.coordination [None req-1c22b18a-416a-4075-9eb6-f611bb2cdeeb tempest-AttachVolumeTestJSON-815334161 None] Lock "b'cinder-b4056312-c961-4634-aeac-24ae28be351c-delete_volume'" released by "delete_volume" :: held 10.453s {{(pid=129952) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 22 21:19:36.675956 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.coordination [None req-52b3d74e-d7ee-4d89-bfbf-a3abf3fd9fda tempest-AttachVolumeTestJSON-815334161 None] Lock "b'cinder-502df3ac-dfa4-4ae0-a658-85716a8e4faf-delete_volume'" acquired by "delete_volume" :: waited 0.011s {{(pid=129952) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 22 21:19:36.816920 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-52b3d74e-d7ee-4d89-bfbf-a3abf3fd9fda tempest-AttachVolumeTestJSON-815334161 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:19:37.140201 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-52b3d74e-d7ee-4d89-bfbf-a3abf3fd9fda tempest-AttachVolumeTestJSON-815334161 None] volume has no backup snaps {{(pid=129952) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Jan 22 21:19:37.140933 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-52b3d74e-d7ee-4d89-bfbf-a3abf3fd9fda tempest-AttachVolumeTestJSON-815334161 None] Volume volume-502df3ac-dfa4-4ae0-a658-85716a8e4faf is not a clone. {{(pid=129952) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Jan 22 21:19:37.404363 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-52b3d74e-d7ee-4d89-bfbf-a3abf3fd9fda tempest-AttachVolumeTestJSON-815334161 None] deleting rbd volume volume-502df3ac-dfa4-4ae0-a658-85716a8e4faf {{(pid=129952) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Jan 22 21:19:43.693178 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.quota [None req-101d256d-0c54-4ff4-bd70-9e45d4904bf1 tempest-VolumesTestJSON-1122461044 None] Created reservations ['f1065275-8efb-4384-9a05-4ae66edd961b', '220dcb8d-846f-4265-9faa-b52d15dbf5a7', '5521108c-5d75-4616-a85e-b2f6324a3296', '05c7ac46-53e0-4d80-a607-487746c98c38'] {{(pid=129952) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 22 21:19:43.858638 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-101d256d-0c54-4ff4-bd70-9e45d4904bf1 tempest-VolumesTestJSON-1122461044 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:19:43.991940 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-101d256d-0c54-4ff4-bd70-9e45d4904bf1 tempest-VolumesTestJSON-1122461044 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:19:44.067294 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.manager [None req-101d256d-0c54-4ff4-bd70-9e45d4904bf1 tempest-VolumesTestJSON-1122461044 None] Notifying Schedulers of capabilities ... {{(pid=129952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 22 21:19:44.072700 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-101d256d-0c54-4ff4-bd70-9e45d4904bf1 tempest-VolumesTestJSON-1122461044 None] Deleted volume successfully. Jan 22 21:19:44.168538 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.coordination [None req-101d256d-0c54-4ff4-bd70-9e45d4904bf1 tempest-VolumesTestJSON-1122461044 None] Lock "b'cinder-1314a309-9a37-47c7-a3bc-ae925af497dd-delete_volume'" released by "delete_volume" :: held 9.425s {{(pid=129952) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 22 21:19:44.610244 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.coordination [None req-e2606cd6-a9f1-4440-a8d2-0e7f24c597cb tempest-VolumesTestJSON-1122461044 None] Lock "b'cinder-32a061d7-dc07-4f80-9b18-9d349eb2f208-delete_volume'" acquired by "delete_volume" :: waited 0.019s {{(pid=129952) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 22 21:19:44.713252 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-e2606cd6-a9f1-4440-a8d2-0e7f24c597cb tempest-VolumesTestJSON-1122461044 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:19:45.048709 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-e2606cd6-a9f1-4440-a8d2-0e7f24c597cb tempest-VolumesTestJSON-1122461044 None] volume has no backup snaps {{(pid=129952) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Jan 22 21:19:45.050051 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-e2606cd6-a9f1-4440-a8d2-0e7f24c597cb tempest-VolumesTestJSON-1122461044 None] Volume volume-32a061d7-dc07-4f80-9b18-9d349eb2f208 is not a clone. {{(pid=129952) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Jan 22 21:19:45.389075 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-e2606cd6-a9f1-4440-a8d2-0e7f24c597cb tempest-VolumesTestJSON-1122461044 None] deleting rbd volume volume-32a061d7-dc07-4f80-9b18-9d349eb2f208 {{(pid=129952) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Jan 22 21:19:45.523169 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.quota [None req-52b3d74e-d7ee-4d89-bfbf-a3abf3fd9fda tempest-AttachVolumeTestJSON-815334161 None] Created reservations ['526a93d0-81c4-4c35-adc4-92255869252b', 'd5359955-0292-4507-8c35-6d4a4f5ab01a', '353b4ab2-aef8-422b-bbdb-58cdd3d623c3', '15b6997a-1c98-496a-aba6-7bbdc554977e'] {{(pid=129952) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 22 21:19:45.824325 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-52b3d74e-d7ee-4d89-bfbf-a3abf3fd9fda tempest-AttachVolumeTestJSON-815334161 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:19:45.859923 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-52b3d74e-d7ee-4d89-bfbf-a3abf3fd9fda tempest-AttachVolumeTestJSON-815334161 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:19:45.893334 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.manager [None req-52b3d74e-d7ee-4d89-bfbf-a3abf3fd9fda tempest-AttachVolumeTestJSON-815334161 None] Notifying Schedulers of capabilities ... {{(pid=129952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 22 21:19:45.900684 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-52b3d74e-d7ee-4d89-bfbf-a3abf3fd9fda tempest-AttachVolumeTestJSON-815334161 None] Deleted volume successfully. Jan 22 21:19:45.969555 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.coordination [None req-52b3d74e-d7ee-4d89-bfbf-a3abf3fd9fda tempest-AttachVolumeTestJSON-815334161 None] Lock "b'cinder-502df3ac-dfa4-4ae0-a658-85716a8e4faf-delete_volume'" released by "delete_volume" :: held 9.293s {{(pid=129952) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 22 21:19:46.620810 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.coordination [None req-862e36b9-2fce-4da3-8dec-87c5775f9ea9 tempest-AttachVolumeTestJSON-815334161 None] Lock "b'cinder-2b554aa9-05f4-43e4-9e7d-76a8b52309ae-delete_volume'" acquired by "delete_volume" :: waited 0.030s {{(pid=129952) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 22 21:19:46.811837 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-862e36b9-2fce-4da3-8dec-87c5775f9ea9 tempest-AttachVolumeTestJSON-815334161 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:19:47.048705 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-862e36b9-2fce-4da3-8dec-87c5775f9ea9 tempest-AttachVolumeTestJSON-815334161 None] volume has no backup snaps {{(pid=129952) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Jan 22 21:19:47.049390 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-862e36b9-2fce-4da3-8dec-87c5775f9ea9 tempest-AttachVolumeTestJSON-815334161 None] Volume volume-2b554aa9-05f4-43e4-9e7d-76a8b52309ae is not a clone. {{(pid=129952) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Jan 22 21:19:47.278671 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-862e36b9-2fce-4da3-8dec-87c5775f9ea9 tempest-AttachVolumeTestJSON-815334161 None] deleting rbd volume volume-2b554aa9-05f4-43e4-9e7d-76a8b52309ae {{(pid=129952) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Jan 22 21:19:53.528760 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.quota [None req-e2606cd6-a9f1-4440-a8d2-0e7f24c597cb tempest-VolumesTestJSON-1122461044 None] Created reservations ['3926ea63-6e10-45ab-b38a-1049f14c6113', '53f4e20c-8e81-4e95-8747-3c5418d289ce', 'eb6a5f4c-5754-4d09-8551-2524885f317d', '85c20aca-0623-43d9-b122-ee76d6670861'] {{(pid=129952) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 22 21:19:53.715550 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-e2606cd6-a9f1-4440-a8d2-0e7f24c597cb tempest-VolumesTestJSON-1122461044 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:19:53.832824 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-e2606cd6-a9f1-4440-a8d2-0e7f24c597cb tempest-VolumesTestJSON-1122461044 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:19:53.861008 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.manager [None req-e2606cd6-a9f1-4440-a8d2-0e7f24c597cb tempest-VolumesTestJSON-1122461044 None] Notifying Schedulers of capabilities ... {{(pid=129952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 22 21:19:53.867764 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-e2606cd6-a9f1-4440-a8d2-0e7f24c597cb tempest-VolumesTestJSON-1122461044 None] Deleted volume successfully. Jan 22 21:19:53.964830 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.coordination [None req-e2606cd6-a9f1-4440-a8d2-0e7f24c597cb tempest-VolumesTestJSON-1122461044 None] Lock "b'cinder-32a061d7-dc07-4f80-9b18-9d349eb2f208-delete_volume'" released by "delete_volume" :: held 9.355s {{(pid=129952) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 22 21:19:54.401613 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.coordination [None req-d66d2b56-1f78-4788-aa2e-8b40e05226b5 tempest-VolumesTestJSON-1122461044 None] Lock "b'cinder-67cf73cc-3775-43c7-8d2e-5adf11338c15-delete_volume'" acquired by "delete_volume" :: waited 0.023s {{(pid=129952) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 22 21:19:54.509294 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-d66d2b56-1f78-4788-aa2e-8b40e05226b5 tempest-VolumesTestJSON-1122461044 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:19:54.775155 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-d66d2b56-1f78-4788-aa2e-8b40e05226b5 tempest-VolumesTestJSON-1122461044 None] volume has no backup snaps {{(pid=129952) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Jan 22 21:19:54.775737 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-d66d2b56-1f78-4788-aa2e-8b40e05226b5 tempest-VolumesTestJSON-1122461044 None] Volume volume-67cf73cc-3775-43c7-8d2e-5adf11338c15 is not a clone. {{(pid=129952) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Jan 22 21:19:55.040001 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-d66d2b56-1f78-4788-aa2e-8b40e05226b5 tempest-VolumesTestJSON-1122461044 None] deleting rbd volume volume-67cf73cc-3775-43c7-8d2e-5adf11338c15 {{(pid=129952) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Jan 22 21:19:55.245856 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.quota [None req-862e36b9-2fce-4da3-8dec-87c5775f9ea9 tempest-AttachVolumeTestJSON-815334161 None] Created reservations ['37e8e554-5a9f-42e3-af57-6d5ad97e1f14', '821e254f-75c6-4319-8d73-51827189a837', '8749e336-f85d-4ad9-872f-a6804105a8b9', 'be55e412-8650-4b8e-be8a-eef37b86acc8'] {{(pid=129952) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 22 21:19:55.454711 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-862e36b9-2fce-4da3-8dec-87c5775f9ea9 tempest-AttachVolumeTestJSON-815334161 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:19:55.506195 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-862e36b9-2fce-4da3-8dec-87c5775f9ea9 tempest-AttachVolumeTestJSON-815334161 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:19:55.533820 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.manager [None req-862e36b9-2fce-4da3-8dec-87c5775f9ea9 tempest-AttachVolumeTestJSON-815334161 None] Notifying Schedulers of capabilities ... {{(pid=129952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 22 21:19:55.537976 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-862e36b9-2fce-4da3-8dec-87c5775f9ea9 tempest-AttachVolumeTestJSON-815334161 None] Deleted volume successfully. Jan 22 21:19:55.648135 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.coordination [None req-862e36b9-2fce-4da3-8dec-87c5775f9ea9 tempest-AttachVolumeTestJSON-815334161 None] Lock "b'cinder-2b554aa9-05f4-43e4-9e7d-76a8b52309ae-delete_volume'" released by "delete_volume" :: held 9.027s {{(pid=129952) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 22 21:20:02.365671 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.quota [None req-d66d2b56-1f78-4788-aa2e-8b40e05226b5 tempest-VolumesTestJSON-1122461044 None] Created reservations ['56218254-68b1-4ad0-87f9-a064c30e6085', 'c96ac9a1-211a-43c1-91b0-1847f315550b', '34b8d0d9-fc00-491c-81f3-ae7e4f9b7958', 'dab1f897-b3c1-449b-bce9-4802172c611a'] {{(pid=129952) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 22 21:20:02.654720 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-d66d2b56-1f78-4788-aa2e-8b40e05226b5 tempest-VolumesTestJSON-1122461044 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:20:02.821728 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-d66d2b56-1f78-4788-aa2e-8b40e05226b5 tempest-VolumesTestJSON-1122461044 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:20:02.859038 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.manager [None req-d66d2b56-1f78-4788-aa2e-8b40e05226b5 tempest-VolumesTestJSON-1122461044 None] Notifying Schedulers of capabilities ... {{(pid=129952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 22 21:20:02.869495 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-d66d2b56-1f78-4788-aa2e-8b40e05226b5 tempest-VolumesTestJSON-1122461044 None] Deleted volume successfully. Jan 22 21:20:02.991600 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.coordination [None req-d66d2b56-1f78-4788-aa2e-8b40e05226b5 tempest-VolumesTestJSON-1122461044 None] Lock "b'cinder-67cf73cc-3775-43c7-8d2e-5adf11338c15-delete_volume'" released by "delete_volume" :: held 8.587s {{(pid=129952) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 22 21:20:09.699130 ncdv-master-1 cinder-volume[129952]: DEBUG oslo_service.periodic_task [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129952) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jan 22 21:20:09.700776 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:20:09.764572 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:20:09.891815 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.manager [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] Notifying Schedulers of capabilities ... {{(pid=129952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 22 21:21:09.699229 ncdv-master-1 cinder-volume[129952]: DEBUG oslo_service.periodic_task [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129952) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jan 22 21:21:09.699800 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:21:09.772402 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:21:09.819003 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.manager [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] Notifying Schedulers of capabilities ... {{(pid=129952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 22 21:21:30.173981 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.flows.manager.create_volume [None req-cbfcc043-da10-427e-afc7-49f6921cab92 tempest-AttachVolumeShelveTestJSON-1245575078 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129952) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Jan 22 21:21:30.179533 ncdv-master-1 cinder-volume[129952]: WARNING stevedore.named [None req-cbfcc043-da10-427e-afc7-49f6921cab92 tempest-AttachVolumeShelveTestJSON-1245575078 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jan 22 21:21:30.180118 ncdv-master-1 cinder-volume[129952]: WARNING castellan.key_manager [None req-cbfcc043-da10-427e-afc7-49f6921cab92 tempest-AttachVolumeShelveTestJSON-1245575078 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 22 21:21:30.200497 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-cbfcc043-da10-427e-afc7-49f6921cab92 tempest-AttachVolumeShelveTestJSON-1245575078 None] Flow 'volume_create_manager' (1c9e4469-e423-4003-8d76-7df134b44248) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 22 21:21:30.207546 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-cbfcc043-da10-427e-afc7-49f6921cab92 tempest-AttachVolumeShelveTestJSON-1245575078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6b3016e-dcc4-49e2-abf0-1984b883061e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:21:30.215110 ncdv-master-1 cinder-volume[129952]: DEBUG oslo_db.sqlalchemy.engines [None req-cbfcc043-da10-427e-afc7-49f6921cab92 tempest-AttachVolumeShelveTestJSON-1245575078 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129952) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 22 21:21:30.232891 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-cbfcc043-da10-427e-afc7-49f6921cab92 tempest-AttachVolumeShelveTestJSON-1245575078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6b3016e-dcc4-49e2-abf0-1984b883061e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-01-22T21:21:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-851719981',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=bcf9e38f-e4c1-4f42-8baf-0eeb0ff77489,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='76ecd70d0be147b59ffbda6d93f73aa6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-01-22T21:21:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-01-22T21:21:30Z,use_quota=True,user_id='c0be514b27f14d8a9e4fd71b31a6d2e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6dacb05b-a7ea-4056-85ff-98f0ea5c54eb),volume_type_id=6dacb05b-a7ea-4056-85ff-98f0ea5c54eb)' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:21:30.239127 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-cbfcc043-da10-427e-afc7-49f6921cab92 tempest-AttachVolumeShelveTestJSON-1245575078 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c3ac473-28bb-4c8e-9493-2fe34b3766c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:21:30.244661 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-cbfcc043-da10-427e-afc7-49f6921cab92 tempest-AttachVolumeShelveTestJSON-1245575078 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c3ac473-28bb-4c8e-9493-2fe34b3766c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:21:30.250100 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-cbfcc043-da10-427e-afc7-49f6921cab92 tempest-AttachVolumeShelveTestJSON-1245575078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2564da7b-f802-460c-8022-b4062f25b112) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:21:30.254510 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-cbfcc043-da10-427e-afc7-49f6921cab92 tempest-AttachVolumeShelveTestJSON-1245575078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2564da7b-f802-460c-8022-b4062f25b112) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bcf9e38f-e4c1-4f42-8baf-0eeb0ff77489', 'volume_name': 'volume-bcf9e38f-e4c1-4f42-8baf-0eeb0ff77489', 'volume_size': 1}' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:21:30.259876 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-cbfcc043-da10-427e-afc7-49f6921cab92 tempest-AttachVolumeShelveTestJSON-1245575078 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (352c013d-af68-4627-b119-59e0defc50ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:21:30.264046 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-cbfcc043-da10-427e-afc7-49f6921cab92 tempest-AttachVolumeShelveTestJSON-1245575078 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (352c013d-af68-4627-b119-59e0defc50ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:21:30.268919 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-cbfcc043-da10-427e-afc7-49f6921cab92 tempest-AttachVolumeShelveTestJSON-1245575078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1b567c7-cdd6-44d3-87ab-49d7964a7898) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:21:30.270072 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.flows.manager.create_volume [None req-cbfcc043-da10-427e-afc7-49f6921cab92 tempest-AttachVolumeShelveTestJSON-1245575078 None] Volume bcf9e38f-e4c1-4f42-8baf-0eeb0ff77489: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bcf9e38f-e4c1-4f42-8baf-0eeb0ff77489', 'volume_size': 1} Jan 22 21:21:30.270466 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-cbfcc043-da10-427e-afc7-49f6921cab92 tempest-AttachVolumeShelveTestJSON-1245575078 None] creating volume 'volume-bcf9e38f-e4c1-4f42-8baf-0eeb0ff77489' {{(pid=129952) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Jan 22 21:21:30.272348 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-cbfcc043-da10-427e-afc7-49f6921cab92 tempest-AttachVolumeShelveTestJSON-1245575078 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:21:31.189299 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-cbfcc043-da10-427e-afc7-49f6921cab92 tempest-AttachVolumeShelveTestJSON-1245575078 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129952) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 22 21:21:31.190395 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-cbfcc043-da10-427e-afc7-49f6921cab92 tempest-AttachVolumeShelveTestJSON-1245575078 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129952) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 22 21:21:31.195538 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-cbfcc043-da10-427e-afc7-49f6921cab92 tempest-AttachVolumeShelveTestJSON-1245575078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1b567c7-cdd6-44d3-87ab-49d7964a7898) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bcf9e38f-e4c1-4f42-8baf-0eeb0ff77489', 'volume_size': 1}' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:21:31.205011 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-cbfcc043-da10-427e-afc7-49f6921cab92 tempest-AttachVolumeShelveTestJSON-1245575078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54bc75d0-25ce-43f2-a90e-2ee2520c0d82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:21:31.298136 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.flows.manager.create_volume [None req-cbfcc043-da10-427e-afc7-49f6921cab92 tempest-AttachVolumeShelveTestJSON-1245575078 None] Volume volume-bcf9e38f-e4c1-4f42-8baf-0eeb0ff77489 (bcf9e38f-e4c1-4f42-8baf-0eeb0ff77489): created successfully Jan 22 21:21:31.302101 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-cbfcc043-da10-427e-afc7-49f6921cab92 tempest-AttachVolumeShelveTestJSON-1245575078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54bc75d0-25ce-43f2-a90e-2ee2520c0d82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:21:31.309137 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-cbfcc043-da10-427e-afc7-49f6921cab92 tempest-AttachVolumeShelveTestJSON-1245575078 None] Flow 'volume_create_manager' (1c9e4469-e423-4003-8d76-7df134b44248) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129952) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 22 21:21:31.410870 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-cbfcc043-da10-427e-afc7-49f6921cab92 tempest-AttachVolumeShelveTestJSON-1245575078 None] Created volume successfully. Jan 22 21:21:42.510375 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.flows.manager.create_volume [None req-d0ce60b1-1cd2-4eca-840b-787614682a16 tempest-AttachVolumeNegativeTest-1922868514 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129952) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Jan 22 21:21:42.515647 ncdv-master-1 cinder-volume[129952]: WARNING stevedore.named [None req-d0ce60b1-1cd2-4eca-840b-787614682a16 tempest-AttachVolumeNegativeTest-1922868514 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jan 22 21:21:42.516076 ncdv-master-1 cinder-volume[129952]: WARNING castellan.key_manager [None req-d0ce60b1-1cd2-4eca-840b-787614682a16 tempest-AttachVolumeNegativeTest-1922868514 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 22 21:21:42.540854 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-d0ce60b1-1cd2-4eca-840b-787614682a16 tempest-AttachVolumeNegativeTest-1922868514 None] Flow 'volume_create_manager' (16dda971-c1fd-449d-88a3-cccededde435) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 22 21:21:42.556576 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-d0ce60b1-1cd2-4eca-840b-787614682a16 tempest-AttachVolumeNegativeTest-1922868514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (593bcc36-4315-432a-ad34-e2f6e33e6f1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:21:42.575925 ncdv-master-1 cinder-volume[129952]: DEBUG oslo_db.sqlalchemy.engines [None req-d0ce60b1-1cd2-4eca-840b-787614682a16 tempest-AttachVolumeNegativeTest-1922868514 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129952) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 22 21:21:42.620410 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-d0ce60b1-1cd2-4eca-840b-787614682a16 tempest-AttachVolumeNegativeTest-1922868514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (593bcc36-4315-432a-ad34-e2f6e33e6f1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-01-22T21:21:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-803332877',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=60b38738-e71a-4465-8224-7dd4972ee31c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='063a9e2a155241a3bf27e7d1b16d0419',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-01-22T21:21:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-01-22T21:21:42Z,use_quota=True,user_id='b9ea4bd8d1d94d6a8e41b26da41bd6fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6dacb05b-a7ea-4056-85ff-98f0ea5c54eb),volume_type_id=6dacb05b-a7ea-4056-85ff-98f0ea5c54eb)' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:21:42.629416 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-d0ce60b1-1cd2-4eca-840b-787614682a16 tempest-AttachVolumeNegativeTest-1922868514 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be1092c4-bd0d-4102-8e9a-ae4f353c4eb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:21:42.639611 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-d0ce60b1-1cd2-4eca-840b-787614682a16 tempest-AttachVolumeNegativeTest-1922868514 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be1092c4-bd0d-4102-8e9a-ae4f353c4eb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:21:42.650825 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-d0ce60b1-1cd2-4eca-840b-787614682a16 tempest-AttachVolumeNegativeTest-1922868514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81124a1c-f7ce-4ac1-a3f9-193c7629ccc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:21:42.655268 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-d0ce60b1-1cd2-4eca-840b-787614682a16 tempest-AttachVolumeNegativeTest-1922868514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81124a1c-f7ce-4ac1-a3f9-193c7629ccc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '60b38738-e71a-4465-8224-7dd4972ee31c', 'volume_name': 'volume-60b38738-e71a-4465-8224-7dd4972ee31c', 'volume_size': 1}' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:21:42.669882 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-d0ce60b1-1cd2-4eca-840b-787614682a16 tempest-AttachVolumeNegativeTest-1922868514 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0abb7d1b-4baf-4758-9f3e-ef7dc49f22a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:21:42.675376 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-d0ce60b1-1cd2-4eca-840b-787614682a16 tempest-AttachVolumeNegativeTest-1922868514 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0abb7d1b-4baf-4758-9f3e-ef7dc49f22a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:21:42.685201 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-d0ce60b1-1cd2-4eca-840b-787614682a16 tempest-AttachVolumeNegativeTest-1922868514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ba204fd-02a1-40ed-9241-df8587f6915f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:21:42.685201 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.flows.manager.create_volume [None req-d0ce60b1-1cd2-4eca-840b-787614682a16 tempest-AttachVolumeNegativeTest-1922868514 None] Volume 60b38738-e71a-4465-8224-7dd4972ee31c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-60b38738-e71a-4465-8224-7dd4972ee31c', 'volume_size': 1} Jan 22 21:21:42.685201 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-d0ce60b1-1cd2-4eca-840b-787614682a16 tempest-AttachVolumeNegativeTest-1922868514 None] creating volume 'volume-60b38738-e71a-4465-8224-7dd4972ee31c' {{(pid=129952) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Jan 22 21:21:42.685201 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-d0ce60b1-1cd2-4eca-840b-787614682a16 tempest-AttachVolumeNegativeTest-1922868514 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:21:43.706959 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-d0ce60b1-1cd2-4eca-840b-787614682a16 tempest-AttachVolumeNegativeTest-1922868514 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129952) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 22 21:21:43.709612 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-d0ce60b1-1cd2-4eca-840b-787614682a16 tempest-AttachVolumeNegativeTest-1922868514 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129952) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 22 21:21:43.716010 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-d0ce60b1-1cd2-4eca-840b-787614682a16 tempest-AttachVolumeNegativeTest-1922868514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ba204fd-02a1-40ed-9241-df8587f6915f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-60b38738-e71a-4465-8224-7dd4972ee31c', 'volume_size': 1}' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:21:43.722062 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-d0ce60b1-1cd2-4eca-840b-787614682a16 tempest-AttachVolumeNegativeTest-1922868514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ada9d11f-0a7f-4ca7-b40c-138e0f60fe46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:21:43.800745 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.flows.manager.create_volume [None req-d0ce60b1-1cd2-4eca-840b-787614682a16 tempest-AttachVolumeNegativeTest-1922868514 None] Volume volume-60b38738-e71a-4465-8224-7dd4972ee31c (60b38738-e71a-4465-8224-7dd4972ee31c): created successfully Jan 22 21:21:43.814987 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-d0ce60b1-1cd2-4eca-840b-787614682a16 tempest-AttachVolumeNegativeTest-1922868514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ada9d11f-0a7f-4ca7-b40c-138e0f60fe46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:21:43.823865 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-d0ce60b1-1cd2-4eca-840b-787614682a16 tempest-AttachVolumeNegativeTest-1922868514 None] Flow 'volume_create_manager' (16dda971-c1fd-449d-88a3-cccededde435) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129952) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 22 21:21:43.949785 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-d0ce60b1-1cd2-4eca-840b-787614682a16 tempest-AttachVolumeNegativeTest-1922868514 None] Created volume successfully. Jan 22 21:21:45.778508 ncdv-master-1 cinder-volume[129952]: DEBUG oslo_concurrency.processutils [req-480981cf-cd6d-4f3d-a2fd-3525d6c56295 req-370dce54-6f8f-42e2-9035-55bb1ba56259 tempest-AttachVolumeNegativeTest-1922868514 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129952) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jan 22 21:21:46.657616 ncdv-master-1 cinder-volume[129952]: DEBUG oslo_concurrency.processutils [req-480981cf-cd6d-4f3d-a2fd-3525d6c56295 req-370dce54-6f8f-42e2-9035-55bb1ba56259 tempest-AttachVolumeNegativeTest-1922868514 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.879s {{(pid=129952) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jan 22 21:21:46.658823 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [req-480981cf-cd6d-4f3d-a2fd-3525d6c56295 req-370dce54-6f8f-42e2-9035-55bb1ba56259 tempest-AttachVolumeNegativeTest-1922868514 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-60b38738-e71a-4465-8224-7dd4972ee31c', 'hosts': ['10.222.0.100'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'c7ee930a-3b87-450e-91f6-d4eef70cb484', 'volume_id': '60b38738-e71a-4465-8224-7dd4972ee31c', 'discard': True}} {{(pid=129952) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Jan 22 21:21:46.766119 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [req-480981cf-cd6d-4f3d-a2fd-3525d6c56295 req-370dce54-6f8f-42e2-9035-55bb1ba56259 tempest-AttachVolumeNegativeTest-1922868514 None] Connection info returned from driver {'name': 'volumes/volume-60b38738-e71a-4465-8224-7dd4972ee31c', 'hosts': ['10.222.0.100'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '60b38738-e71a-4465-8224-7dd4972ee31c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '9a088840-aba3-4dd1-a532-eaf2c00da056'} {{(pid=129952) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4811}} Jan 22 21:21:46.954991 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [req-480981cf-cd6d-4f3d-a2fd-3525d6c56295 req-370dce54-6f8f-42e2-9035-55bb1ba56259 tempest-AttachVolumeNegativeTest-1922868514 None] attachment_update completed successfully. Jan 22 21:22:09.705101 ncdv-master-1 cinder-volume[129952]: DEBUG oslo_service.periodic_task [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129952) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jan 22 21:22:09.706157 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:22:09.797353 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:22:09.886163 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.manager [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] Notifying Schedulers of capabilities ... {{(pid=129952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 22 21:22:14.669749 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [req-abc8d6b8-6e15-477b-9637-e8562135acf7 req-2f73c0c9-ae07-47c7-ad96-1693a9734831 tempest-AttachVolumeNegativeTest-1922868514 None] Terminate volume connection completed successfully. Jan 22 21:22:14.671276 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [req-abc8d6b8-6e15-477b-9637-e8562135acf7 req-2f73c0c9-ae07-47c7-ad96-1693a9734831 tempest-AttachVolumeNegativeTest-1922868514 None] Deleting attachment 9a088840-aba3-4dd1-a532-eaf2c00da056. {{(pid=129952) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4947}} Jan 22 21:22:27.669957 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [req-88a29350-197f-4c3a-b45f-b61a62bb48ef req-d102fba2-d5e0-49bc-b64a-a03c63a170c3 tempest-AttachVolumeShelveTestJSON-1245575078 None] No connector for attachment ddf8e8cf-0e38-46e2-92b3-57a5ab67a9c4; skipping storage backend terminate_connection call. {{(pid=129952) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:4902}} Jan 22 21:22:27.670574 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [req-88a29350-197f-4c3a-b45f-b61a62bb48ef req-d102fba2-d5e0-49bc-b64a-a03c63a170c3 tempest-AttachVolumeShelveTestJSON-1245575078 None] Deleting attachment ddf8e8cf-0e38-46e2-92b3-57a5ab67a9c4. {{(pid=129952) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4947}} Jan 22 21:22:31.759719 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-a11ddb77-5293-4483-ae13-594cdaeda51a tempest-GroupSnapshotsV319Test-2117095492 None] Group tempest-GroupSnapshotsV319Test-Group-577139301: creating Jan 22 21:22:31.850854 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-a11ddb77-5293-4483-ae13-594cdaeda51a tempest-GroupSnapshotsV319Test-2117095492 None] Group tempest-GroupSnapshotsV319Test-Group-577139301: created successfully Jan 22 21:22:31.879300 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-a11ddb77-5293-4483-ae13-594cdaeda51a tempest-GroupSnapshotsV319Test-2117095492 None] Create group completed successfully. Jan 22 21:22:33.937012 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.flows.manager.create_volume [None req-74ff8383-8030-4d20-a0f8-f592ac5486dc tempest-GroupSnapshotsV319Test-2117095492 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129952) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Jan 22 21:22:33.962812 ncdv-master-1 cinder-volume[129952]: WARNING stevedore.named [None req-74ff8383-8030-4d20-a0f8-f592ac5486dc tempest-GroupSnapshotsV319Test-2117095492 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jan 22 21:22:33.962812 ncdv-master-1 cinder-volume[129952]: WARNING castellan.key_manager [None req-74ff8383-8030-4d20-a0f8-f592ac5486dc tempest-GroupSnapshotsV319Test-2117095492 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 22 21:22:33.987872 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-74ff8383-8030-4d20-a0f8-f592ac5486dc tempest-GroupSnapshotsV319Test-2117095492 None] Flow 'volume_create_manager' (d97941ab-d9fa-4e9b-ade7-c85c4ca2bfc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 22 21:22:34.005634 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-74ff8383-8030-4d20-a0f8-f592ac5486dc tempest-GroupSnapshotsV319Test-2117095492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d515e9a4-c1cf-4702-b60b-b2035fa0236e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:22:34.022459 ncdv-master-1 cinder-volume[129952]: DEBUG oslo_db.sqlalchemy.engines [None req-74ff8383-8030-4d20-a0f8-f592ac5486dc tempest-GroupSnapshotsV319Test-2117095492 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129952) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 22 21:22:34.037969 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-74ff8383-8030-4d20-a0f8-f592ac5486dc tempest-GroupSnapshotsV319Test-2117095492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d515e9a4-c1cf-4702-b60b-b2035fa0236e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-01-22T21:22:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-GroupSnapshotsV319Test-Volume-729710769',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=6f0063a1-5f69-4e8c-8b37-411641b6ae47,host='ncdv-master-1@ceph#ceph',id=4994604c-7196-48c1-97d1-4727507bb0da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f3eaa0f540a341c398fd2226fe395cdb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-01-22T21:22:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-01-22T21:22:34Z,use_quota=True,user_id='3b885051ab404a37a88160d058baf2eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(05119f7f-1149-41fe-94ac-7ce5ce06e911),volume_type_id=05119f7f-1149-41fe-94ac-7ce5ce06e911)' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:22:34.043566 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-74ff8383-8030-4d20-a0f8-f592ac5486dc tempest-GroupSnapshotsV319Test-2117095492 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e115300-2f17-47d3-801c-7eba566f6955) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:22:34.054364 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-74ff8383-8030-4d20-a0f8-f592ac5486dc tempest-GroupSnapshotsV319Test-2117095492 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e115300-2f17-47d3-801c-7eba566f6955) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:22:34.061614 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-74ff8383-8030-4d20-a0f8-f592ac5486dc tempest-GroupSnapshotsV319Test-2117095492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60478a0e-333f-479b-9243-212f4da782f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:22:34.066066 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-74ff8383-8030-4d20-a0f8-f592ac5486dc tempest-GroupSnapshotsV319Test-2117095492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60478a0e-333f-479b-9243-212f4da782f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4994604c-7196-48c1-97d1-4727507bb0da', 'volume_name': 'volume-4994604c-7196-48c1-97d1-4727507bb0da', 'volume_size': 1}' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:22:34.071643 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-74ff8383-8030-4d20-a0f8-f592ac5486dc tempest-GroupSnapshotsV319Test-2117095492 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7c055a0-8865-4787-9d92-98f5dead05ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:22:34.076001 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-74ff8383-8030-4d20-a0f8-f592ac5486dc tempest-GroupSnapshotsV319Test-2117095492 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7c055a0-8865-4787-9d92-98f5dead05ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:22:34.082692 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-74ff8383-8030-4d20-a0f8-f592ac5486dc tempest-GroupSnapshotsV319Test-2117095492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eac71b51-ffac-4ef0-a9a3-a34fd4738126) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:22:34.084106 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.flows.manager.create_volume [None req-74ff8383-8030-4d20-a0f8-f592ac5486dc tempest-GroupSnapshotsV319Test-2117095492 None] Volume 4994604c-7196-48c1-97d1-4727507bb0da: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4994604c-7196-48c1-97d1-4727507bb0da', 'volume_size': 1} Jan 22 21:22:34.084671 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-74ff8383-8030-4d20-a0f8-f592ac5486dc tempest-GroupSnapshotsV319Test-2117095492 None] creating volume 'volume-4994604c-7196-48c1-97d1-4727507bb0da' {{(pid=129952) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Jan 22 21:22:34.085895 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-74ff8383-8030-4d20-a0f8-f592ac5486dc tempest-GroupSnapshotsV319Test-2117095492 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:22:35.207501 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-74ff8383-8030-4d20-a0f8-f592ac5486dc tempest-GroupSnapshotsV319Test-2117095492 None] extra_specs: {} {{(pid=129952) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 22 21:22:35.208310 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-74ff8383-8030-4d20-a0f8-f592ac5486dc tempest-GroupSnapshotsV319Test-2117095492 None] extra_specs: {} {{(pid=129952) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 22 21:22:35.212184 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-74ff8383-8030-4d20-a0f8-f592ac5486dc tempest-GroupSnapshotsV319Test-2117095492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eac71b51-ffac-4ef0-a9a3-a34fd4738126) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4994604c-7196-48c1-97d1-4727507bb0da', 'volume_size': 1}' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:22:35.223523 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-74ff8383-8030-4d20-a0f8-f592ac5486dc tempest-GroupSnapshotsV319Test-2117095492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (632075eb-13ae-49b2-877d-842bd929f422) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:22:35.300833 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.flows.manager.create_volume [None req-74ff8383-8030-4d20-a0f8-f592ac5486dc tempest-GroupSnapshotsV319Test-2117095492 None] Volume volume-4994604c-7196-48c1-97d1-4727507bb0da (4994604c-7196-48c1-97d1-4727507bb0da): created successfully Jan 22 21:22:35.305334 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-74ff8383-8030-4d20-a0f8-f592ac5486dc tempest-GroupSnapshotsV319Test-2117095492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (632075eb-13ae-49b2-877d-842bd929f422) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:22:35.311988 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-74ff8383-8030-4d20-a0f8-f592ac5486dc tempest-GroupSnapshotsV319Test-2117095492 None] Flow 'volume_create_manager' (d97941ab-d9fa-4e9b-ade7-c85c4ca2bfc6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129952) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 22 21:22:35.410068 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-74ff8383-8030-4d20-a0f8-f592ac5486dc tempest-GroupSnapshotsV319Test-2117095492 None] Created volume successfully. Jan 22 21:22:36.590926 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-ea2735a4-cc8e-4bc3-82fb-256bfd8fb0b4 tempest-GroupSnapshotsV319Test-2117095492 None] GroupSnapshot 936dea1f-f0a7-40e7-9b9b-67cdea8722e3: creating. Jan 22 21:22:36.647699 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-ea2735a4-cc8e-4bc3-82fb-256bfd8fb0b4 tempest-GroupSnapshotsV319Test-2117095492 None] Group snapshot 936dea1f-f0a7-40e7-9b9b-67cdea8722e3: creating. {{(pid=129952) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4077}} Jan 22 21:22:36.680885 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-ea2735a4-cc8e-4bc3-82fb-256bfd8fb0b4 tempest-GroupSnapshotsV319Test-2117095492 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:22:40.396176 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.flows.manager.create_volume [None req-5a0d775b-fbde-4d1a-b8be-d0de0064b658 tempest-AttachVolumeNegativeTest-1922868514 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129952) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Jan 22 21:22:40.399784 ncdv-master-1 cinder-volume[129952]: WARNING stevedore.named [None req-5a0d775b-fbde-4d1a-b8be-d0de0064b658 tempest-AttachVolumeNegativeTest-1922868514 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jan 22 21:22:40.400246 ncdv-master-1 cinder-volume[129952]: WARNING castellan.key_manager [None req-5a0d775b-fbde-4d1a-b8be-d0de0064b658 tempest-AttachVolumeNegativeTest-1922868514 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 22 21:22:40.466076 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-5a0d775b-fbde-4d1a-b8be-d0de0064b658 tempest-AttachVolumeNegativeTest-1922868514 None] Flow 'volume_create_manager' (f69ad0b5-ae4f-4df1-b1fd-53cfba4f53a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 22 21:22:40.482161 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-5a0d775b-fbde-4d1a-b8be-d0de0064b658 tempest-AttachVolumeNegativeTest-1922868514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24034e12-cad8-4f50-8210-eadb3bb236ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:22:40.512521 ncdv-master-1 cinder-volume[129952]: DEBUG oslo_db.sqlalchemy.engines [None req-5a0d775b-fbde-4d1a-b8be-d0de0064b658 tempest-AttachVolumeNegativeTest-1922868514 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129952) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 22 21:22:40.558005 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-5a0d775b-fbde-4d1a-b8be-d0de0064b658 tempest-AttachVolumeNegativeTest-1922868514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24034e12-cad8-4f50-8210-eadb3bb236ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-01-22T21:22:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-2091723714',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=62156b55-9cd2-42c5-94d9-6b135ebd45d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='063a9e2a155241a3bf27e7d1b16d0419',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-01-22T21:22:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-01-22T21:22:40Z,use_quota=True,user_id='b9ea4bd8d1d94d6a8e41b26da41bd6fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6dacb05b-a7ea-4056-85ff-98f0ea5c54eb),volume_type_id=6dacb05b-a7ea-4056-85ff-98f0ea5c54eb)' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:22:40.565267 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-5a0d775b-fbde-4d1a-b8be-d0de0064b658 tempest-AttachVolumeNegativeTest-1922868514 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (595cd376-8062-4780-8733-e4f6914bbbf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:22:40.583130 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-5a0d775b-fbde-4d1a-b8be-d0de0064b658 tempest-AttachVolumeNegativeTest-1922868514 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (595cd376-8062-4780-8733-e4f6914bbbf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:22:40.593843 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-5a0d775b-fbde-4d1a-b8be-d0de0064b658 tempest-AttachVolumeNegativeTest-1922868514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95361380-e550-4173-8a70-9e325abcff99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:22:40.607069 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-5a0d775b-fbde-4d1a-b8be-d0de0064b658 tempest-AttachVolumeNegativeTest-1922868514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95361380-e550-4173-8a70-9e325abcff99) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '62156b55-9cd2-42c5-94d9-6b135ebd45d1', 'volume_name': 'volume-62156b55-9cd2-42c5-94d9-6b135ebd45d1', 'volume_size': 1}' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:22:40.615487 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-5a0d775b-fbde-4d1a-b8be-d0de0064b658 tempest-AttachVolumeNegativeTest-1922868514 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95064eb7-fefd-4296-86cd-2cd08405eedf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:22:40.624966 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-5a0d775b-fbde-4d1a-b8be-d0de0064b658 tempest-AttachVolumeNegativeTest-1922868514 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95064eb7-fefd-4296-86cd-2cd08405eedf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:22:40.667399 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-5a0d775b-fbde-4d1a-b8be-d0de0064b658 tempest-AttachVolumeNegativeTest-1922868514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21afb00f-c246-41ff-b649-528722853b6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:22:40.668725 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.flows.manager.create_volume [None req-5a0d775b-fbde-4d1a-b8be-d0de0064b658 tempest-AttachVolumeNegativeTest-1922868514 None] Volume 62156b55-9cd2-42c5-94d9-6b135ebd45d1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-62156b55-9cd2-42c5-94d9-6b135ebd45d1', 'volume_size': 1} Jan 22 21:22:40.669125 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-5a0d775b-fbde-4d1a-b8be-d0de0064b658 tempest-AttachVolumeNegativeTest-1922868514 None] creating volume 'volume-62156b55-9cd2-42c5-94d9-6b135ebd45d1' {{(pid=129952) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Jan 22 21:22:40.675558 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-5a0d775b-fbde-4d1a-b8be-d0de0064b658 tempest-AttachVolumeNegativeTest-1922868514 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:22:41.088329 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-ea2735a4-cc8e-4bc3-82fb-256bfd8fb0b4 tempest-GroupSnapshotsV319Test-2117095492 None] group_snapshot 936dea1f-f0a7-40e7-9b9b-67cdea8722e3: created successfully Jan 22 21:22:41.920123 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-5a0d775b-fbde-4d1a-b8be-d0de0064b658 tempest-AttachVolumeNegativeTest-1922868514 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129952) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 22 21:22:41.920790 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-5a0d775b-fbde-4d1a-b8be-d0de0064b658 tempest-AttachVolumeNegativeTest-1922868514 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129952) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 22 21:22:41.926196 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-5a0d775b-fbde-4d1a-b8be-d0de0064b658 tempest-AttachVolumeNegativeTest-1922868514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21afb00f-c246-41ff-b649-528722853b6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-62156b55-9cd2-42c5-94d9-6b135ebd45d1', 'volume_size': 1}' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:22:41.943349 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-5a0d775b-fbde-4d1a-b8be-d0de0064b658 tempest-AttachVolumeNegativeTest-1922868514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd58c969-67de-41ba-852f-89901435634f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:22:42.038364 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.flows.manager.create_volume [None req-5a0d775b-fbde-4d1a-b8be-d0de0064b658 tempest-AttachVolumeNegativeTest-1922868514 None] Volume volume-62156b55-9cd2-42c5-94d9-6b135ebd45d1 (62156b55-9cd2-42c5-94d9-6b135ebd45d1): created successfully Jan 22 21:22:42.043033 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-5a0d775b-fbde-4d1a-b8be-d0de0064b658 tempest-AttachVolumeNegativeTest-1922868514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd58c969-67de-41ba-852f-89901435634f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:22:42.052066 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-5a0d775b-fbde-4d1a-b8be-d0de0064b658 tempest-AttachVolumeNegativeTest-1922868514 None] Flow 'volume_create_manager' (f69ad0b5-ae4f-4df1-b1fd-53cfba4f53a3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129952) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 22 21:22:42.157536 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-5a0d775b-fbde-4d1a-b8be-d0de0064b658 tempest-AttachVolumeNegativeTest-1922868514 None] Created volume successfully. Jan 22 21:22:43.398952 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-9edc97a8-0a1d-40cc-9826-a6e0e640fc61 tempest-GroupSnapshotsV319Test-2117095492 None] group_snapshot 936dea1f-f0a7-40e7-9b9b-67cdea8722e3: deleting Jan 22 21:22:43.453615 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-9edc97a8-0a1d-40cc-9826-a6e0e640fc61 tempest-GroupSnapshotsV319Test-2117095492 None] group_snapshot 936dea1f-f0a7-40e7-9b9b-67cdea8722e3: deleting {{(pid=129952) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4252}} Jan 22 21:22:43.493427 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-9edc97a8-0a1d-40cc-9826-a6e0e640fc61 tempest-GroupSnapshotsV319Test-2117095492 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:22:43.774102 ncdv-master-1 cinder-volume[129952]: DEBUG oslo_concurrency.processutils [req-8ae7371a-e5d4-48a0-9ac3-3075cc9ab92a req-39368284-a1d5-4449-b34a-d308c137cfc6 tempest-AttachVolumeNegativeTest-1922868514 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129952) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jan 22 21:22:45.046281 ncdv-master-1 cinder-volume[129952]: DEBUG oslo_concurrency.processutils [req-8ae7371a-e5d4-48a0-9ac3-3075cc9ab92a req-39368284-a1d5-4449-b34a-d308c137cfc6 tempest-AttachVolumeNegativeTest-1922868514 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.272s {{(pid=129952) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jan 22 21:22:45.047947 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [req-8ae7371a-e5d4-48a0-9ac3-3075cc9ab92a req-39368284-a1d5-4449-b34a-d308c137cfc6 tempest-AttachVolumeNegativeTest-1922868514 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-62156b55-9cd2-42c5-94d9-6b135ebd45d1', 'hosts': ['10.222.0.100'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'c7ee930a-3b87-450e-91f6-d4eef70cb484', 'volume_id': '62156b55-9cd2-42c5-94d9-6b135ebd45d1', 'discard': True}} {{(pid=129952) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Jan 22 21:22:45.204117 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [req-8ae7371a-e5d4-48a0-9ac3-3075cc9ab92a req-39368284-a1d5-4449-b34a-d308c137cfc6 tempest-AttachVolumeNegativeTest-1922868514 None] Connection info returned from driver {'name': 'volumes/volume-62156b55-9cd2-42c5-94d9-6b135ebd45d1', 'hosts': ['10.222.0.100'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '62156b55-9cd2-42c5-94d9-6b135ebd45d1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '804a99d9-1db8-45e9-b075-cd260ac3db47'} {{(pid=129952) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4811}} Jan 22 21:22:45.422222 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [req-8ae7371a-e5d4-48a0-9ac3-3075cc9ab92a req-39368284-a1d5-4449-b34a-d308c137cfc6 tempest-AttachVolumeNegativeTest-1922868514 None] attachment_update completed successfully. Jan 22 21:22:49.333598 ncdv-master-1 cinder-volume[129952]: WARNING cinder.quota [None req-9edc97a8-0a1d-40cc-9826-a6e0e640fc61 tempest-GroupSnapshotsV319Test-2117095492 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1719612015 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1719612015, it is now deprecated. Please use the default quota class for default quota. Jan 22 21:22:49.333598 ncdv-master-1 cinder-volume[129952]: WARNING cinder.quota [None req-9edc97a8-0a1d-40cc-9826-a6e0e640fc61 tempest-GroupSnapshotsV319Test-2117095492 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-1719612015 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-1719612015, it is now deprecated. Please use the default quota class for default quota. Jan 22 21:22:49.477592 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.quota [None req-9edc97a8-0a1d-40cc-9826-a6e0e640fc61 tempest-GroupSnapshotsV319Test-2117095492 None] Created reservations ['1aee1884-2817-4b31-958c-75395240faae', '113b04b2-8c41-48f9-89f8-5a9e42777997', 'f2b37372-0122-48c8-b07b-9f41f399a98d', '7d62a036-20fa-4bb9-ad8e-a06060f016a0'] {{(pid=129952) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 22 21:22:50.689778 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-9edc97a8-0a1d-40cc-9826-a6e0e640fc61 tempest-GroupSnapshotsV319Test-2117095492 None] group_snapshot 936dea1f-f0a7-40e7-9b9b-67cdea8722e3: deleted successfully Jan 22 21:22:51.539722 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [req-8c58a36f-2517-4c4f-9f84-e1ba9cfb025a req-90ab3f49-52c0-481a-a815-6fd27d2087e5 tempest-AttachVolumeNegativeTest-1922868514 None] Terminate volume connection completed successfully. Jan 22 21:22:51.540847 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [req-8c58a36f-2517-4c4f-9f84-e1ba9cfb025a req-90ab3f49-52c0-481a-a815-6fd27d2087e5 tempest-AttachVolumeNegativeTest-1922868514 None] Deleting attachment 804a99d9-1db8-45e9-b075-cd260ac3db47. {{(pid=129952) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4947}} Jan 22 21:22:51.710399 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-cf5599c8-ea70-4b24-8fe6-000d2f2ff55f tempest-GroupSnapshotsV319Test-2117095492 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:22:52.051198 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-cf5599c8-ea70-4b24-8fe6-000d2f2ff55f tempest-GroupSnapshotsV319Test-2117095492 None] volume has no backup snaps {{(pid=129952) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Jan 22 21:22:52.051651 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-cf5599c8-ea70-4b24-8fe6-000d2f2ff55f tempest-GroupSnapshotsV319Test-2117095492 None] Volume volume-4994604c-7196-48c1-97d1-4727507bb0da is not a clone. {{(pid=129952) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Jan 22 21:22:52.371536 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-cf5599c8-ea70-4b24-8fe6-000d2f2ff55f tempest-GroupSnapshotsV319Test-2117095492 None] deleting rbd volume volume-4994604c-7196-48c1-97d1-4727507bb0da {{(pid=129952) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Jan 22 21:23:01.183709 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.quota [None req-cf5599c8-ea70-4b24-8fe6-000d2f2ff55f tempest-GroupSnapshotsV319Test-2117095492 None] Created reservations ['ccbe850c-a2a2-4ef9-b849-49a47ec76ec0'] {{(pid=129952) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 22 21:23:01.226430 ncdv-master-1 cinder-volume[129952]: WARNING cinder.quota [None req-cf5599c8-ea70-4b24-8fe6-000d2f2ff55f tempest-GroupSnapshotsV319Test-2117095492 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-1719612015 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-1719612015, it is now deprecated. Please use the default quota class for default quota. Jan 22 21:23:01.368781 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.quota [None req-cf5599c8-ea70-4b24-8fe6-000d2f2ff55f tempest-GroupSnapshotsV319Test-2117095492 None] Created reservations ['1e27199a-0930-4a05-a69c-db4908bc3fa3', '3287bc00-927e-4fb5-9824-5dc10c5a9ff6', '758331bb-dc69-4021-8749-2eb99eeb13f3', '25a88ee2-8854-453c-b18c-8bb43c1a98bd'] {{(pid=129952) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 22 21:23:02.028668 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-cf5599c8-ea70-4b24-8fe6-000d2f2ff55f tempest-GroupSnapshotsV319Test-2117095492 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:23:02.083592 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-cf5599c8-ea70-4b24-8fe6-000d2f2ff55f tempest-GroupSnapshotsV319Test-2117095492 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:23:02.196545 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.manager [None req-cf5599c8-ea70-4b24-8fe6-000d2f2ff55f tempest-GroupSnapshotsV319Test-2117095492 None] Notifying Schedulers of capabilities ... {{(pid=129952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 22 21:23:02.226839 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-cf5599c8-ea70-4b24-8fe6-000d2f2ff55f tempest-GroupSnapshotsV319Test-2117095492 None] Delete group completed successfully. Jan 22 21:23:09.704344 ncdv-master-1 cinder-volume[129952]: DEBUG oslo_service.periodic_task [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129952) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jan 22 21:23:09.708713 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:23:09.915200 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:23:09.984406 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.manager [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] Notifying Schedulers of capabilities ... {{(pid=129952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 22 21:23:17.044107 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.flows.manager.create_volume [None req-5950a4f9-76ef-41ec-8f86-6e7167484cbc tempest-AttachVolumeNegativeTest-1922868514 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129952) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Jan 22 21:23:17.058640 ncdv-master-1 cinder-volume[129952]: WARNING stevedore.named [None req-5950a4f9-76ef-41ec-8f86-6e7167484cbc tempest-AttachVolumeNegativeTest-1922868514 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jan 22 21:23:17.059555 ncdv-master-1 cinder-volume[129952]: WARNING castellan.key_manager [None req-5950a4f9-76ef-41ec-8f86-6e7167484cbc tempest-AttachVolumeNegativeTest-1922868514 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 22 21:23:17.118776 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-5950a4f9-76ef-41ec-8f86-6e7167484cbc tempest-AttachVolumeNegativeTest-1922868514 None] Flow 'volume_create_manager' (853dd2a8-12df-407a-9ada-ba72189fcd43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 22 21:23:17.144589 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-5950a4f9-76ef-41ec-8f86-6e7167484cbc tempest-AttachVolumeNegativeTest-1922868514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8247dfc1-e5a0-4fec-a542-575e0cae01ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:23:17.155652 ncdv-master-1 cinder-volume[129952]: DEBUG oslo_db.sqlalchemy.engines [None req-5950a4f9-76ef-41ec-8f86-6e7167484cbc tempest-AttachVolumeNegativeTest-1922868514 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129952) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 22 21:23:17.204725 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-5950a4f9-76ef-41ec-8f86-6e7167484cbc tempest-AttachVolumeNegativeTest-1922868514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8247dfc1-e5a0-4fec-a542-575e0cae01ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-01-22T21:23:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-916779200',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=6d587d96-e985-4ac3-a9ee-c08c47920b9a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='063a9e2a155241a3bf27e7d1b16d0419',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-01-22T21:23:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-01-22T21:23:17Z,use_quota=True,user_id='b9ea4bd8d1d94d6a8e41b26da41bd6fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6dacb05b-a7ea-4056-85ff-98f0ea5c54eb),volume_type_id=6dacb05b-a7ea-4056-85ff-98f0ea5c54eb)' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:23:17.236269 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-5950a4f9-76ef-41ec-8f86-6e7167484cbc tempest-AttachVolumeNegativeTest-1922868514 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd50a7e5-c8ae-438d-a079-e38fe1d676d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:23:17.241424 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-5950a4f9-76ef-41ec-8f86-6e7167484cbc tempest-AttachVolumeNegativeTest-1922868514 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd50a7e5-c8ae-438d-a079-e38fe1d676d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:23:17.262772 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-5950a4f9-76ef-41ec-8f86-6e7167484cbc tempest-AttachVolumeNegativeTest-1922868514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e602b0c0-a085-4ef7-8b8b-68bbf86f8512) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:23:17.278793 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-5950a4f9-76ef-41ec-8f86-6e7167484cbc tempest-AttachVolumeNegativeTest-1922868514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e602b0c0-a085-4ef7-8b8b-68bbf86f8512) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6d587d96-e985-4ac3-a9ee-c08c47920b9a', 'volume_name': 'volume-6d587d96-e985-4ac3-a9ee-c08c47920b9a', 'volume_size': 1}' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:23:17.290933 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-5950a4f9-76ef-41ec-8f86-6e7167484cbc tempest-AttachVolumeNegativeTest-1922868514 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c03fce17-43b4-499d-baf5-282d6147f1d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:23:17.295207 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-5950a4f9-76ef-41ec-8f86-6e7167484cbc tempest-AttachVolumeNegativeTest-1922868514 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c03fce17-43b4-499d-baf5-282d6147f1d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:23:17.301132 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-5950a4f9-76ef-41ec-8f86-6e7167484cbc tempest-AttachVolumeNegativeTest-1922868514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (904875cb-d9ef-4a2d-9cc4-a0334fa4c78d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:23:17.307132 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.flows.manager.create_volume [None req-5950a4f9-76ef-41ec-8f86-6e7167484cbc tempest-AttachVolumeNegativeTest-1922868514 None] Volume 6d587d96-e985-4ac3-a9ee-c08c47920b9a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6d587d96-e985-4ac3-a9ee-c08c47920b9a', 'volume_size': 1} Jan 22 21:23:17.312547 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-5950a4f9-76ef-41ec-8f86-6e7167484cbc tempest-AttachVolumeNegativeTest-1922868514 None] creating volume 'volume-6d587d96-e985-4ac3-a9ee-c08c47920b9a' {{(pid=129952) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Jan 22 21:23:17.312547 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-5950a4f9-76ef-41ec-8f86-6e7167484cbc tempest-AttachVolumeNegativeTest-1922868514 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:23:18.464799 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-5950a4f9-76ef-41ec-8f86-6e7167484cbc tempest-AttachVolumeNegativeTest-1922868514 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129952) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 22 21:23:18.465445 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-5950a4f9-76ef-41ec-8f86-6e7167484cbc tempest-AttachVolumeNegativeTest-1922868514 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129952) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 22 21:23:18.469375 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-5950a4f9-76ef-41ec-8f86-6e7167484cbc tempest-AttachVolumeNegativeTest-1922868514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (904875cb-d9ef-4a2d-9cc4-a0334fa4c78d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6d587d96-e985-4ac3-a9ee-c08c47920b9a', 'volume_size': 1}' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:23:18.481013 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-5950a4f9-76ef-41ec-8f86-6e7167484cbc tempest-AttachVolumeNegativeTest-1922868514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ee6071c-f9d1-46c3-8ced-cc5631bc0f3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:23:18.618589 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.flows.manager.create_volume [None req-5950a4f9-76ef-41ec-8f86-6e7167484cbc tempest-AttachVolumeNegativeTest-1922868514 None] Volume volume-6d587d96-e985-4ac3-a9ee-c08c47920b9a (6d587d96-e985-4ac3-a9ee-c08c47920b9a): created successfully Jan 22 21:23:18.622596 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-5950a4f9-76ef-41ec-8f86-6e7167484cbc tempest-AttachVolumeNegativeTest-1922868514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ee6071c-f9d1-46c3-8ced-cc5631bc0f3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:23:18.628679 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-5950a4f9-76ef-41ec-8f86-6e7167484cbc tempest-AttachVolumeNegativeTest-1922868514 None] Flow 'volume_create_manager' (853dd2a8-12df-407a-9ada-ba72189fcd43) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129952) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 22 21:23:18.791612 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-5950a4f9-76ef-41ec-8f86-6e7167484cbc tempest-AttachVolumeNegativeTest-1922868514 None] Created volume successfully. Jan 22 21:23:20.506103 ncdv-master-1 cinder-volume[129952]: DEBUG oslo_concurrency.processutils [req-4e9bb7ee-1c4d-4978-a2ac-07283262b341 req-69a8f402-3096-4665-817e-bb0215c5c598 tempest-AttachVolumeNegativeTest-1922868514 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129952) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jan 22 21:23:21.598638 ncdv-master-1 cinder-volume[129952]: DEBUG oslo_concurrency.processutils [req-4e9bb7ee-1c4d-4978-a2ac-07283262b341 req-69a8f402-3096-4665-817e-bb0215c5c598 tempest-AttachVolumeNegativeTest-1922868514 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.092s {{(pid=129952) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jan 22 21:23:21.599698 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [req-4e9bb7ee-1c4d-4978-a2ac-07283262b341 req-69a8f402-3096-4665-817e-bb0215c5c598 tempest-AttachVolumeNegativeTest-1922868514 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-6d587d96-e985-4ac3-a9ee-c08c47920b9a', 'hosts': ['10.222.0.100'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'c7ee930a-3b87-450e-91f6-d4eef70cb484', 'volume_id': '6d587d96-e985-4ac3-a9ee-c08c47920b9a', 'discard': True}} {{(pid=129952) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Jan 22 21:23:21.716457 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [req-4e9bb7ee-1c4d-4978-a2ac-07283262b341 req-69a8f402-3096-4665-817e-bb0215c5c598 tempest-AttachVolumeNegativeTest-1922868514 None] Connection info returned from driver {'name': 'volumes/volume-6d587d96-e985-4ac3-a9ee-c08c47920b9a', 'hosts': ['10.222.0.100'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '6d587d96-e985-4ac3-a9ee-c08c47920b9a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '38d81361-1454-42cb-9ad1-92acef5b9d40'} {{(pid=129952) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4811}} Jan 22 21:23:21.878244 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [req-4e9bb7ee-1c4d-4978-a2ac-07283262b341 req-69a8f402-3096-4665-817e-bb0215c5c598 tempest-AttachVolumeNegativeTest-1922868514 None] attachment_update completed successfully. Jan 22 21:23:23.072571 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.flows.manager.create_volume [None req-7cf6fdac-b969-41a9-a7c5-5b130aecc4e4 tempest-VolumesActionsTest-1017798535 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129952) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Jan 22 21:23:23.076794 ncdv-master-1 cinder-volume[129952]: WARNING stevedore.named [None req-7cf6fdac-b969-41a9-a7c5-5b130aecc4e4 tempest-VolumesActionsTest-1017798535 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jan 22 21:23:23.081335 ncdv-master-1 cinder-volume[129952]: WARNING castellan.key_manager [None req-7cf6fdac-b969-41a9-a7c5-5b130aecc4e4 tempest-VolumesActionsTest-1017798535 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 22 21:23:23.099783 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-7cf6fdac-b969-41a9-a7c5-5b130aecc4e4 tempest-VolumesActionsTest-1017798535 None] Flow 'volume_create_manager' (4e09d0ef-186e-4986-adf7-96dc2feeae28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 22 21:23:23.108323 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-7cf6fdac-b969-41a9-a7c5-5b130aecc4e4 tempest-VolumesActionsTest-1017798535 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (219d578a-5a45-40f0-824e-7d7b64f80e8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:23:23.121040 ncdv-master-1 cinder-volume[129952]: DEBUG oslo_db.sqlalchemy.engines [None req-7cf6fdac-b969-41a9-a7c5-5b130aecc4e4 tempest-VolumesActionsTest-1017798535 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129952) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 22 21:23:23.138582 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-7cf6fdac-b969-41a9-a7c5-5b130aecc4e4 tempest-VolumesActionsTest-1017798535 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (219d578a-5a45-40f0-824e-7d7b64f80e8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-01-22T21:23:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1186083156',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=e5261dfb-ee0e-4e0d-84e7-8798204804b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a97cd2dba7a47729ce29b8973f3bc44',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-01-22T21:23:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-01-22T21:23:23Z,use_quota=True,user_id='bc249e0680014981888b464000ff24fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6dacb05b-a7ea-4056-85ff-98f0ea5c54eb),volume_type_id=6dacb05b-a7ea-4056-85ff-98f0ea5c54eb)' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:23:23.144675 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-7cf6fdac-b969-41a9-a7c5-5b130aecc4e4 tempest-VolumesActionsTest-1017798535 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0cc9813-8f69-4d8a-89a5-911ca8f11b7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:23:23.150636 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-7cf6fdac-b969-41a9-a7c5-5b130aecc4e4 tempest-VolumesActionsTest-1017798535 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0cc9813-8f69-4d8a-89a5-911ca8f11b7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:23:23.157106 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-7cf6fdac-b969-41a9-a7c5-5b130aecc4e4 tempest-VolumesActionsTest-1017798535 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0750644-1112-4aff-8b65-60803297895a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:23:23.161726 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-7cf6fdac-b969-41a9-a7c5-5b130aecc4e4 tempest-VolumesActionsTest-1017798535 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0750644-1112-4aff-8b65-60803297895a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e5261dfb-ee0e-4e0d-84e7-8798204804b9', 'volume_name': 'volume-e5261dfb-ee0e-4e0d-84e7-8798204804b9', 'volume_size': 1}' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:23:23.167097 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-7cf6fdac-b969-41a9-a7c5-5b130aecc4e4 tempest-VolumesActionsTest-1017798535 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f635ab9a-761f-4e0a-94f6-c59a8f7d82df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:23:23.172275 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-7cf6fdac-b969-41a9-a7c5-5b130aecc4e4 tempest-VolumesActionsTest-1017798535 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f635ab9a-761f-4e0a-94f6-c59a8f7d82df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:23:23.177941 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-7cf6fdac-b969-41a9-a7c5-5b130aecc4e4 tempest-VolumesActionsTest-1017798535 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4cd81605-fa2c-4e6b-a543-2b5929f5e451) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:23:23.179432 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.flows.manager.create_volume [None req-7cf6fdac-b969-41a9-a7c5-5b130aecc4e4 tempest-VolumesActionsTest-1017798535 None] Volume e5261dfb-ee0e-4e0d-84e7-8798204804b9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e5261dfb-ee0e-4e0d-84e7-8798204804b9', 'volume_size': 1} Jan 22 21:23:23.180005 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-7cf6fdac-b969-41a9-a7c5-5b130aecc4e4 tempest-VolumesActionsTest-1017798535 None] creating volume 'volume-e5261dfb-ee0e-4e0d-84e7-8798204804b9' {{(pid=129952) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Jan 22 21:23:23.181277 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-7cf6fdac-b969-41a9-a7c5-5b130aecc4e4 tempest-VolumesActionsTest-1017798535 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:23:24.136529 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-7cf6fdac-b969-41a9-a7c5-5b130aecc4e4 tempest-VolumesActionsTest-1017798535 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129952) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 22 21:23:24.137174 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-7cf6fdac-b969-41a9-a7c5-5b130aecc4e4 tempest-VolumesActionsTest-1017798535 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129952) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 22 21:23:24.141000 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-7cf6fdac-b969-41a9-a7c5-5b130aecc4e4 tempest-VolumesActionsTest-1017798535 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4cd81605-fa2c-4e6b-a543-2b5929f5e451) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e5261dfb-ee0e-4e0d-84e7-8798204804b9', 'volume_size': 1}' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:23:24.145900 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-7cf6fdac-b969-41a9-a7c5-5b130aecc4e4 tempest-VolumesActionsTest-1017798535 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c01783b-8d8c-467a-87ef-61b456fc751c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:23:24.246933 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.flows.manager.create_volume [None req-7cf6fdac-b969-41a9-a7c5-5b130aecc4e4 tempest-VolumesActionsTest-1017798535 None] Volume volume-e5261dfb-ee0e-4e0d-84e7-8798204804b9 (e5261dfb-ee0e-4e0d-84e7-8798204804b9): created successfully Jan 22 21:23:24.251236 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-7cf6fdac-b969-41a9-a7c5-5b130aecc4e4 tempest-VolumesActionsTest-1017798535 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c01783b-8d8c-467a-87ef-61b456fc751c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:23:24.257139 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-7cf6fdac-b969-41a9-a7c5-5b130aecc4e4 tempest-VolumesActionsTest-1017798535 None] Flow 'volume_create_manager' (4e09d0ef-186e-4986-adf7-96dc2feeae28) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129952) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 22 21:23:24.396256 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-7cf6fdac-b969-41a9-a7c5-5b130aecc4e4 tempest-VolumesActionsTest-1017798535 None] Created volume successfully. Jan 22 21:23:26.110347 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [req-df82405b-c12a-42b3-af9d-f1f0a1cd2e03 req-f3008de1-4aa4-4e33-b758-1230bf8033ad tempest-AttachVolumeNegativeTest-1922868514 None] Terminate volume connection completed successfully. Jan 22 21:23:26.110957 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [req-df82405b-c12a-42b3-af9d-f1f0a1cd2e03 req-f3008de1-4aa4-4e33-b758-1230bf8033ad tempest-AttachVolumeNegativeTest-1922868514 None] Deleting attachment 38d81361-1454-42cb-9ad1-92acef5b9d40. {{(pid=129952) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4947}} Jan 22 21:23:27.747024 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.coordination [None req-4561dd8d-677d-45b6-8345-c2aa4de25048 tempest-AttachVolumeNegativeTest-1922868514 None] Lock "b'cinder-6d587d96-e985-4ac3-a9ee-c08c47920b9a-delete_volume'" acquired by "delete_volume" :: waited 0.020s {{(pid=129952) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 22 21:23:27.873006 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-4561dd8d-677d-45b6-8345-c2aa4de25048 tempest-AttachVolumeNegativeTest-1922868514 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:23:28.040644 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-4561dd8d-677d-45b6-8345-c2aa4de25048 tempest-AttachVolumeNegativeTest-1922868514 None] volume has no backup snaps {{(pid=129952) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Jan 22 21:23:28.041097 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-4561dd8d-677d-45b6-8345-c2aa4de25048 tempest-AttachVolumeNegativeTest-1922868514 None] Volume volume-6d587d96-e985-4ac3-a9ee-c08c47920b9a is not a clone. {{(pid=129952) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Jan 22 21:23:28.162182 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-4561dd8d-677d-45b6-8345-c2aa4de25048 tempest-AttachVolumeNegativeTest-1922868514 None] deleting rbd volume volume-6d587d96-e985-4ac3-a9ee-c08c47920b9a {{(pid=129952) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Jan 22 21:23:34.846676 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.quota [None req-4561dd8d-677d-45b6-8345-c2aa4de25048 tempest-AttachVolumeNegativeTest-1922868514 None] Created reservations ['d695b372-f6fe-4315-9e47-424cbb0fac06', 'cc51f2e4-6d9d-4f9e-b1ee-c748085ffbcd', '87478c7c-fe34-4be7-92ac-a1ce3fc301a8', 'c0d7b6a8-f9ec-4287-b8c1-f3042d312633'] {{(pid=129952) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 22 21:23:35.096392 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-4561dd8d-677d-45b6-8345-c2aa4de25048 tempest-AttachVolumeNegativeTest-1922868514 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:23:35.164454 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-4561dd8d-677d-45b6-8345-c2aa4de25048 tempest-AttachVolumeNegativeTest-1922868514 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:23:35.239925 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.manager [None req-4561dd8d-677d-45b6-8345-c2aa4de25048 tempest-AttachVolumeNegativeTest-1922868514 None] Notifying Schedulers of capabilities ... {{(pid=129952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 22 21:23:35.252353 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-4561dd8d-677d-45b6-8345-c2aa4de25048 tempest-AttachVolumeNegativeTest-1922868514 None] Deleted volume successfully. Jan 22 21:23:35.353263 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.coordination [None req-4561dd8d-677d-45b6-8345-c2aa4de25048 tempest-AttachVolumeNegativeTest-1922868514 None] Lock "b'cinder-6d587d96-e985-4ac3-a9ee-c08c47920b9a-delete_volume'" released by "delete_volume" :: held 7.606s {{(pid=129952) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 22 21:23:41.953974 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.coordination [None req-7330e48b-b917-456c-b5fd-d2b33ab5a253 tempest-AttachVolumeNegativeTest-1922868514 None] Lock "b'cinder-62156b55-9cd2-42c5-94d9-6b135ebd45d1-delete_volume'" acquired by "delete_volume" :: waited 0.037s {{(pid=129952) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 22 21:23:42.074923 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-7330e48b-b917-456c-b5fd-d2b33ab5a253 tempest-AttachVolumeNegativeTest-1922868514 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:23:42.333251 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-7330e48b-b917-456c-b5fd-d2b33ab5a253 tempest-AttachVolumeNegativeTest-1922868514 None] volume has no backup snaps {{(pid=129952) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Jan 22 21:23:42.333790 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-7330e48b-b917-456c-b5fd-d2b33ab5a253 tempest-AttachVolumeNegativeTest-1922868514 None] Volume volume-62156b55-9cd2-42c5-94d9-6b135ebd45d1 is not a clone. {{(pid=129952) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Jan 22 21:23:42.629436 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-7330e48b-b917-456c-b5fd-d2b33ab5a253 tempest-AttachVolumeNegativeTest-1922868514 None] deleting rbd volume volume-62156b55-9cd2-42c5-94d9-6b135ebd45d1 {{(pid=129952) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Jan 22 21:23:48.069473 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.coordination [None req-3a56cd48-7672-49e1-a6ab-a95ad6563be4 tempest-AttachVolumeShelveTestJSON-1245575078 None] Lock "b'cinder-bcf9e38f-e4c1-4f42-8baf-0eeb0ff77489-delete_volume'" acquired by "delete_volume" :: waited 0.058s {{(pid=129952) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 22 21:23:48.234234 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-3a56cd48-7672-49e1-a6ab-a95ad6563be4 tempest-AttachVolumeShelveTestJSON-1245575078 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:23:48.612203 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-3a56cd48-7672-49e1-a6ab-a95ad6563be4 tempest-AttachVolumeShelveTestJSON-1245575078 None] volume has no backup snaps {{(pid=129952) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Jan 22 21:23:48.615119 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-3a56cd48-7672-49e1-a6ab-a95ad6563be4 tempest-AttachVolumeShelveTestJSON-1245575078 None] Volume volume-bcf9e38f-e4c1-4f42-8baf-0eeb0ff77489 is not a clone. {{(pid=129952) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Jan 22 21:23:48.989301 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-3a56cd48-7672-49e1-a6ab-a95ad6563be4 tempest-AttachVolumeShelveTestJSON-1245575078 None] deleting rbd volume volume-bcf9e38f-e4c1-4f42-8baf-0eeb0ff77489 {{(pid=129952) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Jan 22 21:23:49.008395 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.coordination [None req-55241001-1bb4-4560-9547-b8c0dcd1bd8a tempest-VolumesActionsTest-1017798535 None] Lock "b'cinder-e5261dfb-ee0e-4e0d-84e7-8798204804b9'" acquired by "attach_volume" :: waited 0.014s {{(pid=129952) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 22 21:23:49.304731 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-55241001-1bb4-4560-9547-b8c0dcd1bd8a tempest-VolumesActionsTest-1017798535 None] Attaching volume e5261dfb-ee0e-4e0d-84e7-8798204804b9 to instance d45478b2-2111-4644-a1c1-609e88b42d1c at mountpoint /dev/sdb on host None. Jan 22 21:23:49.420322 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-55241001-1bb4-4560-9547-b8c0dcd1bd8a tempest-VolumesActionsTest-1017798535 None] Attach volume completed successfully. Jan 22 21:23:49.426405 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.coordination [None req-55241001-1bb4-4560-9547-b8c0dcd1bd8a tempest-VolumesActionsTest-1017798535 None] Lock "b'cinder-e5261dfb-ee0e-4e0d-84e7-8798204804b9'" released by "attach_volume" :: held 0.418s {{(pid=129952) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 22 21:23:49.671446 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.coordination [None req-fc4bbd96-5d6e-4e43-bfb7-bd9ccb15b5ea tempest-VolumesActionsTest-1017798535 None] Lock "b'cinder-e5261dfb-ee0e-4e0d-84e7-8798204804b9-detach_volume'" acquired by "detach_volume" :: waited 0.013s {{(pid=129952) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 22 21:23:49.671853 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-fc4bbd96-5d6e-4e43-bfb7-bd9ccb15b5ea tempest-VolumesActionsTest-1017798535 None] Detaching volume e5261dfb-ee0e-4e0d-84e7-8798204804b9 from instance d45478b2-2111-4644-a1c1-609e88b42d1c. Jan 22 21:23:49.901777 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-fc4bbd96-5d6e-4e43-bfb7-bd9ccb15b5ea tempest-VolumesActionsTest-1017798535 None] Detach volume completed successfully. Jan 22 21:23:49.913476 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.coordination [None req-fc4bbd96-5d6e-4e43-bfb7-bd9ccb15b5ea tempest-VolumesActionsTest-1017798535 None] Lock "b'cinder-e5261dfb-ee0e-4e0d-84e7-8798204804b9-detach_volume'" released by "detach_volume" :: held 0.243s {{(pid=129952) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 22 21:23:51.500602 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.quota [None req-7330e48b-b917-456c-b5fd-d2b33ab5a253 tempest-AttachVolumeNegativeTest-1922868514 None] Created reservations ['7693ae04-77a5-4e6a-9384-ad34de1ca943', '32bd0c54-fcbd-459e-a420-41f564d728e7', '4a337047-b5b5-47b4-8d7a-25a2c8f756b1', 'd797c276-c34c-4fa9-8fd4-85aad430f086'] {{(pid=129952) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 22 21:23:51.893918 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-7330e48b-b917-456c-b5fd-d2b33ab5a253 tempest-AttachVolumeNegativeTest-1922868514 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:23:52.126754 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-7330e48b-b917-456c-b5fd-d2b33ab5a253 tempest-AttachVolumeNegativeTest-1922868514 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:23:52.226574 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.manager [None req-7330e48b-b917-456c-b5fd-d2b33ab5a253 tempest-AttachVolumeNegativeTest-1922868514 None] Notifying Schedulers of capabilities ... {{(pid=129952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 22 21:23:52.246083 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-7330e48b-b917-456c-b5fd-d2b33ab5a253 tempest-AttachVolumeNegativeTest-1922868514 None] Deleted volume successfully. Jan 22 21:23:52.466021 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.coordination [None req-7330e48b-b917-456c-b5fd-d2b33ab5a253 tempest-AttachVolumeNegativeTest-1922868514 None] Lock "b'cinder-62156b55-9cd2-42c5-94d9-6b135ebd45d1-delete_volume'" released by "delete_volume" :: held 10.503s {{(pid=129952) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 22 21:23:58.207014 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.quota [None req-3a56cd48-7672-49e1-a6ab-a95ad6563be4 tempest-AttachVolumeShelveTestJSON-1245575078 None] Created reservations ['05509537-10a5-47ba-b1e6-2d9dea68c3e8', 'fa7085a4-50db-4b7c-964e-39dc738164cd', '56a66d4e-8638-4150-99b1-ba5927aa305c', '6694c5ee-a52e-4adb-a620-dcf225889405'] {{(pid=129952) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 22 21:23:58.571567 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-3a56cd48-7672-49e1-a6ab-a95ad6563be4 tempest-AttachVolumeShelveTestJSON-1245575078 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:23:58.639783 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-3a56cd48-7672-49e1-a6ab-a95ad6563be4 tempest-AttachVolumeShelveTestJSON-1245575078 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:23:58.805769 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.manager [None req-3a56cd48-7672-49e1-a6ab-a95ad6563be4 tempest-AttachVolumeShelveTestJSON-1245575078 None] Notifying Schedulers of capabilities ... {{(pid=129952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 22 21:23:58.820627 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-3a56cd48-7672-49e1-a6ab-a95ad6563be4 tempest-AttachVolumeShelveTestJSON-1245575078 None] Deleted volume successfully. Jan 22 21:23:58.944948 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.coordination [None req-3a56cd48-7672-49e1-a6ab-a95ad6563be4 tempest-AttachVolumeShelveTestJSON-1245575078 None] Lock "b'cinder-bcf9e38f-e4c1-4f42-8baf-0eeb0ff77489-delete_volume'" released by "delete_volume" :: held 10.875s {{(pid=129952) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 22 21:24:00.099208 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.coordination [None req-2ab4ce88-d2bd-4bea-9810-572d34417358 tempest-AttachVolumeShelveTestJSON-1245575078 None] Lock "b'cinder-df46cbf4-ba70-4e61-b51d-9f2a257ff669-delete_volume'" acquired by "delete_volume" :: waited 0.045s {{(pid=129952) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 22 21:24:00.295452 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-2ab4ce88-d2bd-4bea-9810-572d34417358 tempest-AttachVolumeShelveTestJSON-1245575078 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:24:00.692327 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-2ab4ce88-d2bd-4bea-9810-572d34417358 tempest-AttachVolumeShelveTestJSON-1245575078 None] volume has no backup snaps {{(pid=129952) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Jan 22 21:24:00.693489 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-2ab4ce88-d2bd-4bea-9810-572d34417358 tempest-AttachVolumeShelveTestJSON-1245575078 None] Volume volume-df46cbf4-ba70-4e61-b51d-9f2a257ff669 is not a clone. {{(pid=129952) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Jan 22 21:24:00.939732 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-2ab4ce88-d2bd-4bea-9810-572d34417358 tempest-AttachVolumeShelveTestJSON-1245575078 None] deleting rbd volume volume-df46cbf4-ba70-4e61-b51d-9f2a257ff669 {{(pid=129952) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Jan 22 21:24:05.737975 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.coordination [None req-49645bed-e674-4a37-93ad-484a8fd82157 tempest-AttachVolumeNegativeTest-1922868514 None] Lock "b'cinder-60b38738-e71a-4465-8224-7dd4972ee31c-delete_volume'" acquired by "delete_volume" :: waited 0.028s {{(pid=129952) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 22 21:24:05.903887 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-49645bed-e674-4a37-93ad-484a8fd82157 tempest-AttachVolumeNegativeTest-1922868514 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:24:06.137430 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-49645bed-e674-4a37-93ad-484a8fd82157 tempest-AttachVolumeNegativeTest-1922868514 None] volume has no backup snaps {{(pid=129952) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Jan 22 21:24:06.137902 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-49645bed-e674-4a37-93ad-484a8fd82157 tempest-AttachVolumeNegativeTest-1922868514 None] Volume volume-60b38738-e71a-4465-8224-7dd4972ee31c is not a clone. {{(pid=129952) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Jan 22 21:24:06.446558 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-49645bed-e674-4a37-93ad-484a8fd82157 tempest-AttachVolumeNegativeTest-1922868514 None] deleting rbd volume volume-60b38738-e71a-4465-8224-7dd4972ee31c {{(pid=129952) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Jan 22 21:24:09.036559 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.quota [None req-2ab4ce88-d2bd-4bea-9810-572d34417358 tempest-AttachVolumeShelveTestJSON-1245575078 None] Created reservations ['9cc5b395-d1f8-4d41-a931-f160e2d775b5', '307a4b8c-963f-407d-b071-cb01e57463f7', '1f467771-05c0-4ff7-b450-9cd4ecdc78b8', 'eb3ffb88-fbe6-4943-bd19-25a76d013226'] {{(pid=129952) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 22 21:24:09.292998 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-2ab4ce88-d2bd-4bea-9810-572d34417358 tempest-AttachVolumeShelveTestJSON-1245575078 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:24:09.403696 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-2ab4ce88-d2bd-4bea-9810-572d34417358 tempest-AttachVolumeShelveTestJSON-1245575078 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:24:09.432698 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.manager [None req-2ab4ce88-d2bd-4bea-9810-572d34417358 tempest-AttachVolumeShelveTestJSON-1245575078 None] Notifying Schedulers of capabilities ... {{(pid=129952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 22 21:24:09.438051 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-2ab4ce88-d2bd-4bea-9810-572d34417358 tempest-AttachVolumeShelveTestJSON-1245575078 None] Deleted volume successfully. Jan 22 21:24:09.538590 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.coordination [None req-2ab4ce88-d2bd-4bea-9810-572d34417358 tempest-AttachVolumeShelveTestJSON-1245575078 None] Lock "b'cinder-df46cbf4-ba70-4e61-b51d-9f2a257ff669-delete_volume'" released by "delete_volume" :: held 9.439s {{(pid=129952) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 22 21:24:09.702898 ncdv-master-1 cinder-volume[129952]: DEBUG oslo_service.periodic_task [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129952) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jan 22 21:24:09.703963 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:24:09.743257 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:24:09.812351 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.manager [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] Notifying Schedulers of capabilities ... {{(pid=129952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 22 21:24:14.793882 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.quota [None req-49645bed-e674-4a37-93ad-484a8fd82157 tempest-AttachVolumeNegativeTest-1922868514 None] Created reservations ['b5f1d09b-3afb-4197-8d22-36541ac564c3', '3f950644-6948-4d2d-b02d-aebdf77d23c0', 'a7a10fc3-cd4c-48a1-b588-fd98bd3e0d9c', '1253666d-589c-47b5-a22a-6480d222e145'] {{(pid=129952) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 22 21:24:15.001290 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-49645bed-e674-4a37-93ad-484a8fd82157 tempest-AttachVolumeNegativeTest-1922868514 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:24:15.040833 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-49645bed-e674-4a37-93ad-484a8fd82157 tempest-AttachVolumeNegativeTest-1922868514 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:24:15.133558 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.manager [None req-49645bed-e674-4a37-93ad-484a8fd82157 tempest-AttachVolumeNegativeTest-1922868514 None] Notifying Schedulers of capabilities ... {{(pid=129952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 22 21:24:15.145090 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-49645bed-e674-4a37-93ad-484a8fd82157 tempest-AttachVolumeNegativeTest-1922868514 None] Deleted volume successfully. Jan 22 21:24:15.283936 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.coordination [None req-49645bed-e674-4a37-93ad-484a8fd82157 tempest-AttachVolumeNegativeTest-1922868514 None] Lock "b'cinder-60b38738-e71a-4465-8224-7dd4972ee31c-delete_volume'" released by "delete_volume" :: held 9.549s {{(pid=129952) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 22 21:24:18.743860 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.coordination [None req-03afe370-e545-4b48-adea-3ae6159640bb tempest-VolumesActionsTest-1017798535 None] Lock "b'cinder-e5261dfb-ee0e-4e0d-84e7-8798204804b9'" acquired by "attach_volume" :: waited 0.029s {{(pid=129952) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 22 21:24:18.989412 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-03afe370-e545-4b48-adea-3ae6159640bb tempest-VolumesActionsTest-1017798535 None] Attaching volume e5261dfb-ee0e-4e0d-84e7-8798204804b9 to instance 9d1e62f2-2ac4-429b-ac51-e10fbb378afe at mountpoint /dev/sdb on host None. Jan 22 21:24:19.121442 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-03afe370-e545-4b48-adea-3ae6159640bb tempest-VolumesActionsTest-1017798535 None] Attach volume completed successfully. Jan 22 21:24:19.128965 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.coordination [None req-03afe370-e545-4b48-adea-3ae6159640bb tempest-VolumesActionsTest-1017798535 None] Lock "b'cinder-e5261dfb-ee0e-4e0d-84e7-8798204804b9'" released by "attach_volume" :: held 0.383s {{(pid=129952) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 22 21:24:19.365331 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.coordination [None req-481bc329-5e21-4da6-8749-fc1c2f94868d tempest-VolumesActionsTest-1017798535 None] Lock "b'cinder-e5261dfb-ee0e-4e0d-84e7-8798204804b9-detach_volume'" acquired by "detach_volume" :: waited 0.015s {{(pid=129952) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 22 21:24:19.366171 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-481bc329-5e21-4da6-8749-fc1c2f94868d tempest-VolumesActionsTest-1017798535 None] Detaching volume e5261dfb-ee0e-4e0d-84e7-8798204804b9 from instance 9d1e62f2-2ac4-429b-ac51-e10fbb378afe. Jan 22 21:24:19.620494 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-481bc329-5e21-4da6-8749-fc1c2f94868d tempest-VolumesActionsTest-1017798535 None] Detach volume completed successfully. Jan 22 21:24:19.635116 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.coordination [None req-481bc329-5e21-4da6-8749-fc1c2f94868d tempest-VolumesActionsTest-1017798535 None] Lock "b'cinder-e5261dfb-ee0e-4e0d-84e7-8798204804b9-detach_volume'" released by "detach_volume" :: held 0.270s {{(pid=129952) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 22 21:24:29.437263 ncdv-master-1 cinder-volume[129952]: DEBUG oslo_concurrency.processutils [None req-28605fc1-0401-47b3-9de4-0779fd0d3ecc tempest-VolumesActionsTest-1017798535 None] Running cmd (subprocess): rbd export --pool volumes volume-e5261dfb-ee0e-4e0d-84e7-8798204804b9 /opt/stack/data/cinder/conversion/volume-e5261dfb-ee0e-4e0d-84e7-8798204804b9-711069a1-40b2-4cb7-a5ce-54aecd09af53 --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129952) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jan 22 21:24:30.690500 ncdv-master-1 cinder-volume[129952]: DEBUG oslo_concurrency.processutils [None req-28605fc1-0401-47b3-9de4-0779fd0d3ecc tempest-VolumesActionsTest-1017798535 None] CMD "rbd export --pool volumes volume-e5261dfb-ee0e-4e0d-84e7-8798204804b9 /opt/stack/data/cinder/conversion/volume-e5261dfb-ee0e-4e0d-84e7-8798204804b9-711069a1-40b2-4cb7-a5ce-54aecd09af53 --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.252s {{(pid=129952) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jan 22 21:24:30.711301 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.image.image_utils [None req-28605fc1-0401-47b3-9de4-0779fd0d3ecc tempest-VolumesActionsTest-1017798535 None] 711069a1-40b2-4cb7-a5ce-54aecd09af53 was raw, no need to convert to raw {{(pid=129952) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:815}} Jan 22 21:25:02.792021 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-fca0e08b-d21b-4cc5-974c-de70952c8ca2 tempest-GroupSnapshotsTest-96709162 None] Group tempest-GroupSnapshotsTest-Group-259143563: creating Jan 22 21:25:02.883085 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-fca0e08b-d21b-4cc5-974c-de70952c8ca2 tempest-GroupSnapshotsTest-96709162 None] Group tempest-GroupSnapshotsTest-Group-259143563: created successfully Jan 22 21:25:02.907600 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-fca0e08b-d21b-4cc5-974c-de70952c8ca2 tempest-GroupSnapshotsTest-96709162 None] Create group completed successfully. Jan 22 21:25:05.458161 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.flows.manager.create_volume [None req-57b9906a-2609-410f-a6a9-1909b8c81e5a tempest-GroupSnapshotsTest-96709162 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129952) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Jan 22 21:25:05.469513 ncdv-master-1 cinder-volume[129952]: WARNING stevedore.named [None req-57b9906a-2609-410f-a6a9-1909b8c81e5a tempest-GroupSnapshotsTest-96709162 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jan 22 21:25:05.470329 ncdv-master-1 cinder-volume[129952]: WARNING castellan.key_manager [None req-57b9906a-2609-410f-a6a9-1909b8c81e5a tempest-GroupSnapshotsTest-96709162 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 22 21:25:05.519439 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-57b9906a-2609-410f-a6a9-1909b8c81e5a tempest-GroupSnapshotsTest-96709162 None] Flow 'volume_create_manager' (434eb503-e647-4b05-ab95-2da17065cefb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 22 21:25:05.537898 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-57b9906a-2609-410f-a6a9-1909b8c81e5a tempest-GroupSnapshotsTest-96709162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (324a9017-22a1-4d1c-a194-d4cf78a7fdc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:25:05.561611 ncdv-master-1 cinder-volume[129952]: DEBUG oslo_db.sqlalchemy.engines [None req-57b9906a-2609-410f-a6a9-1909b8c81e5a tempest-GroupSnapshotsTest-96709162 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129952) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 22 21:25:05.586496 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-57b9906a-2609-410f-a6a9-1909b8c81e5a tempest-GroupSnapshotsTest-96709162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (324a9017-22a1-4d1c-a194-d4cf78a7fdc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-01-22T21:25:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-GroupSnapshotsTest-Volume-1375552542',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=64c5e84f-5441-4bc7-996f-af69ffaa9b33,host='ncdv-master-1@ceph#ceph',id=993b0c97-0356-4672-b996-724e243385b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d5bafe6bd374a4ca4276a464db870b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-01-22T21:25:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-01-22T21:25:05Z,use_quota=True,user_id='289d35e59bfd4735ab80eea97458e077',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(20c20481-1136-4215-b983-6cef5137d46e),volume_type_id=20c20481-1136-4215-b983-6cef5137d46e)' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:25:05.600025 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-57b9906a-2609-410f-a6a9-1909b8c81e5a tempest-GroupSnapshotsTest-96709162 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (289bd713-27d8-4d56-9a27-8192c0662fd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:25:05.608111 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-57b9906a-2609-410f-a6a9-1909b8c81e5a tempest-GroupSnapshotsTest-96709162 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (289bd713-27d8-4d56-9a27-8192c0662fd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:25:05.638367 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-57b9906a-2609-410f-a6a9-1909b8c81e5a tempest-GroupSnapshotsTest-96709162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f929aef4-8d78-4281-8603-14464faef52e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:25:05.649297 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-57b9906a-2609-410f-a6a9-1909b8c81e5a tempest-GroupSnapshotsTest-96709162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f929aef4-8d78-4281-8603-14464faef52e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '993b0c97-0356-4672-b996-724e243385b9', 'volume_name': 'volume-993b0c97-0356-4672-b996-724e243385b9', 'volume_size': 1}' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:25:05.657203 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-57b9906a-2609-410f-a6a9-1909b8c81e5a tempest-GroupSnapshotsTest-96709162 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2cdb7fd4-f763-4d68-bfae-57e43a5be301) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:25:05.663369 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-57b9906a-2609-410f-a6a9-1909b8c81e5a tempest-GroupSnapshotsTest-96709162 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2cdb7fd4-f763-4d68-bfae-57e43a5be301) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:25:05.669416 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-57b9906a-2609-410f-a6a9-1909b8c81e5a tempest-GroupSnapshotsTest-96709162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb1c6a38-5851-4472-8526-fcd00c38d1ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:25:05.671199 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.flows.manager.create_volume [None req-57b9906a-2609-410f-a6a9-1909b8c81e5a tempest-GroupSnapshotsTest-96709162 None] Volume 993b0c97-0356-4672-b996-724e243385b9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-993b0c97-0356-4672-b996-724e243385b9', 'volume_size': 1} Jan 22 21:25:05.671414 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-57b9906a-2609-410f-a6a9-1909b8c81e5a tempest-GroupSnapshotsTest-96709162 None] creating volume 'volume-993b0c97-0356-4672-b996-724e243385b9' {{(pid=129952) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Jan 22 21:25:05.672724 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-57b9906a-2609-410f-a6a9-1909b8c81e5a tempest-GroupSnapshotsTest-96709162 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:25:06.962354 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-57b9906a-2609-410f-a6a9-1909b8c81e5a tempest-GroupSnapshotsTest-96709162 None] extra_specs: {} {{(pid=129952) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 22 21:25:06.962957 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-57b9906a-2609-410f-a6a9-1909b8c81e5a tempest-GroupSnapshotsTest-96709162 None] extra_specs: {} {{(pid=129952) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 22 21:25:06.970564 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-57b9906a-2609-410f-a6a9-1909b8c81e5a tempest-GroupSnapshotsTest-96709162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb1c6a38-5851-4472-8526-fcd00c38d1ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-993b0c97-0356-4672-b996-724e243385b9', 'volume_size': 1}' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:25:06.983803 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-57b9906a-2609-410f-a6a9-1909b8c81e5a tempest-GroupSnapshotsTest-96709162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db9037c3-f31c-460c-a728-a033ef064173) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:25:07.157899 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.flows.manager.create_volume [None req-57b9906a-2609-410f-a6a9-1909b8c81e5a tempest-GroupSnapshotsTest-96709162 None] Volume volume-993b0c97-0356-4672-b996-724e243385b9 (993b0c97-0356-4672-b996-724e243385b9): created successfully Jan 22 21:25:07.162513 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-57b9906a-2609-410f-a6a9-1909b8c81e5a tempest-GroupSnapshotsTest-96709162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db9037c3-f31c-460c-a728-a033ef064173) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:25:07.172747 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-57b9906a-2609-410f-a6a9-1909b8c81e5a tempest-GroupSnapshotsTest-96709162 None] Flow 'volume_create_manager' (434eb503-e647-4b05-ab95-2da17065cefb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129952) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 22 21:25:07.326898 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-57b9906a-2609-410f-a6a9-1909b8c81e5a tempest-GroupSnapshotsTest-96709162 None] Created volume successfully. Jan 22 21:25:08.581228 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-ec394168-2b03-40d3-98b5-9c2b941f8445 tempest-GroupSnapshotsTest-96709162 None] GroupSnapshot 33bcb06f-7aa8-4e1f-b27b-5d5a738520bd: creating. Jan 22 21:25:08.608087 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-ec394168-2b03-40d3-98b5-9c2b941f8445 tempest-GroupSnapshotsTest-96709162 None] Group snapshot 33bcb06f-7aa8-4e1f-b27b-5d5a738520bd: creating. {{(pid=129952) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4077}} Jan 22 21:25:08.626831 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-ec394168-2b03-40d3-98b5-9c2b941f8445 tempest-GroupSnapshotsTest-96709162 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:25:09.710587 ncdv-master-1 cinder-volume[129952]: DEBUG oslo_service.periodic_task [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129952) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jan 22 21:25:09.710587 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:25:09.777888 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:25:09.836762 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.manager [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] Notifying Schedulers of capabilities ... {{(pid=129952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 22 21:25:12.133245 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-28605fc1-0401-47b3-9de4-0779fd0d3ecc tempest-VolumesActionsTest-1017798535 None] Uploaded volume to glance image-id: 711069a1-40b2-4cb7-a5ce-54aecd09af53. {{(pid=129952) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1746}} Jan 22 21:25:12.282014 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-28605fc1-0401-47b3-9de4-0779fd0d3ecc tempest-VolumesActionsTest-1017798535 None] Copy volume to image completed successfully. Jan 22 21:25:13.505450 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-ec394168-2b03-40d3-98b5-9c2b941f8445 tempest-GroupSnapshotsTest-96709162 None] group_snapshot 33bcb06f-7aa8-4e1f-b27b-5d5a738520bd: created successfully Jan 22 21:25:14.999825 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.coordination [None req-8864f487-a994-4d03-a20b-708c3782e37e tempest-VolumesActionsTest-1017798535 None] Lock "b'cinder-e5261dfb-ee0e-4e0d-84e7-8798204804b9-delete_volume'" acquired by "delete_volume" :: waited 0.033s {{(pid=129952) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 22 21:25:15.196168 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-8864f487-a994-4d03-a20b-708c3782e37e tempest-VolumesActionsTest-1017798535 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:25:15.519104 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-8864f487-a994-4d03-a20b-708c3782e37e tempest-VolumesActionsTest-1017798535 None] volume has no backup snaps {{(pid=129952) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Jan 22 21:25:15.519561 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-8864f487-a994-4d03-a20b-708c3782e37e tempest-VolumesActionsTest-1017798535 None] Volume volume-e5261dfb-ee0e-4e0d-84e7-8798204804b9 is not a clone. {{(pid=129952) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Jan 22 21:25:15.773474 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-8864f487-a994-4d03-a20b-708c3782e37e tempest-VolumesActionsTest-1017798535 None] deleting rbd volume volume-e5261dfb-ee0e-4e0d-84e7-8798204804b9 {{(pid=129952) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Jan 22 21:25:15.865215 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-e2754710-ea4f-4b56-965b-e15d94971a87 tempest-GroupSnapshotsTest-96709162 None] cloning volumes/volume-993b0c97-0356-4672-b996-724e243385b9@snapshot-0c0dcd46-f478-49a7-81c8-916dc5a241ce to volume-4071d32f-ef88-40ae-bd77-06e53873c2f8 {{(pid=129952) _clone /opt/stack/cinder/cinder/volume/drivers/rbd.py:1028}} Jan 22 21:25:15.866403 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-e2754710-ea4f-4b56-965b-e15d94971a87 tempest-GroupSnapshotsTest-96709162 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:25:15.938428 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-e2754710-ea4f-4b56-965b-e15d94971a87 tempest-GroupSnapshotsTest-96709162 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:25:18.459933 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-e2754710-ea4f-4b56-965b-e15d94971a87 tempest-GroupSnapshotsTest-96709162 None] extra_specs: {} {{(pid=129952) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 22 21:25:18.461210 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-e2754710-ea4f-4b56-965b-e15d94971a87 tempest-GroupSnapshotsTest-96709162 None] extra_specs: {} {{(pid=129952) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 22 21:25:18.471791 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-e2754710-ea4f-4b56-965b-e15d94971a87 tempest-GroupSnapshotsTest-96709162 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:25:18.544836 ncdv-master-1 cinder-volume[129952]: WARNING cinder.volume.drivers.rbd [None req-e2754710-ea4f-4b56-965b-e15d94971a87 tempest-GroupSnapshotsTest-96709162 None] Not using v2 clone API, please upgrade to mimic+ and set the OSD minimum client compat version to mimic for better performance, fewer deletion issues: NotImplementedError Jan 22 21:25:19.059969 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-e2754710-ea4f-4b56-965b-e15d94971a87 tempest-GroupSnapshotsTest-96709162 None] Create group from source-snapshot-33bcb06f-7aa8-4e1f-b27b-5d5a738520bd completed successfully. Jan 22 21:25:19.727589 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-9c1b5bc7-61ec-447c-b02b-e1af586a2858 tempest-GroupSnapshotsTest-96709162 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:25:20.075578 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-9c1b5bc7-61ec-447c-b02b-e1af586a2858 tempest-GroupSnapshotsTest-96709162 None] volume has no backup snaps {{(pid=129952) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Jan 22 21:25:20.482666 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-9c1b5bc7-61ec-447c-b02b-e1af586a2858 tempest-GroupSnapshotsTest-96709162 None] deleting rbd volume volume-4071d32f-ef88-40ae-bd77-06e53873c2f8 {{(pid=129952) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Jan 22 21:25:24.243622 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.quota [None req-8864f487-a994-4d03-a20b-708c3782e37e tempest-VolumesActionsTest-1017798535 None] Created reservations ['74611e04-7b36-49ed-8f64-149faa23fb04', '13bb6324-9e47-4f7c-9471-31e88ff74569', 'f0431590-9529-4fc5-9cd1-443e99b928c9', 'e31bd7d9-e0f3-403f-8996-dbf0de7c5d36'] {{(pid=129952) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 22 21:25:24.504189 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-8864f487-a994-4d03-a20b-708c3782e37e tempest-VolumesActionsTest-1017798535 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:25:24.547241 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-8864f487-a994-4d03-a20b-708c3782e37e tempest-VolumesActionsTest-1017798535 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:25:24.599950 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.manager [None req-8864f487-a994-4d03-a20b-708c3782e37e tempest-VolumesActionsTest-1017798535 None] Notifying Schedulers of capabilities ... {{(pid=129952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 22 21:25:24.599950 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-8864f487-a994-4d03-a20b-708c3782e37e tempest-VolumesActionsTest-1017798535 None] Deleted volume successfully. Jan 22 21:25:24.757894 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.coordination [None req-8864f487-a994-4d03-a20b-708c3782e37e tempest-VolumesActionsTest-1017798535 None] Lock "b'cinder-e5261dfb-ee0e-4e0d-84e7-8798204804b9-delete_volume'" released by "delete_volume" :: held 9.758s {{(pid=129952) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 22 21:25:28.992315 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.quota [None req-9c1b5bc7-61ec-447c-b02b-e1af586a2858 tempest-GroupSnapshotsTest-96709162 None] Created reservations ['2203d9f0-2dfa-4492-a369-4fb8bb3dce4c'] {{(pid=129952) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 22 21:25:29.010365 ncdv-master-1 cinder-volume[129952]: WARNING cinder.quota [None req-9c1b5bc7-61ec-447c-b02b-e1af586a2858 tempest-GroupSnapshotsTest-96709162 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-748479032 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-748479032, it is now deprecated. Please use the default quota class for default quota. Jan 22 21:25:29.011049 ncdv-master-1 cinder-volume[129952]: WARNING cinder.quota [None req-9c1b5bc7-61ec-447c-b02b-e1af586a2858 tempest-GroupSnapshotsTest-96709162 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-748479032 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-748479032, it is now deprecated. Please use the default quota class for default quota. Jan 22 21:25:29.158658 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.quota [None req-9c1b5bc7-61ec-447c-b02b-e1af586a2858 tempest-GroupSnapshotsTest-96709162 None] Created reservations ['013c8aec-3094-42b4-a5ac-519a4b204839', 'f5de69b4-8948-4ff3-8a92-31bf472907dc', '5eb5131f-913b-4d58-9bee-b42c667fc0af', 'aa24c29a-08d1-451a-a0b8-b8c1de7505e7'] {{(pid=129952) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 22 21:25:29.598645 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-9c1b5bc7-61ec-447c-b02b-e1af586a2858 tempest-GroupSnapshotsTest-96709162 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:25:29.635245 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-9c1b5bc7-61ec-447c-b02b-e1af586a2858 tempest-GroupSnapshotsTest-96709162 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:25:29.682750 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.manager [None req-9c1b5bc7-61ec-447c-b02b-e1af586a2858 tempest-GroupSnapshotsTest-96709162 None] Notifying Schedulers of capabilities ... {{(pid=129952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 22 21:25:29.687618 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-9c1b5bc7-61ec-447c-b02b-e1af586a2858 tempest-GroupSnapshotsTest-96709162 None] Delete group completed successfully. Jan 22 21:25:30.840856 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-88cc3877-ff9f-4fd4-b5f3-e0f29381f2fa tempest-GroupSnapshotsTest-96709162 None] group_snapshot 33bcb06f-7aa8-4e1f-b27b-5d5a738520bd: deleting Jan 22 21:25:30.860593 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-88cc3877-ff9f-4fd4-b5f3-e0f29381f2fa tempest-GroupSnapshotsTest-96709162 None] group_snapshot 33bcb06f-7aa8-4e1f-b27b-5d5a738520bd: deleting {{(pid=129952) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4252}} Jan 22 21:25:30.879778 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-88cc3877-ff9f-4fd4-b5f3-e0f29381f2fa tempest-GroupSnapshotsTest-96709162 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:25:33.916026 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.flows.manager.create_volume [None req-8f8ac1b4-43bf-4f25-b236-8950b5316570 tempest-VolumeSnapshotQuotasNegativeTestJSON-1486717369 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129952) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Jan 22 21:25:33.919817 ncdv-master-1 cinder-volume[129952]: WARNING stevedore.named [None req-8f8ac1b4-43bf-4f25-b236-8950b5316570 tempest-VolumeSnapshotQuotasNegativeTestJSON-1486717369 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jan 22 21:25:33.920325 ncdv-master-1 cinder-volume[129952]: WARNING castellan.key_manager [None req-8f8ac1b4-43bf-4f25-b236-8950b5316570 tempest-VolumeSnapshotQuotasNegativeTestJSON-1486717369 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 22 21:25:33.939793 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-8f8ac1b4-43bf-4f25-b236-8950b5316570 tempest-VolumeSnapshotQuotasNegativeTestJSON-1486717369 None] Flow 'volume_create_manager' (1631b8aa-a3a4-4d53-8605-a541fd03b4f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 22 21:25:33.947541 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-8f8ac1b4-43bf-4f25-b236-8950b5316570 tempest-VolumeSnapshotQuotasNegativeTestJSON-1486717369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad968f7e-0b48-45c7-acf8-1e03d0579099) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:25:33.953694 ncdv-master-1 cinder-volume[129952]: DEBUG oslo_db.sqlalchemy.engines [None req-8f8ac1b4-43bf-4f25-b236-8950b5316570 tempest-VolumeSnapshotQuotasNegativeTestJSON-1486717369 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129952) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 22 21:25:33.969110 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-8f8ac1b4-43bf-4f25-b236-8950b5316570 tempest-VolumeSnapshotQuotasNegativeTestJSON-1486717369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad968f7e-0b48-45c7-acf8-1e03d0579099) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-01-22T21:25:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1772013900',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=60aa7db8-94d3-4836-ba4c-02120f182de4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='192114af2378432f82959c60fa42f1a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-01-22T21:25:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-01-22T21:25:34Z,use_quota=True,user_id='87552c9a040d4efe878e36d3b37ba89a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6dacb05b-a7ea-4056-85ff-98f0ea5c54eb),volume_type_id=6dacb05b-a7ea-4056-85ff-98f0ea5c54eb)' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:25:33.974833 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-8f8ac1b4-43bf-4f25-b236-8950b5316570 tempest-VolumeSnapshotQuotasNegativeTestJSON-1486717369 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6b068cf-0a08-4f1d-830f-dd3e96b94f32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:25:33.979602 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-8f8ac1b4-43bf-4f25-b236-8950b5316570 tempest-VolumeSnapshotQuotasNegativeTestJSON-1486717369 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6b068cf-0a08-4f1d-830f-dd3e96b94f32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:25:33.984830 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-8f8ac1b4-43bf-4f25-b236-8950b5316570 tempest-VolumeSnapshotQuotasNegativeTestJSON-1486717369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51bb0bbc-0df1-4a7f-8773-573e282ee3ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:25:33.989010 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-8f8ac1b4-43bf-4f25-b236-8950b5316570 tempest-VolumeSnapshotQuotasNegativeTestJSON-1486717369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51bb0bbc-0df1-4a7f-8773-573e282ee3ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '60aa7db8-94d3-4836-ba4c-02120f182de4', 'volume_name': 'volume-60aa7db8-94d3-4836-ba4c-02120f182de4', 'volume_size': 1}' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:25:33.994675 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-8f8ac1b4-43bf-4f25-b236-8950b5316570 tempest-VolumeSnapshotQuotasNegativeTestJSON-1486717369 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4061cb01-ecf8-43b7-b3fd-b7665601dbc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:25:33.999198 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-8f8ac1b4-43bf-4f25-b236-8950b5316570 tempest-VolumeSnapshotQuotasNegativeTestJSON-1486717369 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4061cb01-ecf8-43b7-b3fd-b7665601dbc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:25:34.004316 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-8f8ac1b4-43bf-4f25-b236-8950b5316570 tempest-VolumeSnapshotQuotasNegativeTestJSON-1486717369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bfb1fc60-3e50-4070-95d6-d1d8734cd0e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:25:34.005438 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.flows.manager.create_volume [None req-8f8ac1b4-43bf-4f25-b236-8950b5316570 tempest-VolumeSnapshotQuotasNegativeTestJSON-1486717369 None] Volume 60aa7db8-94d3-4836-ba4c-02120f182de4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-60aa7db8-94d3-4836-ba4c-02120f182de4', 'volume_size': 1} Jan 22 21:25:34.005858 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-8f8ac1b4-43bf-4f25-b236-8950b5316570 tempest-VolumeSnapshotQuotasNegativeTestJSON-1486717369 None] creating volume 'volume-60aa7db8-94d3-4836-ba4c-02120f182de4' {{(pid=129952) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Jan 22 21:25:34.006990 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-8f8ac1b4-43bf-4f25-b236-8950b5316570 tempest-VolumeSnapshotQuotasNegativeTestJSON-1486717369 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:25:35.750091 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-8f8ac1b4-43bf-4f25-b236-8950b5316570 tempest-VolumeSnapshotQuotasNegativeTestJSON-1486717369 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129952) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 22 21:25:35.750711 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-8f8ac1b4-43bf-4f25-b236-8950b5316570 tempest-VolumeSnapshotQuotasNegativeTestJSON-1486717369 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129952) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 22 21:25:35.755517 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-8f8ac1b4-43bf-4f25-b236-8950b5316570 tempest-VolumeSnapshotQuotasNegativeTestJSON-1486717369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bfb1fc60-3e50-4070-95d6-d1d8734cd0e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-60aa7db8-94d3-4836-ba4c-02120f182de4', 'volume_size': 1}' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:25:35.759943 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-8f8ac1b4-43bf-4f25-b236-8950b5316570 tempest-VolumeSnapshotQuotasNegativeTestJSON-1486717369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b96ffcbd-3489-41a5-84b8-d52b64565a2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:25:35.776465 ncdv-master-1 cinder-volume[129952]: WARNING cinder.quota [None req-88cc3877-ff9f-4fd4-b5f3-e0f29381f2fa tempest-GroupSnapshotsTest-96709162 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-748479032 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-748479032, it is now deprecated. Please use the default quota class for default quota. Jan 22 21:25:35.965116 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.flows.manager.create_volume [None req-8f8ac1b4-43bf-4f25-b236-8950b5316570 tempest-VolumeSnapshotQuotasNegativeTestJSON-1486717369 None] Volume volume-60aa7db8-94d3-4836-ba4c-02120f182de4 (60aa7db8-94d3-4836-ba4c-02120f182de4): created successfully Jan 22 21:25:35.969843 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-8f8ac1b4-43bf-4f25-b236-8950b5316570 tempest-VolumeSnapshotQuotasNegativeTestJSON-1486717369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b96ffcbd-3489-41a5-84b8-d52b64565a2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:25:35.978435 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-8f8ac1b4-43bf-4f25-b236-8950b5316570 tempest-VolumeSnapshotQuotasNegativeTestJSON-1486717369 None] Flow 'volume_create_manager' (1631b8aa-a3a4-4d53-8605-a541fd03b4f6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129952) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 22 21:25:35.983745 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.quota [None req-88cc3877-ff9f-4fd4-b5f3-e0f29381f2fa tempest-GroupSnapshotsTest-96709162 None] Created reservations ['2686355f-a12b-4cf5-bf19-80747126e661', 'e7956946-20bb-432d-9f6f-5c25c40c80d3', '70fdb1a5-2d2e-47d1-9c0c-42cbd660c7ab', '8373f371-2d0c-4871-b8e3-e2c97065446c'] {{(pid=129952) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 22 21:25:36.076104 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-8f8ac1b4-43bf-4f25-b236-8950b5316570 tempest-VolumeSnapshotQuotasNegativeTestJSON-1486717369 None] Created volume successfully. Jan 22 21:25:36.399203 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-88cc3877-ff9f-4fd4-b5f3-e0f29381f2fa tempest-GroupSnapshotsTest-96709162 None] group_snapshot 33bcb06f-7aa8-4e1f-b27b-5d5a738520bd: deleted successfully Jan 22 21:25:37.617212 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-d7b75a4c-edbf-4154-88a6-0569ce14be43 tempest-VolumeSnapshotQuotasNegativeTestJSON-1486717369 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:25:38.282122 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-79b631c2-6b3b-4ede-93d9-bd70ca1f591d tempest-GroupSnapshotsTest-96709162 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:25:38.886054 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-79b631c2-6b3b-4ede-93d9-bd70ca1f591d tempest-GroupSnapshotsTest-96709162 None] volume has no backup snaps {{(pid=129952) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Jan 22 21:25:38.887280 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-79b631c2-6b3b-4ede-93d9-bd70ca1f591d tempest-GroupSnapshotsTest-96709162 None] Volume volume-993b0c97-0356-4672-b996-724e243385b9 is not a clone. {{(pid=129952) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Jan 22 21:25:39.218157 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-79b631c2-6b3b-4ede-93d9-bd70ca1f591d tempest-GroupSnapshotsTest-96709162 None] deleting rbd volume volume-993b0c97-0356-4672-b996-724e243385b9 {{(pid=129952) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Jan 22 21:25:42.089561 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-d7b75a4c-edbf-4154-88a6-0569ce14be43 tempest-VolumeSnapshotQuotasNegativeTestJSON-1486717369 None] Create snapshot completed successfully Jan 22 21:25:43.814102 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.coordination [None req-125f11b0-e29b-4d60-8ec6-08667a44a54c tempest-VolumeSnapshotQuotasNegativeTestJSON-1486717369 None] Lock "b'cinder-27d75796-e220-4182-a2a9-3c697ba586bc-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.029s {{(pid=129952) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 22 21:25:43.828312 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-125f11b0-e29b-4d60-8ec6-08667a44a54c tempest-VolumeSnapshotQuotasNegativeTestJSON-1486717369 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:25:48.022638 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.quota [None req-79b631c2-6b3b-4ede-93d9-bd70ca1f591d tempest-GroupSnapshotsTest-96709162 None] Created reservations ['8b466706-383a-4ef3-9c18-8bce2f6ca824'] {{(pid=129952) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 22 21:25:48.052976 ncdv-master-1 cinder-volume[129952]: WARNING cinder.db.sqlalchemy.api [None req-79b631c2-6b3b-4ede-93d9-bd70ca1f591d tempest-GroupSnapshotsTest-96709162 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-748479032'] Jan 22 21:25:48.155005 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.quota [None req-79b631c2-6b3b-4ede-93d9-bd70ca1f591d tempest-GroupSnapshotsTest-96709162 None] Created reservations ['aec2534d-1b9d-4ab8-ae4a-c2198cd5b5a1', '8a85623d-e578-4354-9027-89d415efd228', '6076cf3b-5f26-4efa-909f-734b8a986482', '5fa4dbd1-51f5-41fa-9089-8f14f5ebf3d4'] {{(pid=129952) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 22 21:25:48.273883 ncdv-master-1 cinder-volume[129952]: WARNING cinder.quota [None req-125f11b0-e29b-4d60-8ec6-08667a44a54c tempest-VolumeSnapshotQuotasNegativeTestJSON-1486717369 None] Deprecated: Default quota for resource: snapshots_ceph is set by the default quota flag: quota_snapshots_ceph, it is now deprecated. Please use the default quota class for default quota. Jan 22 21:25:48.395219 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.quota [None req-125f11b0-e29b-4d60-8ec6-08667a44a54c tempest-VolumeSnapshotQuotasNegativeTestJSON-1486717369 None] Created reservations ['063b6285-8778-4491-812b-a7bebf1c3bb1', '053f91ea-0f22-42d4-a620-c383eb520a9c', 'e5c8ec1b-790b-44d1-a1ad-4c7c7572c116', '3fe59b3a-41c0-4672-a98b-99b9662b6a4a'] {{(pid=129952) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 22 21:25:48.608993 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-125f11b0-e29b-4d60-8ec6-08667a44a54c tempest-VolumeSnapshotQuotasNegativeTestJSON-1486717369 None] Delete snapshot completed successfully. Jan 22 21:25:48.616915 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.coordination [None req-125f11b0-e29b-4d60-8ec6-08667a44a54c tempest-VolumeSnapshotQuotasNegativeTestJSON-1486717369 None] Lock "b'cinder-27d75796-e220-4182-a2a9-3c697ba586bc-delete_snapshot'" released by "delete_snapshot" :: held 4.803s {{(pid=129952) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 22 21:25:48.751559 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-79b631c2-6b3b-4ede-93d9-bd70ca1f591d tempest-GroupSnapshotsTest-96709162 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:25:48.774498 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-79b631c2-6b3b-4ede-93d9-bd70ca1f591d tempest-GroupSnapshotsTest-96709162 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:25:48.827139 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.manager [None req-79b631c2-6b3b-4ede-93d9-bd70ca1f591d tempest-GroupSnapshotsTest-96709162 None] Notifying Schedulers of capabilities ... {{(pid=129952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 22 21:25:48.853582 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-79b631c2-6b3b-4ede-93d9-bd70ca1f591d tempest-GroupSnapshotsTest-96709162 None] Delete group completed successfully. Jan 22 21:25:49.257233 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.coordination [None req-96558f8f-05ae-447f-9aa3-255b3e251b0e tempest-VolumeSnapshotQuotasNegativeTestJSON-1486717369 None] Lock "b'cinder-60aa7db8-94d3-4836-ba4c-02120f182de4-delete_volume'" acquired by "delete_volume" :: waited 0.018s {{(pid=129952) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 22 21:25:49.406924 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-96558f8f-05ae-447f-9aa3-255b3e251b0e tempest-VolumeSnapshotQuotasNegativeTestJSON-1486717369 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:25:49.700242 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-96558f8f-05ae-447f-9aa3-255b3e251b0e tempest-VolumeSnapshotQuotasNegativeTestJSON-1486717369 None] volume has no backup snaps {{(pid=129952) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Jan 22 21:25:49.700723 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-96558f8f-05ae-447f-9aa3-255b3e251b0e tempest-VolumeSnapshotQuotasNegativeTestJSON-1486717369 None] Volume volume-60aa7db8-94d3-4836-ba4c-02120f182de4 is not a clone. {{(pid=129952) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Jan 22 21:25:49.930422 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-96558f8f-05ae-447f-9aa3-255b3e251b0e tempest-VolumeSnapshotQuotasNegativeTestJSON-1486717369 None] deleting rbd volume volume-60aa7db8-94d3-4836-ba4c-02120f182de4 {{(pid=129952) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Jan 22 21:25:49.945135 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-16695bc6-499b-4cbd-934f-404087d073af tempest-GroupSnapshotsTest-96709162 None] Group tempest-GroupSnapshotsTest-Group-2084629224: creating Jan 22 21:25:50.041773 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-16695bc6-499b-4cbd-934f-404087d073af tempest-GroupSnapshotsTest-96709162 None] Group tempest-GroupSnapshotsTest-Group-2084629224: created successfully Jan 22 21:25:50.057658 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-16695bc6-499b-4cbd-934f-404087d073af tempest-GroupSnapshotsTest-96709162 None] Create group completed successfully. Jan 22 21:25:52.237266 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.flows.manager.create_volume [None req-e6c7c44b-9219-4f57-bb19-a2867877c4f3 tempest-GroupSnapshotsTest-96709162 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129952) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Jan 22 21:25:52.257974 ncdv-master-1 cinder-volume[129952]: WARNING stevedore.named [None req-e6c7c44b-9219-4f57-bb19-a2867877c4f3 tempest-GroupSnapshotsTest-96709162 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jan 22 21:25:52.262125 ncdv-master-1 cinder-volume[129952]: WARNING castellan.key_manager [None req-e6c7c44b-9219-4f57-bb19-a2867877c4f3 tempest-GroupSnapshotsTest-96709162 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 22 21:25:52.335371 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-e6c7c44b-9219-4f57-bb19-a2867877c4f3 tempest-GroupSnapshotsTest-96709162 None] Flow 'volume_create_manager' (d0e26d4f-66c2-452a-b4ea-0978c85aae7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 22 21:25:52.344709 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-e6c7c44b-9219-4f57-bb19-a2867877c4f3 tempest-GroupSnapshotsTest-96709162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b6b64f6-403c-43fc-b1c4-de29592aa8ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:25:52.355708 ncdv-master-1 cinder-volume[129952]: DEBUG oslo_db.sqlalchemy.engines [None req-e6c7c44b-9219-4f57-bb19-a2867877c4f3 tempest-GroupSnapshotsTest-96709162 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129952) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 22 21:25:52.395226 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-e6c7c44b-9219-4f57-bb19-a2867877c4f3 tempest-GroupSnapshotsTest-96709162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b6b64f6-403c-43fc-b1c4-de29592aa8ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-01-22T21:25:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-GroupSnapshotsTest-Volume-1955352965',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=b391be97-377d-4f92-b9fa-70d769123631,host='ncdv-master-1@ceph#ceph',id=597c2e70-c4c5-401f-8be1-374e1f4eed49,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d5bafe6bd374a4ca4276a464db870b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-01-22T21:25:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-01-22T21:25:52Z,use_quota=True,user_id='289d35e59bfd4735ab80eea97458e077',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(05f420b7-6db4-46fd-9263-28339f5e9114),volume_type_id=05f420b7-6db4-46fd-9263-28339f5e9114)' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:25:52.404218 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-e6c7c44b-9219-4f57-bb19-a2867877c4f3 tempest-GroupSnapshotsTest-96709162 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9dbf820-22db-4340-adff-af7426a1d8c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:25:52.413438 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-e6c7c44b-9219-4f57-bb19-a2867877c4f3 tempest-GroupSnapshotsTest-96709162 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9dbf820-22db-4340-adff-af7426a1d8c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:25:52.420709 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-e6c7c44b-9219-4f57-bb19-a2867877c4f3 tempest-GroupSnapshotsTest-96709162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10f87bd0-8488-4316-9707-ff720ca63c0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:25:52.431687 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-e6c7c44b-9219-4f57-bb19-a2867877c4f3 tempest-GroupSnapshotsTest-96709162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10f87bd0-8488-4316-9707-ff720ca63c0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '597c2e70-c4c5-401f-8be1-374e1f4eed49', 'volume_name': 'volume-597c2e70-c4c5-401f-8be1-374e1f4eed49', 'volume_size': 1}' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:25:52.438151 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-e6c7c44b-9219-4f57-bb19-a2867877c4f3 tempest-GroupSnapshotsTest-96709162 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a8e4c85-03b0-400d-9cfa-4f6af608bc75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:25:52.443175 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-e6c7c44b-9219-4f57-bb19-a2867877c4f3 tempest-GroupSnapshotsTest-96709162 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a8e4c85-03b0-400d-9cfa-4f6af608bc75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:25:52.471537 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-e6c7c44b-9219-4f57-bb19-a2867877c4f3 tempest-GroupSnapshotsTest-96709162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (266ead6f-e669-46c5-a862-1a8c2d944e58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:25:52.473816 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.flows.manager.create_volume [None req-e6c7c44b-9219-4f57-bb19-a2867877c4f3 tempest-GroupSnapshotsTest-96709162 None] Volume 597c2e70-c4c5-401f-8be1-374e1f4eed49: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-597c2e70-c4c5-401f-8be1-374e1f4eed49', 'volume_size': 1} Jan 22 21:25:52.474598 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-e6c7c44b-9219-4f57-bb19-a2867877c4f3 tempest-GroupSnapshotsTest-96709162 None] creating volume 'volume-597c2e70-c4c5-401f-8be1-374e1f4eed49' {{(pid=129952) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Jan 22 21:25:52.475847 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-e6c7c44b-9219-4f57-bb19-a2867877c4f3 tempest-GroupSnapshotsTest-96709162 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:25:53.690358 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-e6c7c44b-9219-4f57-bb19-a2867877c4f3 tempest-GroupSnapshotsTest-96709162 None] extra_specs: {} {{(pid=129952) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 22 21:25:53.694267 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-e6c7c44b-9219-4f57-bb19-a2867877c4f3 tempest-GroupSnapshotsTest-96709162 None] extra_specs: {} {{(pid=129952) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 22 21:25:53.699548 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-e6c7c44b-9219-4f57-bb19-a2867877c4f3 tempest-GroupSnapshotsTest-96709162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (266ead6f-e669-46c5-a862-1a8c2d944e58) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-597c2e70-c4c5-401f-8be1-374e1f4eed49', 'volume_size': 1}' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:25:53.707852 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-e6c7c44b-9219-4f57-bb19-a2867877c4f3 tempest-GroupSnapshotsTest-96709162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1cd37678-5558-4099-afc7-b20bda4feb78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:25:53.833645 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.flows.manager.create_volume [None req-e6c7c44b-9219-4f57-bb19-a2867877c4f3 tempest-GroupSnapshotsTest-96709162 None] Volume volume-597c2e70-c4c5-401f-8be1-374e1f4eed49 (597c2e70-c4c5-401f-8be1-374e1f4eed49): created successfully Jan 22 21:25:53.839118 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-e6c7c44b-9219-4f57-bb19-a2867877c4f3 tempest-GroupSnapshotsTest-96709162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1cd37678-5558-4099-afc7-b20bda4feb78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:25:53.844815 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-e6c7c44b-9219-4f57-bb19-a2867877c4f3 tempest-GroupSnapshotsTest-96709162 None] Flow 'volume_create_manager' (d0e26d4f-66c2-452a-b4ea-0978c85aae7d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129952) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 22 21:25:53.942046 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-e6c7c44b-9219-4f57-bb19-a2867877c4f3 tempest-GroupSnapshotsTest-96709162 None] Created volume successfully. Jan 22 21:25:55.261949 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.flows.manager.create_volume [None req-15ce99b3-a58b-4665-801e-e6cc54050f82 tempest-GroupSnapshotsTest-96709162 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129952) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Jan 22 21:25:55.265296 ncdv-master-1 cinder-volume[129952]: WARNING stevedore.named [None req-15ce99b3-a58b-4665-801e-e6cc54050f82 tempest-GroupSnapshotsTest-96709162 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jan 22 21:25:55.265770 ncdv-master-1 cinder-volume[129952]: WARNING castellan.key_manager [None req-15ce99b3-a58b-4665-801e-e6cc54050f82 tempest-GroupSnapshotsTest-96709162 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 22 21:25:55.286652 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-15ce99b3-a58b-4665-801e-e6cc54050f82 tempest-GroupSnapshotsTest-96709162 None] Flow 'volume_create_manager' (f37a7edc-3284-45f0-bc06-26ef829c751d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 22 21:25:55.294535 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-15ce99b3-a58b-4665-801e-e6cc54050f82 tempest-GroupSnapshotsTest-96709162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99912b03-bbd3-4890-9583-18f475950373) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:25:55.301992 ncdv-master-1 cinder-volume[129952]: DEBUG oslo_db.sqlalchemy.engines [None req-15ce99b3-a58b-4665-801e-e6cc54050f82 tempest-GroupSnapshotsTest-96709162 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129952) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 22 21:25:55.317305 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-15ce99b3-a58b-4665-801e-e6cc54050f82 tempest-GroupSnapshotsTest-96709162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99912b03-bbd3-4890-9583-18f475950373) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-01-22T21:25:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-GroupSnapshotsTest-Volume-1698041293',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=b391be97-377d-4f92-b9fa-70d769123631,host='ncdv-master-1@ceph#ceph',id=a54438f5-2322-486c-97a0-32d093da7178,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d5bafe6bd374a4ca4276a464db870b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-01-22T21:25:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-01-22T21:25:55Z,use_quota=True,user_id='289d35e59bfd4735ab80eea97458e077',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(05f420b7-6db4-46fd-9263-28339f5e9114),volume_type_id=05f420b7-6db4-46fd-9263-28339f5e9114)' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:25:55.329416 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-15ce99b3-a58b-4665-801e-e6cc54050f82 tempest-GroupSnapshotsTest-96709162 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32f5d3b9-8460-43a3-b4b5-3bb54dcfdc25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:25:55.333970 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-15ce99b3-a58b-4665-801e-e6cc54050f82 tempest-GroupSnapshotsTest-96709162 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32f5d3b9-8460-43a3-b4b5-3bb54dcfdc25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:25:55.340559 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-15ce99b3-a58b-4665-801e-e6cc54050f82 tempest-GroupSnapshotsTest-96709162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b18f89c3-90d7-467f-aa4f-a703bad93746) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:25:55.345682 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-15ce99b3-a58b-4665-801e-e6cc54050f82 tempest-GroupSnapshotsTest-96709162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b18f89c3-90d7-467f-aa4f-a703bad93746) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a54438f5-2322-486c-97a0-32d093da7178', 'volume_name': 'volume-a54438f5-2322-486c-97a0-32d093da7178', 'volume_size': 1}' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:25:55.351083 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-15ce99b3-a58b-4665-801e-e6cc54050f82 tempest-GroupSnapshotsTest-96709162 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5f4bb83-620c-4c6d-a3b5-aad88e9e1577) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:25:55.356275 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-15ce99b3-a58b-4665-801e-e6cc54050f82 tempest-GroupSnapshotsTest-96709162 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5f4bb83-620c-4c6d-a3b5-aad88e9e1577) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:25:55.365408 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-15ce99b3-a58b-4665-801e-e6cc54050f82 tempest-GroupSnapshotsTest-96709162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d70a5c84-bf20-44e0-ac36-ee8ae84dfc27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:25:55.368758 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.flows.manager.create_volume [None req-15ce99b3-a58b-4665-801e-e6cc54050f82 tempest-GroupSnapshotsTest-96709162 None] Volume a54438f5-2322-486c-97a0-32d093da7178: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a54438f5-2322-486c-97a0-32d093da7178', 'volume_size': 1} Jan 22 21:25:55.368758 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-15ce99b3-a58b-4665-801e-e6cc54050f82 tempest-GroupSnapshotsTest-96709162 None] creating volume 'volume-a54438f5-2322-486c-97a0-32d093da7178' {{(pid=129952) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Jan 22 21:25:55.368758 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-15ce99b3-a58b-4665-801e-e6cc54050f82 tempest-GroupSnapshotsTest-96709162 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:25:56.484030 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-15ce99b3-a58b-4665-801e-e6cc54050f82 tempest-GroupSnapshotsTest-96709162 None] extra_specs: {} {{(pid=129952) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 22 21:25:56.488779 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-15ce99b3-a58b-4665-801e-e6cc54050f82 tempest-GroupSnapshotsTest-96709162 None] extra_specs: {} {{(pid=129952) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 22 21:25:56.488779 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-15ce99b3-a58b-4665-801e-e6cc54050f82 tempest-GroupSnapshotsTest-96709162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d70a5c84-bf20-44e0-ac36-ee8ae84dfc27) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a54438f5-2322-486c-97a0-32d093da7178', 'volume_size': 1}' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:25:56.493387 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-15ce99b3-a58b-4665-801e-e6cc54050f82 tempest-GroupSnapshotsTest-96709162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58efe332-3e64-44df-81f6-2da0906370de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:25:56.568861 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.flows.manager.create_volume [None req-15ce99b3-a58b-4665-801e-e6cc54050f82 tempest-GroupSnapshotsTest-96709162 None] Volume volume-a54438f5-2322-486c-97a0-32d093da7178 (a54438f5-2322-486c-97a0-32d093da7178): created successfully Jan 22 21:25:56.573421 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-15ce99b3-a58b-4665-801e-e6cc54050f82 tempest-GroupSnapshotsTest-96709162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58efe332-3e64-44df-81f6-2da0906370de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:25:56.579349 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-15ce99b3-a58b-4665-801e-e6cc54050f82 tempest-GroupSnapshotsTest-96709162 None] Flow 'volume_create_manager' (f37a7edc-3284-45f0-bc06-26ef829c751d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129952) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 22 21:25:56.643274 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-15ce99b3-a58b-4665-801e-e6cc54050f82 tempest-GroupSnapshotsTest-96709162 None] Created volume successfully. Jan 22 21:25:57.517655 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-ea302d19-17a7-453c-aa72-52a6ea1a99a5 tempest-GroupSnapshotsTest-96709162 None] Update group completed successfully. Jan 22 21:25:58.226283 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.quota [None req-96558f8f-05ae-447f-9aa3-255b3e251b0e tempest-VolumeSnapshotQuotasNegativeTestJSON-1486717369 None] Created reservations ['16089127-85b4-4c22-8eef-2cdc02b53b6b', 'e667577e-74f4-465c-9f84-42a9f4c37e09', '298a26da-7795-4991-bc50-dd8de83e5963', 'df1adb37-376a-4b46-989e-882dc6adb509'] {{(pid=129952) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 22 21:25:58.554389 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-96558f8f-05ae-447f-9aa3-255b3e251b0e tempest-VolumeSnapshotQuotasNegativeTestJSON-1486717369 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:25:58.603075 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-96558f8f-05ae-447f-9aa3-255b3e251b0e tempest-VolumeSnapshotQuotasNegativeTestJSON-1486717369 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:25:58.660455 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.manager [None req-96558f8f-05ae-447f-9aa3-255b3e251b0e tempest-VolumeSnapshotQuotasNegativeTestJSON-1486717369 None] Notifying Schedulers of capabilities ... {{(pid=129952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 22 21:25:58.675603 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-96558f8f-05ae-447f-9aa3-255b3e251b0e tempest-VolumeSnapshotQuotasNegativeTestJSON-1486717369 None] Deleted volume successfully. Jan 22 21:25:58.742665 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.coordination [None req-96558f8f-05ae-447f-9aa3-255b3e251b0e tempest-VolumeSnapshotQuotasNegativeTestJSON-1486717369 None] Lock "b'cinder-60aa7db8-94d3-4836-ba4c-02120f182de4-delete_volume'" released by "delete_volume" :: held 9.486s {{(pid=129952) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 22 21:25:58.902910 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-d7d59c71-4ff2-4465-afc3-a5d73b7c1695 tempest-GroupSnapshotsTest-96709162 None] Update group completed successfully. Jan 22 21:26:00.199288 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-4571bcee-056e-45e6-9017-4364b2391e9a tempest-GroupSnapshotsTest-96709162 None] Update group completed successfully. Jan 22 21:26:01.364182 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-4e6dabc9-1e1b-49b4-a970-ac43d7998900 tempest-GroupSnapshotsTest-96709162 None] Update group completed successfully. Jan 22 21:26:03.171484 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-84f187a1-096c-4678-996b-3b2ebb8a4dc0 tempest-GroupSnapshotsTest-96709162 None] GroupSnapshot 43bbe0a2-89da-4fd8-bb12-8f920e220721: creating. Jan 22 21:26:03.200903 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-84f187a1-096c-4678-996b-3b2ebb8a4dc0 tempest-GroupSnapshotsTest-96709162 None] Group snapshot 43bbe0a2-89da-4fd8-bb12-8f920e220721: creating. {{(pid=129952) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4077}} Jan 22 21:26:03.251867 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-84f187a1-096c-4678-996b-3b2ebb8a4dc0 tempest-GroupSnapshotsTest-96709162 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:26:06.687138 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-84f187a1-096c-4678-996b-3b2ebb8a4dc0 tempest-GroupSnapshotsTest-96709162 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:26:09.713252 ncdv-master-1 cinder-volume[129952]: DEBUG oslo_service.periodic_task [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129952) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jan 22 21:26:09.713984 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:26:09.837604 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:26:09.886911 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.manager [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] Notifying Schedulers of capabilities ... {{(pid=129952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 22 21:26:11.879763 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-84f187a1-096c-4678-996b-3b2ebb8a4dc0 tempest-GroupSnapshotsTest-96709162 None] group_snapshot 43bbe0a2-89da-4fd8-bb12-8f920e220721: created successfully Jan 22 21:26:13.084415 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-3e7deb59-a7e4-4a5e-b331-54c011fa89cd tempest-GroupSnapshotsTest-96709162 None] group_snapshot 43bbe0a2-89da-4fd8-bb12-8f920e220721: deleting Jan 22 21:26:13.112508 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-3e7deb59-a7e4-4a5e-b331-54c011fa89cd tempest-GroupSnapshotsTest-96709162 None] group_snapshot 43bbe0a2-89da-4fd8-bb12-8f920e220721: deleting {{(pid=129952) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4252}} Jan 22 21:26:13.150151 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-3e7deb59-a7e4-4a5e-b331-54c011fa89cd tempest-GroupSnapshotsTest-96709162 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:26:16.480399 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.flows.manager.create_volume [None req-c852cee4-cf29-4d8c-98f2-4852792cf0fd tempest-ServerRescueNegativeTestJSON-158390040 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129952) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Jan 22 21:26:16.483944 ncdv-master-1 cinder-volume[129952]: WARNING stevedore.named [None req-c852cee4-cf29-4d8c-98f2-4852792cf0fd tempest-ServerRescueNegativeTestJSON-158390040 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jan 22 21:26:16.484479 ncdv-master-1 cinder-volume[129952]: WARNING castellan.key_manager [None req-c852cee4-cf29-4d8c-98f2-4852792cf0fd tempest-ServerRescueNegativeTestJSON-158390040 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 22 21:26:16.505823 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-c852cee4-cf29-4d8c-98f2-4852792cf0fd tempest-ServerRescueNegativeTestJSON-158390040 None] Flow 'volume_create_manager' (a1a2c2c7-ed5b-4b92-b756-25380180c567) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 22 21:26:16.513423 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-c852cee4-cf29-4d8c-98f2-4852792cf0fd tempest-ServerRescueNegativeTestJSON-158390040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (935f57d3-a1ae-4f30-bb35-825ab10da10d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:26:16.519856 ncdv-master-1 cinder-volume[129952]: DEBUG oslo_db.sqlalchemy.engines [None req-c852cee4-cf29-4d8c-98f2-4852792cf0fd tempest-ServerRescueNegativeTestJSON-158390040 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129952) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 22 21:26:16.538186 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-c852cee4-cf29-4d8c-98f2-4852792cf0fd tempest-ServerRescueNegativeTestJSON-158390040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (935f57d3-a1ae-4f30-bb35-825ab10da10d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-01-22T21:26:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-636606840',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=c76dc115-8684-4473-93fe-2951f4784073,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33aa542d613e412b9f8da4e23e5ee160',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-01-22T21:26:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-01-22T21:26:16Z,use_quota=True,user_id='6f1e2e6e86ce481f8a8761d163075d67',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6dacb05b-a7ea-4056-85ff-98f0ea5c54eb),volume_type_id=6dacb05b-a7ea-4056-85ff-98f0ea5c54eb)' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:26:16.545137 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-c852cee4-cf29-4d8c-98f2-4852792cf0fd tempest-ServerRescueNegativeTestJSON-158390040 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26769878-377d-4c48-951b-fd9d0089ddca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:26:16.549724 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-c852cee4-cf29-4d8c-98f2-4852792cf0fd tempest-ServerRescueNegativeTestJSON-158390040 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26769878-377d-4c48-951b-fd9d0089ddca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:26:16.555834 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-c852cee4-cf29-4d8c-98f2-4852792cf0fd tempest-ServerRescueNegativeTestJSON-158390040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3374daa-2768-48e6-9a0e-f661f1379c4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:26:16.560374 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-c852cee4-cf29-4d8c-98f2-4852792cf0fd tempest-ServerRescueNegativeTestJSON-158390040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3374daa-2768-48e6-9a0e-f661f1379c4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c76dc115-8684-4473-93fe-2951f4784073', 'volume_name': 'volume-c76dc115-8684-4473-93fe-2951f4784073', 'volume_size': 1}' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:26:16.566242 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-c852cee4-cf29-4d8c-98f2-4852792cf0fd tempest-ServerRescueNegativeTestJSON-158390040 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc6cdaf6-1c73-462a-9285-26c10c95e048) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:26:16.569701 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-c852cee4-cf29-4d8c-98f2-4852792cf0fd tempest-ServerRescueNegativeTestJSON-158390040 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc6cdaf6-1c73-462a-9285-26c10c95e048) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:26:16.575633 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-c852cee4-cf29-4d8c-98f2-4852792cf0fd tempest-ServerRescueNegativeTestJSON-158390040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4007b6b2-607d-418e-94de-42861d134b7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:26:16.576762 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.flows.manager.create_volume [None req-c852cee4-cf29-4d8c-98f2-4852792cf0fd tempest-ServerRescueNegativeTestJSON-158390040 None] Volume c76dc115-8684-4473-93fe-2951f4784073: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c76dc115-8684-4473-93fe-2951f4784073', 'volume_size': 1} Jan 22 21:26:16.577158 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-c852cee4-cf29-4d8c-98f2-4852792cf0fd tempest-ServerRescueNegativeTestJSON-158390040 None] creating volume 'volume-c76dc115-8684-4473-93fe-2951f4784073' {{(pid=129952) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Jan 22 21:26:16.578191 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-c852cee4-cf29-4d8c-98f2-4852792cf0fd tempest-ServerRescueNegativeTestJSON-158390040 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:26:18.098207 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-c852cee4-cf29-4d8c-98f2-4852792cf0fd tempest-ServerRescueNegativeTestJSON-158390040 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129952) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 22 21:26:18.098207 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-c852cee4-cf29-4d8c-98f2-4852792cf0fd tempest-ServerRescueNegativeTestJSON-158390040 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129952) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 22 21:26:18.098207 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-c852cee4-cf29-4d8c-98f2-4852792cf0fd tempest-ServerRescueNegativeTestJSON-158390040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4007b6b2-607d-418e-94de-42861d134b7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c76dc115-8684-4473-93fe-2951f4784073', 'volume_size': 1}' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:26:18.107340 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-c852cee4-cf29-4d8c-98f2-4852792cf0fd tempest-ServerRescueNegativeTestJSON-158390040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24a88323-8bdb-40b6-898e-9942a7d6a744) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:26:18.175344 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.flows.manager.create_volume [None req-c852cee4-cf29-4d8c-98f2-4852792cf0fd tempest-ServerRescueNegativeTestJSON-158390040 None] Volume volume-c76dc115-8684-4473-93fe-2951f4784073 (c76dc115-8684-4473-93fe-2951f4784073): created successfully Jan 22 21:26:18.180090 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-c852cee4-cf29-4d8c-98f2-4852792cf0fd tempest-ServerRescueNegativeTestJSON-158390040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24a88323-8bdb-40b6-898e-9942a7d6a744) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:26:18.197080 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-c852cee4-cf29-4d8c-98f2-4852792cf0fd tempest-ServerRescueNegativeTestJSON-158390040 None] Flow 'volume_create_manager' (a1a2c2c7-ed5b-4b92-b756-25380180c567) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129952) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 22 21:26:18.248854 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-3e7deb59-a7e4-4a5e-b331-54c011fa89cd tempest-GroupSnapshotsTest-96709162 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:26:18.741199 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-c852cee4-cf29-4d8c-98f2-4852792cf0fd tempest-ServerRescueNegativeTestJSON-158390040 None] Created volume successfully. Jan 22 21:26:22.639682 ncdv-master-1 cinder-volume[129952]: WARNING cinder.quota [None req-3e7deb59-a7e4-4a5e-b331-54c011fa89cd tempest-GroupSnapshotsTest-96709162 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1717045441 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1717045441, it is now deprecated. Please use the default quota class for default quota. Jan 22 21:26:22.642038 ncdv-master-1 cinder-volume[129952]: WARNING cinder.quota [None req-3e7deb59-a7e4-4a5e-b331-54c011fa89cd tempest-GroupSnapshotsTest-96709162 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1717045441 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1717045441, it is now deprecated. Please use the default quota class for default quota. Jan 22 21:26:22.751152 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.quota [None req-3e7deb59-a7e4-4a5e-b331-54c011fa89cd tempest-GroupSnapshotsTest-96709162 None] Created reservations ['c8687310-774a-42a9-a1ae-445f7a9c76e8', '50c83c5d-71b2-4b25-ade2-4b530186630a', '347456c9-22ce-4309-846a-50099d3e5582', '3942636a-aefb-4e4a-a2f8-79af27f4cfa3'] {{(pid=129952) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 22 21:26:23.171861 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.quota [None req-3e7deb59-a7e4-4a5e-b331-54c011fa89cd tempest-GroupSnapshotsTest-96709162 None] Created reservations ['fa75858a-9b9c-463a-9952-08e474eb734e', '4f52ff54-1939-45af-989f-2d1f8f0b2b3b', 'ea422245-0298-4189-9ba3-0ff500b6e8d1', '3c323b2f-b1c2-4d18-8930-525af42eae08'] {{(pid=129952) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 22 21:26:23.494795 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-3e7deb59-a7e4-4a5e-b331-54c011fa89cd tempest-GroupSnapshotsTest-96709162 None] group_snapshot 43bbe0a2-89da-4fd8-bb12-8f920e220721: deleted successfully Jan 22 21:26:24.529721 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-9ba84d05-4dda-4efa-a25a-ff15d88124ca tempest-GroupSnapshotsTest-96709162 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:26:24.901153 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-9ba84d05-4dda-4efa-a25a-ff15d88124ca tempest-GroupSnapshotsTest-96709162 None] volume has no backup snaps {{(pid=129952) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Jan 22 21:26:24.901614 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-9ba84d05-4dda-4efa-a25a-ff15d88124ca tempest-GroupSnapshotsTest-96709162 None] Volume volume-597c2e70-c4c5-401f-8be1-374e1f4eed49 is not a clone. {{(pid=129952) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Jan 22 21:26:25.027267 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-9ba84d05-4dda-4efa-a25a-ff15d88124ca tempest-GroupSnapshotsTest-96709162 None] deleting rbd volume volume-597c2e70-c4c5-401f-8be1-374e1f4eed49 {{(pid=129952) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Jan 22 21:26:30.222001 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.flows.manager.create_volume [None req-9dea85c0-cbab-46df-a5b3-3b6fb5ae6d51 tempest-AbsoluteLimitsTests-82220118 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129952) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Jan 22 21:26:30.226990 ncdv-master-1 cinder-volume[129952]: WARNING stevedore.named [None req-9dea85c0-cbab-46df-a5b3-3b6fb5ae6d51 tempest-AbsoluteLimitsTests-82220118 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jan 22 21:26:30.227512 ncdv-master-1 cinder-volume[129952]: WARNING castellan.key_manager [None req-9dea85c0-cbab-46df-a5b3-3b6fb5ae6d51 tempest-AbsoluteLimitsTests-82220118 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 22 21:26:30.251696 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-9dea85c0-cbab-46df-a5b3-3b6fb5ae6d51 tempest-AbsoluteLimitsTests-82220118 None] Flow 'volume_create_manager' (862f5d48-43ee-42de-a784-c9f2b6c64db7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 22 21:26:30.259887 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-9dea85c0-cbab-46df-a5b3-3b6fb5ae6d51 tempest-AbsoluteLimitsTests-82220118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31a2a4f8-7352-4c66-ad7f-02e9a17eb590) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:26:30.267308 ncdv-master-1 cinder-volume[129952]: DEBUG oslo_db.sqlalchemy.engines [None req-9dea85c0-cbab-46df-a5b3-3b6fb5ae6d51 tempest-AbsoluteLimitsTests-82220118 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129952) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 22 21:26:30.282318 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-9dea85c0-cbab-46df-a5b3-3b6fb5ae6d51 tempest-AbsoluteLimitsTests-82220118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31a2a4f8-7352-4c66-ad7f-02e9a17eb590) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-01-22T21:26:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1171030202',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=15a40b38-abe7-4afb-b9fc-02701b53cc0a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ede468ee6a22402b84a760863fbbd4a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-01-22T21:26:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-01-22T21:26:30Z,use_quota=True,user_id='02ec6a0925464284a2d754ce8f1efcc4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6dacb05b-a7ea-4056-85ff-98f0ea5c54eb),volume_type_id=6dacb05b-a7ea-4056-85ff-98f0ea5c54eb)' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:26:30.289075 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-9dea85c0-cbab-46df-a5b3-3b6fb5ae6d51 tempest-AbsoluteLimitsTests-82220118 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1fcaaae3-5197-4396-bed2-feaae64cf422) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:26:30.297784 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-9dea85c0-cbab-46df-a5b3-3b6fb5ae6d51 tempest-AbsoluteLimitsTests-82220118 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1fcaaae3-5197-4396-bed2-feaae64cf422) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:26:30.303689 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-9dea85c0-cbab-46df-a5b3-3b6fb5ae6d51 tempest-AbsoluteLimitsTests-82220118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (760efa7f-3c25-4d92-8434-023526015d90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:26:30.311775 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-9dea85c0-cbab-46df-a5b3-3b6fb5ae6d51 tempest-AbsoluteLimitsTests-82220118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (760efa7f-3c25-4d92-8434-023526015d90) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '15a40b38-abe7-4afb-b9fc-02701b53cc0a', 'volume_name': 'volume-15a40b38-abe7-4afb-b9fc-02701b53cc0a', 'volume_size': 1}' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:26:30.320171 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-9dea85c0-cbab-46df-a5b3-3b6fb5ae6d51 tempest-AbsoluteLimitsTests-82220118 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ae47784-eb4f-404a-acec-69f0f77a1665) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:26:30.325174 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-9dea85c0-cbab-46df-a5b3-3b6fb5ae6d51 tempest-AbsoluteLimitsTests-82220118 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ae47784-eb4f-404a-acec-69f0f77a1665) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:26:30.330974 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-9dea85c0-cbab-46df-a5b3-3b6fb5ae6d51 tempest-AbsoluteLimitsTests-82220118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a237f236-9631-4e3e-b53c-3c3084840307) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:26:30.333180 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.flows.manager.create_volume [None req-9dea85c0-cbab-46df-a5b3-3b6fb5ae6d51 tempest-AbsoluteLimitsTests-82220118 None] Volume 15a40b38-abe7-4afb-b9fc-02701b53cc0a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-15a40b38-abe7-4afb-b9fc-02701b53cc0a', 'volume_size': 1} Jan 22 21:26:30.333954 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-9dea85c0-cbab-46df-a5b3-3b6fb5ae6d51 tempest-AbsoluteLimitsTests-82220118 None] creating volume 'volume-15a40b38-abe7-4afb-b9fc-02701b53cc0a' {{(pid=129952) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Jan 22 21:26:30.335312 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-9dea85c0-cbab-46df-a5b3-3b6fb5ae6d51 tempest-AbsoluteLimitsTests-82220118 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:26:31.458408 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-9dea85c0-cbab-46df-a5b3-3b6fb5ae6d51 tempest-AbsoluteLimitsTests-82220118 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129952) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 22 21:26:31.459558 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-9dea85c0-cbab-46df-a5b3-3b6fb5ae6d51 tempest-AbsoluteLimitsTests-82220118 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129952) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 22 21:26:31.464171 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-9dea85c0-cbab-46df-a5b3-3b6fb5ae6d51 tempest-AbsoluteLimitsTests-82220118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a237f236-9631-4e3e-b53c-3c3084840307) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-15a40b38-abe7-4afb-b9fc-02701b53cc0a', 'volume_size': 1}' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:26:31.469212 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-9dea85c0-cbab-46df-a5b3-3b6fb5ae6d51 tempest-AbsoluteLimitsTests-82220118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1c30381-fab8-4def-9c8a-23fc7c1cfb80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:26:31.557552 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.flows.manager.create_volume [None req-9dea85c0-cbab-46df-a5b3-3b6fb5ae6d51 tempest-AbsoluteLimitsTests-82220118 None] Volume volume-15a40b38-abe7-4afb-b9fc-02701b53cc0a (15a40b38-abe7-4afb-b9fc-02701b53cc0a): created successfully Jan 22 21:26:31.562109 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-9dea85c0-cbab-46df-a5b3-3b6fb5ae6d51 tempest-AbsoluteLimitsTests-82220118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1c30381-fab8-4def-9c8a-23fc7c1cfb80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:26:31.573927 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-9dea85c0-cbab-46df-a5b3-3b6fb5ae6d51 tempest-AbsoluteLimitsTests-82220118 None] Flow 'volume_create_manager' (862f5d48-43ee-42de-a784-c9f2b6c64db7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129952) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 22 21:26:31.654356 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-9dea85c0-cbab-46df-a5b3-3b6fb5ae6d51 tempest-AbsoluteLimitsTests-82220118 None] Created volume successfully. Jan 22 21:26:32.477569 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.coordination [None req-3ad7b34f-61a4-4f85-bdee-960c2d301d91 tempest-AbsoluteLimitsTests-82220118 None] Lock "b'cinder-15a40b38-abe7-4afb-b9fc-02701b53cc0a-delete_volume'" acquired by "delete_volume" :: waited 0.028s {{(pid=129952) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 22 21:26:32.585105 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-3ad7b34f-61a4-4f85-bdee-960c2d301d91 tempest-AbsoluteLimitsTests-82220118 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:26:32.894593 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-3ad7b34f-61a4-4f85-bdee-960c2d301d91 tempest-AbsoluteLimitsTests-82220118 None] volume has no backup snaps {{(pid=129952) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Jan 22 21:26:32.895378 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-3ad7b34f-61a4-4f85-bdee-960c2d301d91 tempest-AbsoluteLimitsTests-82220118 None] Volume volume-15a40b38-abe7-4afb-b9fc-02701b53cc0a is not a clone. {{(pid=129952) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Jan 22 21:26:33.052122 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-3ad7b34f-61a4-4f85-bdee-960c2d301d91 tempest-AbsoluteLimitsTests-82220118 None] deleting rbd volume volume-15a40b38-abe7-4afb-b9fc-02701b53cc0a {{(pid=129952) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Jan 22 21:26:33.067514 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-9ba84d05-4dda-4efa-a25a-ff15d88124ca tempest-GroupSnapshotsTest-96709162 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:26:33.448779 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-9ba84d05-4dda-4efa-a25a-ff15d88124ca tempest-GroupSnapshotsTest-96709162 None] volume has no backup snaps {{(pid=129952) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Jan 22 21:26:33.449205 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-9ba84d05-4dda-4efa-a25a-ff15d88124ca tempest-GroupSnapshotsTest-96709162 None] Volume volume-a54438f5-2322-486c-97a0-32d093da7178 is not a clone. {{(pid=129952) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Jan 22 21:26:33.742420 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-9ba84d05-4dda-4efa-a25a-ff15d88124ca tempest-GroupSnapshotsTest-96709162 None] deleting rbd volume volume-a54438f5-2322-486c-97a0-32d093da7178 {{(pid=129952) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Jan 22 21:26:35.833352 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.flows.manager.create_volume [None req-1dc2eaed-9725-4839-af73-a857dfbb7617 tempest-ServerRescueNegativeTestJSON-158390040 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129952) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Jan 22 21:26:35.841026 ncdv-master-1 cinder-volume[129952]: WARNING stevedore.named [None req-1dc2eaed-9725-4839-af73-a857dfbb7617 tempest-ServerRescueNegativeTestJSON-158390040 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jan 22 21:26:35.841475 ncdv-master-1 cinder-volume[129952]: WARNING castellan.key_manager [None req-1dc2eaed-9725-4839-af73-a857dfbb7617 tempest-ServerRescueNegativeTestJSON-158390040 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 22 21:26:35.864117 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-1dc2eaed-9725-4839-af73-a857dfbb7617 tempest-ServerRescueNegativeTestJSON-158390040 None] Flow 'volume_create_manager' (72067e99-cfa2-4042-ae53-b866f5416a5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 22 21:26:35.872625 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-1dc2eaed-9725-4839-af73-a857dfbb7617 tempest-ServerRescueNegativeTestJSON-158390040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8784af2a-0c67-4ec3-bce2-3c81e72ee36c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:26:35.879984 ncdv-master-1 cinder-volume[129952]: DEBUG oslo_db.sqlalchemy.engines [None req-1dc2eaed-9725-4839-af73-a857dfbb7617 tempest-ServerRescueNegativeTestJSON-158390040 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129952) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 22 21:26:35.914921 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-1dc2eaed-9725-4839-af73-a857dfbb7617 tempest-ServerRescueNegativeTestJSON-158390040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8784af2a-0c67-4ec3-bce2-3c81e72ee36c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-01-22T21:26:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1743456182',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=95aa6904-b117-424d-b97b-91744fe32d8a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33aa542d613e412b9f8da4e23e5ee160',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-01-22T21:26:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-01-22T21:26:36Z,use_quota=True,user_id='6f1e2e6e86ce481f8a8761d163075d67',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6dacb05b-a7ea-4056-85ff-98f0ea5c54eb),volume_type_id=6dacb05b-a7ea-4056-85ff-98f0ea5c54eb)' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:26:35.921878 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-1dc2eaed-9725-4839-af73-a857dfbb7617 tempest-ServerRescueNegativeTestJSON-158390040 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (510bace0-847f-4b5c-861a-824087c057c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:26:35.926941 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-1dc2eaed-9725-4839-af73-a857dfbb7617 tempest-ServerRescueNegativeTestJSON-158390040 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (510bace0-847f-4b5c-861a-824087c057c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:26:35.933560 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-1dc2eaed-9725-4839-af73-a857dfbb7617 tempest-ServerRescueNegativeTestJSON-158390040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7536e41b-5d10-461a-ae95-66df60d96e38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:26:35.938413 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-1dc2eaed-9725-4839-af73-a857dfbb7617 tempest-ServerRescueNegativeTestJSON-158390040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7536e41b-5d10-461a-ae95-66df60d96e38) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '95aa6904-b117-424d-b97b-91744fe32d8a', 'volume_name': 'volume-95aa6904-b117-424d-b97b-91744fe32d8a', 'volume_size': 1}' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:26:35.943806 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-1dc2eaed-9725-4839-af73-a857dfbb7617 tempest-ServerRescueNegativeTestJSON-158390040 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9491c751-3a4e-405c-ba6c-6fd537ae2cb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:26:35.948570 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-1dc2eaed-9725-4839-af73-a857dfbb7617 tempest-ServerRescueNegativeTestJSON-158390040 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9491c751-3a4e-405c-ba6c-6fd537ae2cb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:26:35.954795 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-1dc2eaed-9725-4839-af73-a857dfbb7617 tempest-ServerRescueNegativeTestJSON-158390040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b39e54aa-9847-4c39-83ea-2adebb0ccff0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:26:35.957150 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.flows.manager.create_volume [None req-1dc2eaed-9725-4839-af73-a857dfbb7617 tempest-ServerRescueNegativeTestJSON-158390040 None] Volume 95aa6904-b117-424d-b97b-91744fe32d8a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-95aa6904-b117-424d-b97b-91744fe32d8a', 'volume_size': 1} Jan 22 21:26:35.957658 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-1dc2eaed-9725-4839-af73-a857dfbb7617 tempest-ServerRescueNegativeTestJSON-158390040 None] creating volume 'volume-95aa6904-b117-424d-b97b-91744fe32d8a' {{(pid=129952) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Jan 22 21:26:35.960718 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-1dc2eaed-9725-4839-af73-a857dfbb7617 tempest-ServerRescueNegativeTestJSON-158390040 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:26:37.339440 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-1dc2eaed-9725-4839-af73-a857dfbb7617 tempest-ServerRescueNegativeTestJSON-158390040 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129952) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 22 21:26:37.340533 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-1dc2eaed-9725-4839-af73-a857dfbb7617 tempest-ServerRescueNegativeTestJSON-158390040 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129952) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 22 21:26:37.345336 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-1dc2eaed-9725-4839-af73-a857dfbb7617 tempest-ServerRescueNegativeTestJSON-158390040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b39e54aa-9847-4c39-83ea-2adebb0ccff0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-95aa6904-b117-424d-b97b-91744fe32d8a', 'volume_size': 1}' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:26:37.356557 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-1dc2eaed-9725-4839-af73-a857dfbb7617 tempest-ServerRescueNegativeTestJSON-158390040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ee41df4-c094-4a64-9585-deb4c46e0898) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:26:37.471248 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.flows.manager.create_volume [None req-1dc2eaed-9725-4839-af73-a857dfbb7617 tempest-ServerRescueNegativeTestJSON-158390040 None] Volume volume-95aa6904-b117-424d-b97b-91744fe32d8a (95aa6904-b117-424d-b97b-91744fe32d8a): created successfully Jan 22 21:26:37.475713 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-1dc2eaed-9725-4839-af73-a857dfbb7617 tempest-ServerRescueNegativeTestJSON-158390040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ee41df4-c094-4a64-9585-deb4c46e0898) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:26:37.482913 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-1dc2eaed-9725-4839-af73-a857dfbb7617 tempest-ServerRescueNegativeTestJSON-158390040 None] Flow 'volume_create_manager' (72067e99-cfa2-4042-ae53-b866f5416a5d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129952) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 22 21:26:37.574415 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-1dc2eaed-9725-4839-af73-a857dfbb7617 tempest-ServerRescueNegativeTestJSON-158390040 None] Created volume successfully. Jan 22 21:26:39.349032 ncdv-master-1 cinder-volume[129952]: DEBUG oslo_concurrency.processutils [req-24aea8a8-eb13-4101-8803-195274abda25 req-8ee5ae40-bd56-4621-9970-698ccece1ce9 tempest-ServerRescueNegativeTestJSON-158390040 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129952) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jan 22 21:26:40.324078 ncdv-master-1 cinder-volume[129952]: DEBUG oslo_concurrency.processutils [req-24aea8a8-eb13-4101-8803-195274abda25 req-8ee5ae40-bd56-4621-9970-698ccece1ce9 tempest-ServerRescueNegativeTestJSON-158390040 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.974s {{(pid=129952) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jan 22 21:26:40.325988 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [req-24aea8a8-eb13-4101-8803-195274abda25 req-8ee5ae40-bd56-4621-9970-698ccece1ce9 tempest-ServerRescueNegativeTestJSON-158390040 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-95aa6904-b117-424d-b97b-91744fe32d8a', 'hosts': ['10.222.0.100'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'c7ee930a-3b87-450e-91f6-d4eef70cb484', 'volume_id': '95aa6904-b117-424d-b97b-91744fe32d8a', 'discard': True}} {{(pid=129952) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Jan 22 21:26:40.727292 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [req-24aea8a8-eb13-4101-8803-195274abda25 req-8ee5ae40-bd56-4621-9970-698ccece1ce9 tempest-ServerRescueNegativeTestJSON-158390040 None] Connection info returned from driver {'name': 'volumes/volume-95aa6904-b117-424d-b97b-91744fe32d8a', 'hosts': ['10.222.0.100'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '95aa6904-b117-424d-b97b-91744fe32d8a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '9194cea5-b05f-4b86-be25-5f716d5b5a8d'} {{(pid=129952) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4811}} Jan 22 21:26:40.898840 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [req-24aea8a8-eb13-4101-8803-195274abda25 req-8ee5ae40-bd56-4621-9970-698ccece1ce9 tempest-ServerRescueNegativeTestJSON-158390040 None] attachment_update completed successfully. Jan 22 21:26:42.301058 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.quota [None req-3ad7b34f-61a4-4f85-bdee-960c2d301d91 tempest-AbsoluteLimitsTests-82220118 None] Created reservations ['50be00c1-db23-4121-8934-4786b13184c4', 'cb97139b-b3f8-45f3-9d33-991356baeae5', 'ce7833ef-9c68-4c2e-83e0-8969cd94511f', 'c5ee54e4-f972-4c0b-8123-776db28375a2'] {{(pid=129952) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 22 21:26:42.609332 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-3ad7b34f-61a4-4f85-bdee-960c2d301d91 tempest-AbsoluteLimitsTests-82220118 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:26:42.666919 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-3ad7b34f-61a4-4f85-bdee-960c2d301d91 tempest-AbsoluteLimitsTests-82220118 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:26:42.704407 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.manager [None req-3ad7b34f-61a4-4f85-bdee-960c2d301d91 tempest-AbsoluteLimitsTests-82220118 None] Notifying Schedulers of capabilities ... {{(pid=129952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 22 21:26:42.746208 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-3ad7b34f-61a4-4f85-bdee-960c2d301d91 tempest-AbsoluteLimitsTests-82220118 None] Deleted volume successfully. Jan 22 21:26:42.854753 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.coordination [None req-3ad7b34f-61a4-4f85-bdee-960c2d301d91 tempest-AbsoluteLimitsTests-82220118 None] Lock "b'cinder-15a40b38-abe7-4afb-b9fc-02701b53cc0a-delete_volume'" released by "delete_volume" :: held 10.377s {{(pid=129952) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 22 21:26:43.013886 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.quota [None req-9ba84d05-4dda-4efa-a25a-ff15d88124ca tempest-GroupSnapshotsTest-96709162 None] Created reservations ['6c47eb1d-7a97-4a1f-90ca-4b50b90f5f02'] {{(pid=129952) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 22 21:26:43.041540 ncdv-master-1 cinder-volume[129952]: WARNING cinder.quota [None req-9ba84d05-4dda-4efa-a25a-ff15d88124ca tempest-GroupSnapshotsTest-96709162 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1717045441 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1717045441, it is now deprecated. Please use the default quota class for default quota. Jan 22 21:26:43.176918 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.quota [None req-9ba84d05-4dda-4efa-a25a-ff15d88124ca tempest-GroupSnapshotsTest-96709162 None] Created reservations ['adeca4d9-4d62-4c14-b2be-d93bb4e20289', 'd5b7fb30-7a47-4954-98fb-ad3477ea30ca', '2e37d954-5a19-4da0-ae1d-72d78b9a048b', 'eee04a39-7477-49c7-9fa1-8bc031427bfb'] {{(pid=129952) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 22 21:26:43.556733 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.quota [None req-9ba84d05-4dda-4efa-a25a-ff15d88124ca tempest-GroupSnapshotsTest-96709162 None] Created reservations ['b4959a92-7902-453d-b872-9e988fb002e7', '8dd9e38c-495b-413f-877b-663eaf07d299', 'b79144e6-a922-4bf0-a0da-ed6ddfd8b1bc', 'abdb2d26-21ac-46e8-b5e3-60a19bdfad92'] {{(pid=129952) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 22 21:26:44.192443 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-9ba84d05-4dda-4efa-a25a-ff15d88124ca tempest-GroupSnapshotsTest-96709162 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:26:44.266939 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-9ba84d05-4dda-4efa-a25a-ff15d88124ca tempest-GroupSnapshotsTest-96709162 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:26:44.341949 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.manager [None req-9ba84d05-4dda-4efa-a25a-ff15d88124ca tempest-GroupSnapshotsTest-96709162 None] Notifying Schedulers of capabilities ... {{(pid=129952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 22 21:26:44.349416 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-9ba84d05-4dda-4efa-a25a-ff15d88124ca tempest-GroupSnapshotsTest-96709162 None] Delete group completed successfully. Jan 22 21:26:45.854217 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-a2e4444f-280a-4367-9d08-8c38e2d4ddab tempest-GroupSnapshotsTest-96709162 None] Group tempest-GroupSnapshotsTest-Group-152924873: creating Jan 22 21:26:45.989300 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-a2e4444f-280a-4367-9d08-8c38e2d4ddab tempest-GroupSnapshotsTest-96709162 None] Group tempest-GroupSnapshotsTest-Group-152924873: created successfully Jan 22 21:26:46.000265 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-a2e4444f-280a-4367-9d08-8c38e2d4ddab tempest-GroupSnapshotsTest-96709162 None] Create group completed successfully. Jan 22 21:26:47.925303 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.flows.manager.create_volume [None req-1b3bbf9d-e33e-4269-b65a-13e98d8f0ae6 tempest-GroupSnapshotsTest-96709162 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129952) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Jan 22 21:26:47.934597 ncdv-master-1 cinder-volume[129952]: WARNING stevedore.named [None req-1b3bbf9d-e33e-4269-b65a-13e98d8f0ae6 tempest-GroupSnapshotsTest-96709162 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jan 22 21:26:47.936246 ncdv-master-1 cinder-volume[129952]: WARNING castellan.key_manager [None req-1b3bbf9d-e33e-4269-b65a-13e98d8f0ae6 tempest-GroupSnapshotsTest-96709162 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 22 21:26:47.978779 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-1b3bbf9d-e33e-4269-b65a-13e98d8f0ae6 tempest-GroupSnapshotsTest-96709162 None] Flow 'volume_create_manager' (f4faee2c-b7b1-42b7-a045-faf6fdca5366) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 22 21:26:47.989320 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-1b3bbf9d-e33e-4269-b65a-13e98d8f0ae6 tempest-GroupSnapshotsTest-96709162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (775310b6-2b8e-4244-8892-4af3a3bef233) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:26:47.998323 ncdv-master-1 cinder-volume[129952]: DEBUG oslo_db.sqlalchemy.engines [None req-1b3bbf9d-e33e-4269-b65a-13e98d8f0ae6 tempest-GroupSnapshotsTest-96709162 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129952) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 22 21:26:48.017121 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-1b3bbf9d-e33e-4269-b65a-13e98d8f0ae6 tempest-GroupSnapshotsTest-96709162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (775310b6-2b8e-4244-8892-4af3a3bef233) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-01-22T21:26:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-GroupSnapshotsTest-Volume-1244960634',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e2e0320d-5977-471d-bc5d-50fdc275d90f,host='ncdv-master-1@ceph#ceph',id=69b7bac7-0b84-49bc-abdd-884e1edff11a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d5bafe6bd374a4ca4276a464db870b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-01-22T21:26:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-01-22T21:26:48Z,use_quota=True,user_id='289d35e59bfd4735ab80eea97458e077',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(466c9709-8db6-437a-8901-056f39e2d2c5),volume_type_id=466c9709-8db6-437a-8901-056f39e2d2c5)' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:26:48.024074 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-1b3bbf9d-e33e-4269-b65a-13e98d8f0ae6 tempest-GroupSnapshotsTest-96709162 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac21a45c-25de-4d5c-8bdf-f8c9847020f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:26:48.028560 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-1b3bbf9d-e33e-4269-b65a-13e98d8f0ae6 tempest-GroupSnapshotsTest-96709162 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac21a45c-25de-4d5c-8bdf-f8c9847020f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:26:48.034082 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-1b3bbf9d-e33e-4269-b65a-13e98d8f0ae6 tempest-GroupSnapshotsTest-96709162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (043a8980-6980-4a5e-a8c1-c8c5345870e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:26:48.039826 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-1b3bbf9d-e33e-4269-b65a-13e98d8f0ae6 tempest-GroupSnapshotsTest-96709162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (043a8980-6980-4a5e-a8c1-c8c5345870e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '69b7bac7-0b84-49bc-abdd-884e1edff11a', 'volume_name': 'volume-69b7bac7-0b84-49bc-abdd-884e1edff11a', 'volume_size': 1}' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:26:48.045474 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-1b3bbf9d-e33e-4269-b65a-13e98d8f0ae6 tempest-GroupSnapshotsTest-96709162 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3628a3a4-16b4-492b-9512-1ddbc5f89e66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:26:48.056553 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-1b3bbf9d-e33e-4269-b65a-13e98d8f0ae6 tempest-GroupSnapshotsTest-96709162 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3628a3a4-16b4-492b-9512-1ddbc5f89e66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:26:48.069100 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-1b3bbf9d-e33e-4269-b65a-13e98d8f0ae6 tempest-GroupSnapshotsTest-96709162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a3aada1-025c-4970-95f9-6c33c2cc1ba3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:26:48.069100 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.flows.manager.create_volume [None req-1b3bbf9d-e33e-4269-b65a-13e98d8f0ae6 tempest-GroupSnapshotsTest-96709162 None] Volume 69b7bac7-0b84-49bc-abdd-884e1edff11a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-69b7bac7-0b84-49bc-abdd-884e1edff11a', 'volume_size': 1} Jan 22 21:26:48.069100 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-1b3bbf9d-e33e-4269-b65a-13e98d8f0ae6 tempest-GroupSnapshotsTest-96709162 None] creating volume 'volume-69b7bac7-0b84-49bc-abdd-884e1edff11a' {{(pid=129952) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Jan 22 21:26:48.069100 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-1b3bbf9d-e33e-4269-b65a-13e98d8f0ae6 tempest-GroupSnapshotsTest-96709162 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:26:49.237039 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-1b3bbf9d-e33e-4269-b65a-13e98d8f0ae6 tempest-GroupSnapshotsTest-96709162 None] extra_specs: {} {{(pid=129952) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 22 21:26:49.237906 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-1b3bbf9d-e33e-4269-b65a-13e98d8f0ae6 tempest-GroupSnapshotsTest-96709162 None] extra_specs: {} {{(pid=129952) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 22 21:26:49.252487 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-1b3bbf9d-e33e-4269-b65a-13e98d8f0ae6 tempest-GroupSnapshotsTest-96709162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a3aada1-025c-4970-95f9-6c33c2cc1ba3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-69b7bac7-0b84-49bc-abdd-884e1edff11a', 'volume_size': 1}' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:26:49.257802 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-1b3bbf9d-e33e-4269-b65a-13e98d8f0ae6 tempest-GroupSnapshotsTest-96709162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2e1e0a4-554e-4292-809d-6dfbc3ef7678) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:26:49.443319 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.flows.manager.create_volume [None req-1b3bbf9d-e33e-4269-b65a-13e98d8f0ae6 tempest-GroupSnapshotsTest-96709162 None] Volume volume-69b7bac7-0b84-49bc-abdd-884e1edff11a (69b7bac7-0b84-49bc-abdd-884e1edff11a): created successfully Jan 22 21:26:49.454778 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-1b3bbf9d-e33e-4269-b65a-13e98d8f0ae6 tempest-GroupSnapshotsTest-96709162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2e1e0a4-554e-4292-809d-6dfbc3ef7678) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:26:49.463290 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-1b3bbf9d-e33e-4269-b65a-13e98d8f0ae6 tempest-GroupSnapshotsTest-96709162 None] Flow 'volume_create_manager' (f4faee2c-b7b1-42b7-a045-faf6fdca5366) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129952) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 22 21:26:49.569805 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-1b3bbf9d-e33e-4269-b65a-13e98d8f0ae6 tempest-GroupSnapshotsTest-96709162 None] Created volume successfully. Jan 22 21:26:50.800904 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-7531dfcd-fd49-4926-b31e-d5bdf4aa335b tempest-GroupSnapshotsTest-96709162 None] GroupSnapshot e1720032-5600-4e03-afa2-d0d8d49d456a: creating. Jan 22 21:26:50.852222 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-7531dfcd-fd49-4926-b31e-d5bdf4aa335b tempest-GroupSnapshotsTest-96709162 None] Group snapshot e1720032-5600-4e03-afa2-d0d8d49d456a: creating. {{(pid=129952) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4077}} Jan 22 21:26:50.927604 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-7531dfcd-fd49-4926-b31e-d5bdf4aa335b tempest-GroupSnapshotsTest-96709162 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:26:51.532874 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.flows.manager.create_volume [None req-91649d4b-95b0-4e40-9093-a10dfc80aceb tempest-VolumesBackupsV39Test-1645624774 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129952) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Jan 22 21:26:51.553235 ncdv-master-1 cinder-volume[129952]: WARNING stevedore.named [None req-91649d4b-95b0-4e40-9093-a10dfc80aceb tempest-VolumesBackupsV39Test-1645624774 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jan 22 21:26:51.553379 ncdv-master-1 cinder-volume[129952]: WARNING castellan.key_manager [None req-91649d4b-95b0-4e40-9093-a10dfc80aceb tempest-VolumesBackupsV39Test-1645624774 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 22 21:26:51.613015 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-91649d4b-95b0-4e40-9093-a10dfc80aceb tempest-VolumesBackupsV39Test-1645624774 None] Flow 'volume_create_manager' (c2d99659-5f7b-43e1-a58a-cdd9cd0c5398) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 22 21:26:51.626218 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-91649d4b-95b0-4e40-9093-a10dfc80aceb tempest-VolumesBackupsV39Test-1645624774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3212491f-9a93-45b9-9c33-ba86ef106fe5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:26:51.640950 ncdv-master-1 cinder-volume[129952]: DEBUG oslo_db.sqlalchemy.engines [None req-91649d4b-95b0-4e40-9093-a10dfc80aceb tempest-VolumesBackupsV39Test-1645624774 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129952) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 22 21:26:51.672007 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-91649d4b-95b0-4e40-9093-a10dfc80aceb tempest-VolumesBackupsV39Test-1645624774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3212491f-9a93-45b9-9c33-ba86ef106fe5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-01-22T21:26:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsV39Test-Volume-293700255',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=e9b2332f-81f1-4153-b8b4-cb705451aa3a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd81a8a0829e45e08d53e88a44696e93',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-01-22T21:26:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-01-22T21:26:51Z,use_quota=True,user_id='17d492e153d24389a8326e72f9da4c4a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6dacb05b-a7ea-4056-85ff-98f0ea5c54eb),volume_type_id=6dacb05b-a7ea-4056-85ff-98f0ea5c54eb)' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:26:51.686940 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-91649d4b-95b0-4e40-9093-a10dfc80aceb tempest-VolumesBackupsV39Test-1645624774 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ec5cf40-5234-4b94-82d5-73572de7f678) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:26:51.700222 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-91649d4b-95b0-4e40-9093-a10dfc80aceb tempest-VolumesBackupsV39Test-1645624774 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ec5cf40-5234-4b94-82d5-73572de7f678) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:26:51.703919 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-91649d4b-95b0-4e40-9093-a10dfc80aceb tempest-VolumesBackupsV39Test-1645624774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98400288-abb7-43e8-a649-d73013908701) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:26:51.713191 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-91649d4b-95b0-4e40-9093-a10dfc80aceb tempest-VolumesBackupsV39Test-1645624774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98400288-abb7-43e8-a649-d73013908701) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e9b2332f-81f1-4153-b8b4-cb705451aa3a', 'volume_name': 'volume-e9b2332f-81f1-4153-b8b4-cb705451aa3a', 'volume_size': 1}' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:26:51.719221 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-91649d4b-95b0-4e40-9093-a10dfc80aceb tempest-VolumesBackupsV39Test-1645624774 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d008a0e2-a614-4922-ad47-e9717bc1aacf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:26:51.735530 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-91649d4b-95b0-4e40-9093-a10dfc80aceb tempest-VolumesBackupsV39Test-1645624774 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d008a0e2-a614-4922-ad47-e9717bc1aacf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:26:51.755880 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-91649d4b-95b0-4e40-9093-a10dfc80aceb tempest-VolumesBackupsV39Test-1645624774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2df5efa5-5ba6-4f2d-be22-bae279a46c0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:26:51.758873 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.flows.manager.create_volume [None req-91649d4b-95b0-4e40-9093-a10dfc80aceb tempest-VolumesBackupsV39Test-1645624774 None] Volume e9b2332f-81f1-4153-b8b4-cb705451aa3a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e9b2332f-81f1-4153-b8b4-cb705451aa3a', 'volume_size': 1} Jan 22 21:26:51.759276 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-91649d4b-95b0-4e40-9093-a10dfc80aceb tempest-VolumesBackupsV39Test-1645624774 None] creating volume 'volume-e9b2332f-81f1-4153-b8b4-cb705451aa3a' {{(pid=129952) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Jan 22 21:26:51.761892 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-91649d4b-95b0-4e40-9093-a10dfc80aceb tempest-VolumesBackupsV39Test-1645624774 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:26:52.934711 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-91649d4b-95b0-4e40-9093-a10dfc80aceb tempest-VolumesBackupsV39Test-1645624774 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129952) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 22 21:26:52.943499 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-91649d4b-95b0-4e40-9093-a10dfc80aceb tempest-VolumesBackupsV39Test-1645624774 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129952) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 22 21:26:52.943499 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-91649d4b-95b0-4e40-9093-a10dfc80aceb tempest-VolumesBackupsV39Test-1645624774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2df5efa5-5ba6-4f2d-be22-bae279a46c0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e9b2332f-81f1-4153-b8b4-cb705451aa3a', 'volume_size': 1}' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:26:52.946967 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-91649d4b-95b0-4e40-9093-a10dfc80aceb tempest-VolumesBackupsV39Test-1645624774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9fefe385-b0c0-4ea3-b8d1-3e12ff66823c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:26:53.106560 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.flows.manager.create_volume [None req-91649d4b-95b0-4e40-9093-a10dfc80aceb tempest-VolumesBackupsV39Test-1645624774 None] Volume volume-e9b2332f-81f1-4153-b8b4-cb705451aa3a (e9b2332f-81f1-4153-b8b4-cb705451aa3a): created successfully Jan 22 21:26:53.112423 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-91649d4b-95b0-4e40-9093-a10dfc80aceb tempest-VolumesBackupsV39Test-1645624774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9fefe385-b0c0-4ea3-b8d1-3e12ff66823c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:26:53.119146 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-91649d4b-95b0-4e40-9093-a10dfc80aceb tempest-VolumesBackupsV39Test-1645624774 None] Flow 'volume_create_manager' (c2d99659-5f7b-43e1-a58a-cdd9cd0c5398) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129952) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 22 21:26:53.271804 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-91649d4b-95b0-4e40-9093-a10dfc80aceb tempest-VolumesBackupsV39Test-1645624774 None] Created volume successfully. Jan 22 21:26:55.247190 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-7531dfcd-fd49-4926-b31e-d5bdf4aa335b tempest-GroupSnapshotsTest-96709162 None] group_snapshot e1720032-5600-4e03-afa2-d0d8d49d456a: created successfully Jan 22 21:26:56.581246 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-dc219053-869b-49e1-89ba-1c4e933c782a tempest-GroupSnapshotsTest-96709162 None] group_snapshot e1720032-5600-4e03-afa2-d0d8d49d456a: deleting Jan 22 21:26:56.640518 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-dc219053-869b-49e1-89ba-1c4e933c782a tempest-GroupSnapshotsTest-96709162 None] group_snapshot e1720032-5600-4e03-afa2-d0d8d49d456a: deleting {{(pid=129952) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4252}} Jan 22 21:26:56.682214 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-dc219053-869b-49e1-89ba-1c4e933c782a tempest-GroupSnapshotsTest-96709162 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:27:01.157946 ncdv-master-1 cinder-volume[129952]: WARNING cinder.quota [None req-dc219053-869b-49e1-89ba-1c4e933c782a tempest-GroupSnapshotsTest-96709162 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-815209741 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-815209741, it is now deprecated. Please use the default quota class for default quota. Jan 22 21:27:01.158736 ncdv-master-1 cinder-volume[129952]: WARNING cinder.quota [None req-dc219053-869b-49e1-89ba-1c4e933c782a tempest-GroupSnapshotsTest-96709162 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-815209741 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-815209741, it is now deprecated. Please use the default quota class for default quota. Jan 22 21:27:01.275857 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.quota [None req-dc219053-869b-49e1-89ba-1c4e933c782a tempest-GroupSnapshotsTest-96709162 None] Created reservations ['5ddcc34e-b9c0-4221-96ff-387259cc5973', '30470de7-5d36-494c-8041-356683984abc', '0c0cabbe-d461-4b1f-bbe0-c0aee43a7e59', 'c98ca22b-d65b-4850-aa10-3436e47369cb'] {{(pid=129952) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 22 21:27:01.612948 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-dc219053-869b-49e1-89ba-1c4e933c782a tempest-GroupSnapshotsTest-96709162 None] group_snapshot e1720032-5600-4e03-afa2-d0d8d49d456a: deleted successfully Jan 22 21:27:02.819872 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-3e435355-97c5-4e4e-be2c-80e637cd27d3 tempest-GroupSnapshotsTest-96709162 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:27:03.059063 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-3e435355-97c5-4e4e-be2c-80e637cd27d3 tempest-GroupSnapshotsTest-96709162 None] volume has no backup snaps {{(pid=129952) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Jan 22 21:27:03.059516 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-3e435355-97c5-4e4e-be2c-80e637cd27d3 tempest-GroupSnapshotsTest-96709162 None] Volume volume-69b7bac7-0b84-49bc-abdd-884e1edff11a is not a clone. {{(pid=129952) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Jan 22 21:27:03.500384 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-3e435355-97c5-4e4e-be2c-80e637cd27d3 tempest-GroupSnapshotsTest-96709162 None] deleting rbd volume volume-69b7bac7-0b84-49bc-abdd-884e1edff11a {{(pid=129952) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Jan 22 21:27:03.586755 ncdv-master-1 cinder-volume[129952]: DEBUG oslo_concurrency.processutils [None req-ab5d9243-cd7f-4652-8c89-ab9fd7ce4b5a tempest-VolumesBackupsV39Test-1645624774 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129952) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jan 22 21:27:04.601551 ncdv-master-1 cinder-volume[129952]: DEBUG oslo_concurrency.processutils [None req-ab5d9243-cd7f-4652-8c89-ab9fd7ce4b5a tempest-VolumesBackupsV39Test-1645624774 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.015s {{(pid=129952) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jan 22 21:27:04.603054 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-ab5d9243-cd7f-4652-8c89-ab9fd7ce4b5a tempest-VolumesBackupsV39Test-1645624774 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-e9b2332f-81f1-4153-b8b4-cb705451aa3a', 'hosts': ['10.222.0.100'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'c7ee930a-3b87-450e-91f6-d4eef70cb484', 'volume_id': 'e9b2332f-81f1-4153-b8b4-cb705451aa3a', 'discard': True}} {{(pid=129952) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Jan 22 21:27:04.624994 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-ab5d9243-cd7f-4652-8c89-ab9fd7ce4b5a tempest-VolumesBackupsV39Test-1645624774 None] Initialize volume connection completed successfully. Jan 22 21:27:09.712305 ncdv-master-1 cinder-volume[129952]: DEBUG oslo_service.periodic_task [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129952) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jan 22 21:27:09.725068 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:27:09.781491 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:27:09.854026 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.manager [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] Notifying Schedulers of capabilities ... {{(pid=129952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 22 21:27:12.835548 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.quota [None req-3e435355-97c5-4e4e-be2c-80e637cd27d3 tempest-GroupSnapshotsTest-96709162 None] Created reservations ['f6d77001-e9f0-4bf1-abcc-bace5a9d1375'] {{(pid=129952) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 22 21:27:12.922733 ncdv-master-1 cinder-volume[129952]: WARNING cinder.quota [None req-3e435355-97c5-4e4e-be2c-80e637cd27d3 tempest-GroupSnapshotsTest-96709162 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-815209741 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-815209741, it is now deprecated. Please use the default quota class for default quota. Jan 22 21:27:13.070213 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.quota [None req-3e435355-97c5-4e4e-be2c-80e637cd27d3 tempest-GroupSnapshotsTest-96709162 None] Created reservations ['741ebf27-660f-438c-98fe-2e4425077fa7', '4a10a711-fff9-447d-8652-04a6bf0f25a3', '9d5d4296-65bd-4d73-9d63-5c580152875b', '2791ceed-b4d7-4a0b-8848-e39a4e15ae09'] {{(pid=129952) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 22 21:27:13.642453 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-3e435355-97c5-4e4e-be2c-80e637cd27d3 tempest-GroupSnapshotsTest-96709162 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:27:13.737155 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-3e435355-97c5-4e4e-be2c-80e637cd27d3 tempest-GroupSnapshotsTest-96709162 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:27:13.783130 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.manager [None req-3e435355-97c5-4e4e-be2c-80e637cd27d3 tempest-GroupSnapshotsTest-96709162 None] Notifying Schedulers of capabilities ... {{(pid=129952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 22 21:27:13.792742 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-3e435355-97c5-4e4e-be2c-80e637cd27d3 tempest-GroupSnapshotsTest-96709162 None] Delete group completed successfully. Jan 22 21:27:16.070562 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [req-3d95ddcb-e0f7-496a-897c-7d4d9babca83 req-4d12f7b5-c507-462f-8f3a-546b2bd89b1c tempest-ServerRescueNegativeTestJSON-158390040 None] Terminate volume connection completed successfully. Jan 22 21:27:16.071264 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [req-3d95ddcb-e0f7-496a-897c-7d4d9babca83 req-4d12f7b5-c507-462f-8f3a-546b2bd89b1c tempest-ServerRescueNegativeTestJSON-158390040 None] Deleting attachment 9194cea5-b05f-4b86-be25-5f716d5b5a8d. {{(pid=129952) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4947}} Jan 22 21:27:17.556955 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-ab5d9243-cd7f-4652-8c89-ab9fd7ce4b5a tempest-VolumesBackupsV39Test-1645624774 None] Terminate volume connection completed successfully. Jan 22 21:27:17.581819 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-ab5d9243-cd7f-4652-8c89-ab9fd7ce4b5a tempest-VolumesBackupsV39Test-1645624774 None] Remove volume export completed successfully. Jan 22 21:27:17.978730 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.coordination [None req-789374e2-1ed3-42e1-84cf-b37bdfc9cdc2 tempest-ServerRescueNegativeTestJSON-158390040 None] Lock "b'cinder-95aa6904-b117-424d-b97b-91744fe32d8a-delete_volume'" acquired by "delete_volume" :: waited 0.014s {{(pid=129952) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 22 21:27:18.112002 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-789374e2-1ed3-42e1-84cf-b37bdfc9cdc2 tempest-ServerRescueNegativeTestJSON-158390040 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:27:18.468956 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-789374e2-1ed3-42e1-84cf-b37bdfc9cdc2 tempest-ServerRescueNegativeTestJSON-158390040 None] volume has no backup snaps {{(pid=129952) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Jan 22 21:27:18.469621 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-789374e2-1ed3-42e1-84cf-b37bdfc9cdc2 tempest-ServerRescueNegativeTestJSON-158390040 None] Volume volume-95aa6904-b117-424d-b97b-91744fe32d8a is not a clone. {{(pid=129952) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Jan 22 21:27:18.733810 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-789374e2-1ed3-42e1-84cf-b37bdfc9cdc2 tempest-ServerRescueNegativeTestJSON-158390040 None] deleting rbd volume volume-95aa6904-b117-424d-b97b-91744fe32d8a {{(pid=129952) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Jan 22 21:27:26.549552 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.quota [None req-789374e2-1ed3-42e1-84cf-b37bdfc9cdc2 tempest-ServerRescueNegativeTestJSON-158390040 None] Created reservations ['5d7c89cc-0cf2-417d-909e-864cb6b09d97', 'd3c567f5-9756-406d-a563-5189635ff30c', '5f9b8a65-1ec2-4a7a-8c9f-387ad10acc7d', '55e3fadb-ff16-4d10-a404-4af460adcd68'] {{(pid=129952) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 22 21:27:26.779403 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-789374e2-1ed3-42e1-84cf-b37bdfc9cdc2 tempest-ServerRescueNegativeTestJSON-158390040 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:27:26.841012 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-789374e2-1ed3-42e1-84cf-b37bdfc9cdc2 tempest-ServerRescueNegativeTestJSON-158390040 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:27:26.943080 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.manager [None req-789374e2-1ed3-42e1-84cf-b37bdfc9cdc2 tempest-ServerRescueNegativeTestJSON-158390040 None] Notifying Schedulers of capabilities ... {{(pid=129952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 22 21:27:26.954597 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-789374e2-1ed3-42e1-84cf-b37bdfc9cdc2 tempest-ServerRescueNegativeTestJSON-158390040 None] Deleted volume successfully. Jan 22 21:27:27.131856 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.coordination [None req-789374e2-1ed3-42e1-84cf-b37bdfc9cdc2 tempest-ServerRescueNegativeTestJSON-158390040 None] Lock "b'cinder-95aa6904-b117-424d-b97b-91744fe32d8a-delete_volume'" released by "delete_volume" :: held 9.150s {{(pid=129952) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 22 21:27:27.219731 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.coordination [None req-b12b1734-b03a-47ce-b1fd-a72e3d626759 tempest-ServerRescueNegativeTestJSON-158390040 None] Lock "b'cinder-c76dc115-8684-4473-93fe-2951f4784073-delete_volume'" acquired by "delete_volume" :: waited 0.022s {{(pid=129952) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 22 21:27:27.320205 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-b12b1734-b03a-47ce-b1fd-a72e3d626759 tempest-ServerRescueNegativeTestJSON-158390040 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:27:27.667178 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-b12b1734-b03a-47ce-b1fd-a72e3d626759 tempest-ServerRescueNegativeTestJSON-158390040 None] volume has no backup snaps {{(pid=129952) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Jan 22 21:27:27.668745 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-b12b1734-b03a-47ce-b1fd-a72e3d626759 tempest-ServerRescueNegativeTestJSON-158390040 None] Volume volume-c76dc115-8684-4473-93fe-2951f4784073 is not a clone. {{(pid=129952) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Jan 22 21:27:27.932459 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-b12b1734-b03a-47ce-b1fd-a72e3d626759 tempest-ServerRescueNegativeTestJSON-158390040 None] deleting rbd volume volume-c76dc115-8684-4473-93fe-2951f4784073 {{(pid=129952) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Jan 22 21:27:32.278240 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.coordination [None req-85177a3e-e1d9-4e8c-85e6-1143ee400980 tempest-VolumesBackupsV39Test-1645624774 None] Lock "b'cinder-e9b2332f-81f1-4153-b8b4-cb705451aa3a-delete_volume'" acquired by "delete_volume" :: waited 0.018s {{(pid=129952) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 22 21:27:32.485648 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-85177a3e-e1d9-4e8c-85e6-1143ee400980 tempest-VolumesBackupsV39Test-1645624774 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:27:35.473953 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-85177a3e-e1d9-4e8c-85e6-1143ee400980 tempest-VolumesBackupsV39Test-1645624774 None] Volume volume-e9b2332f-81f1-4153-b8b4-cb705451aa3a is not a clone. {{(pid=129952) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Jan 22 21:27:36.177998 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-85177a3e-e1d9-4e8c-85e6-1143ee400980 tempest-VolumesBackupsV39Test-1645624774 None] deleting rbd volume volume-e9b2332f-81f1-4153-b8b4-cb705451aa3a {{(pid=129952) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Jan 22 21:27:36.397002 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.quota [None req-b12b1734-b03a-47ce-b1fd-a72e3d626759 tempest-ServerRescueNegativeTestJSON-158390040 None] Created reservations ['9a7cb930-1e1d-4674-aa11-6ccf2d87b79c', '8e9c7733-7dde-4ead-af5e-cb5017dc119a', 'e5c3523e-37ab-4c08-929e-3e1753c6c280', 'd6e3d55a-97a4-4f97-a6fe-1c6af97944f6'] {{(pid=129952) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 22 21:27:36.638590 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-b12b1734-b03a-47ce-b1fd-a72e3d626759 tempest-ServerRescueNegativeTestJSON-158390040 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:27:36.720891 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-b12b1734-b03a-47ce-b1fd-a72e3d626759 tempest-ServerRescueNegativeTestJSON-158390040 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:27:36.783037 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.manager [None req-b12b1734-b03a-47ce-b1fd-a72e3d626759 tempest-ServerRescueNegativeTestJSON-158390040 None] Notifying Schedulers of capabilities ... {{(pid=129952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 22 21:27:36.788024 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-b12b1734-b03a-47ce-b1fd-a72e3d626759 tempest-ServerRescueNegativeTestJSON-158390040 None] Deleted volume successfully. Jan 22 21:27:36.907499 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.coordination [None req-b12b1734-b03a-47ce-b1fd-a72e3d626759 tempest-ServerRescueNegativeTestJSON-158390040 None] Lock "b'cinder-c76dc115-8684-4473-93fe-2951f4784073-delete_volume'" released by "delete_volume" :: held 9.687s {{(pid=129952) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 22 21:27:43.841168 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.quota [None req-85177a3e-e1d9-4e8c-85e6-1143ee400980 tempest-VolumesBackupsV39Test-1645624774 None] Created reservations ['fc19ade0-181c-4192-9272-d306f1277034', '6a11b2b0-7440-4d29-8bba-f66f3e9d823e', 'ca933d0d-1846-43fe-993f-161a228ae205', '7ee5ad4a-6baf-4baf-8b94-13c1ba356fd9'] {{(pid=129952) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 22 21:27:43.881786 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.flows.manager.create_volume [None req-ea2518b5-e6c3-4628-9876-f37dc16afb00 tempest-SnapshotsActionsTest-439238394 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129952) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Jan 22 21:27:43.887299 ncdv-master-1 cinder-volume[129952]: WARNING stevedore.named [None req-ea2518b5-e6c3-4628-9876-f37dc16afb00 tempest-SnapshotsActionsTest-439238394 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jan 22 21:27:43.888204 ncdv-master-1 cinder-volume[129952]: WARNING castellan.key_manager [None req-ea2518b5-e6c3-4628-9876-f37dc16afb00 tempest-SnapshotsActionsTest-439238394 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 22 21:27:43.922718 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-ea2518b5-e6c3-4628-9876-f37dc16afb00 tempest-SnapshotsActionsTest-439238394 None] Flow 'volume_create_manager' (220bca26-ecc8-4ccb-aa50-57150470cd5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 22 21:27:43.932326 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-ea2518b5-e6c3-4628-9876-f37dc16afb00 tempest-SnapshotsActionsTest-439238394 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cba7e964-98dd-475d-ae9f-b5dcd944701c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:27:43.940275 ncdv-master-1 cinder-volume[129952]: DEBUG oslo_db.sqlalchemy.engines [None req-ea2518b5-e6c3-4628-9876-f37dc16afb00 tempest-SnapshotsActionsTest-439238394 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129952) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 22 21:27:43.964333 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-ea2518b5-e6c3-4628-9876-f37dc16afb00 tempest-SnapshotsActionsTest-439238394 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cba7e964-98dd-475d-ae9f-b5dcd944701c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-01-22T21:27:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-752746731',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=bf30deb1-4d86-40ec-b213-7f3c413f8541,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d1e1c665129c4c83a7e2a0a2419c69a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-01-22T21:27:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-01-22T21:27:44Z,use_quota=True,user_id='871339cb095d4da4b4f434208f40c178',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6dacb05b-a7ea-4056-85ff-98f0ea5c54eb),volume_type_id=6dacb05b-a7ea-4056-85ff-98f0ea5c54eb)' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:27:43.976900 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-ea2518b5-e6c3-4628-9876-f37dc16afb00 tempest-SnapshotsActionsTest-439238394 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17c950b8-77a5-4745-aa57-0f40467c87f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:27:43.986342 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-ea2518b5-e6c3-4628-9876-f37dc16afb00 tempest-SnapshotsActionsTest-439238394 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17c950b8-77a5-4745-aa57-0f40467c87f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:27:43.995332 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-ea2518b5-e6c3-4628-9876-f37dc16afb00 tempest-SnapshotsActionsTest-439238394 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1bbbb7bb-d3eb-4061-946d-5cad872a1f14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:27:44.001286 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-ea2518b5-e6c3-4628-9876-f37dc16afb00 tempest-SnapshotsActionsTest-439238394 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1bbbb7bb-d3eb-4061-946d-5cad872a1f14) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bf30deb1-4d86-40ec-b213-7f3c413f8541', 'volume_name': 'volume-bf30deb1-4d86-40ec-b213-7f3c413f8541', 'volume_size': 1}' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:27:44.011252 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-ea2518b5-e6c3-4628-9876-f37dc16afb00 tempest-SnapshotsActionsTest-439238394 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0465c661-8bf4-4efa-b29e-e16066769514) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:27:44.032605 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-ea2518b5-e6c3-4628-9876-f37dc16afb00 tempest-SnapshotsActionsTest-439238394 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0465c661-8bf4-4efa-b29e-e16066769514) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:27:44.044520 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-ea2518b5-e6c3-4628-9876-f37dc16afb00 tempest-SnapshotsActionsTest-439238394 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (870777a5-9484-443f-b581-5115bc528377) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:27:44.051232 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.flows.manager.create_volume [None req-ea2518b5-e6c3-4628-9876-f37dc16afb00 tempest-SnapshotsActionsTest-439238394 None] Volume bf30deb1-4d86-40ec-b213-7f3c413f8541: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bf30deb1-4d86-40ec-b213-7f3c413f8541', 'volume_size': 1} Jan 22 21:27:44.051232 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-ea2518b5-e6c3-4628-9876-f37dc16afb00 tempest-SnapshotsActionsTest-439238394 None] creating volume 'volume-bf30deb1-4d86-40ec-b213-7f3c413f8541' {{(pid=129952) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Jan 22 21:27:44.051232 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-ea2518b5-e6c3-4628-9876-f37dc16afb00 tempest-SnapshotsActionsTest-439238394 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:27:44.236007 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-85177a3e-e1d9-4e8c-85e6-1143ee400980 tempest-VolumesBackupsV39Test-1645624774 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:27:44.292406 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-85177a3e-e1d9-4e8c-85e6-1143ee400980 tempest-VolumesBackupsV39Test-1645624774 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:27:44.344475 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.manager [None req-85177a3e-e1d9-4e8c-85e6-1143ee400980 tempest-VolumesBackupsV39Test-1645624774 None] Notifying Schedulers of capabilities ... {{(pid=129952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 22 21:27:44.360801 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-85177a3e-e1d9-4e8c-85e6-1143ee400980 tempest-VolumesBackupsV39Test-1645624774 None] Deleted volume successfully. Jan 22 21:27:44.462608 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.coordination [None req-85177a3e-e1d9-4e8c-85e6-1143ee400980 tempest-VolumesBackupsV39Test-1645624774 None] Lock "b'cinder-e9b2332f-81f1-4153-b8b4-cb705451aa3a-delete_volume'" released by "delete_volume" :: held 12.184s {{(pid=129952) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 22 21:27:45.204246 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-ea2518b5-e6c3-4628-9876-f37dc16afb00 tempest-SnapshotsActionsTest-439238394 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129952) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 22 21:27:45.204246 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-ea2518b5-e6c3-4628-9876-f37dc16afb00 tempest-SnapshotsActionsTest-439238394 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129952) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 22 21:27:45.207131 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-ea2518b5-e6c3-4628-9876-f37dc16afb00 tempest-SnapshotsActionsTest-439238394 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (870777a5-9484-443f-b581-5115bc528377) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bf30deb1-4d86-40ec-b213-7f3c413f8541', 'volume_size': 1}' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:27:45.212782 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-ea2518b5-e6c3-4628-9876-f37dc16afb00 tempest-SnapshotsActionsTest-439238394 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9303f8ee-2769-4e87-aeb3-8594743cac99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:27:45.312786 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.flows.manager.create_volume [None req-ea2518b5-e6c3-4628-9876-f37dc16afb00 tempest-SnapshotsActionsTest-439238394 None] Volume volume-bf30deb1-4d86-40ec-b213-7f3c413f8541 (bf30deb1-4d86-40ec-b213-7f3c413f8541): created successfully Jan 22 21:27:45.317465 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-ea2518b5-e6c3-4628-9876-f37dc16afb00 tempest-SnapshotsActionsTest-439238394 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9303f8ee-2769-4e87-aeb3-8594743cac99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:27:45.324290 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-ea2518b5-e6c3-4628-9876-f37dc16afb00 tempest-SnapshotsActionsTest-439238394 None] Flow 'volume_create_manager' (220bca26-ecc8-4ccb-aa50-57150470cd5e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129952) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 22 21:27:45.416577 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-ea2518b5-e6c3-4628-9876-f37dc16afb00 tempest-SnapshotsActionsTest-439238394 None] Created volume successfully. Jan 22 21:27:46.493413 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-c66ce40c-84c2-423e-a086-81e8614e5802 tempest-SnapshotsActionsTest-439238394 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:27:48.997027 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.flows.manager.create_volume [None req-d0cf2e43-2c85-4753-8f26-10f23b1ec9ea tempest-VolumesCloneTest-2077595781 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129952) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Jan 22 21:27:49.006430 ncdv-master-1 cinder-volume[129952]: WARNING stevedore.named [None req-d0cf2e43-2c85-4753-8f26-10f23b1ec9ea tempest-VolumesCloneTest-2077595781 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jan 22 21:27:49.009209 ncdv-master-1 cinder-volume[129952]: WARNING castellan.key_manager [None req-d0cf2e43-2c85-4753-8f26-10f23b1ec9ea tempest-VolumesCloneTest-2077595781 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 22 21:27:49.035888 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-d0cf2e43-2c85-4753-8f26-10f23b1ec9ea tempest-VolumesCloneTest-2077595781 None] Flow 'volume_create_manager' (ae1c292e-7d37-44eb-a5a0-fd4fd7b2753f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 22 21:27:49.044203 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-d0cf2e43-2c85-4753-8f26-10f23b1ec9ea tempest-VolumesCloneTest-2077595781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1eb25fa6-a12e-4805-a7cd-4247b9849e87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:27:49.054830 ncdv-master-1 cinder-volume[129952]: DEBUG oslo_db.sqlalchemy.engines [None req-d0cf2e43-2c85-4753-8f26-10f23b1ec9ea tempest-VolumesCloneTest-2077595781 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129952) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 22 21:27:49.073584 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-d0cf2e43-2c85-4753-8f26-10f23b1ec9ea tempest-VolumesCloneTest-2077595781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1eb25fa6-a12e-4805-a7cd-4247b9849e87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-01-22T21:27:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1825204306',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=a9e42cee-ab5d-4f06-8a5f-079a07f580e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c9cc9b590854bf7a107b4e726efb410',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-01-22T21:27:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-01-22T21:27:49Z,use_quota=True,user_id='0c4cf03d055440769c5a894208192e5a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6dacb05b-a7ea-4056-85ff-98f0ea5c54eb),volume_type_id=6dacb05b-a7ea-4056-85ff-98f0ea5c54eb)' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:27:49.085938 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-d0cf2e43-2c85-4753-8f26-10f23b1ec9ea tempest-VolumesCloneTest-2077595781 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1600e363-989d-48b7-aa7d-66ec43479fd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:27:49.090623 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-d0cf2e43-2c85-4753-8f26-10f23b1ec9ea tempest-VolumesCloneTest-2077595781 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1600e363-989d-48b7-aa7d-66ec43479fd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:27:49.099718 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-d0cf2e43-2c85-4753-8f26-10f23b1ec9ea tempest-VolumesCloneTest-2077595781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4778949d-12c0-4938-ba41-0eaf9aa4c00d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:27:49.236281 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-d0cf2e43-2c85-4753-8f26-10f23b1ec9ea tempest-VolumesCloneTest-2077595781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4778949d-12c0-4938-ba41-0eaf9aa4c00d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'a9e42cee-ab5d-4f06-8a5f-079a07f580e1', 'volume_name': 'volume-a9e42cee-ab5d-4f06-8a5f-079a07f580e1', 'volume_size': 1, 'image_id': '373cb480-3bc4-4821-93e2-442b4e852b80', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '994e8f6963f04af3be3dbae11a73cdfd', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '373cb480-3bc4-4821-93e2-442b4e852b80', 'created_at': datetime.datetime(2022, 1, 22, 20, 50, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 1, 22, 20, 50, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/373cb480-3bc4-4821-93e2-442b4e852b80/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:27:49.249567 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-d0cf2e43-2c85-4753-8f26-10f23b1ec9ea tempest-VolumesCloneTest-2077595781 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (622bdbdd-cd74-479f-9d5b-de46eedfa4d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:27:49.258760 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-d0cf2e43-2c85-4753-8f26-10f23b1ec9ea tempest-VolumesCloneTest-2077595781 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (622bdbdd-cd74-479f-9d5b-de46eedfa4d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:27:49.265991 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-d0cf2e43-2c85-4753-8f26-10f23b1ec9ea tempest-VolumesCloneTest-2077595781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3bf6a04b-c516-4e69-9cbc-b7e58005c2b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:27:49.272012 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.flows.manager.create_volume [None req-d0cf2e43-2c85-4753-8f26-10f23b1ec9ea tempest-VolumesCloneTest-2077595781 None] Volume a9e42cee-ab5d-4f06-8a5f-079a07f580e1: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-a9e42cee-ab5d-4f06-8a5f-079a07f580e1', 'volume_size': 1, 'image_id': '373cb480-3bc4-4821-93e2-442b4e852b80', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '994e8f6963f04af3be3dbae11a73cdfd', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '373cb480-3bc4-4821-93e2-442b4e852b80', 'created_at': datetime.datetime(2022, 1, 22, 20, 50, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 1, 22, 20, 50, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/373cb480-3bc4-4821-93e2-442b4e852b80/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jan 22 21:27:49.273307 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.flows.manager.create_volume [None req-d0cf2e43-2c85-4753-8f26-10f23b1ec9ea tempest-VolumesCloneTest-2077595781 None] Cloning a9e42cee-ab5d-4f06-8a5f-079a07f580e1 from image 373cb480-3bc4-4821-93e2-442b4e852b80 at location (None, None). {{(pid=129952) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1046}} Jan 22 21:27:49.285318 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.coordination [None req-d0cf2e43-2c85-4753-8f26-10f23b1ec9ea tempest-VolumesCloneTest-2077595781 None] Lock "b'cinder-373cb480-3bc4-4821-93e2-442b4e852b80'" acquired by "_prepare_image_cache_entry" :: waited 0.011s {{(pid=129952) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 22 21:27:49.365962 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.image.cache [None req-d0cf2e43-2c85-4753-8f26-10f23b1ec9ea tempest-VolumesCloneTest-2077595781 None] Found image-volume cache entry: {'id': 1, 'image_id': '373cb480-3bc4-4821-93e2-442b4e852b80', 'volume_id': 'f39c1078-cff4-40dd-93df-4ce49cd873b4', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 1, 22, 20, 50, 57), 'last_used': datetime.datetime(2022, 1, 22, 21, 27, 49, 290653)}. {{(pid=129952) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Jan 22 21:27:49.367524 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.image.cache [None req-d0cf2e43-2c85-4753-8f26-10f23b1ec9ea tempest-VolumesCloneTest-2077595781 None] Image-volume cache entry image_update_at = 2022-01-22 20:50:57+00:00, requested image updated_at = 2022-01-22 20:50:57+00:00. {{(pid=129952) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Jan 22 21:27:49.367524 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.flows.manager.create_volume [None req-d0cf2e43-2c85-4753-8f26-10f23b1ec9ea tempest-VolumesCloneTest-2077595781 None] Found cache entry for image = 373cb480-3bc4-4821-93e2-442b4e852b80 on host ncdv-master-1@ceph#ceph. {{(pid=129952) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:869}} Jan 22 21:27:49.372493 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.coordination [None req-d0cf2e43-2c85-4753-8f26-10f23b1ec9ea tempest-VolumesCloneTest-2077595781 None] Lock "b'cinder-373cb480-3bc4-4821-93e2-442b4e852b80'" released by "_prepare_image_cache_entry" :: held 0.088s {{(pid=129952) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 22 21:27:49.374275 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.flows.manager.create_volume [None req-d0cf2e43-2c85-4753-8f26-10f23b1ec9ea tempest-VolumesCloneTest-2077595781 None] Attempting to retrieve cache entry for image = 373cb480-3bc4-4821-93e2-442b4e852b80 on host ncdv-master-1@ceph#ceph. {{(pid=129952) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:810}} Jan 22 21:27:49.382053 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.image.cache [None req-d0cf2e43-2c85-4753-8f26-10f23b1ec9ea tempest-VolumesCloneTest-2077595781 None] Found image-volume cache entry: {'id': 1, 'image_id': '373cb480-3bc4-4821-93e2-442b4e852b80', 'volume_id': 'f39c1078-cff4-40dd-93df-4ce49cd873b4', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 1, 22, 20, 50, 57), 'last_used': datetime.datetime(2022, 1, 22, 21, 27, 49, 379390)}. {{(pid=129952) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Jan 22 21:27:49.382671 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.image.cache [None req-d0cf2e43-2c85-4753-8f26-10f23b1ec9ea tempest-VolumesCloneTest-2077595781 None] Image-volume cache entry image_update_at = 2022-01-22 20:50:57+00:00, requested image updated_at = 2022-01-22 20:50:57+00:00. {{(pid=129952) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Jan 22 21:27:49.383927 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.flows.manager.create_volume [None req-d0cf2e43-2c85-4753-8f26-10f23b1ec9ea tempest-VolumesCloneTest-2077595781 None] Creating from source image-volume f39c1078-cff4-40dd-93df-4ce49cd873b4 {{(pid=129952) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:824}} Jan 22 21:27:49.414489 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-d0cf2e43-2c85-4753-8f26-10f23b1ec9ea tempest-VolumesCloneTest-2077595781 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:27:49.793489 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-d0cf2e43-2c85-4753-8f26-10f23b1ec9ea tempest-VolumesCloneTest-2077595781 None] creating snapshot='volume-a9e42cee-ab5d-4f06-8a5f-079a07f580e1.clone_snap' {{(pid=129952) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:725}} Jan 22 21:27:52.555730 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-d0cf2e43-2c85-4753-8f26-10f23b1ec9ea tempest-VolumesCloneTest-2077595781 None] cloning 'volume-f39c1078-cff4-40dd-93df-4ce49cd873b4@volume-a9e42cee-ab5d-4f06-8a5f-079a07f580e1.clone_snap' to 'volume-a9e42cee-ab5d-4f06-8a5f-079a07f580e1' {{(pid=129952) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:731}} Jan 22 21:27:53.767693 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-c66ce40c-84c2-423e-a086-81e8614e5802 tempest-SnapshotsActionsTest-439238394 None] Create snapshot completed successfully Jan 22 21:27:55.035915 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-d0cf2e43-2c85-4753-8f26-10f23b1ec9ea tempest-VolumesCloneTest-2077595781 None] Volume volume-0b17e2f4-e149-4a4b-b525-3d029be2e6f6.deleted is not a clone. {{(pid=129952) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Jan 22 21:27:55.038447 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-d0cf2e43-2c85-4753-8f26-10f23b1ec9ea tempest-VolumesCloneTest-2077595781 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129952) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 22 21:27:55.038998 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-d0cf2e43-2c85-4753-8f26-10f23b1ec9ea tempest-VolumesCloneTest-2077595781 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129952) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 22 21:27:55.825275 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-d0cf2e43-2c85-4753-8f26-10f23b1ec9ea tempest-VolumesCloneTest-2077595781 None] clone created successfully {{(pid=129952) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:803}} Jan 22 21:27:55.826028 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.volume_utils [None req-d0cf2e43-2c85-4753-8f26-10f23b1ec9ea tempest-VolumesCloneTest-2077595781 None] Marking volume a9e42cee-ab5d-4f06-8a5f-079a07f580e1 as bootable. {{(pid=129952) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1178}} Jan 22 21:27:55.931767 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.flows.manager.create_volume [None req-d0cf2e43-2c85-4753-8f26-10f23b1ec9ea tempest-VolumesCloneTest-2077595781 None] Copying metadata from image 373cb480-3bc4-4821-93e2-442b4e852b80 to a9e42cee-ab5d-4f06-8a5f-079a07f580e1. {{(pid=129952) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:443}} Jan 22 21:27:55.931767 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.flows.manager.create_volume [None req-d0cf2e43-2c85-4753-8f26-10f23b1ec9ea tempest-VolumesCloneTest-2077595781 None] Creating volume glance metadata for volume a9e42cee-ab5d-4f06-8a5f-079a07f580e1 backed by image 373cb480-3bc4-4821-93e2-442b4e852b80 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '373cb480-3bc4-4821-93e2-442b4e852b80', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=129952) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:666}} Jan 22 21:27:56.089438 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-d0cf2e43-2c85-4753-8f26-10f23b1ec9ea tempest-VolumesCloneTest-2077595781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3bf6a04b-c516-4e69-9cbc-b7e58005c2b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a9e42cee-ab5d-4f06-8a5f-079a07f580e1', 'volume_size': 1, 'image_id': '373cb480-3bc4-4821-93e2-442b4e852b80', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '994e8f6963f04af3be3dbae11a73cdfd', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '373cb480-3bc4-4821-93e2-442b4e852b80', 'created_at': datetime.datetime(2022, 1, 22, 20, 50, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 1, 22, 20, 50, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/373cb480-3bc4-4821-93e2-442b4e852b80/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:27:56.094464 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-d0cf2e43-2c85-4753-8f26-10f23b1ec9ea tempest-VolumesCloneTest-2077595781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5809dd1d-712a-4e7b-ac1b-98b4a716a4c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:27:56.180938 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.flows.manager.create_volume [None req-d0cf2e43-2c85-4753-8f26-10f23b1ec9ea tempest-VolumesCloneTest-2077595781 None] Volume volume-a9e42cee-ab5d-4f06-8a5f-079a07f580e1 (a9e42cee-ab5d-4f06-8a5f-079a07f580e1): created successfully Jan 22 21:27:56.184835 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-d0cf2e43-2c85-4753-8f26-10f23b1ec9ea tempest-VolumesCloneTest-2077595781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5809dd1d-712a-4e7b-ac1b-98b4a716a4c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:27:56.200151 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-d0cf2e43-2c85-4753-8f26-10f23b1ec9ea tempest-VolumesCloneTest-2077595781 None] Flow 'volume_create_manager' (ae1c292e-7d37-44eb-a5a0-fd4fd7b2753f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129952) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 22 21:27:56.251852 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-21d87d4c-caf5-48ee-bd17-50dc80c58e00 tempest-SnapshotsActionsTest-439238394 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:27:56.656124 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-d0cf2e43-2c85-4753-8f26-10f23b1ec9ea tempest-VolumesCloneTest-2077595781 None] Created volume successfully. Jan 22 21:27:57.512513 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.flows.manager.create_volume [None req-b725f80e-58ac-4526-bdc6-c9666235e922 tempest-VolumesCloneTest-2077595781 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129952) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Jan 22 21:27:57.522985 ncdv-master-1 cinder-volume[129952]: WARNING stevedore.named [None req-b725f80e-58ac-4526-bdc6-c9666235e922 tempest-VolumesCloneTest-2077595781 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jan 22 21:27:57.523764 ncdv-master-1 cinder-volume[129952]: WARNING castellan.key_manager [None req-b725f80e-58ac-4526-bdc6-c9666235e922 tempest-VolumesCloneTest-2077595781 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 22 21:27:57.590647 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-b725f80e-58ac-4526-bdc6-c9666235e922 tempest-VolumesCloneTest-2077595781 None] Flow 'volume_create_manager' (39a47237-ccbb-4435-b51e-87d7bc2cff2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 22 21:27:57.605383 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-b725f80e-58ac-4526-bdc6-c9666235e922 tempest-VolumesCloneTest-2077595781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (030fd42f-7abb-448a-8583-1ccb2eece116) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:27:57.627505 ncdv-master-1 cinder-volume[129952]: DEBUG oslo_db.sqlalchemy.engines [None req-b725f80e-58ac-4526-bdc6-c9666235e922 tempest-VolumesCloneTest-2077595781 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129952) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 22 21:27:57.676785 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-b725f80e-58ac-4526-bdc6-c9666235e922 tempest-VolumesCloneTest-2077595781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (030fd42f-7abb-448a-8583-1ccb2eece116) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=True,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-01-22T21:27:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-376541319',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=c5a6fcea-5e75-41ec-a5f0-840407516d3e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c9cc9b590854bf7a107b4e726efb410',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-01-22T21:27:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=a9e42cee-ab5d-4f06-8a5f-079a07f580e1,status='creating',terminated_at=None,updated_at=2022-01-22T21:27:57Z,use_quota=True,user_id='0c4cf03d055440769c5a894208192e5a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6dacb05b-a7ea-4056-85ff-98f0ea5c54eb),volume_type_id=6dacb05b-a7ea-4056-85ff-98f0ea5c54eb)' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:27:57.689835 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-b725f80e-58ac-4526-bdc6-c9666235e922 tempest-VolumesCloneTest-2077595781 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (322fbe1f-03aa-47e9-9e21-ab1b85f7c477) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:27:57.703551 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-b725f80e-58ac-4526-bdc6-c9666235e922 tempest-VolumesCloneTest-2077595781 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (322fbe1f-03aa-47e9-9e21-ab1b85f7c477) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:27:57.714413 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-b725f80e-58ac-4526-bdc6-c9666235e922 tempest-VolumesCloneTest-2077595781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6739e8fa-d49c-4c1b-8c3e-3c1533e0bdfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:27:57.744254 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-b725f80e-58ac-4526-bdc6-c9666235e922 tempest-VolumesCloneTest-2077595781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6739e8fa-d49c-4c1b-8c3e-3c1533e0bdfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'c5a6fcea-5e75-41ec-a5f0-840407516d3e', 'volume_name': 'volume-c5a6fcea-5e75-41ec-a5f0-840407516d3e', 'volume_size': 1, 'source_volid': 'a9e42cee-ab5d-4f06-8a5f-079a07f580e1', 'source_volstatus': 'available'}' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:27:57.750943 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-b725f80e-58ac-4526-bdc6-c9666235e922 tempest-VolumesCloneTest-2077595781 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eabd3144-d368-4694-9642-5bca5ed4e958) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:27:57.757655 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-b725f80e-58ac-4526-bdc6-c9666235e922 tempest-VolumesCloneTest-2077595781 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eabd3144-d368-4694-9642-5bca5ed4e958) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:27:57.766534 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-b725f80e-58ac-4526-bdc6-c9666235e922 tempest-VolumesCloneTest-2077595781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1bd67626-9fd7-458d-a7c2-ec3bed57b67c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:27:57.768367 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.flows.manager.create_volume [None req-b725f80e-58ac-4526-bdc6-c9666235e922 tempest-VolumesCloneTest-2077595781 None] Volume c5a6fcea-5e75-41ec-a5f0-840407516d3e: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-c5a6fcea-5e75-41ec-a5f0-840407516d3e', 'volume_size': 1, 'source_volid': 'a9e42cee-ab5d-4f06-8a5f-079a07f580e1', 'source_volstatus': 'available'} Jan 22 21:27:57.782531 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-b725f80e-58ac-4526-bdc6-c9666235e922 tempest-VolumesCloneTest-2077595781 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:27:58.280987 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-b725f80e-58ac-4526-bdc6-c9666235e922 tempest-VolumesCloneTest-2077595781 None] creating snapshot='volume-c5a6fcea-5e75-41ec-a5f0-840407516d3e.clone_snap' {{(pid=129952) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:725}} Jan 22 21:28:01.177329 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-b725f80e-58ac-4526-bdc6-c9666235e922 tempest-VolumesCloneTest-2077595781 None] cloning 'volume-a9e42cee-ab5d-4f06-8a5f-079a07f580e1@volume-c5a6fcea-5e75-41ec-a5f0-840407516d3e.clone_snap' to 'volume-c5a6fcea-5e75-41ec-a5f0-840407516d3e' {{(pid=129952) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:731}} Jan 22 21:28:02.605484 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-21d87d4c-caf5-48ee-bd17-50dc80c58e00 tempest-SnapshotsActionsTest-439238394 None] Create snapshot completed successfully Jan 22 21:28:03.525075 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-b725f80e-58ac-4526-bdc6-c9666235e922 tempest-VolumesCloneTest-2077595781 None] Volume volume-0b17e2f4-e149-4a4b-b525-3d029be2e6f6.deleted is not a clone. {{(pid=129952) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Jan 22 21:28:03.526662 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-b725f80e-58ac-4526-bdc6-c9666235e922 tempest-VolumesCloneTest-2077595781 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129952) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 22 21:28:03.527042 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-b725f80e-58ac-4526-bdc6-c9666235e922 tempest-VolumesCloneTest-2077595781 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129952) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 22 21:28:04.043510 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-b725f80e-58ac-4526-bdc6-c9666235e922 tempest-VolumesCloneTest-2077595781 None] clone created successfully {{(pid=129952) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:803}} Jan 22 21:28:04.045680 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.volume_utils [None req-b725f80e-58ac-4526-bdc6-c9666235e922 tempest-VolumesCloneTest-2077595781 None] Marking volume c5a6fcea-5e75-41ec-a5f0-840407516d3e as bootable. {{(pid=129952) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1178}} Jan 22 21:28:04.082266 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.coordination [None req-d6ee347f-617f-4b94-8021-64983cb259c8 tempest-SnapshotsActionsTest-542663390 None] Lock "b'cinder-25ceb873-46da-4ca6-ad7a-46809c6c61cf-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.018s {{(pid=129952) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 22 21:28:04.083773 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-d6ee347f-617f-4b94-8021-64983cb259c8 tempest-SnapshotsActionsTest-542663390 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:28:04.323897 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.flows.manager.create_volume [None req-b725f80e-58ac-4526-bdc6-c9666235e922 tempest-VolumesCloneTest-2077595781 None] Copying metadata from source volume a9e42cee-ab5d-4f06-8a5f-079a07f580e1 to c5a6fcea-5e75-41ec-a5f0-840407516d3e. {{(pid=129952) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:431}} Jan 22 21:28:04.554632 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-b725f80e-58ac-4526-bdc6-c9666235e922 tempest-VolumesCloneTest-2077595781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1bd67626-9fd7-458d-a7c2-ec3bed57b67c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c5a6fcea-5e75-41ec-a5f0-840407516d3e', 'volume_size': 1, 'source_volid': 'a9e42cee-ab5d-4f06-8a5f-079a07f580e1', 'source_volstatus': 'available'}' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:28:04.559928 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-b725f80e-58ac-4526-bdc6-c9666235e922 tempest-VolumesCloneTest-2077595781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7cd23a9-a42b-41c9-8a87-f873e65ed5ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:28:04.664374 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.flows.manager.create_volume [None req-b725f80e-58ac-4526-bdc6-c9666235e922 tempest-VolumesCloneTest-2077595781 None] Volume volume-c5a6fcea-5e75-41ec-a5f0-840407516d3e (c5a6fcea-5e75-41ec-a5f0-840407516d3e): created successfully Jan 22 21:28:04.671386 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-b725f80e-58ac-4526-bdc6-c9666235e922 tempest-VolumesCloneTest-2077595781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7cd23a9-a42b-41c9-8a87-f873e65ed5ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:28:04.708374 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-b725f80e-58ac-4526-bdc6-c9666235e922 tempest-VolumesCloneTest-2077595781 None] Flow 'volume_create_manager' (39a47237-ccbb-4435-b51e-87d7bc2cff2f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129952) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 22 21:28:04.788976 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-b725f80e-58ac-4526-bdc6-c9666235e922 tempest-VolumesCloneTest-2077595781 None] Created volume successfully. Jan 22 21:28:07.217547 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.flows.manager.create_volume [None req-ef48d972-56da-4daa-a135-872900821e23 tempest-VolumesCloneTest-2077595781 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129952) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Jan 22 21:28:07.221864 ncdv-master-1 cinder-volume[129952]: WARNING stevedore.named [None req-ef48d972-56da-4daa-a135-872900821e23 tempest-VolumesCloneTest-2077595781 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jan 22 21:28:07.222565 ncdv-master-1 cinder-volume[129952]: WARNING castellan.key_manager [None req-ef48d972-56da-4daa-a135-872900821e23 tempest-VolumesCloneTest-2077595781 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 22 21:28:07.293598 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-ef48d972-56da-4daa-a135-872900821e23 tempest-VolumesCloneTest-2077595781 None] Flow 'volume_create_manager' (3c9dab0b-ccf0-4c4c-af02-af77ed8d3290) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 22 21:28:07.313579 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-ef48d972-56da-4daa-a135-872900821e23 tempest-VolumesCloneTest-2077595781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13a08568-cceb-47df-9c5c-801826dffa33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:28:07.322920 ncdv-master-1 cinder-volume[129952]: DEBUG oslo_db.sqlalchemy.engines [None req-ef48d972-56da-4daa-a135-872900821e23 tempest-VolumesCloneTest-2077595781 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129952) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 22 21:28:07.339992 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-ef48d972-56da-4daa-a135-872900821e23 tempest-VolumesCloneTest-2077595781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13a08568-cceb-47df-9c5c-801826dffa33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-01-22T21:28:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-547874918',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=8f222f86-5a4a-464c-a828-39843c58d1ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c9cc9b590854bf7a107b4e726efb410',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-01-22T21:28:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-01-22T21:28:07Z,use_quota=True,user_id='0c4cf03d055440769c5a894208192e5a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6dacb05b-a7ea-4056-85ff-98f0ea5c54eb),volume_type_id=6dacb05b-a7ea-4056-85ff-98f0ea5c54eb)' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:28:07.345787 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-ef48d972-56da-4daa-a135-872900821e23 tempest-VolumesCloneTest-2077595781 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77e05051-5427-41f4-be95-918b8b10f469) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:28:07.350994 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-ef48d972-56da-4daa-a135-872900821e23 tempest-VolumesCloneTest-2077595781 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77e05051-5427-41f4-be95-918b8b10f469) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:28:07.362311 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-ef48d972-56da-4daa-a135-872900821e23 tempest-VolumesCloneTest-2077595781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1092907-d9c2-43f6-8742-4957c283ed52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:28:07.369737 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-ef48d972-56da-4daa-a135-872900821e23 tempest-VolumesCloneTest-2077595781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1092907-d9c2-43f6-8742-4957c283ed52) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8f222f86-5a4a-464c-a828-39843c58d1ea', 'volume_name': 'volume-8f222f86-5a4a-464c-a828-39843c58d1ea', 'volume_size': 1}' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:28:07.375266 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-ef48d972-56da-4daa-a135-872900821e23 tempest-VolumesCloneTest-2077595781 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0aea373-05c5-40be-8576-afb3d1f5647a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:28:07.380603 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-ef48d972-56da-4daa-a135-872900821e23 tempest-VolumesCloneTest-2077595781 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0aea373-05c5-40be-8576-afb3d1f5647a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:28:07.389114 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-ef48d972-56da-4daa-a135-872900821e23 tempest-VolumesCloneTest-2077595781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (faf2c785-cce5-43a2-b3ef-181096edaf87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:28:07.397921 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.flows.manager.create_volume [None req-ef48d972-56da-4daa-a135-872900821e23 tempest-VolumesCloneTest-2077595781 None] Volume 8f222f86-5a4a-464c-a828-39843c58d1ea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8f222f86-5a4a-464c-a828-39843c58d1ea', 'volume_size': 1} Jan 22 21:28:07.400730 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-ef48d972-56da-4daa-a135-872900821e23 tempest-VolumesCloneTest-2077595781 None] creating volume 'volume-8f222f86-5a4a-464c-a828-39843c58d1ea' {{(pid=129952) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Jan 22 21:28:07.406162 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-ef48d972-56da-4daa-a135-872900821e23 tempest-VolumesCloneTest-2077595781 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:28:08.799883 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-ef48d972-56da-4daa-a135-872900821e23 tempest-VolumesCloneTest-2077595781 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129952) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 22 21:28:08.804480 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-ef48d972-56da-4daa-a135-872900821e23 tempest-VolumesCloneTest-2077595781 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129952) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 22 21:28:08.809470 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-ef48d972-56da-4daa-a135-872900821e23 tempest-VolumesCloneTest-2077595781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (faf2c785-cce5-43a2-b3ef-181096edaf87) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8f222f86-5a4a-464c-a828-39843c58d1ea', 'volume_size': 1}' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:28:08.818234 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-ef48d972-56da-4daa-a135-872900821e23 tempest-VolumesCloneTest-2077595781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b88e328a-2627-4cb2-af07-18e01edeaf4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:28:08.913843 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.flows.manager.create_volume [None req-ef48d972-56da-4daa-a135-872900821e23 tempest-VolumesCloneTest-2077595781 None] Volume volume-8f222f86-5a4a-464c-a828-39843c58d1ea (8f222f86-5a4a-464c-a828-39843c58d1ea): created successfully Jan 22 21:28:08.917725 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-ef48d972-56da-4daa-a135-872900821e23 tempest-VolumesCloneTest-2077595781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b88e328a-2627-4cb2-af07-18e01edeaf4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:28:08.924833 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-ef48d972-56da-4daa-a135-872900821e23 tempest-VolumesCloneTest-2077595781 None] Flow 'volume_create_manager' (3c9dab0b-ccf0-4c4c-af02-af77ed8d3290) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129952) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 22 21:28:08.999446 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-ef48d972-56da-4daa-a135-872900821e23 tempest-VolumesCloneTest-2077595781 None] Created volume successfully. Jan 22 21:28:09.148620 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.quota [None req-d6ee347f-617f-4b94-8021-64983cb259c8 tempest-SnapshotsActionsTest-542663390 None] Created reservations ['45f0ca0c-9d67-4802-a8cd-48143a488581', '317e6de3-1528-43df-a5f6-cd2f111c6ba5', '4015cd8e-4b39-4a5f-94ce-3902b1ed97a7', '2c9ee085-2fae-4fe8-9d71-1e439280f649'] {{(pid=129952) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 22 21:28:09.501430 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-d6ee347f-617f-4b94-8021-64983cb259c8 tempest-SnapshotsActionsTest-542663390 None] Delete snapshot completed successfully. Jan 22 21:28:09.510616 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.coordination [None req-d6ee347f-617f-4b94-8021-64983cb259c8 tempest-SnapshotsActionsTest-542663390 None] Lock "b'cinder-25ceb873-46da-4ca6-ad7a-46809c6c61cf-delete_snapshot'" released by "delete_snapshot" :: held 5.425s {{(pid=129952) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 22 21:28:09.709386 ncdv-master-1 cinder-volume[129952]: DEBUG oslo_service.periodic_task [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129952) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jan 22 21:28:09.722943 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:28:09.855408 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:28:09.921306 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.manager [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] Notifying Schedulers of capabilities ... {{(pid=129952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 22 21:28:10.344909 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.flows.manager.create_volume [None req-9ba50d8e-45e2-42f3-b30e-b79d5128d2f8 tempest-VolumesCloneTest-2077595781 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129952) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Jan 22 21:28:10.352185 ncdv-master-1 cinder-volume[129952]: WARNING stevedore.named [None req-9ba50d8e-45e2-42f3-b30e-b79d5128d2f8 tempest-VolumesCloneTest-2077595781 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jan 22 21:28:10.352185 ncdv-master-1 cinder-volume[129952]: WARNING castellan.key_manager [None req-9ba50d8e-45e2-42f3-b30e-b79d5128d2f8 tempest-VolumesCloneTest-2077595781 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 22 21:28:10.407506 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-9ba50d8e-45e2-42f3-b30e-b79d5128d2f8 tempest-VolumesCloneTest-2077595781 None] Flow 'volume_create_manager' (bed6a938-fdfc-40c8-b32e-e74f7979b8b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 22 21:28:10.415780 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-9ba50d8e-45e2-42f3-b30e-b79d5128d2f8 tempest-VolumesCloneTest-2077595781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fee2ae0d-0533-46ef-978f-afd1046d0e7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:28:10.422132 ncdv-master-1 cinder-volume[129952]: DEBUG oslo_db.sqlalchemy.engines [None req-9ba50d8e-45e2-42f3-b30e-b79d5128d2f8 tempest-VolumesCloneTest-2077595781 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129952) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 22 21:28:10.443734 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-9ba50d8e-45e2-42f3-b30e-b79d5128d2f8 tempest-VolumesCloneTest-2077595781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fee2ae0d-0533-46ef-978f-afd1046d0e7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-01-22T21:28:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-2053220736',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=40a8ff5b-6979-4eba-994c-56d1d9ffcc9f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c9cc9b590854bf7a107b4e726efb410',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-01-22T21:28:10Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=8f222f86-5a4a-464c-a828-39843c58d1ea,status='creating',terminated_at=None,updated_at=2022-01-22T21:28:10Z,use_quota=True,user_id='0c4cf03d055440769c5a894208192e5a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6dacb05b-a7ea-4056-85ff-98f0ea5c54eb),volume_type_id=6dacb05b-a7ea-4056-85ff-98f0ea5c54eb)' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:28:10.451096 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-9ba50d8e-45e2-42f3-b30e-b79d5128d2f8 tempest-VolumesCloneTest-2077595781 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c73f1b87-c163-4146-9a36-fab202c07e9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:28:10.458052 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-9ba50d8e-45e2-42f3-b30e-b79d5128d2f8 tempest-VolumesCloneTest-2077595781 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c73f1b87-c163-4146-9a36-fab202c07e9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:28:10.466947 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-9ba50d8e-45e2-42f3-b30e-b79d5128d2f8 tempest-VolumesCloneTest-2077595781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c79383c-7b98-4321-ba3c-0d3534c4e1b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:28:10.487394 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-9ba50d8e-45e2-42f3-b30e-b79d5128d2f8 tempest-VolumesCloneTest-2077595781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c79383c-7b98-4321-ba3c-0d3534c4e1b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '40a8ff5b-6979-4eba-994c-56d1d9ffcc9f', 'volume_name': 'volume-40a8ff5b-6979-4eba-994c-56d1d9ffcc9f', 'volume_size': 2, 'source_volid': '8f222f86-5a4a-464c-a828-39843c58d1ea', 'source_volstatus': 'available'}' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:28:10.493102 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-9ba50d8e-45e2-42f3-b30e-b79d5128d2f8 tempest-VolumesCloneTest-2077595781 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d92da495-0130-4309-bc35-05abc37177a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:28:10.498462 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-9ba50d8e-45e2-42f3-b30e-b79d5128d2f8 tempest-VolumesCloneTest-2077595781 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d92da495-0130-4309-bc35-05abc37177a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:28:10.505044 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-9ba50d8e-45e2-42f3-b30e-b79d5128d2f8 tempest-VolumesCloneTest-2077595781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (971294e6-52ee-4485-81a8-c9d1aeaae808) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:28:10.506527 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.flows.manager.create_volume [None req-9ba50d8e-45e2-42f3-b30e-b79d5128d2f8 tempest-VolumesCloneTest-2077595781 None] Volume 40a8ff5b-6979-4eba-994c-56d1d9ffcc9f: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-40a8ff5b-6979-4eba-994c-56d1d9ffcc9f', 'volume_size': 2, 'source_volid': '8f222f86-5a4a-464c-a828-39843c58d1ea', 'source_volstatus': 'available'} Jan 22 21:28:10.521611 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-9ba50d8e-45e2-42f3-b30e-b79d5128d2f8 tempest-VolumesCloneTest-2077595781 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:28:10.833113 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-9ba50d8e-45e2-42f3-b30e-b79d5128d2f8 tempest-VolumesCloneTest-2077595781 None] creating snapshot='volume-40a8ff5b-6979-4eba-994c-56d1d9ffcc9f.clone_snap' {{(pid=129952) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:725}} Jan 22 21:28:14.430332 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-9ba50d8e-45e2-42f3-b30e-b79d5128d2f8 tempest-VolumesCloneTest-2077595781 None] cloning 'volume-8f222f86-5a4a-464c-a828-39843c58d1ea@volume-40a8ff5b-6979-4eba-994c-56d1d9ffcc9f.clone_snap' to 'volume-40a8ff5b-6979-4eba-994c-56d1d9ffcc9f' {{(pid=129952) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:731}} Jan 22 21:28:14.577302 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-9fc7630f-2d2a-40a0-8f58-715f544938c7 tempest-SnapshotsActionsTest-439238394 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:28:17.592759 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-9ba50d8e-45e2-42f3-b30e-b79d5128d2f8 tempest-VolumesCloneTest-2077595781 None] Volume volume-8f222f86-5a4a-464c-a828-39843c58d1ea is not a clone. {{(pid=129952) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Jan 22 21:28:17.594395 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-9ba50d8e-45e2-42f3-b30e-b79d5128d2f8 tempest-VolumesCloneTest-2077595781 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129952) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 22 21:28:17.594983 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-9ba50d8e-45e2-42f3-b30e-b79d5128d2f8 tempest-VolumesCloneTest-2077595781 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129952) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 22 21:28:18.573473 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-9ba50d8e-45e2-42f3-b30e-b79d5128d2f8 tempest-VolumesCloneTest-2077595781 None] resize volume 'volume-40a8ff5b-6979-4eba-994c-56d1d9ffcc9f' from 1 to 2 {{(pid=129952) _extend_if_required /opt/stack/cinder/cinder/volume/drivers/rbd.py:694}} Jan 22 21:28:18.574169 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-9ba50d8e-45e2-42f3-b30e-b79d5128d2f8 tempest-VolumesCloneTest-2077595781 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:28:19.980471 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-9fc7630f-2d2a-40a0-8f58-715f544938c7 tempest-SnapshotsActionsTest-439238394 None] Create snapshot completed successfully Jan 22 21:28:20.707195 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.coordination [None req-46870279-8954-4b64-b77b-f172ccc75a75 tempest-SnapshotsActionsTest-542663390 None] Lock "b'cinder-c445442d-232d-40ca-a891-90694c58b510-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.030s {{(pid=129952) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 22 21:28:20.709279 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-46870279-8954-4b64-b77b-f172ccc75a75 tempest-SnapshotsActionsTest-542663390 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:28:21.009254 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-9ba50d8e-45e2-42f3-b30e-b79d5128d2f8 tempest-VolumesCloneTest-2077595781 None] clone created successfully {{(pid=129952) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:803}} Jan 22 21:28:21.015815 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-9ba50d8e-45e2-42f3-b30e-b79d5128d2f8 tempest-VolumesCloneTest-2077595781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (971294e6-52ee-4485-81a8-c9d1aeaae808) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-40a8ff5b-6979-4eba-994c-56d1d9ffcc9f', 'volume_size': 2, 'source_volid': '8f222f86-5a4a-464c-a828-39843c58d1ea', 'source_volstatus': 'available'}' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:28:21.026420 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-9ba50d8e-45e2-42f3-b30e-b79d5128d2f8 tempest-VolumesCloneTest-2077595781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c39c9bf5-7fae-4f8e-899b-541b701d4d1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:28:21.123972 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.flows.manager.create_volume [None req-9ba50d8e-45e2-42f3-b30e-b79d5128d2f8 tempest-VolumesCloneTest-2077595781 None] Volume volume-40a8ff5b-6979-4eba-994c-56d1d9ffcc9f (40a8ff5b-6979-4eba-994c-56d1d9ffcc9f): created successfully Jan 22 21:28:21.130450 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-9ba50d8e-45e2-42f3-b30e-b79d5128d2f8 tempest-VolumesCloneTest-2077595781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c39c9bf5-7fae-4f8e-899b-541b701d4d1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:28:21.145144 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-9ba50d8e-45e2-42f3-b30e-b79d5128d2f8 tempest-VolumesCloneTest-2077595781 None] Flow 'volume_create_manager' (bed6a938-fdfc-40c8-b32e-e74f7979b8b2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129952) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 22 21:28:21.290298 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-9ba50d8e-45e2-42f3-b30e-b79d5128d2f8 tempest-VolumesCloneTest-2077595781 None] Created volume successfully. Jan 22 21:28:22.209012 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.coordination [None req-e1f48917-c9a6-4f05-9786-affc75280301 tempest-VolumesCloneTest-2077595781 None] Lock "b'cinder-40a8ff5b-6979-4eba-994c-56d1d9ffcc9f-delete_volume'" acquired by "delete_volume" :: waited 0.014s {{(pid=129952) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 22 21:28:22.363546 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-e1f48917-c9a6-4f05-9786-affc75280301 tempest-VolumesCloneTest-2077595781 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:28:22.770301 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-e1f48917-c9a6-4f05-9786-affc75280301 tempest-VolumesCloneTest-2077595781 None] volume has no backup snaps {{(pid=129952) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Jan 22 21:28:23.004615 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-e1f48917-c9a6-4f05-9786-affc75280301 tempest-VolumesCloneTest-2077595781 None] deleting rbd volume volume-40a8ff5b-6979-4eba-994c-56d1d9ffcc9f {{(pid=129952) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Jan 22 21:28:25.458082 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.quota [None req-46870279-8954-4b64-b77b-f172ccc75a75 tempest-SnapshotsActionsTest-542663390 None] Created reservations ['459a9035-6d42-4444-b83b-cc69352c6efb', 'a69c0c96-566e-4388-ac5f-a6ae1e87198d', 'eb2e4bca-8087-436f-b94c-d793fc71e5a0', '63ee9546-c3e7-4988-9ab3-ababc97b88a2'] {{(pid=129952) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 22 21:28:25.800882 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-46870279-8954-4b64-b77b-f172ccc75a75 tempest-SnapshotsActionsTest-542663390 None] Delete snapshot completed successfully. Jan 22 21:28:25.808537 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.coordination [None req-46870279-8954-4b64-b77b-f172ccc75a75 tempest-SnapshotsActionsTest-542663390 None] Lock "b'cinder-c445442d-232d-40ca-a891-90694c58b510-delete_snapshot'" released by "delete_snapshot" :: held 5.101s {{(pid=129952) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 22 21:28:27.134263 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-e04071df-a379-451b-ad87-6e18f134be2d tempest-SnapshotsActionsTest-439238394 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:28:29.697739 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-e1f48917-c9a6-4f05-9786-affc75280301 tempest-VolumesCloneTest-2077595781 None] volume is a clone so cleaning references {{(pid=129952) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1266}} Jan 22 21:28:30.096554 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-e1f48917-c9a6-4f05-9786-affc75280301 tempest-VolumesCloneTest-2077595781 None] Volume volume-8f222f86-5a4a-464c-a828-39843c58d1ea is not a clone. {{(pid=129952) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Jan 22 21:28:30.097089 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-e1f48917-c9a6-4f05-9786-affc75280301 tempest-VolumesCloneTest-2077595781 None] deleting parent snapshot volume-40a8ff5b-6979-4eba-994c-56d1d9ffcc9f.clone_snap {{(pid=129952) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1158}} Jan 22 21:28:33.597981 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.quota [None req-e1f48917-c9a6-4f05-9786-affc75280301 tempest-VolumesCloneTest-2077595781 None] Created reservations ['898cba6d-8aee-4539-ab57-b8163e1ed77d', 'c23a8d02-97e1-4056-96e6-3f640925f89b', '2b5b6bca-1a06-479c-962c-955ee6867bd0', 'ffb921b9-5b5b-4f71-b54e-ab9b30d1cffc'] {{(pid=129952) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 22 21:28:33.894963 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-e1f48917-c9a6-4f05-9786-affc75280301 tempest-VolumesCloneTest-2077595781 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:28:33.968091 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-e1f48917-c9a6-4f05-9786-affc75280301 tempest-VolumesCloneTest-2077595781 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:28:34.097792 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.manager [None req-e1f48917-c9a6-4f05-9786-affc75280301 tempest-VolumesCloneTest-2077595781 None] Notifying Schedulers of capabilities ... {{(pid=129952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 22 21:28:34.102904 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-e1f48917-c9a6-4f05-9786-affc75280301 tempest-VolumesCloneTest-2077595781 None] Deleted volume successfully. Jan 22 21:28:34.194346 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.coordination [None req-e1f48917-c9a6-4f05-9786-affc75280301 tempest-VolumesCloneTest-2077595781 None] Lock "b'cinder-40a8ff5b-6979-4eba-994c-56d1d9ffcc9f-delete_volume'" released by "delete_volume" :: held 11.975s {{(pid=129952) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 22 21:28:34.255691 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-e04071df-a379-451b-ad87-6e18f134be2d tempest-SnapshotsActionsTest-439238394 None] Create snapshot completed successfully Jan 22 21:28:34.547067 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.coordination [None req-d292b0aa-4780-434f-a0d6-6e64e3807730 tempest-VolumesCloneTest-2077595781 None] Lock "b'cinder-8f222f86-5a4a-464c-a828-39843c58d1ea-delete_volume'" acquired by "delete_volume" :: waited 0.012s {{(pid=129952) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 22 21:28:34.707153 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-d292b0aa-4780-434f-a0d6-6e64e3807730 tempest-VolumesCloneTest-2077595781 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:28:34.917159 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-d292b0aa-4780-434f-a0d6-6e64e3807730 tempest-VolumesCloneTest-2077595781 None] volume has no backup snaps {{(pid=129952) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Jan 22 21:28:34.917669 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-d292b0aa-4780-434f-a0d6-6e64e3807730 tempest-VolumesCloneTest-2077595781 None] Volume volume-8f222f86-5a4a-464c-a828-39843c58d1ea is not a clone. {{(pid=129952) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Jan 22 21:28:35.098284 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-d292b0aa-4780-434f-a0d6-6e64e3807730 tempest-VolumesCloneTest-2077595781 None] deleting rbd volume volume-8f222f86-5a4a-464c-a828-39843c58d1ea {{(pid=129952) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Jan 22 21:28:35.787938 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.coordination [None req-36c42e14-9419-4810-a8be-a589d4b15efe tempest-SnapshotsActionsTest-542663390 None] Lock "b'cinder-e333f0db-aa55-4b55-8529-ab89cb016acd-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.013s {{(pid=129952) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 22 21:28:35.789535 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-36c42e14-9419-4810-a8be-a589d4b15efe tempest-SnapshotsActionsTest-542663390 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:28:40.404696 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [req-4745ceca-f282-4fbd-baa5-a3500e8be8bc req-2149b279-1a7b-4d12-bf50-6cfe9d570f96 tempest-TaggedBootDevicesTest-807480544 None] Terminate volume connection completed successfully. Jan 22 21:28:40.405392 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [req-4745ceca-f282-4fbd-baa5-a3500e8be8bc req-2149b279-1a7b-4d12-bf50-6cfe9d570f96 tempest-TaggedBootDevicesTest-807480544 None] Deleting attachment bf46059a-c3df-449e-b06a-329e97a7a79f. {{(pid=129952) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4947}} Jan 22 21:28:40.697315 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [req-4745ceca-f282-4fbd-baa5-a3500e8be8bc req-b01c6e4b-c1e2-4e00-b1ba-9ac78ecdd906 tempest-TaggedBootDevicesTest-807480544 None] Terminate volume connection completed successfully. Jan 22 21:28:40.702607 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [req-4745ceca-f282-4fbd-baa5-a3500e8be8bc req-b01c6e4b-c1e2-4e00-b1ba-9ac78ecdd906 tempest-TaggedBootDevicesTest-807480544 None] Deleting attachment d9204f3f-fdcf-4737-ae80-1f10f8007757. {{(pid=129952) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4947}} Jan 22 21:28:40.717996 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.quota [None req-36c42e14-9419-4810-a8be-a589d4b15efe tempest-SnapshotsActionsTest-542663390 None] Created reservations ['11ea5223-12df-46e8-806b-c10d37325fb8', '63b0ef3b-f4df-48a2-a244-bd3b4d3dc668', '2de12f06-07f8-402b-bbe2-2852cf917cbd', '760ca794-7e6b-4cd3-858e-f878a4aa5f43'] {{(pid=129952) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 22 21:28:41.045829 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [req-4745ceca-f282-4fbd-baa5-a3500e8be8bc req-f5adbd89-99b5-4aad-80d2-1dc4414fe1be tempest-TaggedBootDevicesTest-807480544 None] Terminate volume connection completed successfully. Jan 22 21:28:41.045829 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [req-4745ceca-f282-4fbd-baa5-a3500e8be8bc req-f5adbd89-99b5-4aad-80d2-1dc4414fe1be tempest-TaggedBootDevicesTest-807480544 None] Deleting attachment 44c39bcf-48a3-4406-b713-ad7cf0271b08. {{(pid=129952) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4947}} Jan 22 21:28:41.119695 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-36c42e14-9419-4810-a8be-a589d4b15efe tempest-SnapshotsActionsTest-542663390 None] Delete snapshot completed successfully. Jan 22 21:28:41.127085 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.coordination [None req-36c42e14-9419-4810-a8be-a589d4b15efe tempest-SnapshotsActionsTest-542663390 None] Lock "b'cinder-e333f0db-aa55-4b55-8529-ab89cb016acd-delete_snapshot'" released by "delete_snapshot" :: held 5.339s {{(pid=129952) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 22 21:28:41.240741 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.quota [None req-d292b0aa-4780-434f-a0d6-6e64e3807730 tempest-VolumesCloneTest-2077595781 None] Created reservations ['e16b8a24-917d-422f-a653-44a8925e9b25', 'c786c051-1870-4e82-b5d2-32d321832566', '67a08156-aa65-4e57-a1cc-338f828482be', 'a848ea27-f9b8-4f33-8773-6669623598ba'] {{(pid=129952) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 22 21:28:41.566413 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-d292b0aa-4780-434f-a0d6-6e64e3807730 tempest-VolumesCloneTest-2077595781 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:28:41.640003 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-d292b0aa-4780-434f-a0d6-6e64e3807730 tempest-VolumesCloneTest-2077595781 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:28:41.725750 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.manager [None req-d292b0aa-4780-434f-a0d6-6e64e3807730 tempest-VolumesCloneTest-2077595781 None] Notifying Schedulers of capabilities ... {{(pid=129952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 22 21:28:41.739896 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-d292b0aa-4780-434f-a0d6-6e64e3807730 tempest-VolumesCloneTest-2077595781 None] Deleted volume successfully. Jan 22 21:28:41.849081 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.coordination [None req-d292b0aa-4780-434f-a0d6-6e64e3807730 tempest-VolumesCloneTest-2077595781 None] Lock "b'cinder-8f222f86-5a4a-464c-a828-39843c58d1ea-delete_volume'" released by "delete_volume" :: held 7.302s {{(pid=129952) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 22 21:28:42.279485 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-09517a24-3ea1-491f-a9da-da1b5126f4e3 tempest-SnapshotsActionsTest-439238394 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:28:42.676192 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.coordination [None req-3ccd1d06-f125-4a46-8810-0330da5c9695 tempest-VolumesCloneTest-2077595781 None] Lock "b'cinder-c5a6fcea-5e75-41ec-a5f0-840407516d3e-delete_volume'" acquired by "delete_volume" :: waited 0.016s {{(pid=129952) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 22 21:28:42.808521 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-3ccd1d06-f125-4a46-8810-0330da5c9695 tempest-VolumesCloneTest-2077595781 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:28:43.191672 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-3ccd1d06-f125-4a46-8810-0330da5c9695 tempest-VolumesCloneTest-2077595781 None] volume has no backup snaps {{(pid=129952) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Jan 22 21:28:43.352476 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-3ccd1d06-f125-4a46-8810-0330da5c9695 tempest-VolumesCloneTest-2077595781 None] deleting rbd volume volume-c5a6fcea-5e75-41ec-a5f0-840407516d3e {{(pid=129952) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Jan 22 21:28:45.908319 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-09517a24-3ea1-491f-a9da-da1b5126f4e3 tempest-SnapshotsActionsTest-439238394 None] Create snapshot completed successfully Jan 22 21:28:46.688620 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.coordination [None req-dda4837e-26de-456e-b444-eed7f1f651db tempest-SnapshotsActionsTest-542663390 None] Lock "b'cinder-1f6e0979-5cb6-4fab-a28c-ca472a66ad51-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.022s {{(pid=129952) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 22 21:28:46.690826 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-dda4837e-26de-456e-b444-eed7f1f651db tempest-SnapshotsActionsTest-542663390 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:28:50.530044 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-3ccd1d06-f125-4a46-8810-0330da5c9695 tempest-VolumesCloneTest-2077595781 None] volume is a clone so cleaning references {{(pid=129952) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1266}} Jan 22 21:28:50.724521 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-3ccd1d06-f125-4a46-8810-0330da5c9695 tempest-VolumesCloneTest-2077595781 None] deleting parent snapshot volume-c5a6fcea-5e75-41ec-a5f0-840407516d3e.clone_snap {{(pid=129952) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1158}} Jan 22 21:28:54.012223 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.quota [None req-dda4837e-26de-456e-b444-eed7f1f651db tempest-SnapshotsActionsTest-542663390 None] Created reservations ['c94b671a-6477-4b95-bd2d-51b8c2df9ccc', 'd44b3c19-bb5f-4028-a9f4-88bf86970fb7', '0a71e368-2eb1-41e5-9e58-c7abcd0cd7e6', '9cc44edb-0196-45e8-a49e-088b8b2fcadf'] {{(pid=129952) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 22 21:28:54.207329 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.quota [None req-3ccd1d06-f125-4a46-8810-0330da5c9695 tempest-VolumesCloneTest-2077595781 None] Created reservations ['a84c71c3-44c0-4859-b3cf-5c41e07a9cb5', '03adacda-fb30-4959-bff4-64e31c65508f', '3beed8d3-0845-407f-9212-8cbe67664832', 'cd72d082-2a36-4612-8f81-a9c0307b4605'] {{(pid=129952) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 22 21:28:54.381207 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-dda4837e-26de-456e-b444-eed7f1f651db tempest-SnapshotsActionsTest-542663390 None] Delete snapshot completed successfully. Jan 22 21:28:54.406429 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.coordination [None req-dda4837e-26de-456e-b444-eed7f1f651db tempest-SnapshotsActionsTest-542663390 None] Lock "b'cinder-1f6e0979-5cb6-4fab-a28c-ca472a66ad51-delete_snapshot'" released by "delete_snapshot" :: held 7.717s {{(pid=129952) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 22 21:28:54.526444 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-3ccd1d06-f125-4a46-8810-0330da5c9695 tempest-VolumesCloneTest-2077595781 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:28:54.602382 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-3ccd1d06-f125-4a46-8810-0330da5c9695 tempest-VolumesCloneTest-2077595781 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:28:54.654727 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.manager [None req-3ccd1d06-f125-4a46-8810-0330da5c9695 tempest-VolumesCloneTest-2077595781 None] Notifying Schedulers of capabilities ... {{(pid=129952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 22 21:28:54.665970 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-3ccd1d06-f125-4a46-8810-0330da5c9695 tempest-VolumesCloneTest-2077595781 None] Deleted volume successfully. Jan 22 21:28:54.781648 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.coordination [None req-3ccd1d06-f125-4a46-8810-0330da5c9695 tempest-VolumesCloneTest-2077595781 None] Lock "b'cinder-c5a6fcea-5e75-41ec-a5f0-840407516d3e-delete_volume'" released by "delete_volume" :: held 12.100s {{(pid=129952) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 22 21:28:55.157448 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.coordination [None req-f0abe0b5-822d-4e71-bba3-c6ec13962e15 tempest-VolumesCloneTest-2077595781 None] Lock "b'cinder-a9e42cee-ab5d-4f06-8a5f-079a07f580e1-delete_volume'" acquired by "delete_volume" :: waited 0.014s {{(pid=129952) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 22 21:28:55.377415 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-f0abe0b5-822d-4e71-bba3-c6ec13962e15 tempest-VolumesCloneTest-2077595781 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:28:55.626257 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-f0abe0b5-822d-4e71-bba3-c6ec13962e15 tempest-VolumesCloneTest-2077595781 None] volume has no backup snaps {{(pid=129952) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Jan 22 21:28:55.728817 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-f0abe0b5-822d-4e71-bba3-c6ec13962e15 tempest-VolumesCloneTest-2077595781 None] deleting rbd volume volume-a9e42cee-ab5d-4f06-8a5f-079a07f580e1 {{(pid=129952) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Jan 22 21:28:56.532024 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.coordination [None req-d9d9a9cf-b11a-4db8-ad39-1f4711ba1aa4 tempest-SnapshotsActionsTest-439238394 None] Lock "b'cinder-23248312-719f-4145-9fed-d302d396f5c6-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.014s {{(pid=129952) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 22 21:28:56.532024 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-d9d9a9cf-b11a-4db8-ad39-1f4711ba1aa4 tempest-SnapshotsActionsTest-439238394 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:28:57.224659 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.coordination [None req-3563f9b9-8c41-4ddc-aedf-3238e8e0fc94 tempest-TaggedBootDevicesTest-807480544 None] Lock "b'cinder-0a4a89b1-bfa5-41ab-9b69-2aa9236eafba-delete_volume'" acquired by "delete_volume" :: waited 0.028s {{(pid=129952) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 22 21:28:57.386602 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-3563f9b9-8c41-4ddc-aedf-3238e8e0fc94 tempest-TaggedBootDevicesTest-807480544 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:28:57.729434 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-3563f9b9-8c41-4ddc-aedf-3238e8e0fc94 tempest-TaggedBootDevicesTest-807480544 None] volume has no backup snaps {{(pid=129952) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Jan 22 21:28:57.730075 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-3563f9b9-8c41-4ddc-aedf-3238e8e0fc94 tempest-TaggedBootDevicesTest-807480544 None] Volume volume-0a4a89b1-bfa5-41ab-9b69-2aa9236eafba is not a clone. {{(pid=129952) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Jan 22 21:28:57.955964 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-3563f9b9-8c41-4ddc-aedf-3238e8e0fc94 tempest-TaggedBootDevicesTest-807480544 None] deleting rbd volume volume-0a4a89b1-bfa5-41ab-9b69-2aa9236eafba {{(pid=129952) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Jan 22 21:29:00.415114 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.quota [None req-d9d9a9cf-b11a-4db8-ad39-1f4711ba1aa4 tempest-SnapshotsActionsTest-439238394 None] Created reservations ['7a6cd2a6-63fc-4dea-8103-8e5e177398d6', '59e5538e-4878-4968-a3c3-36f78ff8bb19', '0f470fcb-c2f2-47b7-ad90-6a150f4d895e', 'c491a28d-e3b2-46bc-b19e-407a327fce54'] {{(pid=129952) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 22 21:29:00.673966 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-d9d9a9cf-b11a-4db8-ad39-1f4711ba1aa4 tempest-SnapshotsActionsTest-439238394 None] Delete snapshot completed successfully. Jan 22 21:29:00.683684 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.coordination [None req-d9d9a9cf-b11a-4db8-ad39-1f4711ba1aa4 tempest-SnapshotsActionsTest-439238394 None] Lock "b'cinder-23248312-719f-4145-9fed-d302d396f5c6-delete_snapshot'" released by "delete_snapshot" :: held 4.156s {{(pid=129952) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 22 21:29:00.982937 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.coordination [None req-aeeb3704-eb05-48c8-9989-b88ee96f1b4b tempest-SnapshotsActionsTest-439238394 None] Lock "b'cinder-bf30deb1-4d86-40ec-b213-7f3c413f8541-delete_volume'" acquired by "delete_volume" :: waited 0.010s {{(pid=129952) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 22 21:29:01.105351 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-aeeb3704-eb05-48c8-9989-b88ee96f1b4b tempest-SnapshotsActionsTest-439238394 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:29:01.391006 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-aeeb3704-eb05-48c8-9989-b88ee96f1b4b tempest-SnapshotsActionsTest-439238394 None] volume has no backup snaps {{(pid=129952) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Jan 22 21:29:01.392893 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-aeeb3704-eb05-48c8-9989-b88ee96f1b4b tempest-SnapshotsActionsTest-439238394 None] Volume volume-bf30deb1-4d86-40ec-b213-7f3c413f8541 is not a clone. {{(pid=129952) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Jan 22 21:29:01.711605 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-aeeb3704-eb05-48c8-9989-b88ee96f1b4b tempest-SnapshotsActionsTest-439238394 None] deleting rbd volume volume-bf30deb1-4d86-40ec-b213-7f3c413f8541 {{(pid=129952) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Jan 22 21:29:02.259504 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-f0abe0b5-822d-4e71-bba3-c6ec13962e15 tempest-VolumesCloneTest-2077595781 None] volume is a clone so cleaning references {{(pid=129952) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1266}} Jan 22 21:29:02.553472 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-f0abe0b5-822d-4e71-bba3-c6ec13962e15 tempest-VolumesCloneTest-2077595781 None] deleting parent snapshot volume-a9e42cee-ab5d-4f06-8a5f-079a07f580e1.clone_snap {{(pid=129952) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1158}} Jan 22 21:29:07.351919 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.quota [None req-f0abe0b5-822d-4e71-bba3-c6ec13962e15 tempest-VolumesCloneTest-2077595781 None] Created reservations ['f7d48b56-29b2-4066-aa57-1dc98197d050', '133ca62d-6afd-4bfa-a986-76622d77fccf', '5f0dad61-d9dc-4031-8699-4e9b643b523f', 'b3c0de1b-7563-43d6-a578-5bb8d648a6a9'] {{(pid=129952) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 22 21:29:07.355967 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.quota [None req-3563f9b9-8c41-4ddc-aedf-3238e8e0fc94 tempest-TaggedBootDevicesTest-807480544 None] Created reservations ['3b3ed267-651a-48fb-b449-b55366b87821', '40a9a2c4-338b-4630-b44a-55f30bb2594a', '4a0b62a5-db86-48fd-af83-9f7c2c4f4c26', 'd2cff8fe-bf80-4875-8208-310b253d73b3'] {{(pid=129952) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 22 21:29:07.422300 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.flows.manager.create_volume [None req-8fba3386-dd06-4014-ba96-411c76c854f0 tempest-VolumeRetypeWithoutMigrationTest-730823916 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129952) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Jan 22 21:29:07.434505 ncdv-master-1 cinder-volume[129952]: WARNING stevedore.named [None req-8fba3386-dd06-4014-ba96-411c76c854f0 tempest-VolumeRetypeWithoutMigrationTest-730823916 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jan 22 21:29:07.434505 ncdv-master-1 cinder-volume[129952]: WARNING castellan.key_manager [None req-8fba3386-dd06-4014-ba96-411c76c854f0 tempest-VolumeRetypeWithoutMigrationTest-730823916 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 22 21:29:07.446324 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-8fba3386-dd06-4014-ba96-411c76c854f0 tempest-VolumeRetypeWithoutMigrationTest-730823916 None] Flow 'volume_create_manager' (644fb20b-3094-478b-b820-ee9b5a87958e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 22 21:29:07.454384 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-8fba3386-dd06-4014-ba96-411c76c854f0 tempest-VolumeRetypeWithoutMigrationTest-730823916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (652236fb-0bf2-49aa-b381-317518280f55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:29:07.460983 ncdv-master-1 cinder-volume[129952]: DEBUG oslo_db.sqlalchemy.engines [None req-8fba3386-dd06-4014-ba96-411c76c854f0 tempest-VolumeRetypeWithoutMigrationTest-730823916 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129952) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 22 21:29:07.475609 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-8fba3386-dd06-4014-ba96-411c76c854f0 tempest-VolumeRetypeWithoutMigrationTest-730823916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (652236fb-0bf2-49aa-b381-317518280f55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-01-22T21:29:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-495988747',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=2ce8880e-3870-41c6-a3c4-4f03bbe4fc7d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95ede687eaa24ce0bf90b3cd7432d269',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-01-22T21:29:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-01-22T21:29:04Z,use_quota=True,user_id='d3f2d3a3d01a4c389438cf0b0cd01acb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d2313f0-f46a-4fbc-bbd6-16de0d9b8cab),volume_type_id=5d2313f0-f46a-4fbc-bbd6-16de0d9b8cab)' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:29:07.481144 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-8fba3386-dd06-4014-ba96-411c76c854f0 tempest-VolumeRetypeWithoutMigrationTest-730823916 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1b79cd4-db6e-4955-8d7f-cacf9a746b72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:29:07.485386 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-8fba3386-dd06-4014-ba96-411c76c854f0 tempest-VolumeRetypeWithoutMigrationTest-730823916 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1b79cd4-db6e-4955-8d7f-cacf9a746b72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:29:07.490735 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-8fba3386-dd06-4014-ba96-411c76c854f0 tempest-VolumeRetypeWithoutMigrationTest-730823916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57a8e622-c115-4a3a-844a-6a4c2f0b2f0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:29:07.494987 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-8fba3386-dd06-4014-ba96-411c76c854f0 tempest-VolumeRetypeWithoutMigrationTest-730823916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57a8e622-c115-4a3a-844a-6a4c2f0b2f0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2ce8880e-3870-41c6-a3c4-4f03bbe4fc7d', 'volume_name': 'volume-2ce8880e-3870-41c6-a3c4-4f03bbe4fc7d', 'volume_size': 1}' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:29:07.500226 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-8fba3386-dd06-4014-ba96-411c76c854f0 tempest-VolumeRetypeWithoutMigrationTest-730823916 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9053f868-e477-4067-be54-b597137072c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:29:07.504292 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-8fba3386-dd06-4014-ba96-411c76c854f0 tempest-VolumeRetypeWithoutMigrationTest-730823916 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9053f868-e477-4067-be54-b597137072c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:29:07.509201 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-8fba3386-dd06-4014-ba96-411c76c854f0 tempest-VolumeRetypeWithoutMigrationTest-730823916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84cd15ce-ca98-41d5-9585-738e66314895) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:29:07.510309 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.flows.manager.create_volume [None req-8fba3386-dd06-4014-ba96-411c76c854f0 tempest-VolumeRetypeWithoutMigrationTest-730823916 None] Volume 2ce8880e-3870-41c6-a3c4-4f03bbe4fc7d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2ce8880e-3870-41c6-a3c4-4f03bbe4fc7d', 'volume_size': 1} Jan 22 21:29:07.510706 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-8fba3386-dd06-4014-ba96-411c76c854f0 tempest-VolumeRetypeWithoutMigrationTest-730823916 None] creating volume 'volume-2ce8880e-3870-41c6-a3c4-4f03bbe4fc7d' {{(pid=129952) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Jan 22 21:29:07.511680 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-8fba3386-dd06-4014-ba96-411c76c854f0 tempest-VolumeRetypeWithoutMigrationTest-730823916 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:29:07.733645 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-f0abe0b5-822d-4e71-bba3-c6ec13962e15 tempest-VolumesCloneTest-2077595781 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:29:07.768671 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-f0abe0b5-822d-4e71-bba3-c6ec13962e15 tempest-VolumesCloneTest-2077595781 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:29:07.794312 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.manager [None req-f0abe0b5-822d-4e71-bba3-c6ec13962e15 tempest-VolumesCloneTest-2077595781 None] Notifying Schedulers of capabilities ... {{(pid=129952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 22 21:29:07.805055 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-f0abe0b5-822d-4e71-bba3-c6ec13962e15 tempest-VolumesCloneTest-2077595781 None] Deleted volume successfully. Jan 22 21:29:07.901854 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.coordination [None req-f0abe0b5-822d-4e71-bba3-c6ec13962e15 tempest-VolumesCloneTest-2077595781 None] Lock "b'cinder-a9e42cee-ab5d-4f06-8a5f-079a07f580e1-delete_volume'" released by "delete_volume" :: held 12.741s {{(pid=129952) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 22 21:29:07.923143 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-3563f9b9-8c41-4ddc-aedf-3238e8e0fc94 tempest-TaggedBootDevicesTest-807480544 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:29:07.944283 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-3563f9b9-8c41-4ddc-aedf-3238e8e0fc94 tempest-TaggedBootDevicesTest-807480544 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:29:07.985718 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.manager [None req-3563f9b9-8c41-4ddc-aedf-3238e8e0fc94 tempest-TaggedBootDevicesTest-807480544 None] Notifying Schedulers of capabilities ... {{(pid=129952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 22 21:29:07.989559 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-3563f9b9-8c41-4ddc-aedf-3238e8e0fc94 tempest-TaggedBootDevicesTest-807480544 None] Deleted volume successfully. Jan 22 21:29:08.114274 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.coordination [None req-3563f9b9-8c41-4ddc-aedf-3238e8e0fc94 tempest-TaggedBootDevicesTest-807480544 None] Lock "b'cinder-0a4a89b1-bfa5-41ab-9b69-2aa9236eafba-delete_volume'" released by "delete_volume" :: held 10.891s {{(pid=129952) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 22 21:29:08.629315 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.quota [None req-aeeb3704-eb05-48c8-9989-b88ee96f1b4b tempest-SnapshotsActionsTest-439238394 None] Created reservations ['f1e664a6-0cdb-405c-8a57-d880c9f2a945', 'f884d17c-0011-4235-a89e-46cc07b5ecae', 'efd3a1cf-8306-476a-87e1-968a15b15911', '1b8b958f-7f95-481f-b1fd-23fe5be49b74'] {{(pid=129952) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 22 21:29:08.649043 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-8fba3386-dd06-4014-ba96-411c76c854f0 tempest-VolumeRetypeWithoutMigrationTest-730823916 None] extra_specs: {} {{(pid=129952) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 22 21:29:08.649491 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-8fba3386-dd06-4014-ba96-411c76c854f0 tempest-VolumeRetypeWithoutMigrationTest-730823916 None] extra_specs: {} {{(pid=129952) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 22 21:29:08.653427 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-8fba3386-dd06-4014-ba96-411c76c854f0 tempest-VolumeRetypeWithoutMigrationTest-730823916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84cd15ce-ca98-41d5-9585-738e66314895) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2ce8880e-3870-41c6-a3c4-4f03bbe4fc7d', 'volume_size': 1}' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:29:08.659256 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-8fba3386-dd06-4014-ba96-411c76c854f0 tempest-VolumeRetypeWithoutMigrationTest-730823916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22ad5aae-93ac-45e3-9e47-4475efa5d9af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:29:08.675175 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-c657d6d2-d275-48d7-832a-f149ad242fec tempest-GroupsV320Test-547162198 None] Group tempest-GroupsV320Test-Group-706789384: creating Jan 22 21:29:08.693684 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.coordination [None req-c5bf41c9-fa93-4aa5-b76d-c2b99caa1764 tempest-TaggedBootDevicesTest-807480544 None] Lock "b'cinder-c8294219-e877-4aee-abe6-451466fa194f-delete_volume'" acquired by "delete_volume" :: waited 0.053s {{(pid=129952) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 22 21:29:08.791981 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.flows.manager.create_volume [None req-8fba3386-dd06-4014-ba96-411c76c854f0 tempest-VolumeRetypeWithoutMigrationTest-730823916 None] Volume volume-2ce8880e-3870-41c6-a3c4-4f03bbe4fc7d (2ce8880e-3870-41c6-a3c4-4f03bbe4fc7d): created successfully Jan 22 21:29:08.796425 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-8fba3386-dd06-4014-ba96-411c76c854f0 tempest-VolumeRetypeWithoutMigrationTest-730823916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22ad5aae-93ac-45e3-9e47-4475efa5d9af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:29:08.802628 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-8fba3386-dd06-4014-ba96-411c76c854f0 tempest-VolumeRetypeWithoutMigrationTest-730823916 None] Flow 'volume_create_manager' (644fb20b-3094-478b-b820-ee9b5a87958e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129952) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 22 21:29:08.824837 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-c657d6d2-d275-48d7-832a-f149ad242fec tempest-GroupsV320Test-547162198 None] Group tempest-GroupsV320Test-Group-706789384: created successfully Jan 22 21:29:08.836025 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-c657d6d2-d275-48d7-832a-f149ad242fec tempest-GroupsV320Test-547162198 None] Create group completed successfully. Jan 22 21:29:08.837768 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-c5bf41c9-fa93-4aa5-b76d-c2b99caa1764 tempest-TaggedBootDevicesTest-807480544 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:29:08.956826 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-c5bf41c9-fa93-4aa5-b76d-c2b99caa1764 tempest-TaggedBootDevicesTest-807480544 None] volume has no backup snaps {{(pid=129952) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Jan 22 21:29:08.957255 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-c5bf41c9-fa93-4aa5-b76d-c2b99caa1764 tempest-TaggedBootDevicesTest-807480544 None] Volume volume-c8294219-e877-4aee-abe6-451466fa194f is not a clone. {{(pid=129952) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Jan 22 21:29:09.070220 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-c5bf41c9-fa93-4aa5-b76d-c2b99caa1764 tempest-TaggedBootDevicesTest-807480544 None] deleting rbd volume volume-c8294219-e877-4aee-abe6-451466fa194f {{(pid=129952) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Jan 22 21:29:09.073608 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-aeeb3704-eb05-48c8-9989-b88ee96f1b4b tempest-SnapshotsActionsTest-439238394 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:29:09.137064 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-aeeb3704-eb05-48c8-9989-b88ee96f1b4b tempest-SnapshotsActionsTest-439238394 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:29:09.174107 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.manager [None req-aeeb3704-eb05-48c8-9989-b88ee96f1b4b tempest-SnapshotsActionsTest-439238394 None] Notifying Schedulers of capabilities ... {{(pid=129952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 22 21:29:09.176321 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-8fba3386-dd06-4014-ba96-411c76c854f0 tempest-VolumeRetypeWithoutMigrationTest-730823916 None] Created volume successfully. Jan 22 21:29:09.184262 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-aeeb3704-eb05-48c8-9989-b88ee96f1b4b tempest-SnapshotsActionsTest-439238394 None] Deleted volume successfully. Jan 22 21:29:09.362989 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.coordination [None req-aeeb3704-eb05-48c8-9989-b88ee96f1b4b tempest-SnapshotsActionsTest-439238394 None] Lock "b'cinder-bf30deb1-4d86-40ec-b213-7f3c413f8541-delete_volume'" released by "delete_volume" :: held 8.380s {{(pid=129952) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 22 21:29:09.708791 ncdv-master-1 cinder-volume[129952]: DEBUG oslo_service.periodic_task [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129952) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jan 22 21:29:09.709528 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:29:09.741050 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:29:09.791423 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.manager [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] Notifying Schedulers of capabilities ... {{(pid=129952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 22 21:29:10.418440 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-e0d78e9a-fa06-4c53-98fd-8eb1b3ae689a tempest-VolumeRetypeWithoutMigrationTest-730823916 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:29:10.466704 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-e0d78e9a-fa06-4c53-98fd-8eb1b3ae689a tempest-VolumeRetypeWithoutMigrationTest-730823916 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:29:10.519383 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.manager [None req-e0d78e9a-fa06-4c53-98fd-8eb1b3ae689a tempest-VolumeRetypeWithoutMigrationTest-730823916 None] Notifying Schedulers of capabilities ... {{(pid=129952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 22 21:29:10.533478 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-e0d78e9a-fa06-4c53-98fd-8eb1b3ae689a tempest-VolumeRetypeWithoutMigrationTest-730823916 None] Retype volume completed successfully. Jan 22 21:29:10.780571 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.quota [None req-3eb88a8d-8d1a-4ffc-b337-a91f9293d482 tempest-GroupsV320Test-547162198 None] Created reservations ['16c2a339-d2df-420d-92cb-60435ea5b6b7'] {{(pid=129952) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 22 21:29:11.003312 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-3eb88a8d-8d1a-4ffc-b337-a91f9293d482 tempest-GroupsV320Test-547162198 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:29:11.055186 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-3eb88a8d-8d1a-4ffc-b337-a91f9293d482 tempest-GroupsV320Test-547162198 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:29:11.101653 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.manager [None req-3eb88a8d-8d1a-4ffc-b337-a91f9293d482 tempest-GroupsV320Test-547162198 None] Notifying Schedulers of capabilities ... {{(pid=129952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 22 21:29:11.105732 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-3eb88a8d-8d1a-4ffc-b337-a91f9293d482 tempest-GroupsV320Test-547162198 None] Delete group completed successfully. Jan 22 21:29:11.458924 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.coordination [None req-59032bf4-4eab-48da-a92b-fc261270103f tempest-VolumeRetypeWithoutMigrationTest-730823916 None] Lock "b'cinder-2ce8880e-3870-41c6-a3c4-4f03bbe4fc7d-delete_volume'" acquired by "delete_volume" :: waited 0.015s {{(pid=129952) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 22 21:29:11.688034 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-59032bf4-4eab-48da-a92b-fc261270103f tempest-VolumeRetypeWithoutMigrationTest-730823916 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:29:11.916292 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-59032bf4-4eab-48da-a92b-fc261270103f tempest-VolumeRetypeWithoutMigrationTest-730823916 None] volume has no backup snaps {{(pid=129952) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Jan 22 21:29:11.916968 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-59032bf4-4eab-48da-a92b-fc261270103f tempest-VolumeRetypeWithoutMigrationTest-730823916 None] Volume volume-2ce8880e-3870-41c6-a3c4-4f03bbe4fc7d is not a clone. {{(pid=129952) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Jan 22 21:29:12.122989 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-59032bf4-4eab-48da-a92b-fc261270103f tempest-VolumeRetypeWithoutMigrationTest-730823916 None] deleting rbd volume volume-2ce8880e-3870-41c6-a3c4-4f03bbe4fc7d {{(pid=129952) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Jan 22 21:29:12.466807 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.flows.manager.create_volume [None req-2d91c0cf-118b-43d8-a4eb-2c97b77b55d9 tempest-VolumesCloneNegativeTest-790344344 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129952) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Jan 22 21:29:12.472141 ncdv-master-1 cinder-volume[129952]: WARNING stevedore.named [None req-2d91c0cf-118b-43d8-a4eb-2c97b77b55d9 tempest-VolumesCloneNegativeTest-790344344 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jan 22 21:29:12.483999 ncdv-master-1 cinder-volume[129952]: WARNING castellan.key_manager [None req-2d91c0cf-118b-43d8-a4eb-2c97b77b55d9 tempest-VolumesCloneNegativeTest-790344344 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 22 21:29:12.494336 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-2d91c0cf-118b-43d8-a4eb-2c97b77b55d9 tempest-VolumesCloneNegativeTest-790344344 None] Flow 'volume_create_manager' (66349a58-a7f2-4aa5-a77d-afe018ad972e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 22 21:29:12.501340 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-2d91c0cf-118b-43d8-a4eb-2c97b77b55d9 tempest-VolumesCloneNegativeTest-790344344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13f2b936-ee03-4cb6-a371-31e39eece665) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:29:12.510703 ncdv-master-1 cinder-volume[129952]: DEBUG oslo_db.sqlalchemy.engines [None req-2d91c0cf-118b-43d8-a4eb-2c97b77b55d9 tempest-VolumesCloneNegativeTest-790344344 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129952) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 22 21:29:12.524640 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-2d91c0cf-118b-43d8-a4eb-2c97b77b55d9 tempest-VolumesCloneNegativeTest-790344344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13f2b936-ee03-4cb6-a371-31e39eece665) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-01-22T21:29:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1389565249',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=2e5b7a8c-7110-4d90-8925-8af4be0db03a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a03c5b3776c407b8f5b1ed56df9982f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-01-22T21:29:12Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-01-22T21:29:12Z,use_quota=True,user_id='b0c12a1d721542b69518e8fb810ff7af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6dacb05b-a7ea-4056-85ff-98f0ea5c54eb),volume_type_id=6dacb05b-a7ea-4056-85ff-98f0ea5c54eb)' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:29:12.532515 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-2d91c0cf-118b-43d8-a4eb-2c97b77b55d9 tempest-VolumesCloneNegativeTest-790344344 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9dc895df-3618-4eb5-b527-3a425de4dee3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:29:12.537741 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-2d91c0cf-118b-43d8-a4eb-2c97b77b55d9 tempest-VolumesCloneNegativeTest-790344344 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9dc895df-3618-4eb5-b527-3a425de4dee3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:29:12.543114 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-2d91c0cf-118b-43d8-a4eb-2c97b77b55d9 tempest-VolumesCloneNegativeTest-790344344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00cd349a-d8ae-4132-a023-502e57770b66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:29:12.548897 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-2d91c0cf-118b-43d8-a4eb-2c97b77b55d9 tempest-VolumesCloneNegativeTest-790344344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00cd349a-d8ae-4132-a023-502e57770b66) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2e5b7a8c-7110-4d90-8925-8af4be0db03a', 'volume_name': 'volume-2e5b7a8c-7110-4d90-8925-8af4be0db03a', 'volume_size': 2}' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:29:12.554133 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-2d91c0cf-118b-43d8-a4eb-2c97b77b55d9 tempest-VolumesCloneNegativeTest-790344344 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ee51c62-26e3-49e5-879a-111e60a35742) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:29:12.559269 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-2d91c0cf-118b-43d8-a4eb-2c97b77b55d9 tempest-VolumesCloneNegativeTest-790344344 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ee51c62-26e3-49e5-879a-111e60a35742) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:29:12.564826 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-2d91c0cf-118b-43d8-a4eb-2c97b77b55d9 tempest-VolumesCloneNegativeTest-790344344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b5333b9-873f-4c82-bc7e-0278075fdb24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:29:12.566682 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.flows.manager.create_volume [None req-2d91c0cf-118b-43d8-a4eb-2c97b77b55d9 tempest-VolumesCloneNegativeTest-790344344 None] Volume 2e5b7a8c-7110-4d90-8925-8af4be0db03a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2e5b7a8c-7110-4d90-8925-8af4be0db03a', 'volume_size': 2} Jan 22 21:29:12.567310 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-2d91c0cf-118b-43d8-a4eb-2c97b77b55d9 tempest-VolumesCloneNegativeTest-790344344 None] creating volume 'volume-2e5b7a8c-7110-4d90-8925-8af4be0db03a' {{(pid=129952) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Jan 22 21:29:12.568705 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-2d91c0cf-118b-43d8-a4eb-2c97b77b55d9 tempest-VolumesCloneNegativeTest-790344344 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:29:13.575530 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-2d91c0cf-118b-43d8-a4eb-2c97b77b55d9 tempest-VolumesCloneNegativeTest-790344344 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129952) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 22 21:29:13.577323 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-2d91c0cf-118b-43d8-a4eb-2c97b77b55d9 tempest-VolumesCloneNegativeTest-790344344 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129952) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 22 21:29:13.583003 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-2d91c0cf-118b-43d8-a4eb-2c97b77b55d9 tempest-VolumesCloneNegativeTest-790344344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b5333b9-873f-4c82-bc7e-0278075fdb24) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2e5b7a8c-7110-4d90-8925-8af4be0db03a', 'volume_size': 2}' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:29:13.591135 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-2d91c0cf-118b-43d8-a4eb-2c97b77b55d9 tempest-VolumesCloneNegativeTest-790344344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8bd5c53-17f6-4d77-a744-f05e976c2f22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:29:13.675129 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.flows.manager.create_volume [None req-2d91c0cf-118b-43d8-a4eb-2c97b77b55d9 tempest-VolumesCloneNegativeTest-790344344 None] Volume volume-2e5b7a8c-7110-4d90-8925-8af4be0db03a (2e5b7a8c-7110-4d90-8925-8af4be0db03a): created successfully Jan 22 21:29:13.679257 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-2d91c0cf-118b-43d8-a4eb-2c97b77b55d9 tempest-VolumesCloneNegativeTest-790344344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8bd5c53-17f6-4d77-a744-f05e976c2f22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:29:13.690852 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-2d91c0cf-118b-43d8-a4eb-2c97b77b55d9 tempest-VolumesCloneNegativeTest-790344344 None] Flow 'volume_create_manager' (66349a58-a7f2-4aa5-a77d-afe018ad972e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129952) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 22 21:29:13.751779 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-2d91c0cf-118b-43d8-a4eb-2c97b77b55d9 tempest-VolumesCloneNegativeTest-790344344 None] Created volume successfully. Jan 22 21:29:13.985371 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.quota [None req-c5bf41c9-fa93-4aa5-b76d-c2b99caa1764 tempest-TaggedBootDevicesTest-807480544 None] Created reservations ['0a4c4d58-78fc-447c-b75d-d8090cb00b62', '6757a0c8-2e16-4d8b-bf62-14efbe72f819', 'c37faf38-ae68-4722-bf11-a93a453bc856', 'c3b00363-cec3-4396-9ade-fb22ac43e5c3'] {{(pid=129952) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 22 21:29:14.230039 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-c5bf41c9-fa93-4aa5-b76d-c2b99caa1764 tempest-TaggedBootDevicesTest-807480544 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:29:14.264044 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-c5bf41c9-fa93-4aa5-b76d-c2b99caa1764 tempest-TaggedBootDevicesTest-807480544 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:29:14.322689 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.manager [None req-c5bf41c9-fa93-4aa5-b76d-c2b99caa1764 tempest-TaggedBootDevicesTest-807480544 None] Notifying Schedulers of capabilities ... {{(pid=129952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 22 21:29:14.327934 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-c5bf41c9-fa93-4aa5-b76d-c2b99caa1764 tempest-TaggedBootDevicesTest-807480544 None] Deleted volume successfully. Jan 22 21:29:14.362441 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.coordination [None req-cf008e97-4048-4cc0-a936-02e885c3a0af tempest-TaggedBootDevicesTest-807480544 None] Lock "b'cinder-fe1f8ef9-19a5-4687-8faf-0666021816d4-delete_volume'" acquired by "delete_volume" :: waited 0.011s {{(pid=129952) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 22 21:29:14.471841 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.coordination [None req-c5bf41c9-fa93-4aa5-b76d-c2b99caa1764 tempest-TaggedBootDevicesTest-807480544 None] Lock "b'cinder-c8294219-e877-4aee-abe6-451466fa194f-delete_volume'" released by "delete_volume" :: held 5.776s {{(pid=129952) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 22 21:29:14.510943 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-cf008e97-4048-4cc0-a936-02e885c3a0af tempest-TaggedBootDevicesTest-807480544 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:29:14.923163 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-cf008e97-4048-4cc0-a936-02e885c3a0af tempest-TaggedBootDevicesTest-807480544 None] volume has no backup snaps {{(pid=129952) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Jan 22 21:29:15.700831 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-cf008e97-4048-4cc0-a936-02e885c3a0af tempest-TaggedBootDevicesTest-807480544 None] deleting rbd volume volume-fe1f8ef9-19a5-4687-8faf-0666021816d4 {{(pid=129952) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Jan 22 21:29:15.741165 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.coordination [None req-b736e084-6fe0-463e-aa21-b58ccaa72ba9 tempest-VolumesCloneNegativeTest-790344344 None] Lock "b'cinder-2e5b7a8c-7110-4d90-8925-8af4be0db03a-delete_volume'" acquired by "delete_volume" :: waited 0.034s {{(pid=129952) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 22 21:29:15.903436 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-b736e084-6fe0-463e-aa21-b58ccaa72ba9 tempest-VolumesCloneNegativeTest-790344344 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:29:16.166173 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-b736e084-6fe0-463e-aa21-b58ccaa72ba9 tempest-VolumesCloneNegativeTest-790344344 None] volume has no backup snaps {{(pid=129952) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Jan 22 21:29:16.170065 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-b736e084-6fe0-463e-aa21-b58ccaa72ba9 tempest-VolumesCloneNegativeTest-790344344 None] Volume volume-2e5b7a8c-7110-4d90-8925-8af4be0db03a is not a clone. {{(pid=129952) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Jan 22 21:29:16.368278 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-b736e084-6fe0-463e-aa21-b58ccaa72ba9 tempest-VolumesCloneNegativeTest-790344344 None] deleting rbd volume volume-2e5b7a8c-7110-4d90-8925-8af4be0db03a {{(pid=129952) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Jan 22 21:29:19.450219 ncdv-master-1 cinder-volume[129952]: WARNING cinder.quota [None req-59032bf4-4eab-48da-a92b-fc261270103f tempest-VolumeRetypeWithoutMigrationTest-730823916 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jan 22 21:29:19.455531 ncdv-master-1 cinder-volume[129952]: WARNING cinder.quota [None req-59032bf4-4eab-48da-a92b-fc261270103f tempest-VolumeRetypeWithoutMigrationTest-730823916 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jan 22 21:29:19.532105 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.quota [None req-59032bf4-4eab-48da-a92b-fc261270103f tempest-VolumeRetypeWithoutMigrationTest-730823916 None] Created reservations ['0ad3b235-d824-4076-bbf4-2c52e935fb32', 'aee3de3e-1d53-4999-83a5-2ddeef999907', 'deda2a7c-9f55-4c50-b54b-df15bbc52126', '0e775bf7-53f1-4a7b-a2a7-6986d25bfbc1'] {{(pid=129952) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 22 21:29:19.772771 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-59032bf4-4eab-48da-a92b-fc261270103f tempest-VolumeRetypeWithoutMigrationTest-730823916 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:29:19.810172 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-59032bf4-4eab-48da-a92b-fc261270103f tempest-VolumeRetypeWithoutMigrationTest-730823916 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:29:19.847043 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.manager [None req-59032bf4-4eab-48da-a92b-fc261270103f tempest-VolumeRetypeWithoutMigrationTest-730823916 None] Notifying Schedulers of capabilities ... {{(pid=129952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 22 21:29:19.854991 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-59032bf4-4eab-48da-a92b-fc261270103f tempest-VolumeRetypeWithoutMigrationTest-730823916 None] Deleted volume successfully. Jan 22 21:29:19.932317 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.coordination [None req-59032bf4-4eab-48da-a92b-fc261270103f tempest-VolumeRetypeWithoutMigrationTest-730823916 None] Lock "b'cinder-2ce8880e-3870-41c6-a3c4-4f03bbe4fc7d-delete_volume'" released by "delete_volume" :: held 8.474s {{(pid=129952) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 22 21:29:20.592673 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.flows.manager.create_volume [None req-a19291be-a5a8-4ad1-aa57-1185b78a70bb tempest-VolumeTypesAccessTest-932092832 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129952) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Jan 22 21:29:20.596177 ncdv-master-1 cinder-volume[129952]: WARNING stevedore.named [None req-a19291be-a5a8-4ad1-aa57-1185b78a70bb tempest-VolumeTypesAccessTest-932092832 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jan 22 21:29:20.596812 ncdv-master-1 cinder-volume[129952]: WARNING castellan.key_manager [None req-a19291be-a5a8-4ad1-aa57-1185b78a70bb tempest-VolumeTypesAccessTest-932092832 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 22 21:29:20.622604 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-a19291be-a5a8-4ad1-aa57-1185b78a70bb tempest-VolumeTypesAccessTest-932092832 None] Flow 'volume_create_manager' (726af8c3-42c2-4740-9743-9e139ee91d22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 22 21:29:20.629875 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-a19291be-a5a8-4ad1-aa57-1185b78a70bb tempest-VolumeTypesAccessTest-932092832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f830435-32e3-41df-a247-07096cfea38c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:29:20.637022 ncdv-master-1 cinder-volume[129952]: DEBUG oslo_db.sqlalchemy.engines [None req-a19291be-a5a8-4ad1-aa57-1185b78a70bb tempest-VolumeTypesAccessTest-932092832 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129952) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 22 21:29:20.653564 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-a19291be-a5a8-4ad1-aa57-1185b78a70bb tempest-VolumeTypesAccessTest-932092832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f830435-32e3-41df-a247-07096cfea38c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-01-22T21:29:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1779039117',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=58a8824a-c0ea-4c7f-a826-2fd077f093b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d531d8783ae74cacb9d03662c36166c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-01-22T21:29:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-01-22T21:29:20Z,use_quota=True,user_id='d49cb6cc704c49d0892969cbc90935a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c0bc2b2-1db2-4481-bfd5-3c2d9eb70c51),volume_type_id=7c0bc2b2-1db2-4481-bfd5-3c2d9eb70c51)' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:29:20.660312 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-a19291be-a5a8-4ad1-aa57-1185b78a70bb tempest-VolumeTypesAccessTest-932092832 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc248dba-caa0-412b-9adb-b6de7520b9fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:29:20.664702 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-a19291be-a5a8-4ad1-aa57-1185b78a70bb tempest-VolumeTypesAccessTest-932092832 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc248dba-caa0-412b-9adb-b6de7520b9fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:29:20.670074 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-a19291be-a5a8-4ad1-aa57-1185b78a70bb tempest-VolumeTypesAccessTest-932092832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (362cfd09-754c-46fa-9a1b-0062e38ea767) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:29:20.675106 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-a19291be-a5a8-4ad1-aa57-1185b78a70bb tempest-VolumeTypesAccessTest-932092832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (362cfd09-754c-46fa-9a1b-0062e38ea767) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '58a8824a-c0ea-4c7f-a826-2fd077f093b1', 'volume_name': 'volume-58a8824a-c0ea-4c7f-a826-2fd077f093b1', 'volume_size': 1}' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:29:20.680133 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-a19291be-a5a8-4ad1-aa57-1185b78a70bb tempest-VolumeTypesAccessTest-932092832 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce021298-ac5d-4a1d-9ba6-634a4efbf7d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:29:20.684803 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-a19291be-a5a8-4ad1-aa57-1185b78a70bb tempest-VolumeTypesAccessTest-932092832 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce021298-ac5d-4a1d-9ba6-634a4efbf7d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:29:20.689931 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-a19291be-a5a8-4ad1-aa57-1185b78a70bb tempest-VolumeTypesAccessTest-932092832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ccaa9dd1-a7f2-4725-8146-3ad82c88f661) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:29:20.691036 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.flows.manager.create_volume [None req-a19291be-a5a8-4ad1-aa57-1185b78a70bb tempest-VolumeTypesAccessTest-932092832 None] Volume 58a8824a-c0ea-4c7f-a826-2fd077f093b1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-58a8824a-c0ea-4c7f-a826-2fd077f093b1', 'volume_size': 1} Jan 22 21:29:20.691427 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-a19291be-a5a8-4ad1-aa57-1185b78a70bb tempest-VolumeTypesAccessTest-932092832 None] creating volume 'volume-58a8824a-c0ea-4c7f-a826-2fd077f093b1' {{(pid=129952) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Jan 22 21:29:20.693009 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-a19291be-a5a8-4ad1-aa57-1185b78a70bb tempest-VolumeTypesAccessTest-932092832 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:29:21.776212 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-a19291be-a5a8-4ad1-aa57-1185b78a70bb tempest-VolumeTypesAccessTest-932092832 None] extra_specs: {} {{(pid=129952) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 22 21:29:21.776990 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-a19291be-a5a8-4ad1-aa57-1185b78a70bb tempest-VolumeTypesAccessTest-932092832 None] extra_specs: {} {{(pid=129952) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 22 21:29:21.781540 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-a19291be-a5a8-4ad1-aa57-1185b78a70bb tempest-VolumeTypesAccessTest-932092832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ccaa9dd1-a7f2-4725-8146-3ad82c88f661) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-58a8824a-c0ea-4c7f-a826-2fd077f093b1', 'volume_size': 1}' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:29:21.787050 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-a19291be-a5a8-4ad1-aa57-1185b78a70bb tempest-VolumeTypesAccessTest-932092832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28fe832b-6e7a-4368-86f5-beaf332f1a47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:29:21.871305 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.flows.manager.create_volume [None req-a19291be-a5a8-4ad1-aa57-1185b78a70bb tempest-VolumeTypesAccessTest-932092832 None] Volume volume-58a8824a-c0ea-4c7f-a826-2fd077f093b1 (58a8824a-c0ea-4c7f-a826-2fd077f093b1): created successfully Jan 22 21:29:21.875933 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-a19291be-a5a8-4ad1-aa57-1185b78a70bb tempest-VolumeTypesAccessTest-932092832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28fe832b-6e7a-4368-86f5-beaf332f1a47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:29:21.882073 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-a19291be-a5a8-4ad1-aa57-1185b78a70bb tempest-VolumeTypesAccessTest-932092832 None] Flow 'volume_create_manager' (726af8c3-42c2-4740-9743-9e139ee91d22) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129952) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 22 21:29:21.994489 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-a19291be-a5a8-4ad1-aa57-1185b78a70bb tempest-VolumeTypesAccessTest-932092832 None] Created volume successfully. Jan 22 21:29:23.639047 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.coordination [None req-2b8c6528-0fab-46ac-8ca1-ae8ed23a536b tempest-VolumeTypesAccessTest-932092832 None] Lock "b'cinder-58a8824a-c0ea-4c7f-a826-2fd077f093b1-delete_volume'" acquired by "delete_volume" :: waited 0.009s {{(pid=129952) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 22 21:29:23.773595 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-2b8c6528-0fab-46ac-8ca1-ae8ed23a536b tempest-VolumeTypesAccessTest-932092832 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:29:24.076156 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-2b8c6528-0fab-46ac-8ca1-ae8ed23a536b tempest-VolumeTypesAccessTest-932092832 None] volume has no backup snaps {{(pid=129952) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Jan 22 21:29:24.076811 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-2b8c6528-0fab-46ac-8ca1-ae8ed23a536b tempest-VolumeTypesAccessTest-932092832 None] Volume volume-58a8824a-c0ea-4c7f-a826-2fd077f093b1 is not a clone. {{(pid=129952) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Jan 22 21:29:24.293671 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-2b8c6528-0fab-46ac-8ca1-ae8ed23a536b tempest-VolumeTypesAccessTest-932092832 None] deleting rbd volume volume-58a8824a-c0ea-4c7f-a826-2fd077f093b1 {{(pid=129952) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Jan 22 21:29:24.489386 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.quota [None req-b736e084-6fe0-463e-aa21-b58ccaa72ba9 tempest-VolumesCloneNegativeTest-790344344 None] Created reservations ['fc6e9816-498c-44b4-abda-cfbdaa8b626f', '6cae96a2-9f8c-4736-92ee-f29d97d75a0d', '713ea8ea-fd46-4c8c-8b77-ee4d1c508b9c', '3e113c54-177e-4411-a9d1-7bc4e79fa6dd'] {{(pid=129952) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 22 21:29:24.717114 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-b736e084-6fe0-463e-aa21-b58ccaa72ba9 tempest-VolumesCloneNegativeTest-790344344 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:29:24.743432 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-b736e084-6fe0-463e-aa21-b58ccaa72ba9 tempest-VolumesCloneNegativeTest-790344344 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:29:24.866632 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.manager [None req-b736e084-6fe0-463e-aa21-b58ccaa72ba9 tempest-VolumesCloneNegativeTest-790344344 None] Notifying Schedulers of capabilities ... {{(pid=129952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 22 21:29:24.868198 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-b736e084-6fe0-463e-aa21-b58ccaa72ba9 tempest-VolumesCloneNegativeTest-790344344 None] Deleted volume successfully. Jan 22 21:29:24.949317 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.coordination [None req-b736e084-6fe0-463e-aa21-b58ccaa72ba9 tempest-VolumesCloneNegativeTest-790344344 None] Lock "b'cinder-2e5b7a8c-7110-4d90-8925-8af4be0db03a-delete_volume'" released by "delete_volume" :: held 9.208s {{(pid=129952) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 22 21:29:25.072585 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-cf008e97-4048-4cc0-a936-02e885c3a0af tempest-TaggedBootDevicesTest-807480544 None] volume is a clone so cleaning references {{(pid=129952) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1266}} Jan 22 21:29:25.329815 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-cf008e97-4048-4cc0-a936-02e885c3a0af tempest-TaggedBootDevicesTest-807480544 None] deleting parent snapshot volume-fe1f8ef9-19a5-4687-8faf-0666021816d4.clone_snap {{(pid=129952) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1158}} Jan 22 21:29:29.449401 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.quota [None req-cf008e97-4048-4cc0-a936-02e885c3a0af tempest-TaggedBootDevicesTest-807480544 None] Created reservations ['da955209-74e4-4047-8f39-3e14e0410e63', '6ccd8b8c-cc93-4d07-9174-ce5da2cfebc3', '78f5493d-9aa2-4b21-905a-eb4d11504901', 'c1d2ca14-b718-49de-9321-dc6137aaf0f0'] {{(pid=129952) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 22 21:29:29.571977 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.flows.manager.create_volume [None req-b8423686-231e-4ba7-ba5b-bee52eb2b986 tempest-VolumesServicesTestJSON-463373702 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129952) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Jan 22 21:29:29.576246 ncdv-master-1 cinder-volume[129952]: WARNING stevedore.named [None req-b8423686-231e-4ba7-ba5b-bee52eb2b986 tempest-VolumesServicesTestJSON-463373702 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jan 22 21:29:29.576696 ncdv-master-1 cinder-volume[129952]: WARNING castellan.key_manager [None req-b8423686-231e-4ba7-ba5b-bee52eb2b986 tempest-VolumesServicesTestJSON-463373702 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 22 21:29:29.607539 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-b8423686-231e-4ba7-ba5b-bee52eb2b986 tempest-VolumesServicesTestJSON-463373702 None] Flow 'volume_create_manager' (c8b7d5e8-2e7e-4f3c-8fd6-0095ab98772b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 22 21:29:29.614938 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-b8423686-231e-4ba7-ba5b-bee52eb2b986 tempest-VolumesServicesTestJSON-463373702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5594053-0be1-4685-9e22-8c898e05338c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:29:29.625181 ncdv-master-1 cinder-volume[129952]: DEBUG oslo_db.sqlalchemy.engines [None req-b8423686-231e-4ba7-ba5b-bee52eb2b986 tempest-VolumesServicesTestJSON-463373702 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129952) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 22 21:29:29.643526 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-b8423686-231e-4ba7-ba5b-bee52eb2b986 tempest-VolumesServicesTestJSON-463373702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5594053-0be1-4685-9e22-8c898e05338c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-01-22T21:29:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-686647874',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=a4eb7006-81f6-4336-9139-e4a75db1efcd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='026bff37da254cc4beb7971b58d48166',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-01-22T21:29:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-01-22T21:29:28Z,use_quota=True,user_id='77ea53a94f5e433ca6ade85719638b17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6dacb05b-a7ea-4056-85ff-98f0ea5c54eb),volume_type_id=6dacb05b-a7ea-4056-85ff-98f0ea5c54eb)' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:29:29.649409 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-b8423686-231e-4ba7-ba5b-bee52eb2b986 tempest-VolumesServicesTestJSON-463373702 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f72630f-e8c7-4e7a-8488-280b068775bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:29:29.653679 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-b8423686-231e-4ba7-ba5b-bee52eb2b986 tempest-VolumesServicesTestJSON-463373702 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f72630f-e8c7-4e7a-8488-280b068775bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:29:29.659412 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-b8423686-231e-4ba7-ba5b-bee52eb2b986 tempest-VolumesServicesTestJSON-463373702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e1c2155-64df-4e3c-a7a4-051986335c34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:29:29.663709 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-b8423686-231e-4ba7-ba5b-bee52eb2b986 tempest-VolumesServicesTestJSON-463373702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e1c2155-64df-4e3c-a7a4-051986335c34) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a4eb7006-81f6-4336-9139-e4a75db1efcd', 'volume_name': 'volume-a4eb7006-81f6-4336-9139-e4a75db1efcd', 'volume_size': 1}' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:29:29.668842 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-b8423686-231e-4ba7-ba5b-bee52eb2b986 tempest-VolumesServicesTestJSON-463373702 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (882f2b52-1af7-48c7-9363-aa2bc432e32b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:29:29.673099 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-b8423686-231e-4ba7-ba5b-bee52eb2b986 tempest-VolumesServicesTestJSON-463373702 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (882f2b52-1af7-48c7-9363-aa2bc432e32b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:29:29.677974 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-b8423686-231e-4ba7-ba5b-bee52eb2b986 tempest-VolumesServicesTestJSON-463373702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56f5840d-fcad-42ec-8b2b-b9349a3e5866) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:29:29.679137 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.flows.manager.create_volume [None req-b8423686-231e-4ba7-ba5b-bee52eb2b986 tempest-VolumesServicesTestJSON-463373702 None] Volume a4eb7006-81f6-4336-9139-e4a75db1efcd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a4eb7006-81f6-4336-9139-e4a75db1efcd', 'volume_size': 1} Jan 22 21:29:29.679529 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-b8423686-231e-4ba7-ba5b-bee52eb2b986 tempest-VolumesServicesTestJSON-463373702 None] creating volume 'volume-a4eb7006-81f6-4336-9139-e4a75db1efcd' {{(pid=129952) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Jan 22 21:29:29.680563 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-b8423686-231e-4ba7-ba5b-bee52eb2b986 tempest-VolumesServicesTestJSON-463373702 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:29:29.774061 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-cf008e97-4048-4cc0-a936-02e885c3a0af tempest-TaggedBootDevicesTest-807480544 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:29:29.809450 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-cf008e97-4048-4cc0-a936-02e885c3a0af tempest-TaggedBootDevicesTest-807480544 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:29:29.850189 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.manager [None req-cf008e97-4048-4cc0-a936-02e885c3a0af tempest-TaggedBootDevicesTest-807480544 None] Notifying Schedulers of capabilities ... {{(pid=129952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 22 21:29:29.865326 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-cf008e97-4048-4cc0-a936-02e885c3a0af tempest-TaggedBootDevicesTest-807480544 None] Deleted volume successfully. Jan 22 21:29:29.930164 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.coordination [None req-cf008e97-4048-4cc0-a936-02e885c3a0af tempest-TaggedBootDevicesTest-807480544 None] Lock "b'cinder-fe1f8ef9-19a5-4687-8faf-0666021816d4-delete_volume'" released by "delete_volume" :: held 15.568s {{(pid=129952) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 22 21:29:30.081413 ncdv-master-1 cinder-volume[129952]: WARNING cinder.quota [None req-2b8c6528-0fab-46ac-8ca1-ae8ed23a536b tempest-VolumeTypesAccessTest-932092832 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-319734142 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-319734142, it is now deprecated. Please use the default quota class for default quota. Jan 22 21:29:30.082529 ncdv-master-1 cinder-volume[129952]: WARNING cinder.quota [None req-2b8c6528-0fab-46ac-8ca1-ae8ed23a536b tempest-VolumeTypesAccessTest-932092832 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-319734142 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-319734142, it is now deprecated. Please use the default quota class for default quota. Jan 22 21:29:30.167992 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.quota [None req-2b8c6528-0fab-46ac-8ca1-ae8ed23a536b tempest-VolumeTypesAccessTest-932092832 None] Created reservations ['30d7bccf-ba56-473e-b62f-47fbd38058e1', '059b5e0e-4d94-492b-b954-ec53387ad193', '76f6d0d0-ec0a-4648-951a-a61a6b179876', '09f7ed99-c485-49cb-8972-a67de33d72bc'] {{(pid=129952) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 22 21:29:30.425561 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-2b8c6528-0fab-46ac-8ca1-ae8ed23a536b tempest-VolumeTypesAccessTest-932092832 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:29:30.450518 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-2b8c6528-0fab-46ac-8ca1-ae8ed23a536b tempest-VolumeTypesAccessTest-932092832 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:29:30.481469 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.manager [None req-2b8c6528-0fab-46ac-8ca1-ae8ed23a536b tempest-VolumeTypesAccessTest-932092832 None] Notifying Schedulers of capabilities ... {{(pid=129952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 22 21:29:30.494458 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-b8423686-231e-4ba7-ba5b-bee52eb2b986 tempest-VolumesServicesTestJSON-463373702 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129952) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 22 21:29:30.495056 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-b8423686-231e-4ba7-ba5b-bee52eb2b986 tempest-VolumesServicesTestJSON-463373702 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129952) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 22 21:29:30.503041 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-b8423686-231e-4ba7-ba5b-bee52eb2b986 tempest-VolumesServicesTestJSON-463373702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56f5840d-fcad-42ec-8b2b-b9349a3e5866) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a4eb7006-81f6-4336-9139-e4a75db1efcd', 'volume_size': 1}' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:29:30.513168 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-b8423686-231e-4ba7-ba5b-bee52eb2b986 tempest-VolumesServicesTestJSON-463373702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6fbcd67d-fc98-4d7f-8ccb-2a96456ee35a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:29:30.537601 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-2b8c6528-0fab-46ac-8ca1-ae8ed23a536b tempest-VolumeTypesAccessTest-932092832 None] Deleted volume successfully. Jan 22 21:29:30.613229 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.flows.manager.create_volume [None req-b8423686-231e-4ba7-ba5b-bee52eb2b986 tempest-VolumesServicesTestJSON-463373702 None] Volume volume-a4eb7006-81f6-4336-9139-e4a75db1efcd (a4eb7006-81f6-4336-9139-e4a75db1efcd): created successfully Jan 22 21:29:30.616922 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-b8423686-231e-4ba7-ba5b-bee52eb2b986 tempest-VolumesServicesTestJSON-463373702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6fbcd67d-fc98-4d7f-8ccb-2a96456ee35a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:29:30.623212 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-b8423686-231e-4ba7-ba5b-bee52eb2b986 tempest-VolumesServicesTestJSON-463373702 None] Flow 'volume_create_manager' (c8b7d5e8-2e7e-4f3c-8fd6-0095ab98772b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129952) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 22 21:29:30.644688 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.coordination [None req-2b8c6528-0fab-46ac-8ca1-ae8ed23a536b tempest-VolumeTypesAccessTest-932092832 None] Lock "b'cinder-58a8824a-c0ea-4c7f-a826-2fd077f093b1-delete_volume'" released by "delete_volume" :: held 7.006s {{(pid=129952) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 22 21:29:30.722182 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-b8423686-231e-4ba7-ba5b-bee52eb2b986 tempest-VolumesServicesTestJSON-463373702 None] Created volume successfully. Jan 22 21:29:31.513431 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.flows.manager.create_volume [None req-7afd50e3-f40e-4e88-aeb8-466c0edfb911 tempest-VolumeQuotasAdminTestJSON-283808117 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129952) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Jan 22 21:29:31.518741 ncdv-master-1 cinder-volume[129952]: WARNING stevedore.named [None req-7afd50e3-f40e-4e88-aeb8-466c0edfb911 tempest-VolumeQuotasAdminTestJSON-283808117 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jan 22 21:29:31.519645 ncdv-master-1 cinder-volume[129952]: WARNING castellan.key_manager [None req-7afd50e3-f40e-4e88-aeb8-466c0edfb911 tempest-VolumeQuotasAdminTestJSON-283808117 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 22 21:29:31.542707 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-7afd50e3-f40e-4e88-aeb8-466c0edfb911 tempest-VolumeQuotasAdminTestJSON-283808117 None] Flow 'volume_create_manager' (bb5dc287-31af-4412-a2b2-8a1efa407876) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 22 21:29:31.551043 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-7afd50e3-f40e-4e88-aeb8-466c0edfb911 tempest-VolumeQuotasAdminTestJSON-283808117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1938c5ed-6bfd-4b54-8678-4af1cea5eebb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:29:31.557378 ncdv-master-1 cinder-volume[129952]: DEBUG oslo_db.sqlalchemy.engines [None req-7afd50e3-f40e-4e88-aeb8-466c0edfb911 tempest-VolumeQuotasAdminTestJSON-283808117 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129952) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 22 21:29:31.572252 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-7afd50e3-f40e-4e88-aeb8-466c0edfb911 tempest-VolumeQuotasAdminTestJSON-283808117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1938c5ed-6bfd-4b54-8678-4af1cea5eebb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-01-22T21:29:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1590052935',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=be9df36c-4f16-4e2e-8f90-16d920017786,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eeb84f7778774ea58b037b1d5959d0ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-01-22T21:29:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-01-22T21:29:31Z,use_quota=True,user_id='af9b51ef521748a1970c22dc4f2c3c3c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6dacb05b-a7ea-4056-85ff-98f0ea5c54eb),volume_type_id=6dacb05b-a7ea-4056-85ff-98f0ea5c54eb)' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:29:31.579144 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-7afd50e3-f40e-4e88-aeb8-466c0edfb911 tempest-VolumeQuotasAdminTestJSON-283808117 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35787076-12cf-4434-9bfd-b5170afb61fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:29:31.583618 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-7afd50e3-f40e-4e88-aeb8-466c0edfb911 tempest-VolumeQuotasAdminTestJSON-283808117 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35787076-12cf-4434-9bfd-b5170afb61fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:29:31.589131 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-7afd50e3-f40e-4e88-aeb8-466c0edfb911 tempest-VolumeQuotasAdminTestJSON-283808117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a27b7c67-04df-4491-be45-b7254770c933) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:29:31.593780 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-7afd50e3-f40e-4e88-aeb8-466c0edfb911 tempest-VolumeQuotasAdminTestJSON-283808117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a27b7c67-04df-4491-be45-b7254770c933) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'be9df36c-4f16-4e2e-8f90-16d920017786', 'volume_name': 'volume-be9df36c-4f16-4e2e-8f90-16d920017786', 'volume_size': 1}' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:29:31.599907 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-7afd50e3-f40e-4e88-aeb8-466c0edfb911 tempest-VolumeQuotasAdminTestJSON-283808117 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0cb27171-c813-45e5-b6d8-32efbe5a4e2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:29:31.606427 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-7afd50e3-f40e-4e88-aeb8-466c0edfb911 tempest-VolumeQuotasAdminTestJSON-283808117 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0cb27171-c813-45e5-b6d8-32efbe5a4e2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:29:31.611981 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-7afd50e3-f40e-4e88-aeb8-466c0edfb911 tempest-VolumeQuotasAdminTestJSON-283808117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b952c43d-dc38-42c3-8cad-32ab6dfb3505) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:29:31.616295 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.flows.manager.create_volume [None req-7afd50e3-f40e-4e88-aeb8-466c0edfb911 tempest-VolumeQuotasAdminTestJSON-283808117 None] Volume be9df36c-4f16-4e2e-8f90-16d920017786: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-be9df36c-4f16-4e2e-8f90-16d920017786', 'volume_size': 1} Jan 22 21:29:31.616624 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-7afd50e3-f40e-4e88-aeb8-466c0edfb911 tempest-VolumeQuotasAdminTestJSON-283808117 None] creating volume 'volume-be9df36c-4f16-4e2e-8f90-16d920017786' {{(pid=129952) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Jan 22 21:29:31.617682 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-7afd50e3-f40e-4e88-aeb8-466c0edfb911 tempest-VolumeQuotasAdminTestJSON-283808117 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:29:31.812701 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.coordination [None req-4459df94-5a02-43f4-9410-aedfd0b04196 tempest-VolumesServicesTestJSON-463373702 None] Lock "b'cinder-a4eb7006-81f6-4336-9139-e4a75db1efcd-delete_volume'" acquired by "delete_volume" :: waited 0.013s {{(pid=129952) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 22 21:29:31.927131 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-4459df94-5a02-43f4-9410-aedfd0b04196 tempest-VolumesServicesTestJSON-463373702 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:29:32.314422 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-4459df94-5a02-43f4-9410-aedfd0b04196 tempest-VolumesServicesTestJSON-463373702 None] volume has no backup snaps {{(pid=129952) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Jan 22 21:29:32.315145 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-4459df94-5a02-43f4-9410-aedfd0b04196 tempest-VolumesServicesTestJSON-463373702 None] Volume volume-a4eb7006-81f6-4336-9139-e4a75db1efcd is not a clone. {{(pid=129952) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Jan 22 21:29:32.636744 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-4459df94-5a02-43f4-9410-aedfd0b04196 tempest-VolumesServicesTestJSON-463373702 None] deleting rbd volume volume-a4eb7006-81f6-4336-9139-e4a75db1efcd {{(pid=129952) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Jan 22 21:29:32.766721 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-7afd50e3-f40e-4e88-aeb8-466c0edfb911 tempest-VolumeQuotasAdminTestJSON-283808117 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129952) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 22 21:29:32.767170 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-7afd50e3-f40e-4e88-aeb8-466c0edfb911 tempest-VolumeQuotasAdminTestJSON-283808117 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129952) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 22 21:29:32.771242 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-7afd50e3-f40e-4e88-aeb8-466c0edfb911 tempest-VolumeQuotasAdminTestJSON-283808117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b952c43d-dc38-42c3-8cad-32ab6dfb3505) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-be9df36c-4f16-4e2e-8f90-16d920017786', 'volume_size': 1}' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:29:32.776294 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-7afd50e3-f40e-4e88-aeb8-466c0edfb911 tempest-VolumeQuotasAdminTestJSON-283808117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20156c93-7a1f-48fd-b572-200b4907f908) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:29:33.173177 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.flows.manager.create_volume [None req-7afd50e3-f40e-4e88-aeb8-466c0edfb911 tempest-VolumeQuotasAdminTestJSON-283808117 None] Volume volume-be9df36c-4f16-4e2e-8f90-16d920017786 (be9df36c-4f16-4e2e-8f90-16d920017786): created successfully Jan 22 21:29:33.173177 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-7afd50e3-f40e-4e88-aeb8-466c0edfb911 tempest-VolumeQuotasAdminTestJSON-283808117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20156c93-7a1f-48fd-b572-200b4907f908) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:29:33.173177 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-7afd50e3-f40e-4e88-aeb8-466c0edfb911 tempest-VolumeQuotasAdminTestJSON-283808117 None] Flow 'volume_create_manager' (bb5dc287-31af-4412-a2b2-8a1efa407876) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129952) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 22 21:29:33.173177 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-7afd50e3-f40e-4e88-aeb8-466c0edfb911 tempest-VolumeQuotasAdminTestJSON-283808117 None] Created volume successfully. Jan 22 21:29:33.717252 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.coordination [None req-d3465af9-455d-4ae1-abdd-8db642178ec7 tempest-VolumeQuotasAdminTestJSON-283808117 None] Lock "b'cinder-be9df36c-4f16-4e2e-8f90-16d920017786-delete_volume'" acquired by "delete_volume" :: waited 0.021s {{(pid=129952) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 22 21:29:33.834347 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-d3465af9-455d-4ae1-abdd-8db642178ec7 tempest-VolumeQuotasAdminTestJSON-283808117 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:29:34.036285 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-d3465af9-455d-4ae1-abdd-8db642178ec7 tempest-VolumeQuotasAdminTestJSON-283808117 None] volume has no backup snaps {{(pid=129952) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Jan 22 21:29:34.036712 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-d3465af9-455d-4ae1-abdd-8db642178ec7 tempest-VolumeQuotasAdminTestJSON-283808117 None] Volume volume-be9df36c-4f16-4e2e-8f90-16d920017786 is not a clone. {{(pid=129952) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Jan 22 21:29:34.309203 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-d3465af9-455d-4ae1-abdd-8db642178ec7 tempest-VolumeQuotasAdminTestJSON-283808117 None] deleting rbd volume volume-be9df36c-4f16-4e2e-8f90-16d920017786 {{(pid=129952) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Jan 22 21:29:39.989120 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.quota [None req-4459df94-5a02-43f4-9410-aedfd0b04196 tempest-VolumesServicesTestJSON-463373702 None] Created reservations ['f4215991-3baf-40ce-aa06-97019420623b', '66cf274d-9668-41b6-8750-8ad84a658c13', '0e5d1872-1c2f-42ca-a2d9-c921ffbf6a21', '52a2fba0-cd99-4cbe-8829-619c0d8bf4dc'] {{(pid=129952) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 22 21:29:40.235299 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-4459df94-5a02-43f4-9410-aedfd0b04196 tempest-VolumesServicesTestJSON-463373702 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:29:40.302054 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-4459df94-5a02-43f4-9410-aedfd0b04196 tempest-VolumesServicesTestJSON-463373702 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:29:40.367272 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.manager [None req-4459df94-5a02-43f4-9410-aedfd0b04196 tempest-VolumesServicesTestJSON-463373702 None] Notifying Schedulers of capabilities ... {{(pid=129952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 22 21:29:40.371598 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-4459df94-5a02-43f4-9410-aedfd0b04196 tempest-VolumesServicesTestJSON-463373702 None] Deleted volume successfully. Jan 22 21:29:40.492320 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.coordination [None req-4459df94-5a02-43f4-9410-aedfd0b04196 tempest-VolumesServicesTestJSON-463373702 None] Lock "b'cinder-a4eb7006-81f6-4336-9139-e4a75db1efcd-delete_volume'" released by "delete_volume" :: held 8.680s {{(pid=129952) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 22 21:29:40.848867 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.quota [None req-d3465af9-455d-4ae1-abdd-8db642178ec7 tempest-VolumeQuotasAdminTestJSON-283808117 None] Created reservations ['52d7db17-24d1-4a84-97cf-dd9b1fea6c7c', '23e2602f-d6ec-4585-81e7-10a5227c8c67', '7e3a5c0a-9a7f-487e-94ff-28c677ce6667', 'a1fdaa52-480f-4700-8dcd-d5781071b80a'] {{(pid=129952) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 22 21:29:41.104640 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-d3465af9-455d-4ae1-abdd-8db642178ec7 tempest-VolumeQuotasAdminTestJSON-283808117 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:29:41.194584 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-d3465af9-455d-4ae1-abdd-8db642178ec7 tempest-VolumeQuotasAdminTestJSON-283808117 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:29:41.288926 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.manager [None req-d3465af9-455d-4ae1-abdd-8db642178ec7 tempest-VolumeQuotasAdminTestJSON-283808117 None] Notifying Schedulers of capabilities ... {{(pid=129952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 22 21:29:41.300917 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-d3465af9-455d-4ae1-abdd-8db642178ec7 tempest-VolumeQuotasAdminTestJSON-283808117 None] Deleted volume successfully. Jan 22 21:29:41.394167 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.coordination [None req-d3465af9-455d-4ae1-abdd-8db642178ec7 tempest-VolumeQuotasAdminTestJSON-283808117 None] Lock "b'cinder-be9df36c-4f16-4e2e-8f90-16d920017786-delete_volume'" released by "delete_volume" :: held 7.677s {{(pid=129952) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 22 21:29:42.671783 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.flows.manager.create_volume [None req-e3d5c887-d76a-41d5-a3a8-2254c363519a tempest-VolumeQuotasAdminTestJSON-283808117 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129952) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Jan 22 21:29:42.676771 ncdv-master-1 cinder-volume[129952]: WARNING stevedore.named [None req-e3d5c887-d76a-41d5-a3a8-2254c363519a tempest-VolumeQuotasAdminTestJSON-283808117 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jan 22 21:29:42.677698 ncdv-master-1 cinder-volume[129952]: WARNING castellan.key_manager [None req-e3d5c887-d76a-41d5-a3a8-2254c363519a tempest-VolumeQuotasAdminTestJSON-283808117 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 22 21:29:42.709101 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-e3d5c887-d76a-41d5-a3a8-2254c363519a tempest-VolumeQuotasAdminTestJSON-283808117 None] Flow 'volume_create_manager' (92b2b475-854f-468e-8012-a76878833dae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 22 21:29:42.731666 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-e3d5c887-d76a-41d5-a3a8-2254c363519a tempest-VolumeQuotasAdminTestJSON-283808117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cbd513f5-7335-421f-b355-813f02abbcfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:29:42.747323 ncdv-master-1 cinder-volume[129952]: DEBUG oslo_db.sqlalchemy.engines [None req-e3d5c887-d76a-41d5-a3a8-2254c363519a tempest-VolumeQuotasAdminTestJSON-283808117 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129952) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 22 21:29:42.787425 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-e3d5c887-d76a-41d5-a3a8-2254c363519a tempest-VolumeQuotasAdminTestJSON-283808117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cbd513f5-7335-421f-b355-813f02abbcfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-01-22T21:29:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1842400269',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=3ae70939-9094-4f20-b340-882a7bea05cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eeb84f7778774ea58b037b1d5959d0ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-01-22T21:29:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-01-22T21:29:42Z,use_quota=True,user_id='af9b51ef521748a1970c22dc4f2c3c3c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6dacb05b-a7ea-4056-85ff-98f0ea5c54eb),volume_type_id=6dacb05b-a7ea-4056-85ff-98f0ea5c54eb)' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:29:42.806865 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-e3d5c887-d76a-41d5-a3a8-2254c363519a tempest-VolumeQuotasAdminTestJSON-283808117 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4090f05f-663c-410c-b6cc-1b06449edb35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:29:42.828118 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-e3d5c887-d76a-41d5-a3a8-2254c363519a tempest-VolumeQuotasAdminTestJSON-283808117 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4090f05f-663c-410c-b6cc-1b06449edb35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:29:42.839304 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-e3d5c887-d76a-41d5-a3a8-2254c363519a tempest-VolumeQuotasAdminTestJSON-283808117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (520d58e4-3be5-4dca-8972-2c882abe900d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:29:42.847558 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-e3d5c887-d76a-41d5-a3a8-2254c363519a tempest-VolumeQuotasAdminTestJSON-283808117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (520d58e4-3be5-4dca-8972-2c882abe900d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3ae70939-9094-4f20-b340-882a7bea05cf', 'volume_name': 'volume-3ae70939-9094-4f20-b340-882a7bea05cf', 'volume_size': 1}' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:29:42.860818 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-e3d5c887-d76a-41d5-a3a8-2254c363519a tempest-VolumeQuotasAdminTestJSON-283808117 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3597e48d-0599-4134-ae4b-c7a493c2089e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:29:42.880628 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-e3d5c887-d76a-41d5-a3a8-2254c363519a tempest-VolumeQuotasAdminTestJSON-283808117 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3597e48d-0599-4134-ae4b-c7a493c2089e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:29:42.887998 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-e3d5c887-d76a-41d5-a3a8-2254c363519a tempest-VolumeQuotasAdminTestJSON-283808117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ab33da9-17b3-4da0-8a3c-944edadf277c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:29:42.889963 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.flows.manager.create_volume [None req-e3d5c887-d76a-41d5-a3a8-2254c363519a tempest-VolumeQuotasAdminTestJSON-283808117 None] Volume 3ae70939-9094-4f20-b340-882a7bea05cf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3ae70939-9094-4f20-b340-882a7bea05cf', 'volume_size': 1} Jan 22 21:29:42.890590 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-e3d5c887-d76a-41d5-a3a8-2254c363519a tempest-VolumeQuotasAdminTestJSON-283808117 None] creating volume 'volume-3ae70939-9094-4f20-b340-882a7bea05cf' {{(pid=129952) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Jan 22 21:29:42.897962 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-e3d5c887-d76a-41d5-a3a8-2254c363519a tempest-VolumeQuotasAdminTestJSON-283808117 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:29:43.150674 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.flows.manager.create_volume [None req-5152af97-f43e-4e99-9916-4951a46a880c tempest-VolumesBackupsAdminTest-1905346629 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129952) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Jan 22 21:29:43.156330 ncdv-master-1 cinder-volume[129952]: WARNING stevedore.named [None req-5152af97-f43e-4e99-9916-4951a46a880c tempest-VolumesBackupsAdminTest-1905346629 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jan 22 21:29:43.158349 ncdv-master-1 cinder-volume[129952]: WARNING castellan.key_manager [None req-5152af97-f43e-4e99-9916-4951a46a880c tempest-VolumesBackupsAdminTest-1905346629 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 22 21:29:43.233334 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-5152af97-f43e-4e99-9916-4951a46a880c tempest-VolumesBackupsAdminTest-1905346629 None] Flow 'volume_create_manager' (ca0920cf-f47d-4269-af72-d4ed4a140c88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 22 21:29:43.255302 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-5152af97-f43e-4e99-9916-4951a46a880c tempest-VolumesBackupsAdminTest-1905346629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64f6c678-ad80-4e6f-9497-1251ec3cd43a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:29:43.272112 ncdv-master-1 cinder-volume[129952]: DEBUG oslo_db.sqlalchemy.engines [None req-5152af97-f43e-4e99-9916-4951a46a880c tempest-VolumesBackupsAdminTest-1905346629 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129952) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 22 21:29:43.300980 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-5152af97-f43e-4e99-9916-4951a46a880c tempest-VolumesBackupsAdminTest-1905346629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64f6c678-ad80-4e6f-9497-1251ec3cd43a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-01-22T21:29:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsAdminTest-Volume-1860243210',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=c78173a9-3798-4b6d-91d8-061c98e61c28,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7de28c2068e48759566308168f7c145',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-01-22T21:29:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-01-22T21:29:43Z,use_quota=True,user_id='2703c550f92341b5ab72aefc5402f786',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6dacb05b-a7ea-4056-85ff-98f0ea5c54eb),volume_type_id=6dacb05b-a7ea-4056-85ff-98f0ea5c54eb)' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:29:43.307747 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-5152af97-f43e-4e99-9916-4951a46a880c tempest-VolumesBackupsAdminTest-1905346629 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44100f44-cb66-46b5-9427-c0366f3240cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:29:43.315615 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-5152af97-f43e-4e99-9916-4951a46a880c tempest-VolumesBackupsAdminTest-1905346629 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44100f44-cb66-46b5-9427-c0366f3240cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:29:43.323015 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-5152af97-f43e-4e99-9916-4951a46a880c tempest-VolumesBackupsAdminTest-1905346629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a21cf1e-dcb5-437b-a36b-1c09984fa01a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:29:43.329275 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-5152af97-f43e-4e99-9916-4951a46a880c tempest-VolumesBackupsAdminTest-1905346629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a21cf1e-dcb5-437b-a36b-1c09984fa01a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c78173a9-3798-4b6d-91d8-061c98e61c28', 'volume_name': 'volume-c78173a9-3798-4b6d-91d8-061c98e61c28', 'volume_size': 1}' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:29:43.347011 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-5152af97-f43e-4e99-9916-4951a46a880c tempest-VolumesBackupsAdminTest-1905346629 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2beb399-5a61-49c9-8bf7-0593e35676ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:29:43.352224 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-5152af97-f43e-4e99-9916-4951a46a880c tempest-VolumesBackupsAdminTest-1905346629 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2beb399-5a61-49c9-8bf7-0593e35676ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:29:43.360215 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-5152af97-f43e-4e99-9916-4951a46a880c tempest-VolumesBackupsAdminTest-1905346629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c92a0d7d-45ee-4ca4-a1af-a68176a7a983) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:29:43.361694 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.flows.manager.create_volume [None req-5152af97-f43e-4e99-9916-4951a46a880c tempest-VolumesBackupsAdminTest-1905346629 None] Volume c78173a9-3798-4b6d-91d8-061c98e61c28: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c78173a9-3798-4b6d-91d8-061c98e61c28', 'volume_size': 1} Jan 22 21:29:43.362114 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-5152af97-f43e-4e99-9916-4951a46a880c tempest-VolumesBackupsAdminTest-1905346629 None] creating volume 'volume-c78173a9-3798-4b6d-91d8-061c98e61c28' {{(pid=129952) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Jan 22 21:29:43.363280 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-5152af97-f43e-4e99-9916-4951a46a880c tempest-VolumesBackupsAdminTest-1905346629 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:29:43.587898 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-e3d5c887-d76a-41d5-a3a8-2254c363519a tempest-VolumeQuotasAdminTestJSON-283808117 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129952) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 22 21:29:43.588700 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-e3d5c887-d76a-41d5-a3a8-2254c363519a tempest-VolumeQuotasAdminTestJSON-283808117 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129952) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 22 21:29:43.592916 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-e3d5c887-d76a-41d5-a3a8-2254c363519a tempest-VolumeQuotasAdminTestJSON-283808117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ab33da9-17b3-4da0-8a3c-944edadf277c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3ae70939-9094-4f20-b340-882a7bea05cf', 'volume_size': 1}' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:29:43.601716 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-e3d5c887-d76a-41d5-a3a8-2254c363519a tempest-VolumeQuotasAdminTestJSON-283808117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cca74d7b-2b10-4c67-aead-b190dc684020) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:29:43.722098 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.flows.manager.create_volume [None req-e3d5c887-d76a-41d5-a3a8-2254c363519a tempest-VolumeQuotasAdminTestJSON-283808117 None] Volume volume-3ae70939-9094-4f20-b340-882a7bea05cf (3ae70939-9094-4f20-b340-882a7bea05cf): created successfully Jan 22 21:29:43.727810 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-e3d5c887-d76a-41d5-a3a8-2254c363519a tempest-VolumeQuotasAdminTestJSON-283808117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cca74d7b-2b10-4c67-aead-b190dc684020) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:29:43.735245 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-e3d5c887-d76a-41d5-a3a8-2254c363519a tempest-VolumeQuotasAdminTestJSON-283808117 None] Flow 'volume_create_manager' (92b2b475-854f-468e-8012-a76878833dae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129952) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 22 21:29:43.818773 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-e3d5c887-d76a-41d5-a3a8-2254c363519a tempest-VolumeQuotasAdminTestJSON-283808117 None] Created volume successfully. Jan 22 21:29:44.117953 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-5152af97-f43e-4e99-9916-4951a46a880c tempest-VolumesBackupsAdminTest-1905346629 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129952) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 22 21:29:44.118583 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-5152af97-f43e-4e99-9916-4951a46a880c tempest-VolumesBackupsAdminTest-1905346629 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129952) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 22 21:29:44.126163 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-5152af97-f43e-4e99-9916-4951a46a880c tempest-VolumesBackupsAdminTest-1905346629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c92a0d7d-45ee-4ca4-a1af-a68176a7a983) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c78173a9-3798-4b6d-91d8-061c98e61c28', 'volume_size': 1}' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:29:44.134486 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-5152af97-f43e-4e99-9916-4951a46a880c tempest-VolumesBackupsAdminTest-1905346629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4c11fa6-d545-42db-acaf-475d4e2c039f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:29:44.268313 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.flows.manager.create_volume [None req-5152af97-f43e-4e99-9916-4951a46a880c tempest-VolumesBackupsAdminTest-1905346629 None] Volume volume-c78173a9-3798-4b6d-91d8-061c98e61c28 (c78173a9-3798-4b6d-91d8-061c98e61c28): created successfully Jan 22 21:29:44.280928 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-5152af97-f43e-4e99-9916-4951a46a880c tempest-VolumesBackupsAdminTest-1905346629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4c11fa6-d545-42db-acaf-475d4e2c039f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:29:44.288949 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-5152af97-f43e-4e99-9916-4951a46a880c tempest-VolumesBackupsAdminTest-1905346629 None] Flow 'volume_create_manager' (ca0920cf-f47d-4269-af72-d4ed4a140c88) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129952) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 22 21:29:44.406430 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-5152af97-f43e-4e99-9916-4951a46a880c tempest-VolumesBackupsAdminTest-1905346629 None] Created volume successfully. Jan 22 21:29:46.062646 ncdv-master-1 cinder-volume[129952]: DEBUG oslo_concurrency.processutils [None req-aabf0d23-9080-4be8-957c-ccdc51108fcc tempest-VolumesBackupsAdminTest-1905346629 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129952) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jan 22 21:29:46.296226 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-937c7c4b-3142-4e79-8033-b0de708c2f2d tempest-VolumeQuotasAdminTestJSON-262537409 None] Transfer volume completed successfully. Jan 22 21:29:47.030982 ncdv-master-1 cinder-volume[129952]: DEBUG oslo_concurrency.processutils [None req-aabf0d23-9080-4be8-957c-ccdc51108fcc tempest-VolumesBackupsAdminTest-1905346629 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.968s {{(pid=129952) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jan 22 21:29:47.031930 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-aabf0d23-9080-4be8-957c-ccdc51108fcc tempest-VolumesBackupsAdminTest-1905346629 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-c78173a9-3798-4b6d-91d8-061c98e61c28', 'hosts': ['10.222.0.100'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'c7ee930a-3b87-450e-91f6-d4eef70cb484', 'volume_id': 'c78173a9-3798-4b6d-91d8-061c98e61c28', 'discard': True}} {{(pid=129952) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Jan 22 21:29:47.054567 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-aabf0d23-9080-4be8-957c-ccdc51108fcc tempest-VolumesBackupsAdminTest-1905346629 None] Initialize volume connection completed successfully. Jan 22 21:29:47.768400 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.coordination [None req-2ca09213-456c-4eb5-a42a-db6a6f4bc13e tempest-VolumeQuotasAdminTestJSON-1252680407 None] Lock "b'cinder-3ae70939-9094-4f20-b340-882a7bea05cf-delete_volume'" acquired by "delete_volume" :: waited 0.071s {{(pid=129952) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 22 21:29:47.915095 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-2ca09213-456c-4eb5-a42a-db6a6f4bc13e tempest-VolumeQuotasAdminTestJSON-1252680407 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:29:48.213125 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-2ca09213-456c-4eb5-a42a-db6a6f4bc13e tempest-VolumeQuotasAdminTestJSON-1252680407 None] volume has no backup snaps {{(pid=129952) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Jan 22 21:29:48.214255 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-2ca09213-456c-4eb5-a42a-db6a6f4bc13e tempest-VolumeQuotasAdminTestJSON-1252680407 None] Volume volume-3ae70939-9094-4f20-b340-882a7bea05cf is not a clone. {{(pid=129952) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Jan 22 21:29:48.551230 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-2ca09213-456c-4eb5-a42a-db6a6f4bc13e tempest-VolumeQuotasAdminTestJSON-1252680407 None] deleting rbd volume volume-3ae70939-9094-4f20-b340-882a7bea05cf {{(pid=129952) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Jan 22 21:29:52.569310 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.flows.manager.create_volume [None req-627f12af-e23a-402e-8c57-e3566ca0a31e tempest-VolumeTypesTest-1361741682 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129952) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Jan 22 21:29:52.590514 ncdv-master-1 cinder-volume[129952]: WARNING stevedore.named [None req-627f12af-e23a-402e-8c57-e3566ca0a31e tempest-VolumeTypesTest-1361741682 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jan 22 21:29:52.591192 ncdv-master-1 cinder-volume[129952]: WARNING castellan.key_manager [None req-627f12af-e23a-402e-8c57-e3566ca0a31e tempest-VolumeTypesTest-1361741682 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 22 21:29:52.618585 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-627f12af-e23a-402e-8c57-e3566ca0a31e tempest-VolumeTypesTest-1361741682 None] Flow 'volume_create_manager' (7ee67bdd-5230-4869-b688-544e8cd3270a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 22 21:29:52.628351 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-627f12af-e23a-402e-8c57-e3566ca0a31e tempest-VolumeTypesTest-1361741682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5376be17-b019-41dc-9699-a555eb506430) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:29:52.635883 ncdv-master-1 cinder-volume[129952]: DEBUG oslo_db.sqlalchemy.engines [None req-627f12af-e23a-402e-8c57-e3566ca0a31e tempest-VolumeTypesTest-1361741682 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129952) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 22 21:29:52.655985 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-627f12af-e23a-402e-8c57-e3566ca0a31e tempest-VolumeTypesTest-1361741682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5376be17-b019-41dc-9699-a555eb506430) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-01-22T21:29:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesTest-volume-318016615',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=dcaace3d-17e6-4209-ae44-5a6537132a78,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ffec036b26a04d1fb5a4e20e7cbe9445',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-01-22T21:29:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-01-22T21:29:52Z,use_quota=True,user_id='211ce35f96644bfe825ec49b934dbe38',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e9d9b844-12dc-4b55-9783-05b28c2e6b73),volume_type_id=e9d9b844-12dc-4b55-9783-05b28c2e6b73)' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:29:52.664538 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-627f12af-e23a-402e-8c57-e3566ca0a31e tempest-VolumeTypesTest-1361741682 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (941b2837-6010-4a07-8c62-a30d33d1e855) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:29:52.671812 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-627f12af-e23a-402e-8c57-e3566ca0a31e tempest-VolumeTypesTest-1361741682 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (941b2837-6010-4a07-8c62-a30d33d1e855) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:29:52.696066 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-627f12af-e23a-402e-8c57-e3566ca0a31e tempest-VolumeTypesTest-1361741682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8a9c675-08be-4d21-afaf-c45b806d5c34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:29:52.703733 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-627f12af-e23a-402e-8c57-e3566ca0a31e tempest-VolumeTypesTest-1361741682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8a9c675-08be-4d21-afaf-c45b806d5c34) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dcaace3d-17e6-4209-ae44-5a6537132a78', 'volume_name': 'volume-dcaace3d-17e6-4209-ae44-5a6537132a78', 'volume_size': 1}' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:29:52.713319 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-627f12af-e23a-402e-8c57-e3566ca0a31e tempest-VolumeTypesTest-1361741682 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e87f59a-ea9d-4cc8-9cda-371aaaea55de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:29:52.718907 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-627f12af-e23a-402e-8c57-e3566ca0a31e tempest-VolumeTypesTest-1361741682 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e87f59a-ea9d-4cc8-9cda-371aaaea55de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:29:52.742157 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-627f12af-e23a-402e-8c57-e3566ca0a31e tempest-VolumeTypesTest-1361741682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d446b1a7-f643-4609-b605-2942cb874e35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:29:52.743571 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.flows.manager.create_volume [None req-627f12af-e23a-402e-8c57-e3566ca0a31e tempest-VolumeTypesTest-1361741682 None] Volume dcaace3d-17e6-4209-ae44-5a6537132a78: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dcaace3d-17e6-4209-ae44-5a6537132a78', 'volume_size': 1} Jan 22 21:29:52.743991 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-627f12af-e23a-402e-8c57-e3566ca0a31e tempest-VolumeTypesTest-1361741682 None] creating volume 'volume-dcaace3d-17e6-4209-ae44-5a6537132a78' {{(pid=129952) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Jan 22 21:29:52.745651 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-627f12af-e23a-402e-8c57-e3566ca0a31e tempest-VolumeTypesTest-1361741682 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:29:53.993390 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-627f12af-e23a-402e-8c57-e3566ca0a31e tempest-VolumeTypesTest-1361741682 None] extra_specs: {'storage_protocol': 'ceph', 'vendor_name': 'Open Source'} {{(pid=129952) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 22 21:29:53.995204 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-627f12af-e23a-402e-8c57-e3566ca0a31e tempest-VolumeTypesTest-1361741682 None] extra_specs: {'storage_protocol': 'ceph', 'vendor_name': 'Open Source'} {{(pid=129952) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 22 21:29:54.000744 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-627f12af-e23a-402e-8c57-e3566ca0a31e tempest-VolumeTypesTest-1361741682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d446b1a7-f643-4609-b605-2942cb874e35) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dcaace3d-17e6-4209-ae44-5a6537132a78', 'volume_size': 1}' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:29:54.006143 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-627f12af-e23a-402e-8c57-e3566ca0a31e tempest-VolumeTypesTest-1361741682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46a8e2d9-6623-4de7-a4d5-1557d045ecb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:29:54.147995 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.flows.manager.create_volume [None req-627f12af-e23a-402e-8c57-e3566ca0a31e tempest-VolumeTypesTest-1361741682 None] Volume volume-dcaace3d-17e6-4209-ae44-5a6537132a78 (dcaace3d-17e6-4209-ae44-5a6537132a78): created successfully Jan 22 21:29:54.157006 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-627f12af-e23a-402e-8c57-e3566ca0a31e tempest-VolumeTypesTest-1361741682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46a8e2d9-6623-4de7-a4d5-1557d045ecb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:29:54.167873 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-627f12af-e23a-402e-8c57-e3566ca0a31e tempest-VolumeTypesTest-1361741682 None] Flow 'volume_create_manager' (7ee67bdd-5230-4869-b688-544e8cd3270a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129952) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 22 21:29:54.305798 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-627f12af-e23a-402e-8c57-e3566ca0a31e tempest-VolumeTypesTest-1361741682 None] Created volume successfully. Jan 22 21:29:54.913456 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.quota [None req-2ca09213-456c-4eb5-a42a-db6a6f4bc13e tempest-VolumeQuotasAdminTestJSON-1252680407 None] Created reservations ['f5584d10-1f8a-474a-b4b6-05b0518f6c3c', '4cbf3198-583a-4d26-8e85-4a516569b311', '3e963c11-74b6-4c12-baa8-1cc2ffaa2a07', '0d6318f9-5748-4ab0-b3ea-1a304755e1c0'] {{(pid=129952) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 22 21:29:55.112959 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-2ca09213-456c-4eb5-a42a-db6a6f4bc13e tempest-VolumeQuotasAdminTestJSON-1252680407 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:29:55.309733 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-2ca09213-456c-4eb5-a42a-db6a6f4bc13e tempest-VolumeQuotasAdminTestJSON-1252680407 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:29:55.365372 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.manager [None req-2ca09213-456c-4eb5-a42a-db6a6f4bc13e tempest-VolumeQuotasAdminTestJSON-1252680407 None] Notifying Schedulers of capabilities ... {{(pid=129952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 22 21:29:55.370727 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-2ca09213-456c-4eb5-a42a-db6a6f4bc13e tempest-VolumeQuotasAdminTestJSON-1252680407 None] Deleted volume successfully. Jan 22 21:29:55.459887 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.coordination [None req-2ca09213-456c-4eb5-a42a-db6a6f4bc13e tempest-VolumeQuotasAdminTestJSON-1252680407 None] Lock "b'cinder-3ae70939-9094-4f20-b340-882a7bea05cf-delete_volume'" released by "delete_volume" :: held 7.691s {{(pid=129952) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 22 21:29:55.652615 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-89514c12-0f4d-43c5-844d-5a7d93955b33 tempest-VolumeTypesTest-1361741682 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:29:55.705558 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-89514c12-0f4d-43c5-844d-5a7d93955b33 tempest-VolumeTypesTest-1361741682 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:29:55.751463 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.manager [None req-89514c12-0f4d-43c5-844d-5a7d93955b33 tempest-VolumeTypesTest-1361741682 None] Notifying Schedulers of capabilities ... {{(pid=129952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 22 21:29:55.756745 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-89514c12-0f4d-43c5-844d-5a7d93955b33 tempest-VolumeTypesTest-1361741682 None] Retype volume completed successfully. Jan 22 21:29:55.938900 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-aabf0d23-9080-4be8-957c-ccdc51108fcc tempest-VolumesBackupsAdminTest-1905346629 None] Terminate volume connection completed successfully. Jan 22 21:29:55.960203 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-aabf0d23-9080-4be8-957c-ccdc51108fcc tempest-VolumesBackupsAdminTest-1905346629 None] Remove volume export completed successfully. Jan 22 21:29:58.686412 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.coordination [None req-b9d62089-8f79-48e5-bcf7-a049492c5e5c tempest-VolumeTypesTest-1361741682 None] Lock "b'cinder-dcaace3d-17e6-4209-ae44-5a6537132a78-delete_volume'" acquired by "delete_volume" :: waited 0.041s {{(pid=129952) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 22 21:29:58.794107 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-b9d62089-8f79-48e5-bcf7-a049492c5e5c tempest-VolumeTypesTest-1361741682 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:29:59.081321 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-b9d62089-8f79-48e5-bcf7-a049492c5e5c tempest-VolumeTypesTest-1361741682 None] volume has no backup snaps {{(pid=129952) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Jan 22 21:29:59.082188 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-b9d62089-8f79-48e5-bcf7-a049492c5e5c tempest-VolumeTypesTest-1361741682 None] Volume volume-dcaace3d-17e6-4209-ae44-5a6537132a78 is not a clone. {{(pid=129952) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Jan 22 21:29:59.210306 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-b9d62089-8f79-48e5-bcf7-a049492c5e5c tempest-VolumeTypesTest-1361741682 None] deleting rbd volume volume-dcaace3d-17e6-4209-ae44-5a6537132a78 {{(pid=129952) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Jan 22 21:30:00.691519 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.flows.manager.create_volume [None req-d4eb3dad-e04e-44f6-9e83-0a164867dbae tempest-VolumesBackupsAdminTest-1905346629 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129952) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Jan 22 21:30:00.700746 ncdv-master-1 cinder-volume[129952]: WARNING stevedore.named [None req-d4eb3dad-e04e-44f6-9e83-0a164867dbae tempest-VolumesBackupsAdminTest-1905346629 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jan 22 21:30:00.704124 ncdv-master-1 cinder-volume[129952]: WARNING castellan.key_manager [None req-d4eb3dad-e04e-44f6-9e83-0a164867dbae tempest-VolumesBackupsAdminTest-1905346629 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 22 21:30:00.741794 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-d4eb3dad-e04e-44f6-9e83-0a164867dbae tempest-VolumesBackupsAdminTest-1905346629 None] Flow 'volume_create_manager' (56dde662-2870-44df-a570-0e85c8c76db7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 22 21:30:00.752259 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-d4eb3dad-e04e-44f6-9e83-0a164867dbae tempest-VolumesBackupsAdminTest-1905346629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99a6bb27-c84b-4346-b6a6-9eae5e958813) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:30:00.761967 ncdv-master-1 cinder-volume[129952]: DEBUG oslo_db.sqlalchemy.engines [None req-d4eb3dad-e04e-44f6-9e83-0a164867dbae tempest-VolumesBackupsAdminTest-1905346629 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129952) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 22 21:30:00.833736 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-d4eb3dad-e04e-44f6-9e83-0a164867dbae tempest-VolumesBackupsAdminTest-1905346629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99a6bb27-c84b-4346-b6a6-9eae5e958813) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-01-22T21:30:00Z,deleted=False,deleted_at=None,display_description='auto-created_from_restore_from_backup',display_name='restore_backup_3917be5c-da21-4a67-8617-ddf7be83d8a5',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=500e9832-3e26-4318-aa5b-87fa84482aa7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7de28c2068e48759566308168f7c145',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-01-22T21:30:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-01-22T21:30:00Z,use_quota=True,user_id='2703c550f92341b5ab72aefc5402f786',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6dacb05b-a7ea-4056-85ff-98f0ea5c54eb),volume_type_id=6dacb05b-a7ea-4056-85ff-98f0ea5c54eb)' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:30:00.855586 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-d4eb3dad-e04e-44f6-9e83-0a164867dbae tempest-VolumesBackupsAdminTest-1905346629 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2a15d5a-9458-4bcf-b3c4-1a171ac6636d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:30:00.866756 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-d4eb3dad-e04e-44f6-9e83-0a164867dbae tempest-VolumesBackupsAdminTest-1905346629 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2a15d5a-9458-4bcf-b3c4-1a171ac6636d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:30:00.876032 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-d4eb3dad-e04e-44f6-9e83-0a164867dbae tempest-VolumesBackupsAdminTest-1905346629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3058268a-a812-454a-93db-51a8c78c4ec6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:30:00.880422 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-d4eb3dad-e04e-44f6-9e83-0a164867dbae tempest-VolumesBackupsAdminTest-1905346629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3058268a-a812-454a-93db-51a8c78c4ec6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '500e9832-3e26-4318-aa5b-87fa84482aa7', 'volume_name': 'volume-500e9832-3e26-4318-aa5b-87fa84482aa7', 'volume_size': 1}' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:30:00.886045 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-d4eb3dad-e04e-44f6-9e83-0a164867dbae tempest-VolumesBackupsAdminTest-1905346629 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a1456cf-fe5f-42b8-831a-9c5bf6c09fb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:30:00.902351 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-d4eb3dad-e04e-44f6-9e83-0a164867dbae tempest-VolumesBackupsAdminTest-1905346629 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a1456cf-fe5f-42b8-831a-9c5bf6c09fb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:30:00.910461 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-d4eb3dad-e04e-44f6-9e83-0a164867dbae tempest-VolumesBackupsAdminTest-1905346629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (247db9f1-50f0-4e58-95da-69cd8a82cb5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:30:00.911827 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.flows.manager.create_volume [None req-d4eb3dad-e04e-44f6-9e83-0a164867dbae tempest-VolumesBackupsAdminTest-1905346629 None] Volume 500e9832-3e26-4318-aa5b-87fa84482aa7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-500e9832-3e26-4318-aa5b-87fa84482aa7', 'volume_size': 1} Jan 22 21:30:00.912383 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-d4eb3dad-e04e-44f6-9e83-0a164867dbae tempest-VolumesBackupsAdminTest-1905346629 None] creating volume 'volume-500e9832-3e26-4318-aa5b-87fa84482aa7' {{(pid=129952) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Jan 22 21:30:00.913601 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-d4eb3dad-e04e-44f6-9e83-0a164867dbae tempest-VolumesBackupsAdminTest-1905346629 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:30:02.109233 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-d4eb3dad-e04e-44f6-9e83-0a164867dbae tempest-VolumesBackupsAdminTest-1905346629 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129952) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 22 21:30:02.109865 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-d4eb3dad-e04e-44f6-9e83-0a164867dbae tempest-VolumesBackupsAdminTest-1905346629 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129952) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 22 21:30:02.116338 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-d4eb3dad-e04e-44f6-9e83-0a164867dbae tempest-VolumesBackupsAdminTest-1905346629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (247db9f1-50f0-4e58-95da-69cd8a82cb5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-500e9832-3e26-4318-aa5b-87fa84482aa7', 'volume_size': 1}' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:30:02.122479 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-d4eb3dad-e04e-44f6-9e83-0a164867dbae tempest-VolumesBackupsAdminTest-1905346629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (518bbf4a-5519-4772-8bab-cad0be2c9fa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:30:02.270184 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.flows.manager.create_volume [None req-d4eb3dad-e04e-44f6-9e83-0a164867dbae tempest-VolumesBackupsAdminTest-1905346629 None] Volume volume-500e9832-3e26-4318-aa5b-87fa84482aa7 (500e9832-3e26-4318-aa5b-87fa84482aa7): created successfully Jan 22 21:30:02.274222 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-d4eb3dad-e04e-44f6-9e83-0a164867dbae tempest-VolumesBackupsAdminTest-1905346629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (518bbf4a-5519-4772-8bab-cad0be2c9fa3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:30:02.280976 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-d4eb3dad-e04e-44f6-9e83-0a164867dbae tempest-VolumesBackupsAdminTest-1905346629 None] Flow 'volume_create_manager' (56dde662-2870-44df-a570-0e85c8c76db7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129952) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 22 21:30:02.461087 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-d4eb3dad-e04e-44f6-9e83-0a164867dbae tempest-VolumesBackupsAdminTest-1905346629 None] Created volume successfully. Jan 22 21:30:02.794010 ncdv-master-1 cinder-volume[129952]: DEBUG oslo_concurrency.processutils [None req-d4eb3dad-e04e-44f6-9e83-0a164867dbae tempest-VolumesBackupsAdminTest-1905346629 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129952) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jan 22 21:30:03.505608 ncdv-master-1 cinder-volume[129952]: DEBUG oslo_concurrency.processutils [None req-d4eb3dad-e04e-44f6-9e83-0a164867dbae tempest-VolumesBackupsAdminTest-1905346629 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.710s {{(pid=129952) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jan 22 21:30:03.505608 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-d4eb3dad-e04e-44f6-9e83-0a164867dbae tempest-VolumesBackupsAdminTest-1905346629 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-500e9832-3e26-4318-aa5b-87fa84482aa7', 'hosts': ['10.222.0.100'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'c7ee930a-3b87-450e-91f6-d4eef70cb484', 'volume_id': '500e9832-3e26-4318-aa5b-87fa84482aa7', 'discard': True}} {{(pid=129952) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Jan 22 21:30:03.534817 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-d4eb3dad-e04e-44f6-9e83-0a164867dbae tempest-VolumesBackupsAdminTest-1905346629 None] Initialize volume connection completed successfully. Jan 22 21:30:04.295670 ncdv-master-1 cinder-volume[129952]: WARNING cinder.quota [None req-b9d62089-8f79-48e5-bcf7-a049492c5e5c tempest-VolumeTypesTest-1361741682 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesTest-volume-type-1307258955 is set by the default quota flag: quota_volumes_tempest-VolumeTypesTest-volume-type-1307258955, it is now deprecated. Please use the default quota class for default quota. Jan 22 21:30:04.296856 ncdv-master-1 cinder-volume[129952]: WARNING cinder.quota [None req-b9d62089-8f79-48e5-bcf7-a049492c5e5c tempest-VolumeTypesTest-1361741682 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesTest-volume-type-1307258955 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesTest-volume-type-1307258955, it is now deprecated. Please use the default quota class for default quota. Jan 22 21:30:04.418950 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.quota [None req-b9d62089-8f79-48e5-bcf7-a049492c5e5c tempest-VolumeTypesTest-1361741682 None] Created reservations ['fe5cd69c-4b4b-4dcc-bf60-e6a786c92665', '22268ba7-0aca-445f-ba14-35be80873ffa', '146c4cc0-6af6-4542-8123-9d897c03ca29', '1caba113-9791-48d0-b009-742777a8baeb'] {{(pid=129952) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 22 21:30:04.628242 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-b9d62089-8f79-48e5-bcf7-a049492c5e5c tempest-VolumeTypesTest-1361741682 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:30:04.661853 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-b9d62089-8f79-48e5-bcf7-a049492c5e5c tempest-VolumeTypesTest-1361741682 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:30:04.721778 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.manager [None req-b9d62089-8f79-48e5-bcf7-a049492c5e5c tempest-VolumeTypesTest-1361741682 None] Notifying Schedulers of capabilities ... {{(pid=129952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 22 21:30:04.754714 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-b9d62089-8f79-48e5-bcf7-a049492c5e5c tempest-VolumeTypesTest-1361741682 None] Deleted volume successfully. Jan 22 21:30:04.826137 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.coordination [None req-b9d62089-8f79-48e5-bcf7-a049492c5e5c tempest-VolumeTypesTest-1361741682 None] Lock "b'cinder-dcaace3d-17e6-4209-ae44-5a6537132a78-delete_volume'" released by "delete_volume" :: held 6.141s {{(pid=129952) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 22 21:30:06.646113 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.flows.manager.create_volume [None req-8f599118-60f8-4b78-b082-0f141dbc8402 tempest-VolumesImageMetadata-817547703 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129952) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Jan 22 21:30:06.649730 ncdv-master-1 cinder-volume[129952]: WARNING stevedore.named [None req-8f599118-60f8-4b78-b082-0f141dbc8402 tempest-VolumesImageMetadata-817547703 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jan 22 21:30:06.650227 ncdv-master-1 cinder-volume[129952]: WARNING castellan.key_manager [None req-8f599118-60f8-4b78-b082-0f141dbc8402 tempest-VolumesImageMetadata-817547703 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 22 21:30:06.672062 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-8f599118-60f8-4b78-b082-0f141dbc8402 tempest-VolumesImageMetadata-817547703 None] Flow 'volume_create_manager' (cd121f07-d859-4ab3-836a-0dd73a572ee9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 22 21:30:06.679153 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-8f599118-60f8-4b78-b082-0f141dbc8402 tempest-VolumesImageMetadata-817547703 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e89237a9-7f4e-4103-ba40-0683ef3bc766) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:30:06.686434 ncdv-master-1 cinder-volume[129952]: DEBUG oslo_db.sqlalchemy.engines [None req-8f599118-60f8-4b78-b082-0f141dbc8402 tempest-VolumesImageMetadata-817547703 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129952) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 22 21:30:06.702602 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-8f599118-60f8-4b78-b082-0f141dbc8402 tempest-VolumesImageMetadata-817547703 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e89237a9-7f4e-4103-ba40-0683ef3bc766) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-01-22T21:30:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1486969627',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=558c4cbd-419e-4ac2-b0e0-d8b916ea40e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a37846d25834c5f996ffcbc85fd5faa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-01-22T21:30:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-01-22T21:30:06Z,use_quota=True,user_id='f2f5b95f6a89408fbbb7e197ec93275c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6dacb05b-a7ea-4056-85ff-98f0ea5c54eb),volume_type_id=6dacb05b-a7ea-4056-85ff-98f0ea5c54eb)' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:30:06.708198 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-8f599118-60f8-4b78-b082-0f141dbc8402 tempest-VolumesImageMetadata-817547703 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d86b76d5-4d85-41dc-b248-1d91d8e806bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:30:06.712617 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-8f599118-60f8-4b78-b082-0f141dbc8402 tempest-VolumesImageMetadata-817547703 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d86b76d5-4d85-41dc-b248-1d91d8e806bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:30:06.719063 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-8f599118-60f8-4b78-b082-0f141dbc8402 tempest-VolumesImageMetadata-817547703 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (acfc75af-bf99-4b80-bb50-a43e8ce1d063) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:30:06.922617 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-8f599118-60f8-4b78-b082-0f141dbc8402 tempest-VolumesImageMetadata-817547703 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (acfc75af-bf99-4b80-bb50-a43e8ce1d063) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '558c4cbd-419e-4ac2-b0e0-d8b916ea40e1', 'volume_name': 'volume-558c4cbd-419e-4ac2-b0e0-d8b916ea40e1', 'volume_size': 1, 'image_id': '373cb480-3bc4-4821-93e2-442b4e852b80', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '994e8f6963f04af3be3dbae11a73cdfd', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '373cb480-3bc4-4821-93e2-442b4e852b80', 'created_at': datetime.datetime(2022, 1, 22, 20, 50, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 1, 22, 20, 50, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/373cb480-3bc4-4821-93e2-442b4e852b80/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:30:06.924381 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-8f599118-60f8-4b78-b082-0f141dbc8402 tempest-VolumesImageMetadata-817547703 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19ae978e-9fb7-423f-be9c-ffde51f79327) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:30:06.924381 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-8f599118-60f8-4b78-b082-0f141dbc8402 tempest-VolumesImageMetadata-817547703 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19ae978e-9fb7-423f-be9c-ffde51f79327) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:30:06.924381 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-8f599118-60f8-4b78-b082-0f141dbc8402 tempest-VolumesImageMetadata-817547703 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5c0e2b2-4930-4ecd-a6c7-513f5b0c9a96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:30:06.925099 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.flows.manager.create_volume [None req-8f599118-60f8-4b78-b082-0f141dbc8402 tempest-VolumesImageMetadata-817547703 None] Volume 558c4cbd-419e-4ac2-b0e0-d8b916ea40e1: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-558c4cbd-419e-4ac2-b0e0-d8b916ea40e1', 'volume_size': 1, 'image_id': '373cb480-3bc4-4821-93e2-442b4e852b80', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '994e8f6963f04af3be3dbae11a73cdfd', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '373cb480-3bc4-4821-93e2-442b4e852b80', 'created_at': datetime.datetime(2022, 1, 22, 20, 50, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 1, 22, 20, 50, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/373cb480-3bc4-4821-93e2-442b4e852b80/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jan 22 21:30:06.925099 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.flows.manager.create_volume [None req-8f599118-60f8-4b78-b082-0f141dbc8402 tempest-VolumesImageMetadata-817547703 None] Cloning 558c4cbd-419e-4ac2-b0e0-d8b916ea40e1 from image 373cb480-3bc4-4821-93e2-442b4e852b80 at location (None, None). {{(pid=129952) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1046}} Jan 22 21:30:06.925367 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.coordination [None req-8f599118-60f8-4b78-b082-0f141dbc8402 tempest-VolumesImageMetadata-817547703 None] Lock "b'cinder-373cb480-3bc4-4821-93e2-442b4e852b80'" acquired by "_prepare_image_cache_entry" :: waited 0.007s {{(pid=129952) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 22 21:30:07.120412 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.image.cache [None req-8f599118-60f8-4b78-b082-0f141dbc8402 tempest-VolumesImageMetadata-817547703 None] Found image-volume cache entry: {'id': 1, 'image_id': '373cb480-3bc4-4821-93e2-442b4e852b80', 'volume_id': 'f39c1078-cff4-40dd-93df-4ce49cd873b4', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 1, 22, 20, 50, 57), 'last_used': datetime.datetime(2022, 1, 22, 21, 30, 6, 830783)}. {{(pid=129952) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Jan 22 21:30:07.120412 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.image.cache [None req-8f599118-60f8-4b78-b082-0f141dbc8402 tempest-VolumesImageMetadata-817547703 None] Image-volume cache entry image_update_at = 2022-01-22 20:50:57+00:00, requested image updated_at = 2022-01-22 20:50:57+00:00. {{(pid=129952) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Jan 22 21:30:07.120412 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.flows.manager.create_volume [None req-8f599118-60f8-4b78-b082-0f141dbc8402 tempest-VolumesImageMetadata-817547703 None] Found cache entry for image = 373cb480-3bc4-4821-93e2-442b4e852b80 on host ncdv-master-1@ceph#ceph. {{(pid=129952) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:869}} Jan 22 21:30:07.122489 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.coordination [None req-8f599118-60f8-4b78-b082-0f141dbc8402 tempest-VolumesImageMetadata-817547703 None] Lock "b'cinder-373cb480-3bc4-4821-93e2-442b4e852b80'" released by "_prepare_image_cache_entry" :: held 0.296s {{(pid=129952) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 22 21:30:07.124309 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.flows.manager.create_volume [None req-8f599118-60f8-4b78-b082-0f141dbc8402 tempest-VolumesImageMetadata-817547703 None] Attempting to retrieve cache entry for image = 373cb480-3bc4-4821-93e2-442b4e852b80 on host ncdv-master-1@ceph#ceph. {{(pid=129952) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:810}} Jan 22 21:30:07.130223 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.image.cache [None req-8f599118-60f8-4b78-b082-0f141dbc8402 tempest-VolumesImageMetadata-817547703 None] Found image-volume cache entry: {'id': 1, 'image_id': '373cb480-3bc4-4821-93e2-442b4e852b80', 'volume_id': 'f39c1078-cff4-40dd-93df-4ce49cd873b4', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 1, 22, 20, 50, 57), 'last_used': datetime.datetime(2022, 1, 22, 21, 30, 7, 127946)}. {{(pid=129952) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Jan 22 21:30:07.130853 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.image.cache [None req-8f599118-60f8-4b78-b082-0f141dbc8402 tempest-VolumesImageMetadata-817547703 None] Image-volume cache entry image_update_at = 2022-01-22 20:50:57+00:00, requested image updated_at = 2022-01-22 20:50:57+00:00. {{(pid=129952) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Jan 22 21:30:07.131256 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.flows.manager.create_volume [None req-8f599118-60f8-4b78-b082-0f141dbc8402 tempest-VolumesImageMetadata-817547703 None] Creating from source image-volume f39c1078-cff4-40dd-93df-4ce49cd873b4 {{(pid=129952) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:824}} Jan 22 21:30:07.143679 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-8f599118-60f8-4b78-b082-0f141dbc8402 tempest-VolumesImageMetadata-817547703 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:30:07.432773 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-8f599118-60f8-4b78-b082-0f141dbc8402 tempest-VolumesImageMetadata-817547703 None] creating snapshot='volume-558c4cbd-419e-4ac2-b0e0-d8b916ea40e1.clone_snap' {{(pid=129952) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:725}} Jan 22 21:30:09.759663 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-8f599118-60f8-4b78-b082-0f141dbc8402 tempest-VolumesImageMetadata-817547703 None] cloning 'volume-f39c1078-cff4-40dd-93df-4ce49cd873b4@volume-558c4cbd-419e-4ac2-b0e0-d8b916ea40e1.clone_snap' to 'volume-558c4cbd-419e-4ac2-b0e0-d8b916ea40e1' {{(pid=129952) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:731}} Jan 22 21:30:09.780222 ncdv-master-1 cinder-volume[129952]: DEBUG oslo_service.periodic_task [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129952) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jan 22 21:30:09.784720 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:30:09.890158 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:30:09.916666 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.manager [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] Notifying Schedulers of capabilities ... {{(pid=129952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 22 21:30:09.948322 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-d4eb3dad-e04e-44f6-9e83-0a164867dbae tempest-VolumesBackupsAdminTest-1905346629 None] Terminate volume connection completed successfully. Jan 22 21:30:09.973382 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-d4eb3dad-e04e-44f6-9e83-0a164867dbae tempest-VolumesBackupsAdminTest-1905346629 None] Remove volume export completed successfully. Jan 22 21:30:10.694514 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.flows.manager.create_volume [None req-1f11a652-aa18-4a58-9c88-b9bc317dbe6f tempest-VolumesDeleteCascade-238826549 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129952) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Jan 22 21:30:10.698033 ncdv-master-1 cinder-volume[129952]: WARNING stevedore.named [None req-1f11a652-aa18-4a58-9c88-b9bc317dbe6f tempest-VolumesDeleteCascade-238826549 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jan 22 21:30:10.698479 ncdv-master-1 cinder-volume[129952]: WARNING castellan.key_manager [None req-1f11a652-aa18-4a58-9c88-b9bc317dbe6f tempest-VolumesDeleteCascade-238826549 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 22 21:30:10.724140 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-1f11a652-aa18-4a58-9c88-b9bc317dbe6f tempest-VolumesDeleteCascade-238826549 None] Flow 'volume_create_manager' (bc3d536a-f0d0-4222-abad-166678083753) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 22 21:30:10.730841 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-1f11a652-aa18-4a58-9c88-b9bc317dbe6f tempest-VolumesDeleteCascade-238826549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08feaebd-4e5c-475a-87a2-e24d2d26a3e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:30:10.738144 ncdv-master-1 cinder-volume[129952]: DEBUG oslo_db.sqlalchemy.engines [None req-1f11a652-aa18-4a58-9c88-b9bc317dbe6f tempest-VolumesDeleteCascade-238826549 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129952) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 22 21:30:10.752322 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-1f11a652-aa18-4a58-9c88-b9bc317dbe6f tempest-VolumesDeleteCascade-238826549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08feaebd-4e5c-475a-87a2-e24d2d26a3e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-01-22T21:30:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1055351615',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=bdf0ce57-0800-4e78-887b-4117f1e33ccf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88b4293c5f27400b87c8e69ce31db406',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-01-22T21:30:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-01-22T21:30:11Z,use_quota=True,user_id='d7be62472d724f5bae43470308930f66',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6dacb05b-a7ea-4056-85ff-98f0ea5c54eb),volume_type_id=6dacb05b-a7ea-4056-85ff-98f0ea5c54eb)' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:30:10.757913 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-1f11a652-aa18-4a58-9c88-b9bc317dbe6f tempest-VolumesDeleteCascade-238826549 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f703972-9f76-4e79-af66-9116545b9494) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:30:10.762166 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-1f11a652-aa18-4a58-9c88-b9bc317dbe6f tempest-VolumesDeleteCascade-238826549 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f703972-9f76-4e79-af66-9116545b9494) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:30:10.767658 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-1f11a652-aa18-4a58-9c88-b9bc317dbe6f tempest-VolumesDeleteCascade-238826549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60a869fb-a258-4212-828e-dba44c045682) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:30:10.771929 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-1f11a652-aa18-4a58-9c88-b9bc317dbe6f tempest-VolumesDeleteCascade-238826549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60a869fb-a258-4212-828e-dba44c045682) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bdf0ce57-0800-4e78-887b-4117f1e33ccf', 'volume_name': 'volume-bdf0ce57-0800-4e78-887b-4117f1e33ccf', 'volume_size': 1}' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:30:10.777030 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-1f11a652-aa18-4a58-9c88-b9bc317dbe6f tempest-VolumesDeleteCascade-238826549 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1bb661e2-95c2-41f4-94a8-4e3aea528d38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:30:10.781915 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-1f11a652-aa18-4a58-9c88-b9bc317dbe6f tempest-VolumesDeleteCascade-238826549 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1bb661e2-95c2-41f4-94a8-4e3aea528d38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:30:10.787032 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-1f11a652-aa18-4a58-9c88-b9bc317dbe6f tempest-VolumesDeleteCascade-238826549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e94ea318-675c-42c4-90fe-be6ee7fe7a4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:30:10.788244 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.flows.manager.create_volume [None req-1f11a652-aa18-4a58-9c88-b9bc317dbe6f tempest-VolumesDeleteCascade-238826549 None] Volume bdf0ce57-0800-4e78-887b-4117f1e33ccf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bdf0ce57-0800-4e78-887b-4117f1e33ccf', 'volume_size': 1} Jan 22 21:30:10.788690 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-1f11a652-aa18-4a58-9c88-b9bc317dbe6f tempest-VolumesDeleteCascade-238826549 None] creating volume 'volume-bdf0ce57-0800-4e78-887b-4117f1e33ccf' {{(pid=129952) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Jan 22 21:30:10.789733 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-1f11a652-aa18-4a58-9c88-b9bc317dbe6f tempest-VolumesDeleteCascade-238826549 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:30:10.951724 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-8f599118-60f8-4b78-b082-0f141dbc8402 tempest-VolumesImageMetadata-817547703 None] Volume volume-0b17e2f4-e149-4a4b-b525-3d029be2e6f6.deleted is not a clone. {{(pid=129952) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Jan 22 21:30:10.953137 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-8f599118-60f8-4b78-b082-0f141dbc8402 tempest-VolumesImageMetadata-817547703 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129952) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 22 21:30:10.954183 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-8f599118-60f8-4b78-b082-0f141dbc8402 tempest-VolumesImageMetadata-817547703 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129952) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 22 21:30:11.737362 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-8f599118-60f8-4b78-b082-0f141dbc8402 tempest-VolumesImageMetadata-817547703 None] clone created successfully {{(pid=129952) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:803}} Jan 22 21:30:11.738194 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.volume_utils [None req-8f599118-60f8-4b78-b082-0f141dbc8402 tempest-VolumesImageMetadata-817547703 None] Marking volume 558c4cbd-419e-4ac2-b0e0-d8b916ea40e1 as bootable. {{(pid=129952) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1178}} Jan 22 21:30:11.750912 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-1f11a652-aa18-4a58-9c88-b9bc317dbe6f tempest-VolumesDeleteCascade-238826549 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129952) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 22 21:30:11.751380 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-1f11a652-aa18-4a58-9c88-b9bc317dbe6f tempest-VolumesDeleteCascade-238826549 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129952) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 22 21:30:11.755309 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-1f11a652-aa18-4a58-9c88-b9bc317dbe6f tempest-VolumesDeleteCascade-238826549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e94ea318-675c-42c4-90fe-be6ee7fe7a4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bdf0ce57-0800-4e78-887b-4117f1e33ccf', 'volume_size': 1}' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:30:11.760418 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-1f11a652-aa18-4a58-9c88-b9bc317dbe6f tempest-VolumesDeleteCascade-238826549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05c36cad-4922-475b-9dd8-72a36ecd3914) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:30:11.774546 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.coordination [None req-637c9325-44a8-46b4-8cea-ba845465c2da tempest-VolumesBackupsAdminTest-1905346629 None] Lock "b'cinder-500e9832-3e26-4318-aa5b-87fa84482aa7-delete_volume'" acquired by "delete_volume" :: waited 0.029s {{(pid=129952) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 22 21:30:11.836642 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.flows.manager.create_volume [None req-8f599118-60f8-4b78-b082-0f141dbc8402 tempest-VolumesImageMetadata-817547703 None] Copying metadata from image 373cb480-3bc4-4821-93e2-442b4e852b80 to 558c4cbd-419e-4ac2-b0e0-d8b916ea40e1. {{(pid=129952) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:443}} Jan 22 21:30:11.837575 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.flows.manager.create_volume [None req-8f599118-60f8-4b78-b082-0f141dbc8402 tempest-VolumesImageMetadata-817547703 None] Creating volume glance metadata for volume 558c4cbd-419e-4ac2-b0e0-d8b916ea40e1 backed by image 373cb480-3bc4-4821-93e2-442b4e852b80 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '373cb480-3bc4-4821-93e2-442b4e852b80', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=129952) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:666}} Jan 22 21:30:11.843610 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.flows.manager.create_volume [None req-1f11a652-aa18-4a58-9c88-b9bc317dbe6f tempest-VolumesDeleteCascade-238826549 None] Volume volume-bdf0ce57-0800-4e78-887b-4117f1e33ccf (bdf0ce57-0800-4e78-887b-4117f1e33ccf): created successfully Jan 22 21:30:11.847975 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-1f11a652-aa18-4a58-9c88-b9bc317dbe6f tempest-VolumesDeleteCascade-238826549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05c36cad-4922-475b-9dd8-72a36ecd3914) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:30:11.854299 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-1f11a652-aa18-4a58-9c88-b9bc317dbe6f tempest-VolumesDeleteCascade-238826549 None] Flow 'volume_create_manager' (bc3d536a-f0d0-4222-abad-166678083753) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129952) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 22 21:30:11.915006 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-637c9325-44a8-46b4-8cea-ba845465c2da tempest-VolumesBackupsAdminTest-1905346629 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:30:14.512854 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-637c9325-44a8-46b4-8cea-ba845465c2da tempest-VolumesBackupsAdminTest-1905346629 None] Volume volume-500e9832-3e26-4318-aa5b-87fa84482aa7 is not a clone. {{(pid=129952) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Jan 22 21:30:15.319505 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-637c9325-44a8-46b4-8cea-ba845465c2da tempest-VolumesBackupsAdminTest-1905346629 None] deleting rbd volume volume-500e9832-3e26-4318-aa5b-87fa84482aa7 {{(pid=129952) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Jan 22 21:30:15.338715 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-1f11a652-aa18-4a58-9c88-b9bc317dbe6f tempest-VolumesDeleteCascade-238826549 None] Created volume successfully. Jan 22 21:30:15.411985 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-8f599118-60f8-4b78-b082-0f141dbc8402 tempest-VolumesImageMetadata-817547703 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5c0e2b2-4930-4ecd-a6c7-513f5b0c9a96) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-558c4cbd-419e-4ac2-b0e0-d8b916ea40e1', 'volume_size': 1, 'image_id': '373cb480-3bc4-4821-93e2-442b4e852b80', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '994e8f6963f04af3be3dbae11a73cdfd', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '373cb480-3bc4-4821-93e2-442b4e852b80', 'created_at': datetime.datetime(2022, 1, 22, 20, 50, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 1, 22, 20, 50, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/373cb480-3bc4-4821-93e2-442b4e852b80/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:30:15.416854 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-8f599118-60f8-4b78-b082-0f141dbc8402 tempest-VolumesImageMetadata-817547703 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf41d1e9-923b-4962-8418-015105594f5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:30:15.502112 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-dece5b25-0f72-4ab0-b8cd-92cce20980f7 tempest-VolumesDeleteCascade-238826549 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:30:15.737828 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.flows.manager.create_volume [None req-8f599118-60f8-4b78-b082-0f141dbc8402 tempest-VolumesImageMetadata-817547703 None] Volume volume-558c4cbd-419e-4ac2-b0e0-d8b916ea40e1 (558c4cbd-419e-4ac2-b0e0-d8b916ea40e1): created successfully Jan 22 21:30:15.741711 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-8f599118-60f8-4b78-b082-0f141dbc8402 tempest-VolumesImageMetadata-817547703 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf41d1e9-923b-4962-8418-015105594f5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:30:15.747536 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-8f599118-60f8-4b78-b082-0f141dbc8402 tempest-VolumesImageMetadata-817547703 None] Flow 'volume_create_manager' (cd121f07-d859-4ab3-836a-0dd73a572ee9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129952) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 22 21:30:15.856534 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-8f599118-60f8-4b78-b082-0f141dbc8402 tempest-VolumesImageMetadata-817547703 None] Created volume successfully. Jan 22 21:30:16.510341 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.coordination [None req-39aca703-e3cb-4a73-abe1-1331fff5b08b tempest-VolumesImageMetadata-817547703 None] Lock "b'cinder-558c4cbd-419e-4ac2-b0e0-d8b916ea40e1-delete_volume'" acquired by "delete_volume" :: waited 0.008s {{(pid=129952) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 22 21:30:16.606213 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-39aca703-e3cb-4a73-abe1-1331fff5b08b tempest-VolumesImageMetadata-817547703 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:30:17.175377 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-39aca703-e3cb-4a73-abe1-1331fff5b08b tempest-VolumesImageMetadata-817547703 None] volume has no backup snaps {{(pid=129952) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Jan 22 21:30:17.520150 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-39aca703-e3cb-4a73-abe1-1331fff5b08b tempest-VolumesImageMetadata-817547703 None] deleting rbd volume volume-558c4cbd-419e-4ac2-b0e0-d8b916ea40e1 {{(pid=129952) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Jan 22 21:30:19.144806 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-dece5b25-0f72-4ab0-b8cd-92cce20980f7 tempest-VolumesDeleteCascade-238826549 None] Create snapshot completed successfully Jan 22 21:30:20.919968 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-b26e4821-ad8e-49e9-981d-5fc014285485 tempest-VolumesDeleteCascade-238826549 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:30:23.284948 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.quota [None req-637c9325-44a8-46b4-8cea-ba845465c2da tempest-VolumesBackupsAdminTest-1905346629 None] Created reservations ['8a8e8dfa-c84a-41fe-a5ab-a08d8ca84e07', '9ec3b3ad-8446-4d81-8709-fab96680d62b', '173f42f5-432d-472c-b833-3f2892687742', '367ad8c9-551c-4e92-8ed0-88d8e6ba17de'] {{(pid=129952) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 22 21:30:23.561099 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-637c9325-44a8-46b4-8cea-ba845465c2da tempest-VolumesBackupsAdminTest-1905346629 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:30:23.658708 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-637c9325-44a8-46b4-8cea-ba845465c2da tempest-VolumesBackupsAdminTest-1905346629 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:30:23.794928 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.manager [None req-637c9325-44a8-46b4-8cea-ba845465c2da tempest-VolumesBackupsAdminTest-1905346629 None] Notifying Schedulers of capabilities ... {{(pid=129952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 22 21:30:23.800015 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-637c9325-44a8-46b4-8cea-ba845465c2da tempest-VolumesBackupsAdminTest-1905346629 None] Deleted volume successfully. Jan 22 21:30:23.968759 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.coordination [None req-637c9325-44a8-46b4-8cea-ba845465c2da tempest-VolumesBackupsAdminTest-1905346629 None] Lock "b'cinder-500e9832-3e26-4318-aa5b-87fa84482aa7-delete_volume'" released by "delete_volume" :: held 12.194s {{(pid=129952) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 22 21:30:24.940350 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-b26e4821-ad8e-49e9-981d-5fc014285485 tempest-VolumesDeleteCascade-238826549 None] Create snapshot completed successfully Jan 22 21:30:25.344142 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-39aca703-e3cb-4a73-abe1-1331fff5b08b tempest-VolumesImageMetadata-817547703 None] volume is a clone so cleaning references {{(pid=129952) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1266}} Jan 22 21:30:25.563841 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-39aca703-e3cb-4a73-abe1-1331fff5b08b tempest-VolumesImageMetadata-817547703 None] deleting parent snapshot volume-558c4cbd-419e-4ac2-b0e0-d8b916ea40e1.clone_snap {{(pid=129952) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1158}} Jan 22 21:30:28.596544 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.flows.manager.create_volume [None req-dcb14258-8379-4112-a555-c345aca07aac tempest-VolumesBackupsAdminTest-1905346629 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129952) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Jan 22 21:30:28.601107 ncdv-master-1 cinder-volume[129952]: WARNING stevedore.named [None req-dcb14258-8379-4112-a555-c345aca07aac tempest-VolumesBackupsAdminTest-1905346629 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jan 22 21:30:28.601833 ncdv-master-1 cinder-volume[129952]: WARNING castellan.key_manager [None req-dcb14258-8379-4112-a555-c345aca07aac tempest-VolumesBackupsAdminTest-1905346629 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 22 21:30:28.630626 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-dcb14258-8379-4112-a555-c345aca07aac tempest-VolumesBackupsAdminTest-1905346629 None] Flow 'volume_create_manager' (1773df0b-53c5-407a-aafe-51dd8d3e0069) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 22 21:30:28.641207 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-dcb14258-8379-4112-a555-c345aca07aac tempest-VolumesBackupsAdminTest-1905346629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b524e505-7d5d-4cf5-84d7-00dff6548440) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:30:28.669658 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.coordination [None req-d4b813b9-1dc8-41f1-bf35-f49ceb8f7409 tempest-VolumesDeleteCascade-238826549 None] Lock "b'cinder-bdf0ce57-0800-4e78-887b-4117f1e33ccf-delete_volume'" acquired by "delete_volume" :: waited 0.111s {{(pid=129952) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 22 21:30:28.675676 ncdv-master-1 cinder-volume[129952]: DEBUG oslo_db.sqlalchemy.engines [None req-dcb14258-8379-4112-a555-c345aca07aac tempest-VolumesBackupsAdminTest-1905346629 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129952) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 22 21:30:28.707151 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-dcb14258-8379-4112-a555-c345aca07aac tempest-VolumesBackupsAdminTest-1905346629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b524e505-7d5d-4cf5-84d7-00dff6548440) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-01-22T21:30:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsAdminTest-Volume-1951891308',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=9543bc04-28d3-48b7-9540-82e1613a4a5c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7de28c2068e48759566308168f7c145',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-01-22T21:30:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-01-22T21:30:25Z,use_quota=True,user_id='2703c550f92341b5ab72aefc5402f786',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6dacb05b-a7ea-4056-85ff-98f0ea5c54eb),volume_type_id=6dacb05b-a7ea-4056-85ff-98f0ea5c54eb)' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:30:28.713033 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-dcb14258-8379-4112-a555-c345aca07aac tempest-VolumesBackupsAdminTest-1905346629 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35e9137b-1d15-46b7-aed3-1f1e29fe0094) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:30:28.720070 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-dcb14258-8379-4112-a555-c345aca07aac tempest-VolumesBackupsAdminTest-1905346629 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35e9137b-1d15-46b7-aed3-1f1e29fe0094) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:30:28.726570 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-dcb14258-8379-4112-a555-c345aca07aac tempest-VolumesBackupsAdminTest-1905346629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dec9cc88-d112-4e34-9f25-efad43d13b97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:30:28.731247 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-dcb14258-8379-4112-a555-c345aca07aac tempest-VolumesBackupsAdminTest-1905346629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dec9cc88-d112-4e34-9f25-efad43d13b97) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9543bc04-28d3-48b7-9540-82e1613a4a5c', 'volume_name': 'volume-9543bc04-28d3-48b7-9540-82e1613a4a5c', 'volume_size': 1}' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:30:28.738490 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-dcb14258-8379-4112-a555-c345aca07aac tempest-VolumesBackupsAdminTest-1905346629 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07d43079-5854-4f28-afe1-0a8970560524) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:30:28.743844 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-dcb14258-8379-4112-a555-c345aca07aac tempest-VolumesBackupsAdminTest-1905346629 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07d43079-5854-4f28-afe1-0a8970560524) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:30:28.750169 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-dcb14258-8379-4112-a555-c345aca07aac tempest-VolumesBackupsAdminTest-1905346629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e50172c5-096b-4d85-889a-4b33d2b2ba3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:30:28.751615 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.flows.manager.create_volume [None req-dcb14258-8379-4112-a555-c345aca07aac tempest-VolumesBackupsAdminTest-1905346629 None] Volume 9543bc04-28d3-48b7-9540-82e1613a4a5c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9543bc04-28d3-48b7-9540-82e1613a4a5c', 'volume_size': 1} Jan 22 21:30:28.752423 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-dcb14258-8379-4112-a555-c345aca07aac tempest-VolumesBackupsAdminTest-1905346629 None] creating volume 'volume-9543bc04-28d3-48b7-9540-82e1613a4a5c' {{(pid=129952) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Jan 22 21:30:28.753747 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-dcb14258-8379-4112-a555-c345aca07aac tempest-VolumesBackupsAdminTest-1905346629 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:30:28.958053 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.quota [None req-39aca703-e3cb-4a73-abe1-1331fff5b08b tempest-VolumesImageMetadata-817547703 None] Created reservations ['93580363-b5ce-4c77-8bb3-a127c2def0cf', 'b43744d2-3c21-40e2-bc64-5a1bc62765cc', '76abf674-1fd1-4ff6-b00b-663384492ac3', '03ad20da-0c5f-4351-a16d-c9cfe5ba7b06'] {{(pid=129952) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 22 21:30:28.966936 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-d4b813b9-1dc8-41f1-bf35-f49ceb8f7409 tempest-VolumesDeleteCascade-238826549 None] Performing cascade delete. {{(pid=129952) delete_volume /opt/stack/cinder/cinder/volume/manager.py:958}} Jan 22 21:30:29.021803 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.coordination [None req-d4b813b9-1dc8-41f1-bf35-f49ceb8f7409 tempest-VolumesDeleteCascade-238826549 None] Lock "b'cinder-0bacf5d1-de93-4fd5-a8a6-69bddc58c758-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.024s {{(pid=129952) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 22 21:30:29.041344 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-d4b813b9-1dc8-41f1-bf35-f49ceb8f7409 tempest-VolumesDeleteCascade-238826549 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:30:29.537275 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-39aca703-e3cb-4a73-abe1-1331fff5b08b tempest-VolumesImageMetadata-817547703 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:30:29.564990 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-39aca703-e3cb-4a73-abe1-1331fff5b08b tempest-VolumesImageMetadata-817547703 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:30:29.678845 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.manager [None req-39aca703-e3cb-4a73-abe1-1331fff5b08b tempest-VolumesImageMetadata-817547703 None] Notifying Schedulers of capabilities ... {{(pid=129952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 22 21:30:29.684541 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-39aca703-e3cb-4a73-abe1-1331fff5b08b tempest-VolumesImageMetadata-817547703 None] Deleted volume successfully. Jan 22 21:30:29.696944 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-dcb14258-8379-4112-a555-c345aca07aac tempest-VolumesBackupsAdminTest-1905346629 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129952) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 22 21:30:29.698323 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-dcb14258-8379-4112-a555-c345aca07aac tempest-VolumesBackupsAdminTest-1905346629 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129952) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 22 21:30:29.707789 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-dcb14258-8379-4112-a555-c345aca07aac tempest-VolumesBackupsAdminTest-1905346629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e50172c5-096b-4d85-889a-4b33d2b2ba3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9543bc04-28d3-48b7-9540-82e1613a4a5c', 'volume_size': 1}' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:30:29.724783 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-dcb14258-8379-4112-a555-c345aca07aac tempest-VolumesBackupsAdminTest-1905346629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b9d5656-86f8-4ea4-827e-976857453b13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:30:29.837838 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.coordination [None req-39aca703-e3cb-4a73-abe1-1331fff5b08b tempest-VolumesImageMetadata-817547703 None] Lock "b'cinder-558c4cbd-419e-4ac2-b0e0-d8b916ea40e1-delete_volume'" released by "delete_volume" :: held 13.326s {{(pid=129952) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 22 21:30:29.856537 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.flows.manager.create_volume [None req-dcb14258-8379-4112-a555-c345aca07aac tempest-VolumesBackupsAdminTest-1905346629 None] Volume volume-9543bc04-28d3-48b7-9540-82e1613a4a5c (9543bc04-28d3-48b7-9540-82e1613a4a5c): created successfully Jan 22 21:30:29.861037 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-dcb14258-8379-4112-a555-c345aca07aac tempest-VolumesBackupsAdminTest-1905346629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b9d5656-86f8-4ea4-827e-976857453b13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:30:29.874858 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-dcb14258-8379-4112-a555-c345aca07aac tempest-VolumesBackupsAdminTest-1905346629 None] Flow 'volume_create_manager' (1773df0b-53c5-407a-aafe-51dd8d3e0069) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129952) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 22 21:30:29.999566 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-dcb14258-8379-4112-a555-c345aca07aac tempest-VolumesBackupsAdminTest-1905346629 None] Created volume successfully. Jan 22 21:30:31.748225 ncdv-master-1 cinder-volume[129952]: DEBUG oslo_concurrency.processutils [None req-33761fd4-d4ca-4018-a914-9d67212c09db tempest-VolumesBackupsAdminTest-1905346629 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129952) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jan 22 21:30:32.482941 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.quota [None req-d4b813b9-1dc8-41f1-bf35-f49ceb8f7409 tempest-VolumesDeleteCascade-238826549 None] Created reservations ['34bec028-4588-4113-b300-3f60e9304916', '23682fec-d869-4882-a70f-71144c9ffa29', 'ba9bc0b9-d9fa-4708-8e66-7f45f443b300', 'c099b406-8cf1-49d1-a61e-09c9d1f75877'] {{(pid=129952) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 22 21:30:32.705453 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-d4b813b9-1dc8-41f1-bf35-f49ceb8f7409 tempest-VolumesDeleteCascade-238826549 None] Delete snapshot completed successfully. Jan 22 21:30:32.718191 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.coordination [None req-d4b813b9-1dc8-41f1-bf35-f49ceb8f7409 tempest-VolumesDeleteCascade-238826549 None] Lock "b'cinder-0bacf5d1-de93-4fd5-a8a6-69bddc58c758-delete_snapshot'" released by "delete_snapshot" :: held 3.692s {{(pid=129952) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 22 21:30:32.737806 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.coordination [None req-d4b813b9-1dc8-41f1-bf35-f49ceb8f7409 tempest-VolumesDeleteCascade-238826549 None] Lock "b'cinder-8f1627a2-24e4-474b-bea5-7ce9c83e26f4-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.022s {{(pid=129952) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 22 21:30:32.765691 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-d4b813b9-1dc8-41f1-bf35-f49ceb8f7409 tempest-VolumesDeleteCascade-238826549 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:30:32.996107 ncdv-master-1 cinder-volume[129952]: DEBUG oslo_concurrency.processutils [None req-33761fd4-d4ca-4018-a914-9d67212c09db tempest-VolumesBackupsAdminTest-1905346629 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.248s {{(pid=129952) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jan 22 21:30:32.996889 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-33761fd4-d4ca-4018-a914-9d67212c09db tempest-VolumesBackupsAdminTest-1905346629 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-9543bc04-28d3-48b7-9540-82e1613a4a5c', 'hosts': ['10.222.0.100'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'c7ee930a-3b87-450e-91f6-d4eef70cb484', 'volume_id': '9543bc04-28d3-48b7-9540-82e1613a4a5c', 'discard': True}} {{(pid=129952) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Jan 22 21:30:33.042125 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-33761fd4-d4ca-4018-a914-9d67212c09db tempest-VolumesBackupsAdminTest-1905346629 None] Initialize volume connection completed successfully. Jan 22 21:30:34.766779 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.flows.manager.create_volume [None req-65c8f3c3-8334-42c3-bc79-8ad9bcd6bdb8 tempest-VolumesBackupsTest-1274070825 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129952) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Jan 22 21:30:34.771151 ncdv-master-1 cinder-volume[129952]: WARNING stevedore.named [None req-65c8f3c3-8334-42c3-bc79-8ad9bcd6bdb8 tempest-VolumesBackupsTest-1274070825 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jan 22 21:30:34.771643 ncdv-master-1 cinder-volume[129952]: WARNING castellan.key_manager [None req-65c8f3c3-8334-42c3-bc79-8ad9bcd6bdb8 tempest-VolumesBackupsTest-1274070825 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 22 21:30:34.797742 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-65c8f3c3-8334-42c3-bc79-8ad9bcd6bdb8 tempest-VolumesBackupsTest-1274070825 None] Flow 'volume_create_manager' (bbe11d22-4142-4ecc-b826-ac22df3a2ba4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 22 21:30:34.816694 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-65c8f3c3-8334-42c3-bc79-8ad9bcd6bdb8 tempest-VolumesBackupsTest-1274070825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc6125c5-26b6-4618-8caa-419527e9ab8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:30:34.823953 ncdv-master-1 cinder-volume[129952]: DEBUG oslo_db.sqlalchemy.engines [None req-65c8f3c3-8334-42c3-bc79-8ad9bcd6bdb8 tempest-VolumesBackupsTest-1274070825 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129952) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 22 21:30:34.840407 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-65c8f3c3-8334-42c3-bc79-8ad9bcd6bdb8 tempest-VolumesBackupsTest-1274070825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc6125c5-26b6-4618-8caa-419527e9ab8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-01-22T21:30:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsTest-Volume-1726980696',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=5c51668d-fc20-4f01-a879-3813357f7a73,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44f9009465234bd2b86f8525b5b212c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-01-22T21:30:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-01-22T21:30:35Z,use_quota=True,user_id='6199d0571f624eebbc985677380351fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6dacb05b-a7ea-4056-85ff-98f0ea5c54eb),volume_type_id=6dacb05b-a7ea-4056-85ff-98f0ea5c54eb)' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:30:34.855389 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-65c8f3c3-8334-42c3-bc79-8ad9bcd6bdb8 tempest-VolumesBackupsTest-1274070825 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4abb6bfc-6e5c-4951-9fea-d9c7e1f74eca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:30:34.861713 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-65c8f3c3-8334-42c3-bc79-8ad9bcd6bdb8 tempest-VolumesBackupsTest-1274070825 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4abb6bfc-6e5c-4951-9fea-d9c7e1f74eca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:30:34.869646 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-65c8f3c3-8334-42c3-bc79-8ad9bcd6bdb8 tempest-VolumesBackupsTest-1274070825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c58e802-ae98-4dc4-a883-ecc52e5451f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:30:34.875254 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-65c8f3c3-8334-42c3-bc79-8ad9bcd6bdb8 tempest-VolumesBackupsTest-1274070825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c58e802-ae98-4dc4-a883-ecc52e5451f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5c51668d-fc20-4f01-a879-3813357f7a73', 'volume_name': 'volume-5c51668d-fc20-4f01-a879-3813357f7a73', 'volume_size': 1}' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:30:34.881760 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-65c8f3c3-8334-42c3-bc79-8ad9bcd6bdb8 tempest-VolumesBackupsTest-1274070825 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5882f928-8f2c-4e03-bb83-ec7e3b84581d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:30:34.887639 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-65c8f3c3-8334-42c3-bc79-8ad9bcd6bdb8 tempest-VolumesBackupsTest-1274070825 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5882f928-8f2c-4e03-bb83-ec7e3b84581d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:30:34.894503 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-65c8f3c3-8334-42c3-bc79-8ad9bcd6bdb8 tempest-VolumesBackupsTest-1274070825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f806d754-6e89-4c6f-b8da-787bfc8bbb2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:30:34.896002 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.flows.manager.create_volume [None req-65c8f3c3-8334-42c3-bc79-8ad9bcd6bdb8 tempest-VolumesBackupsTest-1274070825 None] Volume 5c51668d-fc20-4f01-a879-3813357f7a73: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5c51668d-fc20-4f01-a879-3813357f7a73', 'volume_size': 1} Jan 22 21:30:34.896615 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-65c8f3c3-8334-42c3-bc79-8ad9bcd6bdb8 tempest-VolumesBackupsTest-1274070825 None] creating volume 'volume-5c51668d-fc20-4f01-a879-3813357f7a73' {{(pid=129952) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Jan 22 21:30:34.897709 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-65c8f3c3-8334-42c3-bc79-8ad9bcd6bdb8 tempest-VolumesBackupsTest-1274070825 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:30:35.544736 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-65c8f3c3-8334-42c3-bc79-8ad9bcd6bdb8 tempest-VolumesBackupsTest-1274070825 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129952) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 22 21:30:35.545122 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-65c8f3c3-8334-42c3-bc79-8ad9bcd6bdb8 tempest-VolumesBackupsTest-1274070825 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129952) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 22 21:30:35.549312 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-65c8f3c3-8334-42c3-bc79-8ad9bcd6bdb8 tempest-VolumesBackupsTest-1274070825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f806d754-6e89-4c6f-b8da-787bfc8bbb2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5c51668d-fc20-4f01-a879-3813357f7a73', 'volume_size': 1}' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:30:35.554272 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-65c8f3c3-8334-42c3-bc79-8ad9bcd6bdb8 tempest-VolumesBackupsTest-1274070825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5dcb754-4b98-410d-bc58-c0ddc1f67c20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:30:35.644601 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.flows.manager.create_volume [None req-65c8f3c3-8334-42c3-bc79-8ad9bcd6bdb8 tempest-VolumesBackupsTest-1274070825 None] Volume volume-5c51668d-fc20-4f01-a879-3813357f7a73 (5c51668d-fc20-4f01-a879-3813357f7a73): created successfully Jan 22 21:30:35.649522 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-65c8f3c3-8334-42c3-bc79-8ad9bcd6bdb8 tempest-VolumesBackupsTest-1274070825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5dcb754-4b98-410d-bc58-c0ddc1f67c20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:30:35.657366 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-65c8f3c3-8334-42c3-bc79-8ad9bcd6bdb8 tempest-VolumesBackupsTest-1274070825 None] Flow 'volume_create_manager' (bbe11d22-4142-4ecc-b826-ac22df3a2ba4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129952) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 22 21:30:35.768497 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-65c8f3c3-8334-42c3-bc79-8ad9bcd6bdb8 tempest-VolumesBackupsTest-1274070825 None] Created volume successfully. Jan 22 21:30:37.008695 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.quota [None req-d4b813b9-1dc8-41f1-bf35-f49ceb8f7409 tempest-VolumesDeleteCascade-238826549 None] Created reservations ['67aadb18-423e-41d4-b0b6-3160af046463', '97b8d180-a29e-4704-ba3d-efb89897e6ea', '3306137c-f9fb-42ae-908e-3abe0b4dadc2', '94d4a0db-3833-41e0-ab88-655681c05fdb'] {{(pid=129952) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 22 21:30:37.318042 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-d4b813b9-1dc8-41f1-bf35-f49ceb8f7409 tempest-VolumesDeleteCascade-238826549 None] Delete snapshot completed successfully. Jan 22 21:30:37.323015 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.coordination [None req-d4b813b9-1dc8-41f1-bf35-f49ceb8f7409 tempest-VolumesDeleteCascade-238826549 None] Lock "b'cinder-8f1627a2-24e4-474b-bea5-7ce9c83e26f4-delete_snapshot'" released by "delete_snapshot" :: held 4.586s {{(pid=129952) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 22 21:30:37.324045 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-d4b813b9-1dc8-41f1-bf35-f49ceb8f7409 tempest-VolumesDeleteCascade-238826549 None] Snapshots deleted, issuing volume delete {{(pid=129952) delete_volume /opt/stack/cinder/cinder/volume/manager.py:973}} Jan 22 21:30:37.325802 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-d4b813b9-1dc8-41f1-bf35-f49ceb8f7409 tempest-VolumesDeleteCascade-238826549 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:30:37.539376 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-d4b813b9-1dc8-41f1-bf35-f49ceb8f7409 tempest-VolumesDeleteCascade-238826549 None] volume has no backup snaps {{(pid=129952) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Jan 22 21:30:37.539840 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-d4b813b9-1dc8-41f1-bf35-f49ceb8f7409 tempest-VolumesDeleteCascade-238826549 None] Volume volume-bdf0ce57-0800-4e78-887b-4117f1e33ccf is not a clone. {{(pid=129952) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Jan 22 21:30:37.636942 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-d4b813b9-1dc8-41f1-bf35-f49ceb8f7409 tempest-VolumesDeleteCascade-238826549 None] deleting rbd volume volume-bdf0ce57-0800-4e78-887b-4117f1e33ccf {{(pid=129952) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Jan 22 21:30:40.892324 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-33761fd4-d4ca-4018-a914-9d67212c09db tempest-VolumesBackupsAdminTest-1905346629 None] Terminate volume connection completed successfully. Jan 22 21:30:40.910319 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-33761fd4-d4ca-4018-a914-9d67212c09db tempest-VolumesBackupsAdminTest-1905346629 None] Remove volume export completed successfully. Jan 22 21:30:42.922741 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.quota [None req-d4b813b9-1dc8-41f1-bf35-f49ceb8f7409 tempest-VolumesDeleteCascade-238826549 None] Created reservations ['4fdd36c0-bbd6-4c33-b179-c5afa6a12944', 'd82b0525-b282-4174-8c1d-279e91e3abdd', 'dc44e3db-39de-41d1-adff-386df065436b', '25201697-ecb4-4421-9bc1-ee5b3edd5bc7'] {{(pid=129952) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 22 21:30:43.237686 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-d4b813b9-1dc8-41f1-bf35-f49ceb8f7409 tempest-VolumesDeleteCascade-238826549 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:30:43.272620 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-d4b813b9-1dc8-41f1-bf35-f49ceb8f7409 tempest-VolumesDeleteCascade-238826549 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:30:43.313913 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.manager [None req-d4b813b9-1dc8-41f1-bf35-f49ceb8f7409 tempest-VolumesDeleteCascade-238826549 None] Notifying Schedulers of capabilities ... {{(pid=129952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 22 21:30:43.325651 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-d4b813b9-1dc8-41f1-bf35-f49ceb8f7409 tempest-VolumesDeleteCascade-238826549 None] Deleted volume successfully. Jan 22 21:30:43.453331 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.coordination [None req-d4b813b9-1dc8-41f1-bf35-f49ceb8f7409 tempest-VolumesDeleteCascade-238826549 None] Lock "b'cinder-bdf0ce57-0800-4e78-887b-4117f1e33ccf-delete_volume'" released by "delete_volume" :: held 14.784s {{(pid=129952) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 22 21:30:49.651947 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.flows.manager.create_volume [None req-b179c0ba-8f1f-4168-9943-943f0ebb772f tempest-VolumesTransfersV355Test-1595966134 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129952) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Jan 22 21:30:49.656448 ncdv-master-1 cinder-volume[129952]: WARNING stevedore.named [None req-b179c0ba-8f1f-4168-9943-943f0ebb772f tempest-VolumesTransfersV355Test-1595966134 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jan 22 21:30:49.662582 ncdv-master-1 cinder-volume[129952]: WARNING castellan.key_manager [None req-b179c0ba-8f1f-4168-9943-943f0ebb772f tempest-VolumesTransfersV355Test-1595966134 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 22 21:30:49.678117 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-b179c0ba-8f1f-4168-9943-943f0ebb772f tempest-VolumesTransfersV355Test-1595966134 None] Flow 'volume_create_manager' (96a7479c-1c5c-46ee-b274-a7033a235e2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 22 21:30:49.689035 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-b179c0ba-8f1f-4168-9943-943f0ebb772f tempest-VolumesTransfersV355Test-1595966134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6728dfbe-1ec6-4abd-a11f-13c4f0973ce4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:30:49.695653 ncdv-master-1 cinder-volume[129952]: DEBUG oslo_db.sqlalchemy.engines [None req-b179c0ba-8f1f-4168-9943-943f0ebb772f tempest-VolumesTransfersV355Test-1595966134 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129952) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 22 21:30:49.712852 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-b179c0ba-8f1f-4168-9943-943f0ebb772f tempest-VolumesTransfersV355Test-1595966134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6728dfbe-1ec6-4abd-a11f-13c4f0973ce4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-01-22T21:30:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-936737535',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=2042cbbd-1aca-4693-b30c-745c26468f85,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32a0ef1657c44b6a9de7e41688ed1419',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-01-22T21:30:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-01-22T21:30:49Z,use_quota=True,user_id='3201f332cbfc42f5b57ffe126956e082',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6dacb05b-a7ea-4056-85ff-98f0ea5c54eb),volume_type_id=6dacb05b-a7ea-4056-85ff-98f0ea5c54eb)' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:30:49.721802 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-b179c0ba-8f1f-4168-9943-943f0ebb772f tempest-VolumesTransfersV355Test-1595966134 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88dd8837-71c9-4fee-ac59-a8b50371a2c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:30:49.730322 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-b179c0ba-8f1f-4168-9943-943f0ebb772f tempest-VolumesTransfersV355Test-1595966134 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88dd8837-71c9-4fee-ac59-a8b50371a2c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:30:49.737315 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-b179c0ba-8f1f-4168-9943-943f0ebb772f tempest-VolumesTransfersV355Test-1595966134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce6922f1-160f-4f89-b5ff-07460dc51e7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:30:49.742669 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-b179c0ba-8f1f-4168-9943-943f0ebb772f tempest-VolumesTransfersV355Test-1595966134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce6922f1-160f-4f89-b5ff-07460dc51e7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2042cbbd-1aca-4693-b30c-745c26468f85', 'volume_name': 'volume-2042cbbd-1aca-4693-b30c-745c26468f85', 'volume_size': 1}' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:30:49.751592 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-b179c0ba-8f1f-4168-9943-943f0ebb772f tempest-VolumesTransfersV355Test-1595966134 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0ff73a0-aa33-459d-b265-812ff4fc7d1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:30:49.756012 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-b179c0ba-8f1f-4168-9943-943f0ebb772f tempest-VolumesTransfersV355Test-1595966134 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0ff73a0-aa33-459d-b265-812ff4fc7d1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:30:49.761610 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-b179c0ba-8f1f-4168-9943-943f0ebb772f tempest-VolumesTransfersV355Test-1595966134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bbaf8140-38da-4c48-929a-453282d4608f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:30:49.762800 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.flows.manager.create_volume [None req-b179c0ba-8f1f-4168-9943-943f0ebb772f tempest-VolumesTransfersV355Test-1595966134 None] Volume 2042cbbd-1aca-4693-b30c-745c26468f85: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2042cbbd-1aca-4693-b30c-745c26468f85', 'volume_size': 1} Jan 22 21:30:49.763192 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-b179c0ba-8f1f-4168-9943-943f0ebb772f tempest-VolumesTransfersV355Test-1595966134 None] creating volume 'volume-2042cbbd-1aca-4693-b30c-745c26468f85' {{(pid=129952) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Jan 22 21:30:49.764341 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-b179c0ba-8f1f-4168-9943-943f0ebb772f tempest-VolumesTransfersV355Test-1595966134 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:30:50.410582 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-b179c0ba-8f1f-4168-9943-943f0ebb772f tempest-VolumesTransfersV355Test-1595966134 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129952) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 22 21:30:50.410955 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-b179c0ba-8f1f-4168-9943-943f0ebb772f tempest-VolumesTransfersV355Test-1595966134 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129952) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 22 21:30:50.416014 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-b179c0ba-8f1f-4168-9943-943f0ebb772f tempest-VolumesTransfersV355Test-1595966134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bbaf8140-38da-4c48-929a-453282d4608f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2042cbbd-1aca-4693-b30c-745c26468f85', 'volume_size': 1}' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:30:50.422273 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-b179c0ba-8f1f-4168-9943-943f0ebb772f tempest-VolumesTransfersV355Test-1595966134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f56a9ac3-ed9d-4a0d-9927-7143d7704782) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:30:50.500693 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.flows.manager.create_volume [None req-b179c0ba-8f1f-4168-9943-943f0ebb772f tempest-VolumesTransfersV355Test-1595966134 None] Volume volume-2042cbbd-1aca-4693-b30c-745c26468f85 (2042cbbd-1aca-4693-b30c-745c26468f85): created successfully Jan 22 21:30:50.505359 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-b179c0ba-8f1f-4168-9943-943f0ebb772f tempest-VolumesTransfersV355Test-1595966134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f56a9ac3-ed9d-4a0d-9927-7143d7704782) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:30:50.513802 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-b179c0ba-8f1f-4168-9943-943f0ebb772f tempest-VolumesTransfersV355Test-1595966134 None] Flow 'volume_create_manager' (96a7479c-1c5c-46ee-b274-a7033a235e2e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129952) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 22 21:30:50.552036 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.coordination [None req-2bc3965c-17dc-4e60-b7b2-699efd8e5aa8 tempest-VolumesBackupsAdminTest-1905346629 None] Lock "b'cinder-9543bc04-28d3-48b7-9540-82e1613a4a5c-delete_volume'" acquired by "delete_volume" :: waited 0.010s {{(pid=129952) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 22 21:30:50.593082 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-b179c0ba-8f1f-4168-9943-943f0ebb772f tempest-VolumesTransfersV355Test-1595966134 None] Created volume successfully. Jan 22 21:30:50.674024 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-2bc3965c-17dc-4e60-b7b2-699efd8e5aa8 tempest-VolumesBackupsAdminTest-1905346629 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:30:52.583934 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-2bc3965c-17dc-4e60-b7b2-699efd8e5aa8 tempest-VolumesBackupsAdminTest-1905346629 None] Volume volume-9543bc04-28d3-48b7-9540-82e1613a4a5c is not a clone. {{(pid=129952) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Jan 22 21:30:53.088679 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-2bc3965c-17dc-4e60-b7b2-699efd8e5aa8 tempest-VolumesBackupsAdminTest-1905346629 None] deleting rbd volume volume-9543bc04-28d3-48b7-9540-82e1613a4a5c {{(pid=129952) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Jan 22 21:30:53.141791 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-bdf791b3-b291-417c-8b43-b834ebc08ee9 tempest-VolumesTransfersV355Test-955817293 None] Transfer volume completed successfully. Jan 22 21:30:54.419181 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.coordination [None req-7358a5ba-4f83-4585-ada7-ccb6426df0b0 tempest-VolumesTransfersV355Test-572049783 None] Lock "b'cinder-2042cbbd-1aca-4693-b30c-745c26468f85-delete_volume'" acquired by "delete_volume" :: waited 0.018s {{(pid=129952) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 22 21:30:54.524544 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-7358a5ba-4f83-4585-ada7-ccb6426df0b0 tempest-VolumesTransfersV355Test-572049783 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:30:54.802750 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-7358a5ba-4f83-4585-ada7-ccb6426df0b0 tempest-VolumesTransfersV355Test-572049783 None] volume has no backup snaps {{(pid=129952) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Jan 22 21:30:54.803200 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-7358a5ba-4f83-4585-ada7-ccb6426df0b0 tempest-VolumesTransfersV355Test-572049783 None] Volume volume-2042cbbd-1aca-4693-b30c-745c26468f85 is not a clone. {{(pid=129952) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Jan 22 21:30:55.085549 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-7358a5ba-4f83-4585-ada7-ccb6426df0b0 tempest-VolumesTransfersV355Test-572049783 None] deleting rbd volume volume-2042cbbd-1aca-4693-b30c-745c26468f85 {{(pid=129952) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Jan 22 21:30:55.723824 ncdv-master-1 cinder-volume[129952]: DEBUG oslo_concurrency.processutils [req-0415ea23-f158-4dca-9df5-b3be0152c486 req-519cc241-2cac-4542-90e2-4e7bb337a2de tempest-VolumesBackupsTest-1274070825 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129952) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jan 22 21:30:56.624264 ncdv-master-1 cinder-volume[129952]: DEBUG oslo_concurrency.processutils [req-0415ea23-f158-4dca-9df5-b3be0152c486 req-519cc241-2cac-4542-90e2-4e7bb337a2de tempest-VolumesBackupsTest-1274070825 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.900s {{(pid=129952) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jan 22 21:30:56.627261 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [req-0415ea23-f158-4dca-9df5-b3be0152c486 req-519cc241-2cac-4542-90e2-4e7bb337a2de tempest-VolumesBackupsTest-1274070825 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-5c51668d-fc20-4f01-a879-3813357f7a73', 'hosts': ['10.222.0.100'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'c7ee930a-3b87-450e-91f6-d4eef70cb484', 'volume_id': '5c51668d-fc20-4f01-a879-3813357f7a73', 'discard': True}} {{(pid=129952) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Jan 22 21:30:56.753467 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [req-0415ea23-f158-4dca-9df5-b3be0152c486 req-519cc241-2cac-4542-90e2-4e7bb337a2de tempest-VolumesBackupsTest-1274070825 None] Connection info returned from driver {'name': 'volumes/volume-5c51668d-fc20-4f01-a879-3813357f7a73', 'hosts': ['10.222.0.100'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '5c51668d-fc20-4f01-a879-3813357f7a73', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'b9c0495a-88e8-4888-87ae-9f34b1a69731'} {{(pid=129952) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4811}} Jan 22 21:30:56.891350 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [req-0415ea23-f158-4dca-9df5-b3be0152c486 req-519cc241-2cac-4542-90e2-4e7bb337a2de tempest-VolumesBackupsTest-1274070825 None] attachment_update completed successfully. Jan 22 21:30:59.537272 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.quota [None req-2bc3965c-17dc-4e60-b7b2-699efd8e5aa8 tempest-VolumesBackupsAdminTest-1905346629 None] Created reservations ['3b5ff9f8-dbea-48cf-80aa-f2126ccc6b5f', '5a012cbc-9cb5-4373-9b60-b563fe44c56e', '0c5e4eec-9910-458a-be5b-50ac8d9201d5', '06ab0824-5cd1-49a8-be50-8a8f70294bd1'] {{(pid=129952) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 22 21:30:59.730702 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-2bc3965c-17dc-4e60-b7b2-699efd8e5aa8 tempest-VolumesBackupsAdminTest-1905346629 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:30:59.799281 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-2bc3965c-17dc-4e60-b7b2-699efd8e5aa8 tempest-VolumesBackupsAdminTest-1905346629 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:30:59.847851 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.manager [None req-2bc3965c-17dc-4e60-b7b2-699efd8e5aa8 tempest-VolumesBackupsAdminTest-1905346629 None] Notifying Schedulers of capabilities ... {{(pid=129952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 22 21:30:59.853672 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-2bc3965c-17dc-4e60-b7b2-699efd8e5aa8 tempest-VolumesBackupsAdminTest-1905346629 None] Deleted volume successfully. Jan 22 21:30:59.962056 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.coordination [None req-2bc3965c-17dc-4e60-b7b2-699efd8e5aa8 tempest-VolumesBackupsAdminTest-1905346629 None] Lock "b'cinder-9543bc04-28d3-48b7-9540-82e1613a4a5c-delete_volume'" released by "delete_volume" :: held 9.409s {{(pid=129952) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 22 21:31:00.448522 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.coordination [None req-9ff0ea0d-b3cb-4b42-ad22-14410258f8f1 tempest-VolumesBackupsAdminTest-1905346629 None] Lock "b'cinder-c78173a9-3798-4b6d-91d8-061c98e61c28-delete_volume'" acquired by "delete_volume" :: waited 0.009s {{(pid=129952) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 22 21:31:00.570618 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-9ff0ea0d-b3cb-4b42-ad22-14410258f8f1 tempest-VolumesBackupsAdminTest-1905346629 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:31:03.147130 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-9ff0ea0d-b3cb-4b42-ad22-14410258f8f1 tempest-VolumesBackupsAdminTest-1905346629 None] Volume volume-c78173a9-3798-4b6d-91d8-061c98e61c28 is not a clone. {{(pid=129952) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Jan 22 21:31:03.442598 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-9ff0ea0d-b3cb-4b42-ad22-14410258f8f1 tempest-VolumesBackupsAdminTest-1905346629 None] deleting rbd volume volume-c78173a9-3798-4b6d-91d8-061c98e61c28 {{(pid=129952) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Jan 22 21:31:03.491815 ncdv-master-1 cinder-volume[129952]: DEBUG oslo_concurrency.processutils [None req-c0323dde-c64c-4188-a24b-f1e011ebe944 tempest-VolumesBackupsTest-1274070825 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129952) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jan 22 21:31:03.634971 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.quota [None req-7358a5ba-4f83-4585-ada7-ccb6426df0b0 tempest-VolumesTransfersV355Test-572049783 None] Created reservations ['bb8456ce-18e9-496e-932d-51dbe85f5092', '2f91f89e-380f-4622-bbd9-0aa764e00b40', 'd0aaeecf-bfa4-42a2-9dee-73a645732723', 'c752c0a1-87f5-4459-8e23-1f6289938901'] {{(pid=129952) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 22 21:31:03.864413 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-7358a5ba-4f83-4585-ada7-ccb6426df0b0 tempest-VolumesTransfersV355Test-572049783 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:31:03.901011 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-7358a5ba-4f83-4585-ada7-ccb6426df0b0 tempest-VolumesTransfersV355Test-572049783 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:31:03.930974 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.manager [None req-7358a5ba-4f83-4585-ada7-ccb6426df0b0 tempest-VolumesTransfersV355Test-572049783 None] Notifying Schedulers of capabilities ... {{(pid=129952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 22 21:31:03.937313 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-7358a5ba-4f83-4585-ada7-ccb6426df0b0 tempest-VolumesTransfersV355Test-572049783 None] Deleted volume successfully. Jan 22 21:31:04.052835 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.coordination [None req-7358a5ba-4f83-4585-ada7-ccb6426df0b0 tempest-VolumesTransfersV355Test-572049783 None] Lock "b'cinder-2042cbbd-1aca-4693-b30c-745c26468f85-delete_volume'" released by "delete_volume" :: held 9.633s {{(pid=129952) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 22 21:31:04.200689 ncdv-master-1 cinder-volume[129952]: DEBUG oslo_concurrency.processutils [None req-c0323dde-c64c-4188-a24b-f1e011ebe944 tempest-VolumesBackupsTest-1274070825 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.709s {{(pid=129952) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jan 22 21:31:04.201358 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-c0323dde-c64c-4188-a24b-f1e011ebe944 tempest-VolumesBackupsTest-1274070825 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-5c51668d-fc20-4f01-a879-3813357f7a73', 'hosts': ['10.222.0.100'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'c7ee930a-3b87-450e-91f6-d4eef70cb484', 'volume_id': '5c51668d-fc20-4f01-a879-3813357f7a73', 'discard': True}} {{(pid=129952) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Jan 22 21:31:04.229685 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-c0323dde-c64c-4188-a24b-f1e011ebe944 tempest-VolumesBackupsTest-1274070825 None] Initialize volume connection completed successfully. Jan 22 21:31:04.891434 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.flows.manager.create_volume [None req-85458d9e-6a1a-446f-b7fe-21f958ee9a1b tempest-VolumesTransfersV355Test-1595966134 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129952) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Jan 22 21:31:04.895442 ncdv-master-1 cinder-volume[129952]: WARNING stevedore.named [None req-85458d9e-6a1a-446f-b7fe-21f958ee9a1b tempest-VolumesTransfersV355Test-1595966134 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jan 22 21:31:04.895936 ncdv-master-1 cinder-volume[129952]: WARNING castellan.key_manager [None req-85458d9e-6a1a-446f-b7fe-21f958ee9a1b tempest-VolumesTransfersV355Test-1595966134 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 22 21:31:04.918637 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-85458d9e-6a1a-446f-b7fe-21f958ee9a1b tempest-VolumesTransfersV355Test-1595966134 None] Flow 'volume_create_manager' (e78294c9-dfe6-460e-bdb4-496642f603cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 22 21:31:04.925578 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-85458d9e-6a1a-446f-b7fe-21f958ee9a1b tempest-VolumesTransfersV355Test-1595966134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ccdd21ac-0a77-4f8f-a2cb-0adf67c21a77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:31:04.931815 ncdv-master-1 cinder-volume[129952]: DEBUG oslo_db.sqlalchemy.engines [None req-85458d9e-6a1a-446f-b7fe-21f958ee9a1b tempest-VolumesTransfersV355Test-1595966134 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129952) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 22 21:31:04.946761 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-85458d9e-6a1a-446f-b7fe-21f958ee9a1b tempest-VolumesTransfersV355Test-1595966134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ccdd21ac-0a77-4f8f-a2cb-0adf67c21a77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-01-22T21:31:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-408116384',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=80f51f10-2b48-4dc2-bd17-2936d865412b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32a0ef1657c44b6a9de7e41688ed1419',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-01-22T21:31:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-01-22T21:31:05Z,use_quota=True,user_id='3201f332cbfc42f5b57ffe126956e082',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6dacb05b-a7ea-4056-85ff-98f0ea5c54eb),volume_type_id=6dacb05b-a7ea-4056-85ff-98f0ea5c54eb)' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:31:04.952447 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-85458d9e-6a1a-446f-b7fe-21f958ee9a1b tempest-VolumesTransfersV355Test-1595966134 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a41219d0-553a-4bb2-9bbf-fa0076a83e9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:31:04.957536 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-85458d9e-6a1a-446f-b7fe-21f958ee9a1b tempest-VolumesTransfersV355Test-1595966134 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a41219d0-553a-4bb2-9bbf-fa0076a83e9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:31:04.962845 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-85458d9e-6a1a-446f-b7fe-21f958ee9a1b tempest-VolumesTransfersV355Test-1595966134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3c47d6f-2aae-4041-81cd-929694919b94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:31:04.969202 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-85458d9e-6a1a-446f-b7fe-21f958ee9a1b tempest-VolumesTransfersV355Test-1595966134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3c47d6f-2aae-4041-81cd-929694919b94) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '80f51f10-2b48-4dc2-bd17-2936d865412b', 'volume_name': 'volume-80f51f10-2b48-4dc2-bd17-2936d865412b', 'volume_size': 1}' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:31:04.972537 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-85458d9e-6a1a-446f-b7fe-21f958ee9a1b tempest-VolumesTransfersV355Test-1595966134 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a0f1901-36f6-4db7-ae0d-56f43aad0f8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:31:04.976666 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-85458d9e-6a1a-446f-b7fe-21f958ee9a1b tempest-VolumesTransfersV355Test-1595966134 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a0f1901-36f6-4db7-ae0d-56f43aad0f8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:31:04.981569 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-85458d9e-6a1a-446f-b7fe-21f958ee9a1b tempest-VolumesTransfersV355Test-1595966134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5ebef28-364d-435c-a672-640fd3428a24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:31:04.982684 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.flows.manager.create_volume [None req-85458d9e-6a1a-446f-b7fe-21f958ee9a1b tempest-VolumesTransfersV355Test-1595966134 None] Volume 80f51f10-2b48-4dc2-bd17-2936d865412b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-80f51f10-2b48-4dc2-bd17-2936d865412b', 'volume_size': 1} Jan 22 21:31:04.983089 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-85458d9e-6a1a-446f-b7fe-21f958ee9a1b tempest-VolumesTransfersV355Test-1595966134 None] creating volume 'volume-80f51f10-2b48-4dc2-bd17-2936d865412b' {{(pid=129952) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Jan 22 21:31:04.984066 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-85458d9e-6a1a-446f-b7fe-21f958ee9a1b tempest-VolumesTransfersV355Test-1595966134 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:31:05.946540 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-85458d9e-6a1a-446f-b7fe-21f958ee9a1b tempest-VolumesTransfersV355Test-1595966134 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129952) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 22 21:31:05.947130 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-85458d9e-6a1a-446f-b7fe-21f958ee9a1b tempest-VolumesTransfersV355Test-1595966134 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129952) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 22 21:31:05.950827 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-85458d9e-6a1a-446f-b7fe-21f958ee9a1b tempest-VolumesTransfersV355Test-1595966134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5ebef28-364d-435c-a672-640fd3428a24) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-80f51f10-2b48-4dc2-bd17-2936d865412b', 'volume_size': 1}' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:31:05.956261 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-85458d9e-6a1a-446f-b7fe-21f958ee9a1b tempest-VolumesTransfersV355Test-1595966134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24a66c2f-753c-43c5-83ae-0644efdd10bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:31:06.073045 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.flows.manager.create_volume [None req-85458d9e-6a1a-446f-b7fe-21f958ee9a1b tempest-VolumesTransfersV355Test-1595966134 None] Volume volume-80f51f10-2b48-4dc2-bd17-2936d865412b (80f51f10-2b48-4dc2-bd17-2936d865412b): created successfully Jan 22 21:31:06.077613 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-85458d9e-6a1a-446f-b7fe-21f958ee9a1b tempest-VolumesTransfersV355Test-1595966134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24a66c2f-753c-43c5-83ae-0644efdd10bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:31:06.084210 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-85458d9e-6a1a-446f-b7fe-21f958ee9a1b tempest-VolumesTransfersV355Test-1595966134 None] Flow 'volume_create_manager' (e78294c9-dfe6-460e-bdb4-496642f603cd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129952) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 22 21:31:06.142837 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-85458d9e-6a1a-446f-b7fe-21f958ee9a1b tempest-VolumesTransfersV355Test-1595966134 None] Created volume successfully. Jan 22 21:31:07.650520 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.coordination [None req-9c594c21-82cd-4810-bf71-472bbb889aab tempest-VolumesTransfersV355Test-572049783 None] Lock "b'cinder-80f51f10-2b48-4dc2-bd17-2936d865412b-delete_volume'" acquired by "delete_volume" :: waited 0.016s {{(pid=129952) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 22 21:31:07.737439 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-9c594c21-82cd-4810-bf71-472bbb889aab tempest-VolumesTransfersV355Test-572049783 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:31:08.061964 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-9c594c21-82cd-4810-bf71-472bbb889aab tempest-VolumesTransfersV355Test-572049783 None] volume has no backup snaps {{(pid=129952) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Jan 22 21:31:08.062695 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-9c594c21-82cd-4810-bf71-472bbb889aab tempest-VolumesTransfersV355Test-572049783 None] Volume volume-80f51f10-2b48-4dc2-bd17-2936d865412b is not a clone. {{(pid=129952) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Jan 22 21:31:08.400008 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-9c594c21-82cd-4810-bf71-472bbb889aab tempest-VolumesTransfersV355Test-572049783 None] deleting rbd volume volume-80f51f10-2b48-4dc2-bd17-2936d865412b {{(pid=129952) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Jan 22 21:31:09.433784 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.quota [None req-9ff0ea0d-b3cb-4b42-ad22-14410258f8f1 tempest-VolumesBackupsAdminTest-1905346629 None] Created reservations ['62429441-8d81-4e42-99f9-48198a168903', '51a8e6ab-73ff-40bc-a14c-4ccd5a535e98', '320f7f87-2e52-4ec7-8b84-2b3657e7be30', '89d4586f-a16f-4f80-8809-2b2ec5d605ac'] {{(pid=129952) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 22 21:31:09.610612 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-9ff0ea0d-b3cb-4b42-ad22-14410258f8f1 tempest-VolumesBackupsAdminTest-1905346629 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:31:09.650510 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-9ff0ea0d-b3cb-4b42-ad22-14410258f8f1 tempest-VolumesBackupsAdminTest-1905346629 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:31:09.788371 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.manager [None req-9ff0ea0d-b3cb-4b42-ad22-14410258f8f1 tempest-VolumesBackupsAdminTest-1905346629 None] Notifying Schedulers of capabilities ... {{(pid=129952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 22 21:31:09.795105 ncdv-master-1 cinder-volume[129952]: DEBUG oslo_service.periodic_task [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129952) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jan 22 21:31:09.795980 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:31:09.917608 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:31:09.966592 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.manager [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] Notifying Schedulers of capabilities ... {{(pid=129952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 22 21:31:09.989093 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-9ff0ea0d-b3cb-4b42-ad22-14410258f8f1 tempest-VolumesBackupsAdminTest-1905346629 None] Deleted volume successfully. Jan 22 21:31:10.132072 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.coordination [None req-9ff0ea0d-b3cb-4b42-ad22-14410258f8f1 tempest-VolumesBackupsAdminTest-1905346629 None] Lock "b'cinder-c78173a9-3798-4b6d-91d8-061c98e61c28-delete_volume'" released by "delete_volume" :: held 9.682s {{(pid=129952) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 22 21:31:12.672625 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-c0323dde-c64c-4188-a24b-f1e011ebe944 tempest-VolumesBackupsTest-1274070825 None] Terminate volume connection completed successfully. Jan 22 21:31:12.693810 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-c0323dde-c64c-4188-a24b-f1e011ebe944 tempest-VolumesBackupsTest-1274070825 None] Remove volume export completed successfully. Jan 22 21:31:14.192141 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.quota [None req-9c594c21-82cd-4810-bf71-472bbb889aab tempest-VolumesTransfersV355Test-572049783 None] Created reservations ['9b1dd73d-e36e-41d3-9810-adc08556ec50', 'afcda991-f1f9-457d-b2ae-c12826027698', '582927a6-cf13-4920-bdde-575265a7638a', '06b63799-5b80-4df0-9af4-e6b32ad88e15'] {{(pid=129952) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 22 21:31:14.399470 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-9c594c21-82cd-4810-bf71-472bbb889aab tempest-VolumesTransfersV355Test-572049783 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:31:14.447075 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-9c594c21-82cd-4810-bf71-472bbb889aab tempest-VolumesTransfersV355Test-572049783 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:31:14.504328 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.manager [None req-9c594c21-82cd-4810-bf71-472bbb889aab tempest-VolumesTransfersV355Test-572049783 None] Notifying Schedulers of capabilities ... {{(pid=129952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 22 21:31:14.510296 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-9c594c21-82cd-4810-bf71-472bbb889aab tempest-VolumesTransfersV355Test-572049783 None] Deleted volume successfully. Jan 22 21:31:14.581767 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.coordination [None req-9c594c21-82cd-4810-bf71-472bbb889aab tempest-VolumesTransfersV355Test-572049783 None] Lock "b'cinder-80f51f10-2b48-4dc2-bd17-2936d865412b-delete_volume'" released by "delete_volume" :: held 6.931s {{(pid=129952) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 22 21:31:22.252815 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.flows.manager.create_volume [None req-1a10b2ac-d8b8-40bd-979b-7193aea34158 tempest-VolumesNegativeTest-1107392943 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129952) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Jan 22 21:31:22.256641 ncdv-master-1 cinder-volume[129952]: WARNING stevedore.named [None req-1a10b2ac-d8b8-40bd-979b-7193aea34158 tempest-VolumesNegativeTest-1107392943 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jan 22 21:31:22.257119 ncdv-master-1 cinder-volume[129952]: WARNING castellan.key_manager [None req-1a10b2ac-d8b8-40bd-979b-7193aea34158 tempest-VolumesNegativeTest-1107392943 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 22 21:31:22.276693 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-1a10b2ac-d8b8-40bd-979b-7193aea34158 tempest-VolumesNegativeTest-1107392943 None] Flow 'volume_create_manager' (168765fa-112a-4b69-8922-c8b902c7b418) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 22 21:31:22.283965 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-1a10b2ac-d8b8-40bd-979b-7193aea34158 tempest-VolumesNegativeTest-1107392943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a240525-cf64-4c15-a80f-7cb65b8824b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:31:22.290299 ncdv-master-1 cinder-volume[129952]: DEBUG oslo_db.sqlalchemy.engines [None req-1a10b2ac-d8b8-40bd-979b-7193aea34158 tempest-VolumesNegativeTest-1107392943 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129952) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 22 21:31:22.304338 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-1a10b2ac-d8b8-40bd-979b-7193aea34158 tempest-VolumesNegativeTest-1107392943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a240525-cf64-4c15-a80f-7cb65b8824b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-01-22T21:31:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-77376319',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=f7e7d227-a2a4-4b3e-8738-cbf03ce9e10f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e82da13b4e8649d39cfeeecdecedd458',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-01-22T21:31:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-01-22T21:31:22Z,use_quota=True,user_id='682168e54f9e446aabf66b552dffb707',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6dacb05b-a7ea-4056-85ff-98f0ea5c54eb),volume_type_id=6dacb05b-a7ea-4056-85ff-98f0ea5c54eb)' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:31:22.309818 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-1a10b2ac-d8b8-40bd-979b-7193aea34158 tempest-VolumesNegativeTest-1107392943 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4557001e-fd1f-4527-aba9-9a9e154a4777) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:31:22.314051 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-1a10b2ac-d8b8-40bd-979b-7193aea34158 tempest-VolumesNegativeTest-1107392943 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4557001e-fd1f-4527-aba9-9a9e154a4777) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:31:22.319561 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-1a10b2ac-d8b8-40bd-979b-7193aea34158 tempest-VolumesNegativeTest-1107392943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bcaf08ea-2bde-48df-a84e-22ff8e0c8f3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:31:22.323972 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-1a10b2ac-d8b8-40bd-979b-7193aea34158 tempest-VolumesNegativeTest-1107392943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bcaf08ea-2bde-48df-a84e-22ff8e0c8f3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f7e7d227-a2a4-4b3e-8738-cbf03ce9e10f', 'volume_name': 'volume-f7e7d227-a2a4-4b3e-8738-cbf03ce9e10f', 'volume_size': 1}' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:31:22.329017 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-1a10b2ac-d8b8-40bd-979b-7193aea34158 tempest-VolumesNegativeTest-1107392943 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eac8c431-4fcc-43b7-bf09-95ab25e9d5d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:31:22.333961 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-1a10b2ac-d8b8-40bd-979b-7193aea34158 tempest-VolumesNegativeTest-1107392943 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eac8c431-4fcc-43b7-bf09-95ab25e9d5d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:31:22.338769 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-1a10b2ac-d8b8-40bd-979b-7193aea34158 tempest-VolumesNegativeTest-1107392943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b594c9f6-203a-4d9c-a85d-6521b4f7cf70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:31:22.340144 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.flows.manager.create_volume [None req-1a10b2ac-d8b8-40bd-979b-7193aea34158 tempest-VolumesNegativeTest-1107392943 None] Volume f7e7d227-a2a4-4b3e-8738-cbf03ce9e10f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f7e7d227-a2a4-4b3e-8738-cbf03ce9e10f', 'volume_size': 1} Jan 22 21:31:22.340538 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-1a10b2ac-d8b8-40bd-979b-7193aea34158 tempest-VolumesNegativeTest-1107392943 None] creating volume 'volume-f7e7d227-a2a4-4b3e-8738-cbf03ce9e10f' {{(pid=129952) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Jan 22 21:31:22.341559 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-1a10b2ac-d8b8-40bd-979b-7193aea34158 tempest-VolumesNegativeTest-1107392943 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:31:22.546591 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [req-c32de7be-b3d0-4630-8c4c-8627ccdc7428 req-f9385288-3429-4dfb-9093-fb1e4c994c75 tempest-VolumesBackupsTest-1274070825 None] Terminate volume connection completed successfully. Jan 22 21:31:22.547098 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [req-c32de7be-b3d0-4630-8c4c-8627ccdc7428 req-f9385288-3429-4dfb-9093-fb1e4c994c75 tempest-VolumesBackupsTest-1274070825 None] Deleting attachment b9c0495a-88e8-4888-87ae-9f34b1a69731. {{(pid=129952) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4947}} Jan 22 21:31:23.199801 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-1a10b2ac-d8b8-40bd-979b-7193aea34158 tempest-VolumesNegativeTest-1107392943 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129952) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 22 21:31:23.200198 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-1a10b2ac-d8b8-40bd-979b-7193aea34158 tempest-VolumesNegativeTest-1107392943 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129952) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 22 21:31:23.204128 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-1a10b2ac-d8b8-40bd-979b-7193aea34158 tempest-VolumesNegativeTest-1107392943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b594c9f6-203a-4d9c-a85d-6521b4f7cf70) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f7e7d227-a2a4-4b3e-8738-cbf03ce9e10f', 'volume_size': 1}' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:31:23.209234 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-1a10b2ac-d8b8-40bd-979b-7193aea34158 tempest-VolumesNegativeTest-1107392943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (408dad7b-6051-449b-8519-4ed03db0a2c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:31:23.289676 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.flows.manager.create_volume [None req-1a10b2ac-d8b8-40bd-979b-7193aea34158 tempest-VolumesNegativeTest-1107392943 None] Volume volume-f7e7d227-a2a4-4b3e-8738-cbf03ce9e10f (f7e7d227-a2a4-4b3e-8738-cbf03ce9e10f): created successfully Jan 22 21:31:23.299638 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-1a10b2ac-d8b8-40bd-979b-7193aea34158 tempest-VolumesNegativeTest-1107392943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (408dad7b-6051-449b-8519-4ed03db0a2c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:31:23.300653 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-1a10b2ac-d8b8-40bd-979b-7193aea34158 tempest-VolumesNegativeTest-1107392943 None] Flow 'volume_create_manager' (168765fa-112a-4b69-8922-c8b902c7b418) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129952) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 22 21:31:23.399132 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-1a10b2ac-d8b8-40bd-979b-7193aea34158 tempest-VolumesNegativeTest-1107392943 None] Created volume successfully. Jan 22 21:31:27.053573 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.coordination [None req-5046b636-20b1-4fdd-9aaa-f599c331e4ef tempest-VolumesBackupsTest-1274070825 None] Lock "b'cinder-5c51668d-fc20-4f01-a879-3813357f7a73-delete_volume'" acquired by "delete_volume" :: waited 0.033s {{(pid=129952) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 22 21:31:27.204823 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-5046b636-20b1-4fdd-9aaa-f599c331e4ef tempest-VolumesBackupsTest-1274070825 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:31:28.416912 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-5046b636-20b1-4fdd-9aaa-f599c331e4ef tempest-VolumesBackupsTest-1274070825 None] Volume volume-5c51668d-fc20-4f01-a879-3813357f7a73 is not a clone. {{(pid=129952) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Jan 22 21:31:28.948217 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-5046b636-20b1-4fdd-9aaa-f599c331e4ef tempest-VolumesBackupsTest-1274070825 None] deleting rbd volume volume-5c51668d-fc20-4f01-a879-3813357f7a73 {{(pid=129952) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Jan 22 21:31:32.186468 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.quota [None req-5046b636-20b1-4fdd-9aaa-f599c331e4ef tempest-VolumesBackupsTest-1274070825 None] Created reservations ['0eed44f1-0f13-4975-ac8d-4d0f882d6823', '11640fc8-c162-455e-8050-75bdfb976681', 'ee68a061-e1b9-4daa-8337-0d96b26f723b', '6c085480-d4e7-4ed9-bb37-5212c1815f2b'] {{(pid=129952) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 22 21:31:32.388316 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-5046b636-20b1-4fdd-9aaa-f599c331e4ef tempest-VolumesBackupsTest-1274070825 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:31:32.422663 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-5046b636-20b1-4fdd-9aaa-f599c331e4ef tempest-VolumesBackupsTest-1274070825 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:31:32.476225 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.manager [None req-5046b636-20b1-4fdd-9aaa-f599c331e4ef tempest-VolumesBackupsTest-1274070825 None] Notifying Schedulers of capabilities ... {{(pid=129952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 22 21:31:32.480953 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-5046b636-20b1-4fdd-9aaa-f599c331e4ef tempest-VolumesBackupsTest-1274070825 None] Deleted volume successfully. Jan 22 21:31:32.552735 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.coordination [None req-5046b636-20b1-4fdd-9aaa-f599c331e4ef tempest-VolumesBackupsTest-1274070825 None] Lock "b'cinder-5c51668d-fc20-4f01-a879-3813357f7a73-delete_volume'" released by "delete_volume" :: held 5.499s {{(pid=129952) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 22 21:31:33.337362 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.flows.manager.create_volume [None req-c2c237de-5bea-4cdc-8c20-f4c2d9b0fb48 tempest-VolumesBackupsTest-1274070825 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129952) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Jan 22 21:31:33.340598 ncdv-master-1 cinder-volume[129952]: WARNING stevedore.named [None req-c2c237de-5bea-4cdc-8c20-f4c2d9b0fb48 tempest-VolumesBackupsTest-1274070825 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jan 22 21:31:33.341049 ncdv-master-1 cinder-volume[129952]: WARNING castellan.key_manager [None req-c2c237de-5bea-4cdc-8c20-f4c2d9b0fb48 tempest-VolumesBackupsTest-1274070825 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 22 21:31:33.361135 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-c2c237de-5bea-4cdc-8c20-f4c2d9b0fb48 tempest-VolumesBackupsTest-1274070825 None] Flow 'volume_create_manager' (cfe8a04e-c45c-4c84-bea5-8d8d031797f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 22 21:31:33.368372 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-c2c237de-5bea-4cdc-8c20-f4c2d9b0fb48 tempest-VolumesBackupsTest-1274070825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8877bce5-0d54-4f3d-8a7c-04b9a1afdfd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:31:33.374609 ncdv-master-1 cinder-volume[129952]: DEBUG oslo_db.sqlalchemy.engines [None req-c2c237de-5bea-4cdc-8c20-f4c2d9b0fb48 tempest-VolumesBackupsTest-1274070825 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129952) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 22 21:31:33.393756 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-c2c237de-5bea-4cdc-8c20-f4c2d9b0fb48 tempest-VolumesBackupsTest-1274070825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8877bce5-0d54-4f3d-8a7c-04b9a1afdfd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-01-22T21:31:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsTest-Volume-641398661',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=8ce51a79-e21d-40d7-9de1-28e5ee775236,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44f9009465234bd2b86f8525b5b212c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-01-22T21:31:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-01-22T21:31:33Z,use_quota=True,user_id='6199d0571f624eebbc985677380351fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6dacb05b-a7ea-4056-85ff-98f0ea5c54eb),volume_type_id=6dacb05b-a7ea-4056-85ff-98f0ea5c54eb)' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:31:33.399726 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-c2c237de-5bea-4cdc-8c20-f4c2d9b0fb48 tempest-VolumesBackupsTest-1274070825 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff69eb33-f738-48b6-a039-e5b568a491fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:31:33.404204 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-c2c237de-5bea-4cdc-8c20-f4c2d9b0fb48 tempest-VolumesBackupsTest-1274070825 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff69eb33-f738-48b6-a039-e5b568a491fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:31:33.410475 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-c2c237de-5bea-4cdc-8c20-f4c2d9b0fb48 tempest-VolumesBackupsTest-1274070825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (621877c8-c383-4264-bde7-a973e48797dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:31:33.496020 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-c2c237de-5bea-4cdc-8c20-f4c2d9b0fb48 tempest-VolumesBackupsTest-1274070825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (621877c8-c383-4264-bde7-a973e48797dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '8ce51a79-e21d-40d7-9de1-28e5ee775236', 'volume_name': 'volume-8ce51a79-e21d-40d7-9de1-28e5ee775236', 'volume_size': 1, 'image_id': '373cb480-3bc4-4821-93e2-442b4e852b80', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '994e8f6963f04af3be3dbae11a73cdfd', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '373cb480-3bc4-4821-93e2-442b4e852b80', 'created_at': datetime.datetime(2022, 1, 22, 20, 50, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 1, 22, 20, 50, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/373cb480-3bc4-4821-93e2-442b4e852b80/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:31:33.501210 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-c2c237de-5bea-4cdc-8c20-f4c2d9b0fb48 tempest-VolumesBackupsTest-1274070825 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b4c606d-add9-4d5f-9293-5ef75cfeaeb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:31:33.505514 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-c2c237de-5bea-4cdc-8c20-f4c2d9b0fb48 tempest-VolumesBackupsTest-1274070825 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b4c606d-add9-4d5f-9293-5ef75cfeaeb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:31:33.510447 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-c2c237de-5bea-4cdc-8c20-f4c2d9b0fb48 tempest-VolumesBackupsTest-1274070825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f23b29b-cdb6-4ea0-840f-1bbf65ebe9af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:31:33.511636 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.flows.manager.create_volume [None req-c2c237de-5bea-4cdc-8c20-f4c2d9b0fb48 tempest-VolumesBackupsTest-1274070825 None] Volume 8ce51a79-e21d-40d7-9de1-28e5ee775236: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-8ce51a79-e21d-40d7-9de1-28e5ee775236', 'volume_size': 1, 'image_id': '373cb480-3bc4-4821-93e2-442b4e852b80', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '994e8f6963f04af3be3dbae11a73cdfd', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '373cb480-3bc4-4821-93e2-442b4e852b80', 'created_at': datetime.datetime(2022, 1, 22, 20, 50, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 1, 22, 20, 50, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/373cb480-3bc4-4821-93e2-442b4e852b80/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jan 22 21:31:33.512216 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.flows.manager.create_volume [None req-c2c237de-5bea-4cdc-8c20-f4c2d9b0fb48 tempest-VolumesBackupsTest-1274070825 None] Cloning 8ce51a79-e21d-40d7-9de1-28e5ee775236 from image 373cb480-3bc4-4821-93e2-442b4e852b80 at location (None, None). {{(pid=129952) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1046}} Jan 22 21:31:33.523162 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.coordination [None req-c2c237de-5bea-4cdc-8c20-f4c2d9b0fb48 tempest-VolumesBackupsTest-1274070825 None] Lock "b'cinder-373cb480-3bc4-4821-93e2-442b4e852b80'" acquired by "_prepare_image_cache_entry" :: waited 0.010s {{(pid=129952) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 22 21:31:33.602941 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.image.cache [None req-c2c237de-5bea-4cdc-8c20-f4c2d9b0fb48 tempest-VolumesBackupsTest-1274070825 None] Found image-volume cache entry: {'id': 1, 'image_id': '373cb480-3bc4-4821-93e2-442b4e852b80', 'volume_id': 'f39c1078-cff4-40dd-93df-4ce49cd873b4', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 1, 22, 20, 50, 57), 'last_used': datetime.datetime(2022, 1, 22, 21, 31, 33, 527254)}. {{(pid=129952) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Jan 22 21:31:33.603681 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.image.cache [None req-c2c237de-5bea-4cdc-8c20-f4c2d9b0fb48 tempest-VolumesBackupsTest-1274070825 None] Image-volume cache entry image_update_at = 2022-01-22 20:50:57+00:00, requested image updated_at = 2022-01-22 20:50:57+00:00. {{(pid=129952) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Jan 22 21:31:33.604363 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.flows.manager.create_volume [None req-c2c237de-5bea-4cdc-8c20-f4c2d9b0fb48 tempest-VolumesBackupsTest-1274070825 None] Found cache entry for image = 373cb480-3bc4-4821-93e2-442b4e852b80 on host ncdv-master-1@ceph#ceph. {{(pid=129952) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:869}} Jan 22 21:31:33.609542 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.coordination [None req-c2c237de-5bea-4cdc-8c20-f4c2d9b0fb48 tempest-VolumesBackupsTest-1274070825 None] Lock "b'cinder-373cb480-3bc4-4821-93e2-442b4e852b80'" released by "_prepare_image_cache_entry" :: held 0.086s {{(pid=129952) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 22 21:31:33.610539 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.flows.manager.create_volume [None req-c2c237de-5bea-4cdc-8c20-f4c2d9b0fb48 tempest-VolumesBackupsTest-1274070825 None] Attempting to retrieve cache entry for image = 373cb480-3bc4-4821-93e2-442b4e852b80 on host ncdv-master-1@ceph#ceph. {{(pid=129952) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:810}} Jan 22 21:31:33.616576 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.image.cache [None req-c2c237de-5bea-4cdc-8c20-f4c2d9b0fb48 tempest-VolumesBackupsTest-1274070825 None] Found image-volume cache entry: {'id': 1, 'image_id': '373cb480-3bc4-4821-93e2-442b4e852b80', 'volume_id': 'f39c1078-cff4-40dd-93df-4ce49cd873b4', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 1, 22, 20, 50, 57), 'last_used': datetime.datetime(2022, 1, 22, 21, 31, 33, 614097)}. {{(pid=129952) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Jan 22 21:31:33.616985 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.image.cache [None req-c2c237de-5bea-4cdc-8c20-f4c2d9b0fb48 tempest-VolumesBackupsTest-1274070825 None] Image-volume cache entry image_update_at = 2022-01-22 20:50:57+00:00, requested image updated_at = 2022-01-22 20:50:57+00:00. {{(pid=129952) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Jan 22 21:31:33.617430 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.flows.manager.create_volume [None req-c2c237de-5bea-4cdc-8c20-f4c2d9b0fb48 tempest-VolumesBackupsTest-1274070825 None] Creating from source image-volume f39c1078-cff4-40dd-93df-4ce49cd873b4 {{(pid=129952) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:824}} Jan 22 21:31:33.638161 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-c2c237de-5bea-4cdc-8c20-f4c2d9b0fb48 tempest-VolumesBackupsTest-1274070825 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:31:33.785907 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-c2c237de-5bea-4cdc-8c20-f4c2d9b0fb48 tempest-VolumesBackupsTest-1274070825 None] creating snapshot='volume-8ce51a79-e21d-40d7-9de1-28e5ee775236.clone_snap' {{(pid=129952) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:725}} Jan 22 21:31:35.948544 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-c2c237de-5bea-4cdc-8c20-f4c2d9b0fb48 tempest-VolumesBackupsTest-1274070825 None] cloning 'volume-f39c1078-cff4-40dd-93df-4ce49cd873b4@volume-8ce51a79-e21d-40d7-9de1-28e5ee775236.clone_snap' to 'volume-8ce51a79-e21d-40d7-9de1-28e5ee775236' {{(pid=129952) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:731}} Jan 22 21:31:36.990156 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-c2c237de-5bea-4cdc-8c20-f4c2d9b0fb48 tempest-VolumesBackupsTest-1274070825 None] Volume volume-0b17e2f4-e149-4a4b-b525-3d029be2e6f6.deleted is not a clone. {{(pid=129952) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Jan 22 21:31:36.991304 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-c2c237de-5bea-4cdc-8c20-f4c2d9b0fb48 tempest-VolumesBackupsTest-1274070825 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129952) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 22 21:31:36.991687 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-c2c237de-5bea-4cdc-8c20-f4c2d9b0fb48 tempest-VolumesBackupsTest-1274070825 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129952) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 22 21:31:37.318896 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-c2c237de-5bea-4cdc-8c20-f4c2d9b0fb48 tempest-VolumesBackupsTest-1274070825 None] clone created successfully {{(pid=129952) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:803}} Jan 22 21:31:37.319544 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.volume_utils [None req-c2c237de-5bea-4cdc-8c20-f4c2d9b0fb48 tempest-VolumesBackupsTest-1274070825 None] Marking volume 8ce51a79-e21d-40d7-9de1-28e5ee775236 as bootable. {{(pid=129952) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1178}} Jan 22 21:31:37.415911 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.flows.manager.create_volume [None req-c2c237de-5bea-4cdc-8c20-f4c2d9b0fb48 tempest-VolumesBackupsTest-1274070825 None] Copying metadata from image 373cb480-3bc4-4821-93e2-442b4e852b80 to 8ce51a79-e21d-40d7-9de1-28e5ee775236. {{(pid=129952) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:443}} Jan 22 21:31:37.416401 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.flows.manager.create_volume [None req-c2c237de-5bea-4cdc-8c20-f4c2d9b0fb48 tempest-VolumesBackupsTest-1274070825 None] Creating volume glance metadata for volume 8ce51a79-e21d-40d7-9de1-28e5ee775236 backed by image 373cb480-3bc4-4821-93e2-442b4e852b80 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '373cb480-3bc4-4821-93e2-442b4e852b80', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=129952) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:666}} Jan 22 21:31:37.540359 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-c2c237de-5bea-4cdc-8c20-f4c2d9b0fb48 tempest-VolumesBackupsTest-1274070825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f23b29b-cdb6-4ea0-840f-1bbf65ebe9af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8ce51a79-e21d-40d7-9de1-28e5ee775236', 'volume_size': 1, 'image_id': '373cb480-3bc4-4821-93e2-442b4e852b80', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '994e8f6963f04af3be3dbae11a73cdfd', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '373cb480-3bc4-4821-93e2-442b4e852b80', 'created_at': datetime.datetime(2022, 1, 22, 20, 50, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 1, 22, 20, 50, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/373cb480-3bc4-4821-93e2-442b4e852b80/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:31:37.546170 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-c2c237de-5bea-4cdc-8c20-f4c2d9b0fb48 tempest-VolumesBackupsTest-1274070825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0863cee2-7a51-4022-ac75-c31b24b9f514) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:31:37.626280 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.flows.manager.create_volume [None req-c2c237de-5bea-4cdc-8c20-f4c2d9b0fb48 tempest-VolumesBackupsTest-1274070825 None] Volume volume-8ce51a79-e21d-40d7-9de1-28e5ee775236 (8ce51a79-e21d-40d7-9de1-28e5ee775236): created successfully Jan 22 21:31:37.626477 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-c2c237de-5bea-4cdc-8c20-f4c2d9b0fb48 tempest-VolumesBackupsTest-1274070825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0863cee2-7a51-4022-ac75-c31b24b9f514) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:31:37.632528 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-c2c237de-5bea-4cdc-8c20-f4c2d9b0fb48 tempest-VolumesBackupsTest-1274070825 None] Flow 'volume_create_manager' (cfe8a04e-c45c-4c84-bea5-8d8d031797f5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129952) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 22 21:31:37.695911 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-c2c237de-5bea-4cdc-8c20-f4c2d9b0fb48 tempest-VolumesBackupsTest-1274070825 None] Created volume successfully. Jan 22 21:31:39.255734 ncdv-master-1 cinder-volume[129952]: DEBUG oslo_concurrency.processutils [None req-3e219e5f-9d24-4df4-a147-fdc234cd5f9c tempest-VolumesBackupsTest-1274070825 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129952) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jan 22 21:31:40.042798 ncdv-master-1 cinder-volume[129952]: DEBUG oslo_concurrency.processutils [None req-3e219e5f-9d24-4df4-a147-fdc234cd5f9c tempest-VolumesBackupsTest-1274070825 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.787s {{(pid=129952) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jan 22 21:31:40.043560 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-3e219e5f-9d24-4df4-a147-fdc234cd5f9c tempest-VolumesBackupsTest-1274070825 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-8ce51a79-e21d-40d7-9de1-28e5ee775236', 'hosts': ['10.222.0.100'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'c7ee930a-3b87-450e-91f6-d4eef70cb484', 'volume_id': '8ce51a79-e21d-40d7-9de1-28e5ee775236', 'discard': True}} {{(pid=129952) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Jan 22 21:31:40.059816 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-3e219e5f-9d24-4df4-a147-fdc234cd5f9c tempest-VolumesBackupsTest-1274070825 None] Initialize volume connection completed successfully. Jan 22 21:31:50.526723 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.coordination [None req-db733b9e-d7c2-4aef-b254-72f6fef65a4a tempest-VolumesNegativeTest-1107392943 None] Lock "b'cinder-f7e7d227-a2a4-4b3e-8738-cbf03ce9e10f-delete_volume'" acquired by "delete_volume" :: waited 0.012s {{(pid=129952) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 22 21:31:50.675434 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-db733b9e-d7c2-4aef-b254-72f6fef65a4a tempest-VolumesNegativeTest-1107392943 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:31:51.324822 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-db733b9e-d7c2-4aef-b254-72f6fef65a4a tempest-VolumesNegativeTest-1107392943 None] volume has no backup snaps {{(pid=129952) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Jan 22 21:31:51.325192 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-db733b9e-d7c2-4aef-b254-72f6fef65a4a tempest-VolumesNegativeTest-1107392943 None] Volume volume-f7e7d227-a2a4-4b3e-8738-cbf03ce9e10f is not a clone. {{(pid=129952) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Jan 22 21:31:51.680099 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-db733b9e-d7c2-4aef-b254-72f6fef65a4a tempest-VolumesNegativeTest-1107392943 None] deleting rbd volume volume-f7e7d227-a2a4-4b3e-8738-cbf03ce9e10f {{(pid=129952) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Jan 22 21:32:01.561366 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.quota [None req-db733b9e-d7c2-4aef-b254-72f6fef65a4a tempest-VolumesNegativeTest-1107392943 None] Created reservations ['93c73831-15f2-431b-99a4-cc0c1201b293', 'fab7d8ed-ea17-4aa1-a956-c3d9f0441be5', '5db2b80b-a709-4180-9c19-e9bd28590d85', '1e10e43b-2a16-47f4-80c3-0efdea24f3da'] {{(pid=129952) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 22 21:32:01.777068 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-db733b9e-d7c2-4aef-b254-72f6fef65a4a tempest-VolumesNegativeTest-1107392943 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:32:01.808330 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-db733b9e-d7c2-4aef-b254-72f6fef65a4a tempest-VolumesNegativeTest-1107392943 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:32:01.831788 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.manager [None req-db733b9e-d7c2-4aef-b254-72f6fef65a4a tempest-VolumesNegativeTest-1107392943 None] Notifying Schedulers of capabilities ... {{(pid=129952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 22 21:32:01.836129 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-db733b9e-d7c2-4aef-b254-72f6fef65a4a tempest-VolumesNegativeTest-1107392943 None] Deleted volume successfully. Jan 22 21:32:01.924057 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.coordination [None req-db733b9e-d7c2-4aef-b254-72f6fef65a4a tempest-VolumesNegativeTest-1107392943 None] Lock "b'cinder-f7e7d227-a2a4-4b3e-8738-cbf03ce9e10f-delete_volume'" released by "delete_volume" :: held 11.397s {{(pid=129952) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 22 21:32:07.115200 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.flows.manager.create_volume [None req-7591114f-5537-4c77-bf06-ead1e924f8c2 tempest-VolumesSnapshotTestJSON-664893185 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129952) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Jan 22 21:32:07.119887 ncdv-master-1 cinder-volume[129952]: WARNING stevedore.named [None req-7591114f-5537-4c77-bf06-ead1e924f8c2 tempest-VolumesSnapshotTestJSON-664893185 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jan 22 21:32:07.120408 ncdv-master-1 cinder-volume[129952]: WARNING castellan.key_manager [None req-7591114f-5537-4c77-bf06-ead1e924f8c2 tempest-VolumesSnapshotTestJSON-664893185 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 22 21:32:07.150222 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-7591114f-5537-4c77-bf06-ead1e924f8c2 tempest-VolumesSnapshotTestJSON-664893185 None] Flow 'volume_create_manager' (90784037-7662-4b9d-8620-3abedc5334a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 22 21:32:07.157497 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-7591114f-5537-4c77-bf06-ead1e924f8c2 tempest-VolumesSnapshotTestJSON-664893185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (baf712eb-7e8e-4c1f-9dd8-944f97b1dd02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:32:07.165354 ncdv-master-1 cinder-volume[129952]: DEBUG oslo_db.sqlalchemy.engines [None req-7591114f-5537-4c77-bf06-ead1e924f8c2 tempest-VolumesSnapshotTestJSON-664893185 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129952) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 22 21:32:07.182365 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-7591114f-5537-4c77-bf06-ead1e924f8c2 tempest-VolumesSnapshotTestJSON-664893185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (baf712eb-7e8e-4c1f-9dd8-944f97b1dd02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-01-22T21:32:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-249156207',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=f6238c78-261a-421a-b7a2-43273813620f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='037b801bacb742d89e5ea8f5e59ec7b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-01-22T21:32:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-01-22T21:32:07Z,use_quota=True,user_id='912fa15040dc442fa281a72320a10dc5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6dacb05b-a7ea-4056-85ff-98f0ea5c54eb),volume_type_id=6dacb05b-a7ea-4056-85ff-98f0ea5c54eb)' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:32:07.188651 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-7591114f-5537-4c77-bf06-ead1e924f8c2 tempest-VolumesSnapshotTestJSON-664893185 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1da0dcd-9f7d-4619-8024-440549e34a08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:32:07.194525 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-7591114f-5537-4c77-bf06-ead1e924f8c2 tempest-VolumesSnapshotTestJSON-664893185 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1da0dcd-9f7d-4619-8024-440549e34a08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:32:07.200167 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-7591114f-5537-4c77-bf06-ead1e924f8c2 tempest-VolumesSnapshotTestJSON-664893185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fafd1eae-b7ad-422e-8551-371f08f3b378) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:32:07.204751 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-7591114f-5537-4c77-bf06-ead1e924f8c2 tempest-VolumesSnapshotTestJSON-664893185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fafd1eae-b7ad-422e-8551-371f08f3b378) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f6238c78-261a-421a-b7a2-43273813620f', 'volume_name': 'volume-f6238c78-261a-421a-b7a2-43273813620f', 'volume_size': 1}' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:32:07.210530 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-7591114f-5537-4c77-bf06-ead1e924f8c2 tempest-VolumesSnapshotTestJSON-664893185 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06eb7ef4-ae48-4665-a880-2d340b7bf146) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:32:07.214862 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-7591114f-5537-4c77-bf06-ead1e924f8c2 tempest-VolumesSnapshotTestJSON-664893185 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06eb7ef4-ae48-4665-a880-2d340b7bf146) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:32:07.219866 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-7591114f-5537-4c77-bf06-ead1e924f8c2 tempest-VolumesSnapshotTestJSON-664893185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0c8441b-f2fd-466f-a240-6f44cc3370af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:32:07.221179 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.flows.manager.create_volume [None req-7591114f-5537-4c77-bf06-ead1e924f8c2 tempest-VolumesSnapshotTestJSON-664893185 None] Volume f6238c78-261a-421a-b7a2-43273813620f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f6238c78-261a-421a-b7a2-43273813620f', 'volume_size': 1} Jan 22 21:32:07.221657 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-7591114f-5537-4c77-bf06-ead1e924f8c2 tempest-VolumesSnapshotTestJSON-664893185 None] creating volume 'volume-f6238c78-261a-421a-b7a2-43273813620f' {{(pid=129952) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Jan 22 21:32:07.222729 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-7591114f-5537-4c77-bf06-ead1e924f8c2 tempest-VolumesSnapshotTestJSON-664893185 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:32:09.062872 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-7591114f-5537-4c77-bf06-ead1e924f8c2 tempest-VolumesSnapshotTestJSON-664893185 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129952) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 22 21:32:09.063513 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-7591114f-5537-4c77-bf06-ead1e924f8c2 tempest-VolumesSnapshotTestJSON-664893185 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129952) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 22 21:32:09.067912 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-7591114f-5537-4c77-bf06-ead1e924f8c2 tempest-VolumesSnapshotTestJSON-664893185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0c8441b-f2fd-466f-a240-6f44cc3370af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f6238c78-261a-421a-b7a2-43273813620f', 'volume_size': 1}' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:32:09.072760 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-7591114f-5537-4c77-bf06-ead1e924f8c2 tempest-VolumesSnapshotTestJSON-664893185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (256b7a3f-b8d3-446b-909d-13704c1fd813) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:32:09.118929 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.flows.manager.create_volume [None req-7591114f-5537-4c77-bf06-ead1e924f8c2 tempest-VolumesSnapshotTestJSON-664893185 None] Volume volume-f6238c78-261a-421a-b7a2-43273813620f (f6238c78-261a-421a-b7a2-43273813620f): created successfully Jan 22 21:32:09.122738 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-7591114f-5537-4c77-bf06-ead1e924f8c2 tempest-VolumesSnapshotTestJSON-664893185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (256b7a3f-b8d3-446b-909d-13704c1fd813) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:32:09.128427 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-7591114f-5537-4c77-bf06-ead1e924f8c2 tempest-VolumesSnapshotTestJSON-664893185 None] Flow 'volume_create_manager' (90784037-7662-4b9d-8620-3abedc5334a2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129952) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 22 21:32:09.210639 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-7591114f-5537-4c77-bf06-ead1e924f8c2 tempest-VolumesSnapshotTestJSON-664893185 None] Created volume successfully. Jan 22 21:32:09.791128 ncdv-master-1 cinder-volume[129952]: DEBUG oslo_service.periodic_task [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129952) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jan 22 21:32:09.792164 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:32:09.819298 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:32:09.844407 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.manager [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] Notifying Schedulers of capabilities ... {{(pid=129952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 22 21:32:11.034282 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-aefb21c1-5b28-4b9c-99ea-0332a096dd38 tempest-VolumesSnapshotTestJSON-664893185 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:32:16.660858 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-aefb21c1-5b28-4b9c-99ea-0332a096dd38 tempest-VolumesSnapshotTestJSON-664893185 None] Create snapshot completed successfully Jan 22 21:32:17.675678 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.driver [None req-b2de814d-2e8d-4c28-a9aa-830f188a0e41 tempest-VolumesSnapshotTestJSON-664893185 None] Creating a new backup for volume volume-f6238c78-261a-421a-b7a2-43273813620f. {{(pid=129952) _get_backup_volume_temp_volume /opt/stack/cinder/cinder/volume/driver.py:1226}} Jan 22 21:32:17.767878 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-b2de814d-2e8d-4c28-a9aa-830f188a0e41 tempest-VolumesSnapshotTestJSON-664893185 None] cloning volumes/volume-f6238c78-261a-421a-b7a2-43273813620f@snapshot-7c63570e-c956-483e-9263-a774676c22d8 to volume-6d37bad7-ecfe-4e0a-a976-2471b21418e9 {{(pid=129952) _clone /opt/stack/cinder/cinder/volume/drivers/rbd.py:1028}} Jan 22 21:32:17.767878 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-b2de814d-2e8d-4c28-a9aa-830f188a0e41 tempest-VolumesSnapshotTestJSON-664893185 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:32:17.972617 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-b2de814d-2e8d-4c28-a9aa-830f188a0e41 tempest-VolumesSnapshotTestJSON-664893185 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:32:20.700716 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-b2de814d-2e8d-4c28-a9aa-830f188a0e41 tempest-VolumesSnapshotTestJSON-664893185 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129952) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 22 21:32:20.701467 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-b2de814d-2e8d-4c28-a9aa-830f188a0e41 tempest-VolumesSnapshotTestJSON-664893185 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129952) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 22 21:32:20.868833 ncdv-master-1 cinder-volume[129952]: DEBUG oslo_concurrency.processutils [None req-b2de814d-2e8d-4c28-a9aa-830f188a0e41 tempest-VolumesSnapshotTestJSON-664893185 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129952) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jan 22 21:32:21.616046 ncdv-master-1 cinder-volume[129952]: DEBUG oslo_concurrency.processutils [None req-b2de814d-2e8d-4c28-a9aa-830f188a0e41 tempest-VolumesSnapshotTestJSON-664893185 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.746s {{(pid=129952) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jan 22 21:32:21.616977 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-b2de814d-2e8d-4c28-a9aa-830f188a0e41 tempest-VolumesSnapshotTestJSON-664893185 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-6d37bad7-ecfe-4e0a-a976-2471b21418e9', 'hosts': ['10.222.0.100'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'c7ee930a-3b87-450e-91f6-d4eef70cb484', 'volume_id': '6d37bad7-ecfe-4e0a-a976-2471b21418e9', 'discard': True}} {{(pid=129952) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Jan 22 21:32:21.632926 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-b2de814d-2e8d-4c28-a9aa-830f188a0e41 tempest-VolumesSnapshotTestJSON-664893185 None] Initialize volume connection completed successfully. Jan 22 21:32:28.486466 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.flows.manager.create_volume [None req-7b281f27-71d6-4901-b2a9-b2ff123bcbc3 tempest-VolumeQuotasNegativeTestJSON-1857062978 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129952) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Jan 22 21:32:28.490335 ncdv-master-1 cinder-volume[129952]: WARNING stevedore.named [None req-7b281f27-71d6-4901-b2a9-b2ff123bcbc3 tempest-VolumeQuotasNegativeTestJSON-1857062978 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jan 22 21:32:28.490825 ncdv-master-1 cinder-volume[129952]: WARNING castellan.key_manager [None req-7b281f27-71d6-4901-b2a9-b2ff123bcbc3 tempest-VolumeQuotasNegativeTestJSON-1857062978 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 22 21:32:28.511748 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-7b281f27-71d6-4901-b2a9-b2ff123bcbc3 tempest-VolumeQuotasNegativeTestJSON-1857062978 None] Flow 'volume_create_manager' (4724889b-e27e-4b2d-9a27-66ee36779556) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 22 21:32:28.519464 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-7b281f27-71d6-4901-b2a9-b2ff123bcbc3 tempest-VolumeQuotasNegativeTestJSON-1857062978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82653757-a541-4b78-a47c-d148e3a0e785) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:32:28.526616 ncdv-master-1 cinder-volume[129952]: DEBUG oslo_db.sqlalchemy.engines [None req-7b281f27-71d6-4901-b2a9-b2ff123bcbc3 tempest-VolumeQuotasNegativeTestJSON-1857062978 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129952) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 22 21:32:28.542275 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-7b281f27-71d6-4901-b2a9-b2ff123bcbc3 tempest-VolumeQuotasNegativeTestJSON-1857062978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82653757-a541-4b78-a47c-d148e3a0e785) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-01-22T21:32:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-252195949',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=577163e8-5a81-4667-818f-c93980e191d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='014fc54f4dc74d8caaed250bba01a668',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-01-22T21:32:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-01-22T21:32:28Z,use_quota=True,user_id='4e78d6abd8c3434197ec529d527cf2d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6dacb05b-a7ea-4056-85ff-98f0ea5c54eb),volume_type_id=6dacb05b-a7ea-4056-85ff-98f0ea5c54eb)' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:32:28.547899 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-7b281f27-71d6-4901-b2a9-b2ff123bcbc3 tempest-VolumeQuotasNegativeTestJSON-1857062978 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (310901e7-9dad-4eea-a99f-af4b56f5e54c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:32:28.552128 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-7b281f27-71d6-4901-b2a9-b2ff123bcbc3 tempest-VolumeQuotasNegativeTestJSON-1857062978 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (310901e7-9dad-4eea-a99f-af4b56f5e54c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:32:28.558014 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-7b281f27-71d6-4901-b2a9-b2ff123bcbc3 tempest-VolumeQuotasNegativeTestJSON-1857062978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a65bbba-cde5-4758-a346-00d510900107) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:32:28.562356 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-7b281f27-71d6-4901-b2a9-b2ff123bcbc3 tempest-VolumeQuotasNegativeTestJSON-1857062978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a65bbba-cde5-4758-a346-00d510900107) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '577163e8-5a81-4667-818f-c93980e191d3', 'volume_name': 'volume-577163e8-5a81-4667-818f-c93980e191d3', 'volume_size': 1}' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:32:28.567353 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-7b281f27-71d6-4901-b2a9-b2ff123bcbc3 tempest-VolumeQuotasNegativeTestJSON-1857062978 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (522ef0e5-4de8-4ec2-a14b-5c99af6682f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:32:28.571567 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-7b281f27-71d6-4901-b2a9-b2ff123bcbc3 tempest-VolumeQuotasNegativeTestJSON-1857062978 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (522ef0e5-4de8-4ec2-a14b-5c99af6682f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:32:28.576388 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-7b281f27-71d6-4901-b2a9-b2ff123bcbc3 tempest-VolumeQuotasNegativeTestJSON-1857062978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cbb24bf7-c557-437b-a915-f10c30d6c3b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:32:28.577464 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.flows.manager.create_volume [None req-7b281f27-71d6-4901-b2a9-b2ff123bcbc3 tempest-VolumeQuotasNegativeTestJSON-1857062978 None] Volume 577163e8-5a81-4667-818f-c93980e191d3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-577163e8-5a81-4667-818f-c93980e191d3', 'volume_size': 1} Jan 22 21:32:28.577889 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-7b281f27-71d6-4901-b2a9-b2ff123bcbc3 tempest-VolumeQuotasNegativeTestJSON-1857062978 None] creating volume 'volume-577163e8-5a81-4667-818f-c93980e191d3' {{(pid=129952) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Jan 22 21:32:28.578976 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-7b281f27-71d6-4901-b2a9-b2ff123bcbc3 tempest-VolumeQuotasNegativeTestJSON-1857062978 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:32:30.757353 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-7b281f27-71d6-4901-b2a9-b2ff123bcbc3 tempest-VolumeQuotasNegativeTestJSON-1857062978 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129952) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 22 21:32:30.758201 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-7b281f27-71d6-4901-b2a9-b2ff123bcbc3 tempest-VolumeQuotasNegativeTestJSON-1857062978 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129952) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 22 21:32:30.762115 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-7b281f27-71d6-4901-b2a9-b2ff123bcbc3 tempest-VolumeQuotasNegativeTestJSON-1857062978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cbb24bf7-c557-437b-a915-f10c30d6c3b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-577163e8-5a81-4667-818f-c93980e191d3', 'volume_size': 1}' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:32:30.766931 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-7b281f27-71d6-4901-b2a9-b2ff123bcbc3 tempest-VolumeQuotasNegativeTestJSON-1857062978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81f14497-6f07-4fc4-8920-791a4ea7758b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:32:30.839080 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.flows.manager.create_volume [None req-7b281f27-71d6-4901-b2a9-b2ff123bcbc3 tempest-VolumeQuotasNegativeTestJSON-1857062978 None] Volume volume-577163e8-5a81-4667-818f-c93980e191d3 (577163e8-5a81-4667-818f-c93980e191d3): created successfully Jan 22 21:32:30.843191 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-7b281f27-71d6-4901-b2a9-b2ff123bcbc3 tempest-VolumeQuotasNegativeTestJSON-1857062978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81f14497-6f07-4fc4-8920-791a4ea7758b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:32:30.848945 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-7b281f27-71d6-4901-b2a9-b2ff123bcbc3 tempest-VolumeQuotasNegativeTestJSON-1857062978 None] Flow 'volume_create_manager' (4724889b-e27e-4b2d-9a27-66ee36779556) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129952) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 22 21:32:30.918811 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-7b281f27-71d6-4901-b2a9-b2ff123bcbc3 tempest-VolumeQuotasNegativeTestJSON-1857062978 None] Created volume successfully. Jan 22 21:32:32.629759 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.coordination [None req-f79511b8-d5d9-4994-82a9-dc49ce3d35f0 tempest-VolumeQuotasNegativeTestJSON-1857062978 None] Lock "b'cinder-577163e8-5a81-4667-818f-c93980e191d3-delete_volume'" acquired by "delete_volume" :: waited 0.009s {{(pid=129952) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 22 21:32:32.709596 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-f79511b8-d5d9-4994-82a9-dc49ce3d35f0 tempest-VolumeQuotasNegativeTestJSON-1857062978 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:32:33.091210 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-f79511b8-d5d9-4994-82a9-dc49ce3d35f0 tempest-VolumeQuotasNegativeTestJSON-1857062978 None] volume has no backup snaps {{(pid=129952) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Jan 22 21:32:33.091675 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-f79511b8-d5d9-4994-82a9-dc49ce3d35f0 tempest-VolumeQuotasNegativeTestJSON-1857062978 None] Volume volume-577163e8-5a81-4667-818f-c93980e191d3 is not a clone. {{(pid=129952) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Jan 22 21:32:33.342149 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-f79511b8-d5d9-4994-82a9-dc49ce3d35f0 tempest-VolumeQuotasNegativeTestJSON-1857062978 None] deleting rbd volume volume-577163e8-5a81-4667-818f-c93980e191d3 {{(pid=129952) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Jan 22 21:32:33.357285 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-3e219e5f-9d24-4df4-a147-fdc234cd5f9c tempest-VolumesBackupsTest-1274070825 None] Terminate volume connection completed successfully. Jan 22 21:32:33.373990 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-3e219e5f-9d24-4df4-a147-fdc234cd5f9c tempest-VolumesBackupsTest-1274070825 None] Remove volume export completed successfully. Jan 22 21:32:35.280675 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.flows.manager.create_volume [None req-d04bb3e9-455d-414b-af61-94c87fe4b1ad tempest-VolumesBackupsTest-1274070825 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129952) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Jan 22 21:32:35.284282 ncdv-master-1 cinder-volume[129952]: WARNING stevedore.named [None req-d04bb3e9-455d-414b-af61-94c87fe4b1ad tempest-VolumesBackupsTest-1274070825 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jan 22 21:32:35.284825 ncdv-master-1 cinder-volume[129952]: WARNING castellan.key_manager [None req-d04bb3e9-455d-414b-af61-94c87fe4b1ad tempest-VolumesBackupsTest-1274070825 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 22 21:32:35.305099 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-d04bb3e9-455d-414b-af61-94c87fe4b1ad tempest-VolumesBackupsTest-1274070825 None] Flow 'volume_create_manager' (c4d21f1c-424c-4a38-9a04-d7a34e1240bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 22 21:32:35.311692 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-d04bb3e9-455d-414b-af61-94c87fe4b1ad tempest-VolumesBackupsTest-1274070825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0fdfab53-cd4a-413e-ab81-5393e8f8702f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:32:35.318257 ncdv-master-1 cinder-volume[129952]: DEBUG oslo_db.sqlalchemy.engines [None req-d04bb3e9-455d-414b-af61-94c87fe4b1ad tempest-VolumesBackupsTest-1274070825 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129952) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 22 21:32:35.335440 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-d04bb3e9-455d-414b-af61-94c87fe4b1ad tempest-VolumesBackupsTest-1274070825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0fdfab53-cd4a-413e-ab81-5393e8f8702f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-01-22T21:32:35Z,deleted=False,deleted_at=None,display_description='auto-created_from_restore_from_backup',display_name='restore_backup_2f5b12fd-27aa-456a-9138-a7d22a5a9d91',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=ac9572a9-a61b-4baa-bd8e-fe21c648011a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44f9009465234bd2b86f8525b5b212c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-01-22T21:32:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-01-22T21:32:35Z,use_quota=True,user_id='6199d0571f624eebbc985677380351fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6dacb05b-a7ea-4056-85ff-98f0ea5c54eb),volume_type_id=6dacb05b-a7ea-4056-85ff-98f0ea5c54eb)' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:32:35.341894 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-d04bb3e9-455d-414b-af61-94c87fe4b1ad tempest-VolumesBackupsTest-1274070825 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef0e3bf1-f123-4eeb-a0ff-f49e2b39e6a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:32:35.346170 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-d04bb3e9-455d-414b-af61-94c87fe4b1ad tempest-VolumesBackupsTest-1274070825 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef0e3bf1-f123-4eeb-a0ff-f49e2b39e6a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:32:35.351537 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-d04bb3e9-455d-414b-af61-94c87fe4b1ad tempest-VolumesBackupsTest-1274070825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e262f4dd-f21b-4ee9-b6d6-9879e9381a01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:32:35.356047 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-d04bb3e9-455d-414b-af61-94c87fe4b1ad tempest-VolumesBackupsTest-1274070825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e262f4dd-f21b-4ee9-b6d6-9879e9381a01) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ac9572a9-a61b-4baa-bd8e-fe21c648011a', 'volume_name': 'volume-ac9572a9-a61b-4baa-bd8e-fe21c648011a', 'volume_size': 1}' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:32:35.361338 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-d04bb3e9-455d-414b-af61-94c87fe4b1ad tempest-VolumesBackupsTest-1274070825 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (708703c3-b94b-40a8-95e3-00147943fec0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:32:35.365541 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-d04bb3e9-455d-414b-af61-94c87fe4b1ad tempest-VolumesBackupsTest-1274070825 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (708703c3-b94b-40a8-95e3-00147943fec0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:32:35.370803 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-d04bb3e9-455d-414b-af61-94c87fe4b1ad tempest-VolumesBackupsTest-1274070825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cbab23b3-932b-4f55-bc6a-9a30927b34f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:32:35.371964 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.flows.manager.create_volume [None req-d04bb3e9-455d-414b-af61-94c87fe4b1ad tempest-VolumesBackupsTest-1274070825 None] Volume ac9572a9-a61b-4baa-bd8e-fe21c648011a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ac9572a9-a61b-4baa-bd8e-fe21c648011a', 'volume_size': 1} Jan 22 21:32:35.372365 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-d04bb3e9-455d-414b-af61-94c87fe4b1ad tempest-VolumesBackupsTest-1274070825 None] creating volume 'volume-ac9572a9-a61b-4baa-bd8e-fe21c648011a' {{(pid=129952) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Jan 22 21:32:35.373363 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-d04bb3e9-455d-414b-af61-94c87fe4b1ad tempest-VolumesBackupsTest-1274070825 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:32:36.874426 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-d04bb3e9-455d-414b-af61-94c87fe4b1ad tempest-VolumesBackupsTest-1274070825 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129952) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 22 21:32:36.875046 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-d04bb3e9-455d-414b-af61-94c87fe4b1ad tempest-VolumesBackupsTest-1274070825 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129952) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 22 21:32:36.878646 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-d04bb3e9-455d-414b-af61-94c87fe4b1ad tempest-VolumesBackupsTest-1274070825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cbab23b3-932b-4f55-bc6a-9a30927b34f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ac9572a9-a61b-4baa-bd8e-fe21c648011a', 'volume_size': 1}' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:32:36.884206 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-d04bb3e9-455d-414b-af61-94c87fe4b1ad tempest-VolumesBackupsTest-1274070825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (183c67fc-8bf7-41d5-9b12-68d0eb79fbdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:32:36.943054 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.flows.manager.create_volume [None req-d04bb3e9-455d-414b-af61-94c87fe4b1ad tempest-VolumesBackupsTest-1274070825 None] Volume volume-ac9572a9-a61b-4baa-bd8e-fe21c648011a (ac9572a9-a61b-4baa-bd8e-fe21c648011a): created successfully Jan 22 21:32:36.946299 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-d04bb3e9-455d-414b-af61-94c87fe4b1ad tempest-VolumesBackupsTest-1274070825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (183c67fc-8bf7-41d5-9b12-68d0eb79fbdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:32:36.952266 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-d04bb3e9-455d-414b-af61-94c87fe4b1ad tempest-VolumesBackupsTest-1274070825 None] Flow 'volume_create_manager' (c4d21f1c-424c-4a38-9a04-d7a34e1240bb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129952) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 22 21:32:37.044358 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-d04bb3e9-455d-414b-af61-94c87fe4b1ad tempest-VolumesBackupsTest-1274070825 None] Created volume successfully. Jan 22 21:32:37.351392 ncdv-master-1 cinder-volume[129952]: DEBUG oslo_concurrency.processutils [None req-d04bb3e9-455d-414b-af61-94c87fe4b1ad tempest-VolumesBackupsTest-1274070825 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129952) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jan 22 21:32:38.018908 ncdv-master-1 cinder-volume[129952]: DEBUG oslo_concurrency.processutils [None req-d04bb3e9-455d-414b-af61-94c87fe4b1ad tempest-VolumesBackupsTest-1274070825 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.667s {{(pid=129952) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jan 22 21:32:38.019712 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-d04bb3e9-455d-414b-af61-94c87fe4b1ad tempest-VolumesBackupsTest-1274070825 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-ac9572a9-a61b-4baa-bd8e-fe21c648011a', 'hosts': ['10.222.0.100'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'c7ee930a-3b87-450e-91f6-d4eef70cb484', 'volume_id': 'ac9572a9-a61b-4baa-bd8e-fe21c648011a', 'discard': True}} {{(pid=129952) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Jan 22 21:32:38.036880 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-d04bb3e9-455d-414b-af61-94c87fe4b1ad tempest-VolumesBackupsTest-1274070825 None] Initialize volume connection completed successfully. Jan 22 21:32:42.210636 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.quota [None req-f79511b8-d5d9-4994-82a9-dc49ce3d35f0 tempest-VolumeQuotasNegativeTestJSON-1857062978 None] Created reservations ['f92dc884-cfa4-43e5-b235-967dcfba8e5c', 'f9969a26-3f6a-42b9-b31b-a33e34e0442f', 'eb84b41e-ec97-4565-a73c-2feb28f3a368', 'd4aef3d6-4f7f-4986-b4f9-bf02580440ae'] {{(pid=129952) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 22 21:32:42.411150 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-f79511b8-d5d9-4994-82a9-dc49ce3d35f0 tempest-VolumeQuotasNegativeTestJSON-1857062978 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:32:42.434860 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-f79511b8-d5d9-4994-82a9-dc49ce3d35f0 tempest-VolumeQuotasNegativeTestJSON-1857062978 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:32:42.459848 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.manager [None req-f79511b8-d5d9-4994-82a9-dc49ce3d35f0 tempest-VolumeQuotasNegativeTestJSON-1857062978 None] Notifying Schedulers of capabilities ... {{(pid=129952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 22 21:32:42.464570 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-f79511b8-d5d9-4994-82a9-dc49ce3d35f0 tempest-VolumeQuotasNegativeTestJSON-1857062978 None] Deleted volume successfully. Jan 22 21:32:42.540971 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.coordination [None req-f79511b8-d5d9-4994-82a9-dc49ce3d35f0 tempest-VolumeQuotasNegativeTestJSON-1857062978 None] Lock "b'cinder-577163e8-5a81-4667-818f-c93980e191d3-delete_volume'" released by "delete_volume" :: held 9.911s {{(pid=129952) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 22 21:32:53.006762 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.flows.manager.create_volume [None req-cbd38d25-49cd-451f-8e01-72a45f3d1f9f tempest-VolumesListAdminTestJSON-1180040031 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129952) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Jan 22 21:32:53.010390 ncdv-master-1 cinder-volume[129952]: WARNING stevedore.named [None req-cbd38d25-49cd-451f-8e01-72a45f3d1f9f tempest-VolumesListAdminTestJSON-1180040031 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jan 22 21:32:53.011019 ncdv-master-1 cinder-volume[129952]: WARNING castellan.key_manager [None req-cbd38d25-49cd-451f-8e01-72a45f3d1f9f tempest-VolumesListAdminTestJSON-1180040031 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 22 21:32:53.037173 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-cbd38d25-49cd-451f-8e01-72a45f3d1f9f tempest-VolumesListAdminTestJSON-1180040031 None] Flow 'volume_create_manager' (3fa79ae3-40cf-4ec0-84bb-6b1b4944f7a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 22 21:32:53.040121 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-cbd38d25-49cd-451f-8e01-72a45f3d1f9f tempest-VolumesListAdminTestJSON-1180040031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (968edae7-97f8-4d18-95db-ccba70353850) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:32:53.046612 ncdv-master-1 cinder-volume[129952]: DEBUG oslo_db.sqlalchemy.engines [None req-cbd38d25-49cd-451f-8e01-72a45f3d1f9f tempest-VolumesListAdminTestJSON-1180040031 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129952) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 22 21:32:53.062147 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-cbd38d25-49cd-451f-8e01-72a45f3d1f9f tempest-VolumesListAdminTestJSON-1180040031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (968edae7-97f8-4d18-95db-ccba70353850) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-01-22T21:32:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1876746664',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=4db65b6d-a523-47b9-b6ae-039d53155529,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f22cb8ef9fc4dac9a2a5bebe21b82ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-01-22T21:32:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-01-22T21:32:53Z,use_quota=True,user_id='145e101171d5480d887c68f8ac8be508',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6dacb05b-a7ea-4056-85ff-98f0ea5c54eb),volume_type_id=6dacb05b-a7ea-4056-85ff-98f0ea5c54eb)' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:32:53.076947 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-cbd38d25-49cd-451f-8e01-72a45f3d1f9f tempest-VolumesListAdminTestJSON-1180040031 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (862d1e1b-8d8e-479f-8255-dc8d1f2b1f8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:32:53.076947 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-cbd38d25-49cd-451f-8e01-72a45f3d1f9f tempest-VolumesListAdminTestJSON-1180040031 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (862d1e1b-8d8e-479f-8255-dc8d1f2b1f8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:32:53.077743 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-cbd38d25-49cd-451f-8e01-72a45f3d1f9f tempest-VolumesListAdminTestJSON-1180040031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c7fb3ff-312e-4436-9d03-adb36e05d7b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:32:53.082004 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-cbd38d25-49cd-451f-8e01-72a45f3d1f9f tempest-VolumesListAdminTestJSON-1180040031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c7fb3ff-312e-4436-9d03-adb36e05d7b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4db65b6d-a523-47b9-b6ae-039d53155529', 'volume_name': 'volume-4db65b6d-a523-47b9-b6ae-039d53155529', 'volume_size': 1}' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:32:53.087131 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-cbd38d25-49cd-451f-8e01-72a45f3d1f9f tempest-VolumesListAdminTestJSON-1180040031 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80df0256-d004-449b-986f-5b614c6722f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:32:53.091311 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-cbd38d25-49cd-451f-8e01-72a45f3d1f9f tempest-VolumesListAdminTestJSON-1180040031 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80df0256-d004-449b-986f-5b614c6722f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:32:53.096188 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-cbd38d25-49cd-451f-8e01-72a45f3d1f9f tempest-VolumesListAdminTestJSON-1180040031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad14f8b2-900a-403d-b221-eb768226c789) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:32:53.097279 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.flows.manager.create_volume [None req-cbd38d25-49cd-451f-8e01-72a45f3d1f9f tempest-VolumesListAdminTestJSON-1180040031 None] Volume 4db65b6d-a523-47b9-b6ae-039d53155529: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4db65b6d-a523-47b9-b6ae-039d53155529', 'volume_size': 1} Jan 22 21:32:53.097704 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-cbd38d25-49cd-451f-8e01-72a45f3d1f9f tempest-VolumesListAdminTestJSON-1180040031 None] creating volume 'volume-4db65b6d-a523-47b9-b6ae-039d53155529' {{(pid=129952) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Jan 22 21:32:53.099810 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-cbd38d25-49cd-451f-8e01-72a45f3d1f9f tempest-VolumesListAdminTestJSON-1180040031 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:32:55.894108 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-cbd38d25-49cd-451f-8e01-72a45f3d1f9f tempest-VolumesListAdminTestJSON-1180040031 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129952) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 22 21:32:55.894794 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-cbd38d25-49cd-451f-8e01-72a45f3d1f9f tempest-VolumesListAdminTestJSON-1180040031 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129952) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 22 21:32:55.898340 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-cbd38d25-49cd-451f-8e01-72a45f3d1f9f tempest-VolumesListAdminTestJSON-1180040031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad14f8b2-900a-403d-b221-eb768226c789) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4db65b6d-a523-47b9-b6ae-039d53155529', 'volume_size': 1}' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:32:55.903079 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-cbd38d25-49cd-451f-8e01-72a45f3d1f9f tempest-VolumesListAdminTestJSON-1180040031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ee10267-ff08-40d0-8362-d275f079ea70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:32:55.993365 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.flows.manager.create_volume [None req-cbd38d25-49cd-451f-8e01-72a45f3d1f9f tempest-VolumesListAdminTestJSON-1180040031 None] Volume volume-4db65b6d-a523-47b9-b6ae-039d53155529 (4db65b6d-a523-47b9-b6ae-039d53155529): created successfully Jan 22 21:32:55.997004 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-cbd38d25-49cd-451f-8e01-72a45f3d1f9f tempest-VolumesListAdminTestJSON-1180040031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ee10267-ff08-40d0-8362-d275f079ea70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:32:56.003486 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-cbd38d25-49cd-451f-8e01-72a45f3d1f9f tempest-VolumesListAdminTestJSON-1180040031 None] Flow 'volume_create_manager' (3fa79ae3-40cf-4ec0-84bb-6b1b4944f7a7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129952) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 22 21:32:56.091052 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-cbd38d25-49cd-451f-8e01-72a45f3d1f9f tempest-VolumesListAdminTestJSON-1180040031 None] Created volume successfully. Jan 22 21:32:57.977522 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.flows.manager.create_volume [None req-553e9c28-78f4-4386-8a2c-dd26f7f22d8e tempest-VolumesListAdminTestJSON-1180040031 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129952) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Jan 22 21:32:57.980671 ncdv-master-1 cinder-volume[129952]: WARNING stevedore.named [None req-553e9c28-78f4-4386-8a2c-dd26f7f22d8e tempest-VolumesListAdminTestJSON-1180040031 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jan 22 21:32:57.981200 ncdv-master-1 cinder-volume[129952]: WARNING castellan.key_manager [None req-553e9c28-78f4-4386-8a2c-dd26f7f22d8e tempest-VolumesListAdminTestJSON-1180040031 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 22 21:32:58.027878 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-553e9c28-78f4-4386-8a2c-dd26f7f22d8e tempest-VolumesListAdminTestJSON-1180040031 None] Flow 'volume_create_manager' (b2986616-add1-4c05-b6d2-6ef12f7c7b97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 22 21:32:58.034853 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-553e9c28-78f4-4386-8a2c-dd26f7f22d8e tempest-VolumesListAdminTestJSON-1180040031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db8776a4-1cf8-4138-8263-4f0fe6502f9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:32:58.041582 ncdv-master-1 cinder-volume[129952]: DEBUG oslo_db.sqlalchemy.engines [None req-553e9c28-78f4-4386-8a2c-dd26f7f22d8e tempest-VolumesListAdminTestJSON-1180040031 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129952) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 22 21:32:58.055790 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-553e9c28-78f4-4386-8a2c-dd26f7f22d8e tempest-VolumesListAdminTestJSON-1180040031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db8776a4-1cf8-4138-8263-4f0fe6502f9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-01-22T21:32:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-199207437',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=b751052f-36cf-41c9-bf9e-91d91620b088,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f22cb8ef9fc4dac9a2a5bebe21b82ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-01-22T21:32:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-01-22T21:32:58Z,use_quota=True,user_id='145e101171d5480d887c68f8ac8be508',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6dacb05b-a7ea-4056-85ff-98f0ea5c54eb),volume_type_id=6dacb05b-a7ea-4056-85ff-98f0ea5c54eb)' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:32:58.062273 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-553e9c28-78f4-4386-8a2c-dd26f7f22d8e tempest-VolumesListAdminTestJSON-1180040031 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00b045d8-c7db-4723-b8c6-3047a50c701a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:32:58.066489 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-553e9c28-78f4-4386-8a2c-dd26f7f22d8e tempest-VolumesListAdminTestJSON-1180040031 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00b045d8-c7db-4723-b8c6-3047a50c701a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:32:58.071708 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-553e9c28-78f4-4386-8a2c-dd26f7f22d8e tempest-VolumesListAdminTestJSON-1180040031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45fdd15f-43f7-4ebe-9b97-8d45a2bf351e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:32:58.075948 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-553e9c28-78f4-4386-8a2c-dd26f7f22d8e tempest-VolumesListAdminTestJSON-1180040031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45fdd15f-43f7-4ebe-9b97-8d45a2bf351e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b751052f-36cf-41c9-bf9e-91d91620b088', 'volume_name': 'volume-b751052f-36cf-41c9-bf9e-91d91620b088', 'volume_size': 1}' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:32:58.080903 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-553e9c28-78f4-4386-8a2c-dd26f7f22d8e tempest-VolumesListAdminTestJSON-1180040031 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1434d5bf-5bc2-485d-86f1-e1e479b1e461) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:32:58.084987 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-553e9c28-78f4-4386-8a2c-dd26f7f22d8e tempest-VolumesListAdminTestJSON-1180040031 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1434d5bf-5bc2-485d-86f1-e1e479b1e461) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:32:58.089787 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-553e9c28-78f4-4386-8a2c-dd26f7f22d8e tempest-VolumesListAdminTestJSON-1180040031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d53b507-fea1-43f0-8ef9-8fc0a663f26d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:32:58.090883 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.flows.manager.create_volume [None req-553e9c28-78f4-4386-8a2c-dd26f7f22d8e tempest-VolumesListAdminTestJSON-1180040031 None] Volume b751052f-36cf-41c9-bf9e-91d91620b088: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b751052f-36cf-41c9-bf9e-91d91620b088', 'volume_size': 1} Jan 22 21:32:58.091275 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-553e9c28-78f4-4386-8a2c-dd26f7f22d8e tempest-VolumesListAdminTestJSON-1180040031 None] creating volume 'volume-b751052f-36cf-41c9-bf9e-91d91620b088' {{(pid=129952) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Jan 22 21:32:58.092226 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-553e9c28-78f4-4386-8a2c-dd26f7f22d8e tempest-VolumesListAdminTestJSON-1180040031 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:33:01.432303 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-553e9c28-78f4-4386-8a2c-dd26f7f22d8e tempest-VolumesListAdminTestJSON-1180040031 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129952) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 22 21:33:01.433442 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-553e9c28-78f4-4386-8a2c-dd26f7f22d8e tempest-VolumesListAdminTestJSON-1180040031 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129952) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 22 21:33:01.439324 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-553e9c28-78f4-4386-8a2c-dd26f7f22d8e tempest-VolumesListAdminTestJSON-1180040031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d53b507-fea1-43f0-8ef9-8fc0a663f26d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b751052f-36cf-41c9-bf9e-91d91620b088', 'volume_size': 1}' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:33:01.444788 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-553e9c28-78f4-4386-8a2c-dd26f7f22d8e tempest-VolumesListAdminTestJSON-1180040031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9bcc07a9-fb31-48be-8e88-235866a8cbd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:33:01.565012 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.flows.manager.create_volume [None req-553e9c28-78f4-4386-8a2c-dd26f7f22d8e tempest-VolumesListAdminTestJSON-1180040031 None] Volume volume-b751052f-36cf-41c9-bf9e-91d91620b088 (b751052f-36cf-41c9-bf9e-91d91620b088): created successfully Jan 22 21:33:01.569077 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-553e9c28-78f4-4386-8a2c-dd26f7f22d8e tempest-VolumesListAdminTestJSON-1180040031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9bcc07a9-fb31-48be-8e88-235866a8cbd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:33:01.576117 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-553e9c28-78f4-4386-8a2c-dd26f7f22d8e tempest-VolumesListAdminTestJSON-1180040031 None] Flow 'volume_create_manager' (b2986616-add1-4c05-b6d2-6ef12f7c7b97) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129952) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 22 21:33:01.656125 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-553e9c28-78f4-4386-8a2c-dd26f7f22d8e tempest-VolumesListAdminTestJSON-1180040031 None] Created volume successfully. Jan 22 21:33:02.892324 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.flows.manager.create_volume [None req-b41e9f9d-b878-43e6-a817-90048fad1f98 tempest-VolumesListAdminTestJSON-1180040031 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129952) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Jan 22 21:33:02.895588 ncdv-master-1 cinder-volume[129952]: WARNING stevedore.named [None req-b41e9f9d-b878-43e6-a817-90048fad1f98 tempest-VolumesListAdminTestJSON-1180040031 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jan 22 21:33:02.896171 ncdv-master-1 cinder-volume[129952]: WARNING castellan.key_manager [None req-b41e9f9d-b878-43e6-a817-90048fad1f98 tempest-VolumesListAdminTestJSON-1180040031 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 22 21:33:02.916866 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-b41e9f9d-b878-43e6-a817-90048fad1f98 tempest-VolumesListAdminTestJSON-1180040031 None] Flow 'volume_create_manager' (493a2b87-9a96-41cd-8ef5-5c7fa347c581) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 22 21:33:02.923947 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-b41e9f9d-b878-43e6-a817-90048fad1f98 tempest-VolumesListAdminTestJSON-1180040031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41bbf50d-4d80-443f-bf1a-2f26d048439b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:33:02.929841 ncdv-master-1 cinder-volume[129952]: DEBUG oslo_db.sqlalchemy.engines [None req-b41e9f9d-b878-43e6-a817-90048fad1f98 tempest-VolumesListAdminTestJSON-1180040031 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129952) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 22 21:33:02.944659 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-b41e9f9d-b878-43e6-a817-90048fad1f98 tempest-VolumesListAdminTestJSON-1180040031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41bbf50d-4d80-443f-bf1a-2f26d048439b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-01-22T21:33:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1018438736',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=98955b01-b7c9-4f15-965a-7ab34b1ee833,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f22cb8ef9fc4dac9a2a5bebe21b82ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-01-22T21:33:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-01-22T21:33:03Z,use_quota=True,user_id='145e101171d5480d887c68f8ac8be508',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6dacb05b-a7ea-4056-85ff-98f0ea5c54eb),volume_type_id=6dacb05b-a7ea-4056-85ff-98f0ea5c54eb)' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:33:02.950510 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-b41e9f9d-b878-43e6-a817-90048fad1f98 tempest-VolumesListAdminTestJSON-1180040031 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a31a96ea-9f6f-41a2-b2c7-1f214f75a813) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:33:02.955901 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-b41e9f9d-b878-43e6-a817-90048fad1f98 tempest-VolumesListAdminTestJSON-1180040031 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a31a96ea-9f6f-41a2-b2c7-1f214f75a813) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:33:02.961170 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-b41e9f9d-b878-43e6-a817-90048fad1f98 tempest-VolumesListAdminTestJSON-1180040031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (592772cd-4e6f-43f6-aa35-0872c108ea48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:33:02.965459 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-b41e9f9d-b878-43e6-a817-90048fad1f98 tempest-VolumesListAdminTestJSON-1180040031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (592772cd-4e6f-43f6-aa35-0872c108ea48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '98955b01-b7c9-4f15-965a-7ab34b1ee833', 'volume_name': 'volume-98955b01-b7c9-4f15-965a-7ab34b1ee833', 'volume_size': 1}' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:33:02.970937 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-b41e9f9d-b878-43e6-a817-90048fad1f98 tempest-VolumesListAdminTestJSON-1180040031 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f742c2a5-eb06-47da-975d-eed2d6c30353) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:33:02.975007 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-b41e9f9d-b878-43e6-a817-90048fad1f98 tempest-VolumesListAdminTestJSON-1180040031 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f742c2a5-eb06-47da-975d-eed2d6c30353) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:33:02.979976 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-b41e9f9d-b878-43e6-a817-90048fad1f98 tempest-VolumesListAdminTestJSON-1180040031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d768e50d-2b02-4be2-ad4f-721e745b00ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:33:02.981060 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.flows.manager.create_volume [None req-b41e9f9d-b878-43e6-a817-90048fad1f98 tempest-VolumesListAdminTestJSON-1180040031 None] Volume 98955b01-b7c9-4f15-965a-7ab34b1ee833: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-98955b01-b7c9-4f15-965a-7ab34b1ee833', 'volume_size': 1} Jan 22 21:33:02.981450 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-b41e9f9d-b878-43e6-a817-90048fad1f98 tempest-VolumesListAdminTestJSON-1180040031 None] creating volume 'volume-98955b01-b7c9-4f15-965a-7ab34b1ee833' {{(pid=129952) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Jan 22 21:33:02.982453 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-b41e9f9d-b878-43e6-a817-90048fad1f98 tempest-VolumesListAdminTestJSON-1180040031 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:33:07.618830 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-b41e9f9d-b878-43e6-a817-90048fad1f98 tempest-VolumesListAdminTestJSON-1180040031 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129952) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 22 21:33:07.619488 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-b41e9f9d-b878-43e6-a817-90048fad1f98 tempest-VolumesListAdminTestJSON-1180040031 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129952) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 22 21:33:07.623179 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-b41e9f9d-b878-43e6-a817-90048fad1f98 tempest-VolumesListAdminTestJSON-1180040031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d768e50d-2b02-4be2-ad4f-721e745b00ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-98955b01-b7c9-4f15-965a-7ab34b1ee833', 'volume_size': 1}' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:33:07.628771 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-b41e9f9d-b878-43e6-a817-90048fad1f98 tempest-VolumesListAdminTestJSON-1180040031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1023e1a8-d75d-4a31-b3bf-ed4c80c55fb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:33:07.736804 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.flows.manager.create_volume [None req-b41e9f9d-b878-43e6-a817-90048fad1f98 tempest-VolumesListAdminTestJSON-1180040031 None] Volume volume-98955b01-b7c9-4f15-965a-7ab34b1ee833 (98955b01-b7c9-4f15-965a-7ab34b1ee833): created successfully Jan 22 21:33:07.740490 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-b41e9f9d-b878-43e6-a817-90048fad1f98 tempest-VolumesListAdminTestJSON-1180040031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1023e1a8-d75d-4a31-b3bf-ed4c80c55fb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:33:07.746243 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-b41e9f9d-b878-43e6-a817-90048fad1f98 tempest-VolumesListAdminTestJSON-1180040031 None] Flow 'volume_create_manager' (493a2b87-9a96-41cd-8ef5-5c7fa347c581) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129952) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 22 21:33:07.845529 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-b41e9f9d-b878-43e6-a817-90048fad1f98 tempest-VolumesListAdminTestJSON-1180040031 None] Created volume successfully. Jan 22 21:33:09.081419 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.flows.manager.create_volume [None req-107fe725-3102-4e0b-a24c-8f89303df379 tempest-VolumesListAdminTestJSON-263552260 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129952) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Jan 22 21:33:09.085057 ncdv-master-1 cinder-volume[129952]: WARNING stevedore.named [None req-107fe725-3102-4e0b-a24c-8f89303df379 tempest-VolumesListAdminTestJSON-263552260 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jan 22 21:33:09.085556 ncdv-master-1 cinder-volume[129952]: WARNING castellan.key_manager [None req-107fe725-3102-4e0b-a24c-8f89303df379 tempest-VolumesListAdminTestJSON-263552260 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 22 21:33:09.105055 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-107fe725-3102-4e0b-a24c-8f89303df379 tempest-VolumesListAdminTestJSON-263552260 None] Flow 'volume_create_manager' (5d9945e0-6465-4141-a632-cee65015ccdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 22 21:33:09.111801 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-107fe725-3102-4e0b-a24c-8f89303df379 tempest-VolumesListAdminTestJSON-263552260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62fc4776-d88a-41e1-98ed-811753c6181e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:33:09.117864 ncdv-master-1 cinder-volume[129952]: DEBUG oslo_db.sqlalchemy.engines [None req-107fe725-3102-4e0b-a24c-8f89303df379 tempest-VolumesListAdminTestJSON-263552260 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129952) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 22 21:33:09.133305 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-107fe725-3102-4e0b-a24c-8f89303df379 tempest-VolumesListAdminTestJSON-263552260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62fc4776-d88a-41e1-98ed-811753c6181e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-01-22T21:33:08Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=cab61681-76e7-4910-8fce-c36480680fcf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='165d8491b89c46688d435c4e37f6ebad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-01-22T21:33:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-01-22T21:33:09Z,use_quota=True,user_id='bea047b79117440e937b0264a0b0da19',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6dacb05b-a7ea-4056-85ff-98f0ea5c54eb),volume_type_id=6dacb05b-a7ea-4056-85ff-98f0ea5c54eb)' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:33:09.139018 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-107fe725-3102-4e0b-a24c-8f89303df379 tempest-VolumesListAdminTestJSON-263552260 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9491ea43-be46-4397-b0b3-f1ddbf8f7b23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:33:09.144011 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-107fe725-3102-4e0b-a24c-8f89303df379 tempest-VolumesListAdminTestJSON-263552260 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9491ea43-be46-4397-b0b3-f1ddbf8f7b23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:33:09.149303 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-107fe725-3102-4e0b-a24c-8f89303df379 tempest-VolumesListAdminTestJSON-263552260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6ae5a83-8e1c-4318-a8a2-53e3e8c7c1c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:33:09.153586 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-107fe725-3102-4e0b-a24c-8f89303df379 tempest-VolumesListAdminTestJSON-263552260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6ae5a83-8e1c-4318-a8a2-53e3e8c7c1c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cab61681-76e7-4910-8fce-c36480680fcf', 'volume_name': 'volume-cab61681-76e7-4910-8fce-c36480680fcf', 'volume_size': 1}' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:33:09.158913 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-107fe725-3102-4e0b-a24c-8f89303df379 tempest-VolumesListAdminTestJSON-263552260 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (490cb500-6df0-471b-8947-4b2d645906fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:33:09.163266 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-107fe725-3102-4e0b-a24c-8f89303df379 tempest-VolumesListAdminTestJSON-263552260 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (490cb500-6df0-471b-8947-4b2d645906fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:33:09.168510 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-107fe725-3102-4e0b-a24c-8f89303df379 tempest-VolumesListAdminTestJSON-263552260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc6d124e-a6da-4b95-b477-d5238b33cb85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:33:09.169591 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.flows.manager.create_volume [None req-107fe725-3102-4e0b-a24c-8f89303df379 tempest-VolumesListAdminTestJSON-263552260 None] Volume cab61681-76e7-4910-8fce-c36480680fcf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cab61681-76e7-4910-8fce-c36480680fcf', 'volume_size': 1} Jan 22 21:33:09.170001 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-107fe725-3102-4e0b-a24c-8f89303df379 tempest-VolumesListAdminTestJSON-263552260 None] creating volume 'volume-cab61681-76e7-4910-8fce-c36480680fcf' {{(pid=129952) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Jan 22 21:33:09.171717 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-107fe725-3102-4e0b-a24c-8f89303df379 tempest-VolumesListAdminTestJSON-263552260 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:33:15.263259 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-107fe725-3102-4e0b-a24c-8f89303df379 tempest-VolumesListAdminTestJSON-263552260 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129952) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 22 21:33:15.263974 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-107fe725-3102-4e0b-a24c-8f89303df379 tempest-VolumesListAdminTestJSON-263552260 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129952) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 22 21:33:15.268641 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-107fe725-3102-4e0b-a24c-8f89303df379 tempest-VolumesListAdminTestJSON-263552260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc6d124e-a6da-4b95-b477-d5238b33cb85) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cab61681-76e7-4910-8fce-c36480680fcf', 'volume_size': 1}' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:33:15.273119 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-107fe725-3102-4e0b-a24c-8f89303df379 tempest-VolumesListAdminTestJSON-263552260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10cd2498-9de7-4d87-a2be-dd35a5ca67c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:33:15.383153 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.flows.manager.create_volume [None req-107fe725-3102-4e0b-a24c-8f89303df379 tempest-VolumesListAdminTestJSON-263552260 None] Volume volume-cab61681-76e7-4910-8fce-c36480680fcf (cab61681-76e7-4910-8fce-c36480680fcf): created successfully Jan 22 21:33:15.387895 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-107fe725-3102-4e0b-a24c-8f89303df379 tempest-VolumesListAdminTestJSON-263552260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10cd2498-9de7-4d87-a2be-dd35a5ca67c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:33:15.395630 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-107fe725-3102-4e0b-a24c-8f89303df379 tempest-VolumesListAdminTestJSON-263552260 None] Flow 'volume_create_manager' (5d9945e0-6465-4141-a632-cee65015ccdb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129952) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 22 21:33:15.519523 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-107fe725-3102-4e0b-a24c-8f89303df379 tempest-VolumesListAdminTestJSON-263552260 None] Created volume successfully. Jan 22 21:33:16.415517 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.coordination [None req-8d82c5da-8d88-4c11-ae72-0a360c5a9e04 tempest-VolumesListAdminTestJSON-263552260 None] Lock "b'cinder-cab61681-76e7-4910-8fce-c36480680fcf-delete_volume'" acquired by "delete_volume" :: waited 0.010s {{(pid=129952) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 22 21:33:16.535929 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-8d82c5da-8d88-4c11-ae72-0a360c5a9e04 tempest-VolumesListAdminTestJSON-263552260 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:33:18.017265 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-8d82c5da-8d88-4c11-ae72-0a360c5a9e04 tempest-VolumesListAdminTestJSON-263552260 None] volume has no backup snaps {{(pid=129952) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Jan 22 21:33:18.018164 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-8d82c5da-8d88-4c11-ae72-0a360c5a9e04 tempest-VolumesListAdminTestJSON-263552260 None] Volume volume-cab61681-76e7-4910-8fce-c36480680fcf is not a clone. {{(pid=129952) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Jan 22 21:33:18.394464 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-8d82c5da-8d88-4c11-ae72-0a360c5a9e04 tempest-VolumesListAdminTestJSON-263552260 None] deleting rbd volume volume-cab61681-76e7-4910-8fce-c36480680fcf {{(pid=129952) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Jan 22 21:33:18.416983 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.coordination [None req-518cd62d-3ae4-4d52-9239-45c6f0819f21 tempest-VolumesListAdminTestJSON-1180040031 None] Lock "b'cinder-98955b01-b7c9-4f15-965a-7ab34b1ee833-delete_volume'" acquired by "delete_volume" :: waited 0.008s {{(pid=129952) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 22 21:33:18.564354 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-518cd62d-3ae4-4d52-9239-45c6f0819f21 tempest-VolumesListAdminTestJSON-1180040031 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:33:21.038972 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-518cd62d-3ae4-4d52-9239-45c6f0819f21 tempest-VolumesListAdminTestJSON-1180040031 None] volume has no backup snaps {{(pid=129952) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Jan 22 21:33:21.039692 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-518cd62d-3ae4-4d52-9239-45c6f0819f21 tempest-VolumesListAdminTestJSON-1180040031 None] Volume volume-98955b01-b7c9-4f15-965a-7ab34b1ee833 is not a clone. {{(pid=129952) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Jan 22 21:33:21.565306 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-518cd62d-3ae4-4d52-9239-45c6f0819f21 tempest-VolumesListAdminTestJSON-1180040031 None] deleting rbd volume volume-98955b01-b7c9-4f15-965a-7ab34b1ee833 {{(pid=129952) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Jan 22 21:33:44.977323 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.quota [None req-8d82c5da-8d88-4c11-ae72-0a360c5a9e04 tempest-VolumesListAdminTestJSON-263552260 None] Created reservations ['5c0bfbd6-b9f0-47d6-8089-a2bebf71ff89', '9d1f28b0-d10d-45b8-b144-29f91e9914b1', '81e9a79f-9c71-422a-b9c9-54dd1c8ad954', '38e14c62-19b7-4cb8-8974-b71396b117a4'] {{(pid=129952) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 22 21:33:45.161905 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-8d82c5da-8d88-4c11-ae72-0a360c5a9e04 tempest-VolumesListAdminTestJSON-263552260 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:33:45.245216 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-8d82c5da-8d88-4c11-ae72-0a360c5a9e04 tempest-VolumesListAdminTestJSON-263552260 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:33:45.273801 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.manager [None req-8d82c5da-8d88-4c11-ae72-0a360c5a9e04 tempest-VolumesListAdminTestJSON-263552260 None] Notifying Schedulers of capabilities ... {{(pid=129952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 22 21:33:45.278267 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-8d82c5da-8d88-4c11-ae72-0a360c5a9e04 tempest-VolumesListAdminTestJSON-263552260 None] Deleted volume successfully. Jan 22 21:33:45.415072 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.coordination [None req-8d82c5da-8d88-4c11-ae72-0a360c5a9e04 tempest-VolumesListAdminTestJSON-263552260 None] Lock "b'cinder-cab61681-76e7-4910-8fce-c36480680fcf-delete_volume'" released by "delete_volume" :: held 28.978s {{(pid=129952) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 22 21:33:50.443927 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.quota [None req-518cd62d-3ae4-4d52-9239-45c6f0819f21 tempest-VolumesListAdminTestJSON-1180040031 None] Created reservations ['9b4d6d3c-9b5e-4807-a71f-41bc289fa5e7', '6cd64e9f-29c6-4a22-8d4e-af9cd1632b67', 'e1c277ed-68b4-419b-a3ff-762aff64c912', 'e52ec04a-8892-42b8-8e56-1da8be44e829'] {{(pid=129952) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 22 21:33:50.641808 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-518cd62d-3ae4-4d52-9239-45c6f0819f21 tempest-VolumesListAdminTestJSON-1180040031 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:33:50.666497 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-518cd62d-3ae4-4d52-9239-45c6f0819f21 tempest-VolumesListAdminTestJSON-1180040031 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:33:50.690808 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.manager [None req-518cd62d-3ae4-4d52-9239-45c6f0819f21 tempest-VolumesListAdminTestJSON-1180040031 None] Notifying Schedulers of capabilities ... {{(pid=129952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 22 21:33:50.695092 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-518cd62d-3ae4-4d52-9239-45c6f0819f21 tempest-VolumesListAdminTestJSON-1180040031 None] Deleted volume successfully. Jan 22 21:33:50.774233 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.coordination [None req-518cd62d-3ae4-4d52-9239-45c6f0819f21 tempest-VolumesListAdminTestJSON-1180040031 None] Lock "b'cinder-98955b01-b7c9-4f15-965a-7ab34b1ee833-delete_volume'" released by "delete_volume" :: held 32.367s {{(pid=129952) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 22 21:33:51.551780 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.coordination [None req-0da602ae-b774-405f-9554-9724a59f8735 tempest-VolumesListAdminTestJSON-1180040031 None] Lock "b'cinder-b751052f-36cf-41c9-bf9e-91d91620b088-delete_volume'" acquired by "delete_volume" :: waited 0.009s {{(pid=129952) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 22 21:33:51.673951 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-0da602ae-b774-405f-9554-9724a59f8735 tempest-VolumesListAdminTestJSON-1180040031 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:33:52.923821 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-0da602ae-b774-405f-9554-9724a59f8735 tempest-VolumesListAdminTestJSON-1180040031 None] volume has no backup snaps {{(pid=129952) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Jan 22 21:33:52.924482 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-0da602ae-b774-405f-9554-9724a59f8735 tempest-VolumesListAdminTestJSON-1180040031 None] Volume volume-b751052f-36cf-41c9-bf9e-91d91620b088 is not a clone. {{(pid=129952) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Jan 22 21:33:53.863138 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-0da602ae-b774-405f-9554-9724a59f8735 tempest-VolumesListAdminTestJSON-1180040031 None] deleting rbd volume volume-b751052f-36cf-41c9-bf9e-91d91620b088 {{(pid=129952) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Jan 22 21:34:08.140769 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-d04bb3e9-455d-414b-af61-94c87fe4b1ad tempest-VolumesBackupsTest-1274070825 None] Terminate volume connection completed successfully. Jan 22 21:34:08.160945 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-d04bb3e9-455d-414b-af61-94c87fe4b1ad tempest-VolumesBackupsTest-1274070825 None] Remove volume export completed successfully. Jan 22 21:34:08.371292 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.quota [None req-0da602ae-b774-405f-9554-9724a59f8735 tempest-VolumesListAdminTestJSON-1180040031 None] Created reservations ['b86157ff-5fb0-457e-97ee-71be540bb7de', 'eaf72f03-681e-4e7a-9bee-6c0deb1ca9c3', '718f45f7-3c99-4617-ad17-3097463a3d9e', 'ae36e902-5180-4a77-a9e8-818b57a28967'] {{(pid=129952) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 22 21:34:08.569972 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-0da602ae-b774-405f-9554-9724a59f8735 tempest-VolumesListAdminTestJSON-1180040031 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:34:08.594044 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-0da602ae-b774-405f-9554-9724a59f8735 tempest-VolumesListAdminTestJSON-1180040031 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:34:08.618397 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.manager [None req-0da602ae-b774-405f-9554-9724a59f8735 tempest-VolumesListAdminTestJSON-1180040031 None] Notifying Schedulers of capabilities ... {{(pid=129952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 22 21:34:08.622563 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-0da602ae-b774-405f-9554-9724a59f8735 tempest-VolumesListAdminTestJSON-1180040031 None] Deleted volume successfully. Jan 22 21:34:08.690266 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.coordination [None req-0da602ae-b774-405f-9554-9724a59f8735 tempest-VolumesListAdminTestJSON-1180040031 None] Lock "b'cinder-b751052f-36cf-41c9-bf9e-91d91620b088-delete_volume'" released by "delete_volume" :: held 17.144s {{(pid=129952) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 22 21:34:09.007808 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.coordination [None req-11f99f9c-7f38-4a97-a307-76a48d104b69 tempest-VolumesBackupsTest-1274070825 None] Lock "b'cinder-ac9572a9-a61b-4baa-bd8e-fe21c648011a-delete_volume'" acquired by "delete_volume" :: waited 0.009s {{(pid=129952) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 22 21:34:09.120139 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-11f99f9c-7f38-4a97-a307-76a48d104b69 tempest-VolumesBackupsTest-1274070825 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:34:13.327114 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-11f99f9c-7f38-4a97-a307-76a48d104b69 tempest-VolumesBackupsTest-1274070825 None] Volume volume-ac9572a9-a61b-4baa-bd8e-fe21c648011a is not a clone. {{(pid=129952) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Jan 22 21:34:14.258073 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-11f99f9c-7f38-4a97-a307-76a48d104b69 tempest-VolumesBackupsTest-1274070825 None] deleting rbd volume volume-ac9572a9-a61b-4baa-bd8e-fe21c648011a {{(pid=129952) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Jan 22 21:34:14.261127 ncdv-master-1 cinder-volume[129952]: DEBUG oslo_service.periodic_task [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129952) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jan 22 21:34:14.261738 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:34:14.291132 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:34:14.320888 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.manager [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] Notifying Schedulers of capabilities ... {{(pid=129952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 22 21:34:14.380851 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.coordination [None req-f1593031-0221-49ed-bb78-a2fabd76d92d tempest-VolumesListAdminTestJSON-1180040031 None] Lock "b'cinder-4db65b6d-a523-47b9-b6ae-039d53155529-delete_volume'" acquired by "delete_volume" :: waited 0.053s {{(pid=129952) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 22 21:34:14.547885 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-f1593031-0221-49ed-bb78-a2fabd76d92d tempest-VolumesListAdminTestJSON-1180040031 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:34:16.445527 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-f1593031-0221-49ed-bb78-a2fabd76d92d tempest-VolumesListAdminTestJSON-1180040031 None] volume has no backup snaps {{(pid=129952) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Jan 22 21:34:16.446221 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-f1593031-0221-49ed-bb78-a2fabd76d92d tempest-VolumesListAdminTestJSON-1180040031 None] Volume volume-4db65b6d-a523-47b9-b6ae-039d53155529 is not a clone. {{(pid=129952) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Jan 22 21:34:16.846393 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-f1593031-0221-49ed-bb78-a2fabd76d92d tempest-VolumesListAdminTestJSON-1180040031 None] deleting rbd volume volume-4db65b6d-a523-47b9-b6ae-039d53155529 {{(pid=129952) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Jan 22 21:34:27.443779 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.quota [None req-f1593031-0221-49ed-bb78-a2fabd76d92d tempest-VolumesListAdminTestJSON-1180040031 None] Created reservations ['925062e2-b01a-4087-b7b4-3195a2db5d16', '96d6fc6e-fdea-400a-bc22-10786c79475f', 'c98921e8-05d4-4a30-aa0e-0ad07907643c', '9f5530eb-aa24-4be7-85d7-2157083ff755'] {{(pid=129952) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 22 21:34:27.623452 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-f1593031-0221-49ed-bb78-a2fabd76d92d tempest-VolumesListAdminTestJSON-1180040031 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:34:27.657655 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-f1593031-0221-49ed-bb78-a2fabd76d92d tempest-VolumesListAdminTestJSON-1180040031 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:34:27.704036 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.manager [None req-f1593031-0221-49ed-bb78-a2fabd76d92d tempest-VolumesListAdminTestJSON-1180040031 None] Notifying Schedulers of capabilities ... {{(pid=129952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 22 21:34:27.709192 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-f1593031-0221-49ed-bb78-a2fabd76d92d tempest-VolumesListAdminTestJSON-1180040031 None] Deleted volume successfully. Jan 22 21:34:27.810519 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.coordination [None req-f1593031-0221-49ed-bb78-a2fabd76d92d tempest-VolumesListAdminTestJSON-1180040031 None] Lock "b'cinder-4db65b6d-a523-47b9-b6ae-039d53155529-delete_volume'" released by "delete_volume" :: held 13.430s {{(pid=129952) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 22 21:34:31.907290 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.quota [None req-11f99f9c-7f38-4a97-a307-76a48d104b69 tempest-VolumesBackupsTest-1274070825 None] Created reservations ['b69b6462-0da3-4dd6-83fb-bf36641fba73', '3f6ed04f-0b47-4017-9835-9ed84a4cb66e', '9d6aa8ce-5316-45fe-8c42-f53cb0db41f6', '38fe8de9-03cb-4fb5-9aab-68fb7a911cf4'] {{(pid=129952) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 22 21:34:32.189315 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-11f99f9c-7f38-4a97-a307-76a48d104b69 tempest-VolumesBackupsTest-1274070825 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:34:32.267676 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-11f99f9c-7f38-4a97-a307-76a48d104b69 tempest-VolumesBackupsTest-1274070825 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:34:32.308690 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.manager [None req-11f99f9c-7f38-4a97-a307-76a48d104b69 tempest-VolumesBackupsTest-1274070825 None] Notifying Schedulers of capabilities ... {{(pid=129952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 22 21:34:32.313048 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-11f99f9c-7f38-4a97-a307-76a48d104b69 tempest-VolumesBackupsTest-1274070825 None] Deleted volume successfully. Jan 22 21:34:32.411262 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.coordination [None req-11f99f9c-7f38-4a97-a307-76a48d104b69 tempest-VolumesBackupsTest-1274070825 None] Lock "b'cinder-ac9572a9-a61b-4baa-bd8e-fe21c648011a-delete_volume'" released by "delete_volume" :: held 23.403s {{(pid=129952) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 22 21:34:32.447635 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-b2de814d-2e8d-4c28-a9aa-830f188a0e41 tempest-VolumesSnapshotTestJSON-664893185 None] Terminate volume connection completed successfully. Jan 22 21:34:32.476820 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-b2de814d-2e8d-4c28-a9aa-830f188a0e41 tempest-VolumesSnapshotTestJSON-664893185 None] Remove volume export completed successfully. Jan 22 21:34:32.621387 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.coordination [None req-b2de814d-2e8d-4c28-a9aa-830f188a0e41 tempest-VolumesSnapshotTestJSON-664893185 None] Lock "b'cinder-6d37bad7-ecfe-4e0a-a976-2471b21418e9-delete_volume'" acquired by "delete_volume" :: waited 0.010s {{(pid=129952) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 22 21:34:32.634178 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-b2de814d-2e8d-4c28-a9aa-830f188a0e41 tempest-VolumesSnapshotTestJSON-664893185 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:34:32.894905 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-b2de814d-2e8d-4c28-a9aa-830f188a0e41 tempest-VolumesSnapshotTestJSON-664893185 None] volume has no backup snaps {{(pid=129952) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Jan 22 21:34:33.130584 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-b2de814d-2e8d-4c28-a9aa-830f188a0e41 tempest-VolumesSnapshotTestJSON-664893185 None] deleting rbd volume volume-6d37bad7-ecfe-4e0a-a976-2471b21418e9 {{(pid=129952) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Jan 22 21:34:34.596061 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.flows.manager.create_volume [None req-2477a16a-4cfa-42fa-972e-a82de833f9ad tempest-VolumesMetadataTest-1203295214 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129952) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Jan 22 21:34:34.599807 ncdv-master-1 cinder-volume[129952]: WARNING stevedore.named [None req-2477a16a-4cfa-42fa-972e-a82de833f9ad tempest-VolumesMetadataTest-1203295214 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jan 22 21:34:34.600263 ncdv-master-1 cinder-volume[129952]: WARNING castellan.key_manager [None req-2477a16a-4cfa-42fa-972e-a82de833f9ad tempest-VolumesMetadataTest-1203295214 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 22 21:34:34.620288 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-2477a16a-4cfa-42fa-972e-a82de833f9ad tempest-VolumesMetadataTest-1203295214 None] Flow 'volume_create_manager' (a7f14e9c-183b-4f90-a9ed-aee92a22c348) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 22 21:34:34.627275 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-2477a16a-4cfa-42fa-972e-a82de833f9ad tempest-VolumesMetadataTest-1203295214 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d803660c-57d4-4010-9290-eb8c42a2d3fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:34:34.633662 ncdv-master-1 cinder-volume[129952]: DEBUG oslo_db.sqlalchemy.engines [None req-2477a16a-4cfa-42fa-972e-a82de833f9ad tempest-VolumesMetadataTest-1203295214 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129952) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 22 21:34:34.648035 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-2477a16a-4cfa-42fa-972e-a82de833f9ad tempest-VolumesMetadataTest-1203295214 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d803660c-57d4-4010-9290-eb8c42a2d3fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-01-22T21:34:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1162791415',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=ef9ee5ab-f0e8-44c7-9e84-c97b0099d4d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6b3f766608a4fddbe985329bf7c97a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-01-22T21:34:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-01-22T21:34:34Z,use_quota=True,user_id='60c7eb970bb5459f839ff6e212b1b334',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6dacb05b-a7ea-4056-85ff-98f0ea5c54eb),volume_type_id=6dacb05b-a7ea-4056-85ff-98f0ea5c54eb)' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:34:34.654028 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-2477a16a-4cfa-42fa-972e-a82de833f9ad tempest-VolumesMetadataTest-1203295214 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2020bb5b-81d6-4af8-9b3a-4bfe481b2f72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:34:34.658223 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-2477a16a-4cfa-42fa-972e-a82de833f9ad tempest-VolumesMetadataTest-1203295214 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2020bb5b-81d6-4af8-9b3a-4bfe481b2f72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:34:34.664415 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-2477a16a-4cfa-42fa-972e-a82de833f9ad tempest-VolumesMetadataTest-1203295214 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f706fd6c-11f7-45a4-bf9b-860e63be6f8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:34:34.668743 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-2477a16a-4cfa-42fa-972e-a82de833f9ad tempest-VolumesMetadataTest-1203295214 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f706fd6c-11f7-45a4-bf9b-860e63be6f8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ef9ee5ab-f0e8-44c7-9e84-c97b0099d4d5', 'volume_name': 'volume-ef9ee5ab-f0e8-44c7-9e84-c97b0099d4d5', 'volume_size': 1}' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:34:34.673807 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-2477a16a-4cfa-42fa-972e-a82de833f9ad tempest-VolumesMetadataTest-1203295214 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da47988a-ce15-4c50-823d-66bd2e48f482) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:34:34.677855 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-2477a16a-4cfa-42fa-972e-a82de833f9ad tempest-VolumesMetadataTest-1203295214 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da47988a-ce15-4c50-823d-66bd2e48f482) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:34:34.682703 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-2477a16a-4cfa-42fa-972e-a82de833f9ad tempest-VolumesMetadataTest-1203295214 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24806857-fd23-4c05-86a8-672947e26ee0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:34:34.683782 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.flows.manager.create_volume [None req-2477a16a-4cfa-42fa-972e-a82de833f9ad tempest-VolumesMetadataTest-1203295214 None] Volume ef9ee5ab-f0e8-44c7-9e84-c97b0099d4d5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ef9ee5ab-f0e8-44c7-9e84-c97b0099d4d5', 'volume_size': 1} Jan 22 21:34:34.684167 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-2477a16a-4cfa-42fa-972e-a82de833f9ad tempest-VolumesMetadataTest-1203295214 None] creating volume 'volume-ef9ee5ab-f0e8-44c7-9e84-c97b0099d4d5' {{(pid=129952) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Jan 22 21:34:34.685171 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-2477a16a-4cfa-42fa-972e-a82de833f9ad tempest-VolumesMetadataTest-1203295214 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:34:35.903924 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-2477a16a-4cfa-42fa-972e-a82de833f9ad tempest-VolumesMetadataTest-1203295214 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129952) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 22 21:34:35.904634 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-2477a16a-4cfa-42fa-972e-a82de833f9ad tempest-VolumesMetadataTest-1203295214 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129952) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 22 21:34:35.908196 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-2477a16a-4cfa-42fa-972e-a82de833f9ad tempest-VolumesMetadataTest-1203295214 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24806857-fd23-4c05-86a8-672947e26ee0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ef9ee5ab-f0e8-44c7-9e84-c97b0099d4d5', 'volume_size': 1}' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:34:35.913866 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-2477a16a-4cfa-42fa-972e-a82de833f9ad tempest-VolumesMetadataTest-1203295214 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c09e0273-2aa1-4226-be1e-13519ed89fed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:34:36.006403 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.flows.manager.create_volume [None req-2477a16a-4cfa-42fa-972e-a82de833f9ad tempest-VolumesMetadataTest-1203295214 None] Volume volume-ef9ee5ab-f0e8-44c7-9e84-c97b0099d4d5 (ef9ee5ab-f0e8-44c7-9e84-c97b0099d4d5): created successfully Jan 22 21:34:36.011235 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-2477a16a-4cfa-42fa-972e-a82de833f9ad tempest-VolumesMetadataTest-1203295214 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c09e0273-2aa1-4226-be1e-13519ed89fed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:34:36.016891 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-2477a16a-4cfa-42fa-972e-a82de833f9ad tempest-VolumesMetadataTest-1203295214 None] Flow 'volume_create_manager' (a7f14e9c-183b-4f90-a9ed-aee92a22c348) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129952) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 22 21:34:36.097815 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-2477a16a-4cfa-42fa-972e-a82de833f9ad tempest-VolumesMetadataTest-1203295214 None] Created volume successfully. Jan 22 21:34:37.954170 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.coordination [None req-0a4d0c99-4743-4585-bab5-20bb9228a769 tempest-VolumesMetadataTest-1203295214 None] Lock "b'cinder-ef9ee5ab-f0e8-44c7-9e84-c97b0099d4d5-delete_volume'" acquired by "delete_volume" :: waited 0.013s {{(pid=129952) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 22 21:34:38.078809 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-0a4d0c99-4743-4585-bab5-20bb9228a769 tempest-VolumesMetadataTest-1203295214 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:34:38.226537 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-0a4d0c99-4743-4585-bab5-20bb9228a769 tempest-VolumesMetadataTest-1203295214 None] volume has no backup snaps {{(pid=129952) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Jan 22 21:34:38.226894 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-0a4d0c99-4743-4585-bab5-20bb9228a769 tempest-VolumesMetadataTest-1203295214 None] Volume volume-ef9ee5ab-f0e8-44c7-9e84-c97b0099d4d5 is not a clone. {{(pid=129952) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Jan 22 21:34:38.538912 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-0a4d0c99-4743-4585-bab5-20bb9228a769 tempest-VolumesMetadataTest-1203295214 None] deleting rbd volume volume-ef9ee5ab-f0e8-44c7-9e84-c97b0099d4d5 {{(pid=129952) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Jan 22 21:34:40.529318 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-b2de814d-2e8d-4c28-a9aa-830f188a0e41 tempest-VolumesSnapshotTestJSON-664893185 None] Deleted volume successfully. Jan 22 21:34:40.535722 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.coordination [None req-b2de814d-2e8d-4c28-a9aa-830f188a0e41 tempest-VolumesSnapshotTestJSON-664893185 None] Lock "b'cinder-6d37bad7-ecfe-4e0a-a976-2471b21418e9-delete_volume'" released by "delete_volume" :: held 7.914s {{(pid=129952) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 22 21:34:45.854984 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.quota [None req-0a4d0c99-4743-4585-bab5-20bb9228a769 tempest-VolumesMetadataTest-1203295214 None] Created reservations ['5810bff6-a772-4f64-8937-d2935438a6b4', 'e7451a16-31e2-4849-b3bb-71c053319af8', '12a67b6c-362c-4247-87b9-e92cfc7bfdda', 'edca0fe8-4a0c-495a-b7f2-4c674e5d63b4'] {{(pid=129952) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 22 21:34:46.029436 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-0a4d0c99-4743-4585-bab5-20bb9228a769 tempest-VolumesMetadataTest-1203295214 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:34:46.123496 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-0a4d0c99-4743-4585-bab5-20bb9228a769 tempest-VolumesMetadataTest-1203295214 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:34:46.148468 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.manager [None req-0a4d0c99-4743-4585-bab5-20bb9228a769 tempest-VolumesMetadataTest-1203295214 None] Notifying Schedulers of capabilities ... {{(pid=129952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 22 21:34:46.152789 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-0a4d0c99-4743-4585-bab5-20bb9228a769 tempest-VolumesMetadataTest-1203295214 None] Deleted volume successfully. Jan 22 21:34:46.232617 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.coordination [None req-0a4d0c99-4743-4585-bab5-20bb9228a769 tempest-VolumesMetadataTest-1203295214 None] Lock "b'cinder-ef9ee5ab-f0e8-44c7-9e84-c97b0099d4d5-delete_volume'" released by "delete_volume" :: held 8.278s {{(pid=129952) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 22 21:34:49.079049 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.coordination [None req-e178c96a-ddfa-4636-a4d4-674bc23d6464 tempest-VolumesBackupsTest-1274070825 None] Lock "b'cinder-8ce51a79-e21d-40d7-9de1-28e5ee775236-delete_volume'" acquired by "delete_volume" :: waited 0.008s {{(pid=129952) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 22 21:34:49.224980 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-e178c96a-ddfa-4636-a4d4-674bc23d6464 tempest-VolumesBackupsTest-1274070825 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:34:51.305369 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-e178c96a-ddfa-4636-a4d4-674bc23d6464 tempest-VolumesBackupsTest-1274070825 None] deleting rbd volume volume-8ce51a79-e21d-40d7-9de1-28e5ee775236 {{(pid=129952) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Jan 22 21:34:51.395632 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.flows.manager.create_volume [None req-86c8eda4-b796-47a7-a9da-6ea0f49306c3 tempest-VolumesGetTest-1998535251 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129952) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Jan 22 21:34:51.397982 ncdv-master-1 cinder-volume[129952]: WARNING stevedore.named [None req-86c8eda4-b796-47a7-a9da-6ea0f49306c3 tempest-VolumesGetTest-1998535251 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jan 22 21:34:51.398438 ncdv-master-1 cinder-volume[129952]: WARNING castellan.key_manager [None req-86c8eda4-b796-47a7-a9da-6ea0f49306c3 tempest-VolumesGetTest-1998535251 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 22 21:34:51.418844 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-86c8eda4-b796-47a7-a9da-6ea0f49306c3 tempest-VolumesGetTest-1998535251 None] Flow 'volume_create_manager' (c10314c3-7a4f-4f5c-a298-b9d2bd7045c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 22 21:34:51.425572 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-86c8eda4-b796-47a7-a9da-6ea0f49306c3 tempest-VolumesGetTest-1998535251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ed3d838-1c4a-45a2-8330-b97fc6c53b1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:34:51.432907 ncdv-master-1 cinder-volume[129952]: DEBUG oslo_db.sqlalchemy.engines [None req-86c8eda4-b796-47a7-a9da-6ea0f49306c3 tempest-VolumesGetTest-1998535251 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129952) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 22 21:34:51.447259 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-86c8eda4-b796-47a7-a9da-6ea0f49306c3 tempest-VolumesGetTest-1998535251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ed3d838-1c4a-45a2-8330-b97fc6c53b1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-01-22T21:34:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-359035111',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=ebfba50b-3ada-426a-b5af-8e32a4506718,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='db23715a4466471abfb9e11a261fee71',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-01-22T21:34:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-01-22T21:34:49Z,use_quota=True,user_id='209c06231de64d2b9d3f5eee76baf31e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6dacb05b-a7ea-4056-85ff-98f0ea5c54eb),volume_type_id=6dacb05b-a7ea-4056-85ff-98f0ea5c54eb)' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:34:51.452820 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-86c8eda4-b796-47a7-a9da-6ea0f49306c3 tempest-VolumesGetTest-1998535251 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f80d710c-2882-4151-8831-6e19baabb0a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:34:51.457075 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-86c8eda4-b796-47a7-a9da-6ea0f49306c3 tempest-VolumesGetTest-1998535251 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f80d710c-2882-4151-8831-6e19baabb0a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:34:51.462383 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-86c8eda4-b796-47a7-a9da-6ea0f49306c3 tempest-VolumesGetTest-1998535251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (924ffefc-7fb8-42cc-b464-a3416c630d47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:34:51.466673 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-86c8eda4-b796-47a7-a9da-6ea0f49306c3 tempest-VolumesGetTest-1998535251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (924ffefc-7fb8-42cc-b464-a3416c630d47) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ebfba50b-3ada-426a-b5af-8e32a4506718', 'volume_name': 'volume-ebfba50b-3ada-426a-b5af-8e32a4506718', 'volume_size': 1}' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:34:51.471750 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-86c8eda4-b796-47a7-a9da-6ea0f49306c3 tempest-VolumesGetTest-1998535251 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70b9e76b-98b2-4520-a2d4-2b25bccda453) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:34:51.476767 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-86c8eda4-b796-47a7-a9da-6ea0f49306c3 tempest-VolumesGetTest-1998535251 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70b9e76b-98b2-4520-a2d4-2b25bccda453) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:34:51.481667 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-86c8eda4-b796-47a7-a9da-6ea0f49306c3 tempest-VolumesGetTest-1998535251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d0896b8-3b4c-4909-bc6c-f5578441111b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:34:51.482772 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.flows.manager.create_volume [None req-86c8eda4-b796-47a7-a9da-6ea0f49306c3 tempest-VolumesGetTest-1998535251 None] Volume ebfba50b-3ada-426a-b5af-8e32a4506718: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ebfba50b-3ada-426a-b5af-8e32a4506718', 'volume_size': 1} Jan 22 21:34:51.483166 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-86c8eda4-b796-47a7-a9da-6ea0f49306c3 tempest-VolumesGetTest-1998535251 None] creating volume 'volume-ebfba50b-3ada-426a-b5af-8e32a4506718' {{(pid=129952) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Jan 22 21:34:51.484147 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-86c8eda4-b796-47a7-a9da-6ea0f49306c3 tempest-VolumesGetTest-1998535251 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:34:52.580017 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-86c8eda4-b796-47a7-a9da-6ea0f49306c3 tempest-VolumesGetTest-1998535251 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129952) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 22 21:34:52.580662 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-86c8eda4-b796-47a7-a9da-6ea0f49306c3 tempest-VolumesGetTest-1998535251 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129952) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 22 21:34:52.584284 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-86c8eda4-b796-47a7-a9da-6ea0f49306c3 tempest-VolumesGetTest-1998535251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d0896b8-3b4c-4909-bc6c-f5578441111b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ebfba50b-3ada-426a-b5af-8e32a4506718', 'volume_size': 1}' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:34:52.589115 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-86c8eda4-b796-47a7-a9da-6ea0f49306c3 tempest-VolumesGetTest-1998535251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e37ee803-0abf-40f9-938b-14c90da3c81f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:34:52.685890 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.flows.manager.create_volume [None req-86c8eda4-b796-47a7-a9da-6ea0f49306c3 tempest-VolumesGetTest-1998535251 None] Volume volume-ebfba50b-3ada-426a-b5af-8e32a4506718 (ebfba50b-3ada-426a-b5af-8e32a4506718): created successfully Jan 22 21:34:52.689645 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-86c8eda4-b796-47a7-a9da-6ea0f49306c3 tempest-VolumesGetTest-1998535251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e37ee803-0abf-40f9-938b-14c90da3c81f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:34:52.696174 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-86c8eda4-b796-47a7-a9da-6ea0f49306c3 tempest-VolumesGetTest-1998535251 None] Flow 'volume_create_manager' (c10314c3-7a4f-4f5c-a298-b9d2bd7045c5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129952) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 22 21:34:52.786292 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-86c8eda4-b796-47a7-a9da-6ea0f49306c3 tempest-VolumesGetTest-1998535251 None] Created volume successfully. Jan 22 21:34:54.729175 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.flows.manager.create_volume [None req-aa5d564f-7d30-42c5-ae0b-07bcfd86053c tempest-VolumesGetTest-1998535251 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129952) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Jan 22 21:34:54.735790 ncdv-master-1 cinder-volume[129952]: WARNING stevedore.named [None req-aa5d564f-7d30-42c5-ae0b-07bcfd86053c tempest-VolumesGetTest-1998535251 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jan 22 21:34:54.735790 ncdv-master-1 cinder-volume[129952]: WARNING castellan.key_manager [None req-aa5d564f-7d30-42c5-ae0b-07bcfd86053c tempest-VolumesGetTest-1998535251 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 22 21:34:54.765741 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-aa5d564f-7d30-42c5-ae0b-07bcfd86053c tempest-VolumesGetTest-1998535251 None] Flow 'volume_create_manager' (05c50786-a65c-441b-8fb6-c31dd9bf2a39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 22 21:34:54.773882 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-aa5d564f-7d30-42c5-ae0b-07bcfd86053c tempest-VolumesGetTest-1998535251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d4de4f9-6ee0-44db-9d13-8b7d037baa92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:34:54.782317 ncdv-master-1 cinder-volume[129952]: DEBUG oslo_db.sqlalchemy.engines [None req-aa5d564f-7d30-42c5-ae0b-07bcfd86053c tempest-VolumesGetTest-1998535251 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129952) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 22 21:34:54.798976 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-aa5d564f-7d30-42c5-ae0b-07bcfd86053c tempest-VolumesGetTest-1998535251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d4de4f9-6ee0-44db-9d13-8b7d037baa92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-01-22T21:34:54Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-486940477',display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=b67d87f3-bac4-47a6-9aea-81db18992096,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db23715a4466471abfb9e11a261fee71',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-01-22T21:34:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-01-22T21:34:55Z,use_quota=True,user_id='209c06231de64d2b9d3f5eee76baf31e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6dacb05b-a7ea-4056-85ff-98f0ea5c54eb),volume_type_id=6dacb05b-a7ea-4056-85ff-98f0ea5c54eb)' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:34:54.805098 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-aa5d564f-7d30-42c5-ae0b-07bcfd86053c tempest-VolumesGetTest-1998535251 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f3256ce-a643-4cf6-8cd1-069d24c74f6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:34:54.809601 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-aa5d564f-7d30-42c5-ae0b-07bcfd86053c tempest-VolumesGetTest-1998535251 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f3256ce-a643-4cf6-8cd1-069d24c74f6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:34:54.814740 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-aa5d564f-7d30-42c5-ae0b-07bcfd86053c tempest-VolumesGetTest-1998535251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9ea4abb-4f84-422c-a666-8e09b7425aa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:34:54.818994 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-aa5d564f-7d30-42c5-ae0b-07bcfd86053c tempest-VolumesGetTest-1998535251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9ea4abb-4f84-422c-a666-8e09b7425aa1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b67d87f3-bac4-47a6-9aea-81db18992096', 'volume_name': 'volume-b67d87f3-bac4-47a6-9aea-81db18992096', 'volume_size': 1}' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:34:54.825043 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-aa5d564f-7d30-42c5-ae0b-07bcfd86053c tempest-VolumesGetTest-1998535251 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d1bb826-7259-410b-865e-240079efccdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:34:54.829078 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-aa5d564f-7d30-42c5-ae0b-07bcfd86053c tempest-VolumesGetTest-1998535251 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d1bb826-7259-410b-865e-240079efccdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:34:54.833949 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-aa5d564f-7d30-42c5-ae0b-07bcfd86053c tempest-VolumesGetTest-1998535251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a1c5e02-b2c2-4cc2-9655-f3bef0f06428) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:34:54.835828 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.flows.manager.create_volume [None req-aa5d564f-7d30-42c5-ae0b-07bcfd86053c tempest-VolumesGetTest-1998535251 None] Volume b67d87f3-bac4-47a6-9aea-81db18992096: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b67d87f3-bac4-47a6-9aea-81db18992096', 'volume_size': 1} Jan 22 21:34:54.836457 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-aa5d564f-7d30-42c5-ae0b-07bcfd86053c tempest-VolumesGetTest-1998535251 None] creating volume 'volume-b67d87f3-bac4-47a6-9aea-81db18992096' {{(pid=129952) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Jan 22 21:34:54.837377 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-aa5d564f-7d30-42c5-ae0b-07bcfd86053c tempest-VolumesGetTest-1998535251 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:34:55.694949 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-aa5d564f-7d30-42c5-ae0b-07bcfd86053c tempest-VolumesGetTest-1998535251 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129952) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 22 21:34:55.695602 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-aa5d564f-7d30-42c5-ae0b-07bcfd86053c tempest-VolumesGetTest-1998535251 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129952) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 22 21:34:55.699574 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-aa5d564f-7d30-42c5-ae0b-07bcfd86053c tempest-VolumesGetTest-1998535251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a1c5e02-b2c2-4cc2-9655-f3bef0f06428) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b67d87f3-bac4-47a6-9aea-81db18992096', 'volume_size': 1}' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:34:55.704305 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-aa5d564f-7d30-42c5-ae0b-07bcfd86053c tempest-VolumesGetTest-1998535251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3927e869-961e-4cac-bec5-d0b1c7fc9763) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:34:55.868848 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.flows.manager.create_volume [None req-aa5d564f-7d30-42c5-ae0b-07bcfd86053c tempest-VolumesGetTest-1998535251 None] Volume volume-b67d87f3-bac4-47a6-9aea-81db18992096 (b67d87f3-bac4-47a6-9aea-81db18992096): created successfully Jan 22 21:34:55.872561 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-aa5d564f-7d30-42c5-ae0b-07bcfd86053c tempest-VolumesGetTest-1998535251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3927e869-961e-4cac-bec5-d0b1c7fc9763) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:34:55.878119 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-aa5d564f-7d30-42c5-ae0b-07bcfd86053c tempest-VolumesGetTest-1998535251 None] Flow 'volume_create_manager' (05c50786-a65c-441b-8fb6-c31dd9bf2a39) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129952) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 22 21:34:55.949663 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-e178c96a-ddfa-4636-a4d4-674bc23d6464 tempest-VolumesBackupsTest-1274070825 None] volume is a clone so cleaning references {{(pid=129952) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1266}} Jan 22 21:34:56.103757 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-e178c96a-ddfa-4636-a4d4-674bc23d6464 tempest-VolumesBackupsTest-1274070825 None] deleting parent snapshot volume-8ce51a79-e21d-40d7-9de1-28e5ee775236.clone_snap {{(pid=129952) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1158}} Jan 22 21:34:58.129426 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-aa5d564f-7d30-42c5-ae0b-07bcfd86053c tempest-VolumesGetTest-1998535251 None] Created volume successfully. Jan 22 21:34:58.143639 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.coordination [None req-9d712b05-3531-4607-a852-d62704070da3 tempest-VolumesGetTest-1998535251 None] Lock "b'cinder-b67d87f3-bac4-47a6-9aea-81db18992096-delete_volume'" acquired by "delete_volume" :: waited 0.016s {{(pid=129952) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 22 21:34:58.255458 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.quota [None req-e178c96a-ddfa-4636-a4d4-674bc23d6464 tempest-VolumesBackupsTest-1274070825 None] Created reservations ['d790f798-6e28-4e0d-8853-7a261a6106d1', '1ac95be3-6d5d-4c5c-af64-80c21e067cdd', '5f8522fa-9a5e-42e7-a0b3-fd77410243f3', '9dca879f-4279-4c34-ab7e-c0f2cda3be42'] {{(pid=129952) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 22 21:34:58.270626 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-9d712b05-3531-4607-a852-d62704070da3 tempest-VolumesGetTest-1998535251 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:34:58.457347 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-9d712b05-3531-4607-a852-d62704070da3 tempest-VolumesGetTest-1998535251 None] volume has no backup snaps {{(pid=129952) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Jan 22 21:34:58.457818 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-9d712b05-3531-4607-a852-d62704070da3 tempest-VolumesGetTest-1998535251 None] Volume volume-b67d87f3-bac4-47a6-9aea-81db18992096 is not a clone. {{(pid=129952) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Jan 22 21:34:58.543566 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-9d712b05-3531-4607-a852-d62704070da3 tempest-VolumesGetTest-1998535251 None] deleting rbd volume volume-b67d87f3-bac4-47a6-9aea-81db18992096 {{(pid=129952) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Jan 22 21:34:58.700940 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-e178c96a-ddfa-4636-a4d4-674bc23d6464 tempest-VolumesBackupsTest-1274070825 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:34:58.731438 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-e178c96a-ddfa-4636-a4d4-674bc23d6464 tempest-VolumesBackupsTest-1274070825 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:34:58.769207 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.manager [None req-e178c96a-ddfa-4636-a4d4-674bc23d6464 tempest-VolumesBackupsTest-1274070825 None] Notifying Schedulers of capabilities ... {{(pid=129952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 22 21:34:58.774540 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-e178c96a-ddfa-4636-a4d4-674bc23d6464 tempest-VolumesBackupsTest-1274070825 None] Deleted volume successfully. Jan 22 21:34:58.873394 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.coordination [None req-e178c96a-ddfa-4636-a4d4-674bc23d6464 tempest-VolumesBackupsTest-1274070825 None] Lock "b'cinder-8ce51a79-e21d-40d7-9de1-28e5ee775236-delete_volume'" released by "delete_volume" :: held 9.794s {{(pid=129952) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 22 21:35:01.746729 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.quota [None req-9d712b05-3531-4607-a852-d62704070da3 tempest-VolumesGetTest-1998535251 None] Created reservations ['e78094b9-47c2-47a0-af73-cbbd8f6ce715', '23d67ccf-f3b3-429c-a1dc-d92dacc5d02a', '1b3b1081-6116-417d-81c5-87ada023e623', 'd3e26e3b-0eb9-45bc-9e5d-1072890fd80a'] {{(pid=129952) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 22 21:35:01.938052 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-9d712b05-3531-4607-a852-d62704070da3 tempest-VolumesGetTest-1998535251 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:35:01.966041 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-9d712b05-3531-4607-a852-d62704070da3 tempest-VolumesGetTest-1998535251 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:35:01.999560 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.manager [None req-9d712b05-3531-4607-a852-d62704070da3 tempest-VolumesGetTest-1998535251 None] Notifying Schedulers of capabilities ... {{(pid=129952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 22 21:35:02.008585 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-9d712b05-3531-4607-a852-d62704070da3 tempest-VolumesGetTest-1998535251 None] Deleted volume successfully. Jan 22 21:35:02.096539 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.coordination [None req-9d712b05-3531-4607-a852-d62704070da3 tempest-VolumesGetTest-1998535251 None] Lock "b'cinder-b67d87f3-bac4-47a6-9aea-81db18992096-delete_volume'" released by "delete_volume" :: held 3.953s {{(pid=129952) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 22 21:35:02.513159 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.coordination [None req-94c2bd82-14dd-4a97-a593-c7cd29510dc3 tempest-VolumesGetTest-1998535251 None] Lock "b'cinder-ebfba50b-3ada-426a-b5af-8e32a4506718-delete_volume'" acquired by "delete_volume" :: waited 0.009s {{(pid=129952) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 22 21:35:02.675158 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-94c2bd82-14dd-4a97-a593-c7cd29510dc3 tempest-VolumesGetTest-1998535251 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:35:02.959711 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-94c2bd82-14dd-4a97-a593-c7cd29510dc3 tempest-VolumesGetTest-1998535251 None] volume has no backup snaps {{(pid=129952) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Jan 22 21:35:02.960355 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-94c2bd82-14dd-4a97-a593-c7cd29510dc3 tempest-VolumesGetTest-1998535251 None] Volume volume-ebfba50b-3ada-426a-b5af-8e32a4506718 is not a clone. {{(pid=129952) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Jan 22 21:35:03.087234 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-94c2bd82-14dd-4a97-a593-c7cd29510dc3 tempest-VolumesGetTest-1998535251 None] deleting rbd volume volume-ebfba50b-3ada-426a-b5af-8e32a4506718 {{(pid=129952) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Jan 22 21:35:03.210315 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.flows.manager.create_volume [None req-5bf61bd1-274e-4dde-a3e1-c603300027aa tempest-VolumesExtendTest-172453353 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129952) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Jan 22 21:35:03.214432 ncdv-master-1 cinder-volume[129952]: WARNING stevedore.named [None req-5bf61bd1-274e-4dde-a3e1-c603300027aa tempest-VolumesExtendTest-172453353 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jan 22 21:35:03.214874 ncdv-master-1 cinder-volume[129952]: WARNING castellan.key_manager [None req-5bf61bd1-274e-4dde-a3e1-c603300027aa tempest-VolumesExtendTest-172453353 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 22 21:35:03.233868 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-5bf61bd1-274e-4dde-a3e1-c603300027aa tempest-VolumesExtendTest-172453353 None] Flow 'volume_create_manager' (f9ac16c6-76e5-4913-8703-f007340c2a72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 22 21:35:03.240522 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-5bf61bd1-274e-4dde-a3e1-c603300027aa tempest-VolumesExtendTest-172453353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d24aeb06-4bf5-469d-9571-c3c5d8f3d66d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:35:03.247281 ncdv-master-1 cinder-volume[129952]: DEBUG oslo_db.sqlalchemy.engines [None req-5bf61bd1-274e-4dde-a3e1-c603300027aa tempest-VolumesExtendTest-172453353 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129952) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 22 21:35:03.261947 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-5bf61bd1-274e-4dde-a3e1-c603300027aa tempest-VolumesExtendTest-172453353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d24aeb06-4bf5-469d-9571-c3c5d8f3d66d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-01-22T21:35:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-142623485',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=1aae6e34-1ad9-45a9-b65c-5468341db12f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a42d0a4fe8243169ed95b1b34961af1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-01-22T21:35:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-01-22T21:35:03Z,use_quota=True,user_id='4d2e2691a83f416684637163814ce55f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6dacb05b-a7ea-4056-85ff-98f0ea5c54eb),volume_type_id=6dacb05b-a7ea-4056-85ff-98f0ea5c54eb)' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:35:03.267468 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-5bf61bd1-274e-4dde-a3e1-c603300027aa tempest-VolumesExtendTest-172453353 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7b80b6b-6d62-4ea1-a436-b416f959d9e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:35:03.271660 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-5bf61bd1-274e-4dde-a3e1-c603300027aa tempest-VolumesExtendTest-172453353 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7b80b6b-6d62-4ea1-a436-b416f959d9e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:35:03.277698 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-5bf61bd1-274e-4dde-a3e1-c603300027aa tempest-VolumesExtendTest-172453353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f00dfab4-e80f-4c32-9995-af808aada7ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:35:03.358506 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-5bf61bd1-274e-4dde-a3e1-c603300027aa tempest-VolumesExtendTest-172453353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f00dfab4-e80f-4c32-9995-af808aada7ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '1aae6e34-1ad9-45a9-b65c-5468341db12f', 'volume_name': 'volume-1aae6e34-1ad9-45a9-b65c-5468341db12f', 'volume_size': 1, 'image_id': '373cb480-3bc4-4821-93e2-442b4e852b80', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '994e8f6963f04af3be3dbae11a73cdfd', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '373cb480-3bc4-4821-93e2-442b4e852b80', 'created_at': datetime.datetime(2022, 1, 22, 20, 50, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 1, 22, 20, 50, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/373cb480-3bc4-4821-93e2-442b4e852b80/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:35:03.363945 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-5bf61bd1-274e-4dde-a3e1-c603300027aa tempest-VolumesExtendTest-172453353 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f31be959-9c33-41e8-acd2-aba1fefa6441) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:35:03.368908 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-5bf61bd1-274e-4dde-a3e1-c603300027aa tempest-VolumesExtendTest-172453353 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f31be959-9c33-41e8-acd2-aba1fefa6441) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:35:03.373892 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-5bf61bd1-274e-4dde-a3e1-c603300027aa tempest-VolumesExtendTest-172453353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67cc55b6-dd4b-4afb-94f4-9754f3f7f0a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:35:03.375060 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.flows.manager.create_volume [None req-5bf61bd1-274e-4dde-a3e1-c603300027aa tempest-VolumesExtendTest-172453353 None] Volume 1aae6e34-1ad9-45a9-b65c-5468341db12f: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-1aae6e34-1ad9-45a9-b65c-5468341db12f', 'volume_size': 1, 'image_id': '373cb480-3bc4-4821-93e2-442b4e852b80', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '994e8f6963f04af3be3dbae11a73cdfd', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '373cb480-3bc4-4821-93e2-442b4e852b80', 'created_at': datetime.datetime(2022, 1, 22, 20, 50, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 1, 22, 20, 50, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/373cb480-3bc4-4821-93e2-442b4e852b80/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jan 22 21:35:03.375638 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.flows.manager.create_volume [None req-5bf61bd1-274e-4dde-a3e1-c603300027aa tempest-VolumesExtendTest-172453353 None] Cloning 1aae6e34-1ad9-45a9-b65c-5468341db12f from image 373cb480-3bc4-4821-93e2-442b4e852b80 at location (None, None). {{(pid=129952) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1046}} Jan 22 21:35:03.386758 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.coordination [None req-5bf61bd1-274e-4dde-a3e1-c603300027aa tempest-VolumesExtendTest-172453353 None] Lock "b'cinder-373cb480-3bc4-4821-93e2-442b4e852b80'" acquired by "_prepare_image_cache_entry" :: waited 0.009s {{(pid=129952) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 22 21:35:03.480414 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.image.cache [None req-5bf61bd1-274e-4dde-a3e1-c603300027aa tempest-VolumesExtendTest-172453353 None] Found image-volume cache entry: {'id': 1, 'image_id': '373cb480-3bc4-4821-93e2-442b4e852b80', 'volume_id': 'f39c1078-cff4-40dd-93df-4ce49cd873b4', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 1, 22, 20, 50, 57), 'last_used': datetime.datetime(2022, 1, 22, 21, 35, 3, 389287)}. {{(pid=129952) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Jan 22 21:35:03.480859 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.image.cache [None req-5bf61bd1-274e-4dde-a3e1-c603300027aa tempest-VolumesExtendTest-172453353 None] Image-volume cache entry image_update_at = 2022-01-22 20:50:57+00:00, requested image updated_at = 2022-01-22 20:50:57+00:00. {{(pid=129952) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Jan 22 21:35:03.481266 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.flows.manager.create_volume [None req-5bf61bd1-274e-4dde-a3e1-c603300027aa tempest-VolumesExtendTest-172453353 None] Found cache entry for image = 373cb480-3bc4-4821-93e2-442b4e852b80 on host ncdv-master-1@ceph#ceph. {{(pid=129952) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:869}} Jan 22 21:35:03.485648 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.coordination [None req-5bf61bd1-274e-4dde-a3e1-c603300027aa tempest-VolumesExtendTest-172453353 None] Lock "b'cinder-373cb480-3bc4-4821-93e2-442b4e852b80'" released by "_prepare_image_cache_entry" :: held 0.100s {{(pid=129952) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 22 21:35:03.486570 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.flows.manager.create_volume [None req-5bf61bd1-274e-4dde-a3e1-c603300027aa tempest-VolumesExtendTest-172453353 None] Attempting to retrieve cache entry for image = 373cb480-3bc4-4821-93e2-442b4e852b80 on host ncdv-master-1@ceph#ceph. {{(pid=129952) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:810}} Jan 22 21:35:03.493620 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.image.cache [None req-5bf61bd1-274e-4dde-a3e1-c603300027aa tempest-VolumesExtendTest-172453353 None] Found image-volume cache entry: {'id': 1, 'image_id': '373cb480-3bc4-4821-93e2-442b4e852b80', 'volume_id': 'f39c1078-cff4-40dd-93df-4ce49cd873b4', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 1, 22, 20, 50, 57), 'last_used': datetime.datetime(2022, 1, 22, 21, 35, 3, 490106)}. {{(pid=129952) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Jan 22 21:35:03.494071 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.image.cache [None req-5bf61bd1-274e-4dde-a3e1-c603300027aa tempest-VolumesExtendTest-172453353 None] Image-volume cache entry image_update_at = 2022-01-22 20:50:57+00:00, requested image updated_at = 2022-01-22 20:50:57+00:00. {{(pid=129952) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Jan 22 21:35:03.494467 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.flows.manager.create_volume [None req-5bf61bd1-274e-4dde-a3e1-c603300027aa tempest-VolumesExtendTest-172453353 None] Creating from source image-volume f39c1078-cff4-40dd-93df-4ce49cd873b4 {{(pid=129952) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:824}} Jan 22 21:35:03.505881 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-5bf61bd1-274e-4dde-a3e1-c603300027aa tempest-VolumesExtendTest-172453353 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:35:03.797181 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-5bf61bd1-274e-4dde-a3e1-c603300027aa tempest-VolumesExtendTest-172453353 None] creating snapshot='volume-1aae6e34-1ad9-45a9-b65c-5468341db12f.clone_snap' {{(pid=129952) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:725}} Jan 22 21:35:06.050061 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-5bf61bd1-274e-4dde-a3e1-c603300027aa tempest-VolumesExtendTest-172453353 None] cloning 'volume-f39c1078-cff4-40dd-93df-4ce49cd873b4@volume-1aae6e34-1ad9-45a9-b65c-5468341db12f.clone_snap' to 'volume-1aae6e34-1ad9-45a9-b65c-5468341db12f' {{(pid=129952) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:731}} Jan 22 21:35:06.211067 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.flows.manager.create_volume [None req-b8a5a9be-ed9e-4dc6-a706-a787bc3bd928 tempest-VolumesSnapshotTestJSON-664893185 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129952) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Jan 22 21:35:06.214454 ncdv-master-1 cinder-volume[129952]: WARNING stevedore.named [None req-b8a5a9be-ed9e-4dc6-a706-a787bc3bd928 tempest-VolumesSnapshotTestJSON-664893185 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jan 22 21:35:06.219358 ncdv-master-1 cinder-volume[129952]: WARNING castellan.key_manager [None req-b8a5a9be-ed9e-4dc6-a706-a787bc3bd928 tempest-VolumesSnapshotTestJSON-664893185 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 22 21:35:06.234399 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-b8a5a9be-ed9e-4dc6-a706-a787bc3bd928 tempest-VolumesSnapshotTestJSON-664893185 None] Flow 'volume_create_manager' (21837ef1-1504-4b17-a4ec-32853f078b05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 22 21:35:06.240998 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-b8a5a9be-ed9e-4dc6-a706-a787bc3bd928 tempest-VolumesSnapshotTestJSON-664893185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (faaaa3c0-f641-43cb-ad6f-71f8fa0c8eb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:35:06.247929 ncdv-master-1 cinder-volume[129952]: DEBUG oslo_db.sqlalchemy.engines [None req-b8a5a9be-ed9e-4dc6-a706-a787bc3bd928 tempest-VolumesSnapshotTestJSON-664893185 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129952) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 22 21:35:06.262770 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-b8a5a9be-ed9e-4dc6-a706-a787bc3bd928 tempest-VolumesSnapshotTestJSON-664893185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (faaaa3c0-f641-43cb-ad6f-71f8fa0c8eb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-01-22T21:35:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-844177280',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=03eda9d7-c3c3-4b8d-8aa5-a1533f9ce58b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='037b801bacb742d89e5ea8f5e59ec7b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-01-22T21:35:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-01-22T21:35:04Z,use_quota=True,user_id='912fa15040dc442fa281a72320a10dc5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6dacb05b-a7ea-4056-85ff-98f0ea5c54eb),volume_type_id=6dacb05b-a7ea-4056-85ff-98f0ea5c54eb)' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:35:06.268304 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-b8a5a9be-ed9e-4dc6-a706-a787bc3bd928 tempest-VolumesSnapshotTestJSON-664893185 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de8647bf-a148-419a-a2fd-b324d4feebfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:35:06.272650 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-b8a5a9be-ed9e-4dc6-a706-a787bc3bd928 tempest-VolumesSnapshotTestJSON-664893185 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de8647bf-a148-419a-a2fd-b324d4feebfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:35:06.278210 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-b8a5a9be-ed9e-4dc6-a706-a787bc3bd928 tempest-VolumesSnapshotTestJSON-664893185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d078a4c9-f387-4770-9d8f-1729aa941c13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:35:06.376061 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-b8a5a9be-ed9e-4dc6-a706-a787bc3bd928 tempest-VolumesSnapshotTestJSON-664893185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d078a4c9-f387-4770-9d8f-1729aa941c13) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '03eda9d7-c3c3-4b8d-8aa5-a1533f9ce58b', 'volume_name': 'volume-03eda9d7-c3c3-4b8d-8aa5-a1533f9ce58b', 'volume_size': 1, 'image_id': '373cb480-3bc4-4821-93e2-442b4e852b80', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '994e8f6963f04af3be3dbae11a73cdfd', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '373cb480-3bc4-4821-93e2-442b4e852b80', 'created_at': datetime.datetime(2022, 1, 22, 20, 50, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 1, 22, 20, 50, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/373cb480-3bc4-4821-93e2-442b4e852b80/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:35:06.381328 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-b8a5a9be-ed9e-4dc6-a706-a787bc3bd928 tempest-VolumesSnapshotTestJSON-664893185 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09befcc5-3aa0-4dc0-a6e7-709392d197af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:35:06.389408 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-b8a5a9be-ed9e-4dc6-a706-a787bc3bd928 tempest-VolumesSnapshotTestJSON-664893185 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09befcc5-3aa0-4dc0-a6e7-709392d197af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:35:06.390610 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-b8a5a9be-ed9e-4dc6-a706-a787bc3bd928 tempest-VolumesSnapshotTestJSON-664893185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3cd430e5-d39d-4217-937a-e6921da04882) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:35:06.391808 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.flows.manager.create_volume [None req-b8a5a9be-ed9e-4dc6-a706-a787bc3bd928 tempest-VolumesSnapshotTestJSON-664893185 None] Volume 03eda9d7-c3c3-4b8d-8aa5-a1533f9ce58b: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-03eda9d7-c3c3-4b8d-8aa5-a1533f9ce58b', 'volume_size': 1, 'image_id': '373cb480-3bc4-4821-93e2-442b4e852b80', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '994e8f6963f04af3be3dbae11a73cdfd', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '373cb480-3bc4-4821-93e2-442b4e852b80', 'created_at': datetime.datetime(2022, 1, 22, 20, 50, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 1, 22, 20, 50, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/373cb480-3bc4-4821-93e2-442b4e852b80/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jan 22 21:35:06.392839 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.flows.manager.create_volume [None req-b8a5a9be-ed9e-4dc6-a706-a787bc3bd928 tempest-VolumesSnapshotTestJSON-664893185 None] Cloning 03eda9d7-c3c3-4b8d-8aa5-a1533f9ce58b from image 373cb480-3bc4-4821-93e2-442b4e852b80 at location (None, None). {{(pid=129952) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1046}} Jan 22 21:35:06.401195 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.coordination [None req-b8a5a9be-ed9e-4dc6-a706-a787bc3bd928 tempest-VolumesSnapshotTestJSON-664893185 None] Lock "b'cinder-373cb480-3bc4-4821-93e2-442b4e852b80'" acquired by "_prepare_image_cache_entry" :: waited 0.008s {{(pid=129952) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 22 21:35:06.495091 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.image.cache [None req-b8a5a9be-ed9e-4dc6-a706-a787bc3bd928 tempest-VolumesSnapshotTestJSON-664893185 None] Found image-volume cache entry: {'id': 1, 'image_id': '373cb480-3bc4-4821-93e2-442b4e852b80', 'volume_id': 'f39c1078-cff4-40dd-93df-4ce49cd873b4', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 1, 22, 20, 50, 57), 'last_used': datetime.datetime(2022, 1, 22, 21, 35, 6, 405596)}. {{(pid=129952) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Jan 22 21:35:06.495522 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.image.cache [None req-b8a5a9be-ed9e-4dc6-a706-a787bc3bd928 tempest-VolumesSnapshotTestJSON-664893185 None] Image-volume cache entry image_update_at = 2022-01-22 20:50:57+00:00, requested image updated_at = 2022-01-22 20:50:57+00:00. {{(pid=129952) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Jan 22 21:35:06.495930 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.flows.manager.create_volume [None req-b8a5a9be-ed9e-4dc6-a706-a787bc3bd928 tempest-VolumesSnapshotTestJSON-664893185 None] Found cache entry for image = 373cb480-3bc4-4821-93e2-442b4e852b80 on host ncdv-master-1@ceph#ceph. {{(pid=129952) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:869}} Jan 22 21:35:06.500172 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.coordination [None req-b8a5a9be-ed9e-4dc6-a706-a787bc3bd928 tempest-VolumesSnapshotTestJSON-664893185 None] Lock "b'cinder-373cb480-3bc4-4821-93e2-442b4e852b80'" released by "_prepare_image_cache_entry" :: held 0.099s {{(pid=129952) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 22 21:35:06.501008 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.flows.manager.create_volume [None req-b8a5a9be-ed9e-4dc6-a706-a787bc3bd928 tempest-VolumesSnapshotTestJSON-664893185 None] Attempting to retrieve cache entry for image = 373cb480-3bc4-4821-93e2-442b4e852b80 on host ncdv-master-1@ceph#ceph. {{(pid=129952) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:810}} Jan 22 21:35:06.591510 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.image.cache [None req-b8a5a9be-ed9e-4dc6-a706-a787bc3bd928 tempest-VolumesSnapshotTestJSON-664893185 None] Found image-volume cache entry: {'id': 1, 'image_id': '373cb480-3bc4-4821-93e2-442b4e852b80', 'volume_id': 'f39c1078-cff4-40dd-93df-4ce49cd873b4', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 1, 22, 20, 50, 57), 'last_used': datetime.datetime(2022, 1, 22, 21, 35, 6, 504557)}. {{(pid=129952) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Jan 22 21:35:06.591926 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.image.cache [None req-b8a5a9be-ed9e-4dc6-a706-a787bc3bd928 tempest-VolumesSnapshotTestJSON-664893185 None] Image-volume cache entry image_update_at = 2022-01-22 20:50:57+00:00, requested image updated_at = 2022-01-22 20:50:57+00:00. {{(pid=129952) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Jan 22 21:35:06.592331 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.flows.manager.create_volume [None req-b8a5a9be-ed9e-4dc6-a706-a787bc3bd928 tempest-VolumesSnapshotTestJSON-664893185 None] Creating from source image-volume f39c1078-cff4-40dd-93df-4ce49cd873b4 {{(pid=129952) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:824}} Jan 22 21:35:06.604951 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-b8a5a9be-ed9e-4dc6-a706-a787bc3bd928 tempest-VolumesSnapshotTestJSON-664893185 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:35:06.826100 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-b8a5a9be-ed9e-4dc6-a706-a787bc3bd928 tempest-VolumesSnapshotTestJSON-664893185 None] creating snapshot='volume-03eda9d7-c3c3-4b8d-8aa5-a1533f9ce58b.clone_snap' {{(pid=129952) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:725}} Jan 22 21:35:08.510181 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-b8a5a9be-ed9e-4dc6-a706-a787bc3bd928 tempest-VolumesSnapshotTestJSON-664893185 None] cloning 'volume-f39c1078-cff4-40dd-93df-4ce49cd873b4@volume-03eda9d7-c3c3-4b8d-8aa5-a1533f9ce58b.clone_snap' to 'volume-03eda9d7-c3c3-4b8d-8aa5-a1533f9ce58b' {{(pid=129952) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:731}} Jan 22 21:35:08.560534 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-5bf61bd1-274e-4dde-a3e1-c603300027aa tempest-VolumesExtendTest-172453353 None] Volume volume-0b17e2f4-e149-4a4b-b525-3d029be2e6f6.deleted is not a clone. {{(pid=129952) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Jan 22 21:35:08.561876 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-5bf61bd1-274e-4dde-a3e1-c603300027aa tempest-VolumesExtendTest-172453353 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129952) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 22 21:35:08.562259 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-5bf61bd1-274e-4dde-a3e1-c603300027aa tempest-VolumesExtendTest-172453353 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129952) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 22 21:35:09.138066 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-5bf61bd1-274e-4dde-a3e1-c603300027aa tempest-VolumesExtendTest-172453353 None] clone created successfully {{(pid=129952) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:803}} Jan 22 21:35:09.138720 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.volume_utils [None req-5bf61bd1-274e-4dde-a3e1-c603300027aa tempest-VolumesExtendTest-172453353 None] Marking volume 1aae6e34-1ad9-45a9-b65c-5468341db12f as bootable. {{(pid=129952) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1178}} Jan 22 21:35:09.211568 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.flows.manager.create_volume [None req-5bf61bd1-274e-4dde-a3e1-c603300027aa tempest-VolumesExtendTest-172453353 None] Copying metadata from image 373cb480-3bc4-4821-93e2-442b4e852b80 to 1aae6e34-1ad9-45a9-b65c-5468341db12f. {{(pid=129952) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:443}} Jan 22 21:35:09.212519 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.flows.manager.create_volume [None req-5bf61bd1-274e-4dde-a3e1-c603300027aa tempest-VolumesExtendTest-172453353 None] Creating volume glance metadata for volume 1aae6e34-1ad9-45a9-b65c-5468341db12f backed by image 373cb480-3bc4-4821-93e2-442b4e852b80 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '373cb480-3bc4-4821-93e2-442b4e852b80', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=129952) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:666}} Jan 22 21:35:09.256782 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.quota [None req-94c2bd82-14dd-4a97-a593-c7cd29510dc3 tempest-VolumesGetTest-1998535251 None] Created reservations ['8077c93e-6356-453e-8c8d-db6fca95cb9d', '0596ee73-31b3-457e-98ed-50e9fc41cc1c', '0adf7963-d253-4caa-b31f-1abc0bb99070', '2be7d201-0a14-4fd8-9a52-6bbafb0c5c6a'] {{(pid=129952) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 22 21:35:09.309794 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-5bf61bd1-274e-4dde-a3e1-c603300027aa tempest-VolumesExtendTest-172453353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67cc55b6-dd4b-4afb-94f4-9754f3f7f0a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1aae6e34-1ad9-45a9-b65c-5468341db12f', 'volume_size': 1, 'image_id': '373cb480-3bc4-4821-93e2-442b4e852b80', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '994e8f6963f04af3be3dbae11a73cdfd', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '373cb480-3bc4-4821-93e2-442b4e852b80', 'created_at': datetime.datetime(2022, 1, 22, 20, 50, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 1, 22, 20, 50, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/373cb480-3bc4-4821-93e2-442b4e852b80/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:35:09.314648 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-5bf61bd1-274e-4dde-a3e1-c603300027aa tempest-VolumesExtendTest-172453353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2deb543f-bffa-4c84-a61f-5b64abb3240a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:35:09.377093 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.flows.manager.create_volume [None req-5bf61bd1-274e-4dde-a3e1-c603300027aa tempest-VolumesExtendTest-172453353 None] Volume volume-1aae6e34-1ad9-45a9-b65c-5468341db12f (1aae6e34-1ad9-45a9-b65c-5468341db12f): created successfully Jan 22 21:35:09.381208 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-5bf61bd1-274e-4dde-a3e1-c603300027aa tempest-VolumesExtendTest-172453353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2deb543f-bffa-4c84-a61f-5b64abb3240a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:35:09.388022 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-5bf61bd1-274e-4dde-a3e1-c603300027aa tempest-VolumesExtendTest-172453353 None] Flow 'volume_create_manager' (f9ac16c6-76e5-4913-8703-f007340c2a72) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129952) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 22 21:35:09.400994 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-94c2bd82-14dd-4a97-a593-c7cd29510dc3 tempest-VolumesGetTest-1998535251 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:35:09.427517 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-94c2bd82-14dd-4a97-a593-c7cd29510dc3 tempest-VolumesGetTest-1998535251 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:35:09.457654 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.manager [None req-94c2bd82-14dd-4a97-a593-c7cd29510dc3 tempest-VolumesGetTest-1998535251 None] Notifying Schedulers of capabilities ... {{(pid=129952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 22 21:35:09.460172 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-5bf61bd1-274e-4dde-a3e1-c603300027aa tempest-VolumesExtendTest-172453353 None] Created volume successfully. Jan 22 21:35:09.466861 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-94c2bd82-14dd-4a97-a593-c7cd29510dc3 tempest-VolumesGetTest-1998535251 None] Deleted volume successfully. Jan 22 21:35:09.572876 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.coordination [None req-94c2bd82-14dd-4a97-a593-c7cd29510dc3 tempest-VolumesGetTest-1998535251 None] Lock "b'cinder-ebfba50b-3ada-426a-b5af-8e32a4506718-delete_volume'" released by "delete_volume" :: held 7.060s {{(pid=129952) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 22 21:35:09.751340 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-b8a5a9be-ed9e-4dc6-a706-a787bc3bd928 tempest-VolumesSnapshotTestJSON-664893185 None] Volume volume-0b17e2f4-e149-4a4b-b525-3d029be2e6f6.deleted is not a clone. {{(pid=129952) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Jan 22 21:35:09.753107 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-b8a5a9be-ed9e-4dc6-a706-a787bc3bd928 tempest-VolumesSnapshotTestJSON-664893185 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129952) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 22 21:35:09.753575 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-b8a5a9be-ed9e-4dc6-a706-a787bc3bd928 tempest-VolumesSnapshotTestJSON-664893185 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129952) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 22 21:35:09.904250 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-b8a5a9be-ed9e-4dc6-a706-a787bc3bd928 tempest-VolumesSnapshotTestJSON-664893185 None] clone created successfully {{(pid=129952) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:803}} Jan 22 21:35:09.904994 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.volume_utils [None req-b8a5a9be-ed9e-4dc6-a706-a787bc3bd928 tempest-VolumesSnapshotTestJSON-664893185 None] Marking volume 03eda9d7-c3c3-4b8d-8aa5-a1533f9ce58b as bootable. {{(pid=129952) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1178}} Jan 22 21:35:09.974563 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.flows.manager.create_volume [None req-b8a5a9be-ed9e-4dc6-a706-a787bc3bd928 tempest-VolumesSnapshotTestJSON-664893185 None] Copying metadata from image 373cb480-3bc4-4821-93e2-442b4e852b80 to 03eda9d7-c3c3-4b8d-8aa5-a1533f9ce58b. {{(pid=129952) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:443}} Jan 22 21:35:09.974946 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.flows.manager.create_volume [None req-b8a5a9be-ed9e-4dc6-a706-a787bc3bd928 tempest-VolumesSnapshotTestJSON-664893185 None] Creating volume glance metadata for volume 03eda9d7-c3c3-4b8d-8aa5-a1533f9ce58b backed by image 373cb480-3bc4-4821-93e2-442b4e852b80 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '373cb480-3bc4-4821-93e2-442b4e852b80', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=129952) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:666}} Jan 22 21:35:10.087079 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-b8a5a9be-ed9e-4dc6-a706-a787bc3bd928 tempest-VolumesSnapshotTestJSON-664893185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3cd430e5-d39d-4217-937a-e6921da04882) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-03eda9d7-c3c3-4b8d-8aa5-a1533f9ce58b', 'volume_size': 1, 'image_id': '373cb480-3bc4-4821-93e2-442b4e852b80', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '994e8f6963f04af3be3dbae11a73cdfd', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '373cb480-3bc4-4821-93e2-442b4e852b80', 'created_at': datetime.datetime(2022, 1, 22, 20, 50, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 1, 22, 20, 50, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/373cb480-3bc4-4821-93e2-442b4e852b80/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:35:10.092234 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-b8a5a9be-ed9e-4dc6-a706-a787bc3bd928 tempest-VolumesSnapshotTestJSON-664893185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08e1fe6a-6f5b-43d8-bc59-4ec46e0c14e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:35:10.183265 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.flows.manager.create_volume [None req-b8a5a9be-ed9e-4dc6-a706-a787bc3bd928 tempest-VolumesSnapshotTestJSON-664893185 None] Volume volume-03eda9d7-c3c3-4b8d-8aa5-a1533f9ce58b (03eda9d7-c3c3-4b8d-8aa5-a1533f9ce58b): created successfully Jan 22 21:35:10.187419 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-b8a5a9be-ed9e-4dc6-a706-a787bc3bd928 tempest-VolumesSnapshotTestJSON-664893185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08e1fe6a-6f5b-43d8-bc59-4ec46e0c14e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:35:10.193681 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-b8a5a9be-ed9e-4dc6-a706-a787bc3bd928 tempest-VolumesSnapshotTestJSON-664893185 None] Flow 'volume_create_manager' (21837ef1-1504-4b17-a4ec-32853f078b05) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129952) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 22 21:35:10.227792 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-d8a0bb25-e6cc-4b84-aca0-1823d0ea6095 tempest-VolumesExtendTest-172453353 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:35:10.426997 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-b8a5a9be-ed9e-4dc6-a706-a787bc3bd928 tempest-VolumesSnapshotTestJSON-664893185 None] Created volume successfully. Jan 22 21:35:10.662054 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.flows.manager.create_volume [None req-7167abc0-7e06-4399-bc00-cc2c493065d2 tempest-VolumesGetTest-1998535251 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129952) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Jan 22 21:35:10.666057 ncdv-master-1 cinder-volume[129952]: WARNING stevedore.named [None req-7167abc0-7e06-4399-bc00-cc2c493065d2 tempest-VolumesGetTest-1998535251 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jan 22 21:35:10.666511 ncdv-master-1 cinder-volume[129952]: WARNING castellan.key_manager [None req-7167abc0-7e06-4399-bc00-cc2c493065d2 tempest-VolumesGetTest-1998535251 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 22 21:35:10.685882 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-7167abc0-7e06-4399-bc00-cc2c493065d2 tempest-VolumesGetTest-1998535251 None] Flow 'volume_create_manager' (5e4ea00c-4470-4bd4-b068-71ad91760f3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 22 21:35:10.692571 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-7167abc0-7e06-4399-bc00-cc2c493065d2 tempest-VolumesGetTest-1998535251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2afb337-0b66-4857-8897-dd7ec6906f50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:35:10.699429 ncdv-master-1 cinder-volume[129952]: DEBUG oslo_db.sqlalchemy.engines [None req-7167abc0-7e06-4399-bc00-cc2c493065d2 tempest-VolumesGetTest-1998535251 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129952) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 22 21:35:10.713394 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-7167abc0-7e06-4399-bc00-cc2c493065d2 tempest-VolumesGetTest-1998535251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2afb337-0b66-4857-8897-dd7ec6906f50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-01-22T21:35:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-741222202',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=5b3b3cd3-b314-44f8-ab15-4ce06657c94a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db23715a4466471abfb9e11a261fee71',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-01-22T21:35:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-01-22T21:35:11Z,use_quota=True,user_id='209c06231de64d2b9d3f5eee76baf31e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6dacb05b-a7ea-4056-85ff-98f0ea5c54eb),volume_type_id=6dacb05b-a7ea-4056-85ff-98f0ea5c54eb)' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:35:10.719062 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-7167abc0-7e06-4399-bc00-cc2c493065d2 tempest-VolumesGetTest-1998535251 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94602246-83f7-4338-aebc-2a797b4d1f8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:35:10.723363 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-7167abc0-7e06-4399-bc00-cc2c493065d2 tempest-VolumesGetTest-1998535251 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94602246-83f7-4338-aebc-2a797b4d1f8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:35:10.728689 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-7167abc0-7e06-4399-bc00-cc2c493065d2 tempest-VolumesGetTest-1998535251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02d85d36-4ed2-4b77-896b-29026057f072) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:35:10.733047 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-7167abc0-7e06-4399-bc00-cc2c493065d2 tempest-VolumesGetTest-1998535251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02d85d36-4ed2-4b77-896b-29026057f072) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5b3b3cd3-b314-44f8-ab15-4ce06657c94a', 'volume_name': 'volume-5b3b3cd3-b314-44f8-ab15-4ce06657c94a', 'volume_size': 1}' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:35:10.738095 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-7167abc0-7e06-4399-bc00-cc2c493065d2 tempest-VolumesGetTest-1998535251 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1baf61c-6bf1-4127-beed-f71bc0471aa6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:35:10.742209 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-7167abc0-7e06-4399-bc00-cc2c493065d2 tempest-VolumesGetTest-1998535251 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1baf61c-6bf1-4127-beed-f71bc0471aa6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:35:10.747894 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-7167abc0-7e06-4399-bc00-cc2c493065d2 tempest-VolumesGetTest-1998535251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b086de9-5c74-4bf0-8df7-c3384f9f41bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:35:10.748997 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.flows.manager.create_volume [None req-7167abc0-7e06-4399-bc00-cc2c493065d2 tempest-VolumesGetTest-1998535251 None] Volume 5b3b3cd3-b314-44f8-ab15-4ce06657c94a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5b3b3cd3-b314-44f8-ab15-4ce06657c94a', 'volume_size': 1} Jan 22 21:35:10.749395 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-7167abc0-7e06-4399-bc00-cc2c493065d2 tempest-VolumesGetTest-1998535251 None] creating volume 'volume-5b3b3cd3-b314-44f8-ab15-4ce06657c94a' {{(pid=129952) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Jan 22 21:35:10.750406 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-7167abc0-7e06-4399-bc00-cc2c493065d2 tempest-VolumesGetTest-1998535251 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:35:11.578625 ncdv-master-1 cinder-volume[129952]: DEBUG oslo_concurrency.processutils [req-b0814234-940a-4e3d-abb5-cf5e2ffcc149 req-792a6b66-8d2b-44da-a414-86ca8e709efe tempest-VolumesSnapshotTestJSON-664893185 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129952) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jan 22 21:35:11.687319 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-7167abc0-7e06-4399-bc00-cc2c493065d2 tempest-VolumesGetTest-1998535251 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129952) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 22 21:35:11.687960 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-7167abc0-7e06-4399-bc00-cc2c493065d2 tempest-VolumesGetTest-1998535251 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129952) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 22 21:35:11.692534 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-7167abc0-7e06-4399-bc00-cc2c493065d2 tempest-VolumesGetTest-1998535251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b086de9-5c74-4bf0-8df7-c3384f9f41bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5b3b3cd3-b314-44f8-ab15-4ce06657c94a', 'volume_size': 1}' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:35:11.698308 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-7167abc0-7e06-4399-bc00-cc2c493065d2 tempest-VolumesGetTest-1998535251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3a5dcbd-612e-4c91-9da1-1205f8a34270) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:35:11.770865 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-d8a0bb25-e6cc-4b84-aca0-1823d0ea6095 tempest-VolumesExtendTest-172453353 None] Extend volume from 1 GB to 2 GB. {{(pid=129952) extend_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1732}} Jan 22 21:35:11.783418 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.flows.manager.create_volume [None req-7167abc0-7e06-4399-bc00-cc2c493065d2 tempest-VolumesGetTest-1998535251 None] Volume volume-5b3b3cd3-b314-44f8-ab15-4ce06657c94a (5b3b3cd3-b314-44f8-ab15-4ce06657c94a): created successfully Jan 22 21:35:11.791035 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-7167abc0-7e06-4399-bc00-cc2c493065d2 tempest-VolumesGetTest-1998535251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3a5dcbd-612e-4c91-9da1-1205f8a34270) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:35:11.801883 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-7167abc0-7e06-4399-bc00-cc2c493065d2 tempest-VolumesGetTest-1998535251 None] Flow 'volume_create_manager' (5e4ea00c-4470-4bd4-b068-71ad91760f3b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129952) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 22 21:35:11.900621 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-7167abc0-7e06-4399-bc00-cc2c493065d2 tempest-VolumesGetTest-1998535251 None] Created volume successfully. Jan 22 21:35:11.968986 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-d8a0bb25-e6cc-4b84-aca0-1823d0ea6095 tempest-VolumesExtendTest-172453353 None] Extend volume completed successfully. Jan 22 21:35:12.410924 ncdv-master-1 cinder-volume[129952]: DEBUG oslo_concurrency.processutils [req-b0814234-940a-4e3d-abb5-cf5e2ffcc149 req-792a6b66-8d2b-44da-a414-86ca8e709efe tempest-VolumesSnapshotTestJSON-664893185 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.831s {{(pid=129952) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jan 22 21:35:12.414219 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [req-b0814234-940a-4e3d-abb5-cf5e2ffcc149 req-792a6b66-8d2b-44da-a414-86ca8e709efe tempest-VolumesSnapshotTestJSON-664893185 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-03eda9d7-c3c3-4b8d-8aa5-a1533f9ce58b', 'hosts': ['10.222.0.100'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'c7ee930a-3b87-450e-91f6-d4eef70cb484', 'volume_id': '03eda9d7-c3c3-4b8d-8aa5-a1533f9ce58b', 'discard': True}} {{(pid=129952) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Jan 22 21:35:12.532259 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [req-b0814234-940a-4e3d-abb5-cf5e2ffcc149 req-792a6b66-8d2b-44da-a414-86ca8e709efe tempest-VolumesSnapshotTestJSON-664893185 None] Connection info returned from driver {'name': 'volumes/volume-03eda9d7-c3c3-4b8d-8aa5-a1533f9ce58b', 'hosts': ['10.222.0.100'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '03eda9d7-c3c3-4b8d-8aa5-a1533f9ce58b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '19a7ca78-a92f-43b4-a890-217920daa30d'} {{(pid=129952) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4811}} Jan 22 21:35:12.654404 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [req-b0814234-940a-4e3d-abb5-cf5e2ffcc149 req-792a6b66-8d2b-44da-a414-86ca8e709efe tempest-VolumesSnapshotTestJSON-664893185 None] attachment_update completed successfully. Jan 22 21:35:13.282498 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.flows.manager.create_volume [None req-52a953fd-b140-41ee-bb70-ebd87ce14e48 tempest-VolumesExtendTest-172453353 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129952) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Jan 22 21:35:13.286637 ncdv-master-1 cinder-volume[129952]: WARNING stevedore.named [None req-52a953fd-b140-41ee-bb70-ebd87ce14e48 tempest-VolumesExtendTest-172453353 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jan 22 21:35:13.287120 ncdv-master-1 cinder-volume[129952]: WARNING castellan.key_manager [None req-52a953fd-b140-41ee-bb70-ebd87ce14e48 tempest-VolumesExtendTest-172453353 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 22 21:35:13.307230 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-52a953fd-b140-41ee-bb70-ebd87ce14e48 tempest-VolumesExtendTest-172453353 None] Flow 'volume_create_manager' (7e76fb60-81a5-4e26-a70d-b1d1bad89ef0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 22 21:35:13.314008 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-52a953fd-b140-41ee-bb70-ebd87ce14e48 tempest-VolumesExtendTest-172453353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20a10eea-d05c-46d0-a5f1-c2d3d80b148c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:35:13.321200 ncdv-master-1 cinder-volume[129952]: DEBUG oslo_db.sqlalchemy.engines [None req-52a953fd-b140-41ee-bb70-ebd87ce14e48 tempest-VolumesExtendTest-172453353 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129952) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 22 21:35:13.335975 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-52a953fd-b140-41ee-bb70-ebd87ce14e48 tempest-VolumesExtendTest-172453353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20a10eea-d05c-46d0-a5f1-c2d3d80b148c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-01-22T21:35:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-26443268',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=69a6832b-aea3-40d3-8b2a-cd428c15972f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a42d0a4fe8243169ed95b1b34961af1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-01-22T21:35:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-01-22T21:35:13Z,use_quota=True,user_id='4d2e2691a83f416684637163814ce55f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6dacb05b-a7ea-4056-85ff-98f0ea5c54eb),volume_type_id=6dacb05b-a7ea-4056-85ff-98f0ea5c54eb)' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:35:13.341901 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-52a953fd-b140-41ee-bb70-ebd87ce14e48 tempest-VolumesExtendTest-172453353 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3880521e-9dab-4512-ad3b-95156134443b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:35:13.346129 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-52a953fd-b140-41ee-bb70-ebd87ce14e48 tempest-VolumesExtendTest-172453353 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3880521e-9dab-4512-ad3b-95156134443b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:35:13.351442 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-52a953fd-b140-41ee-bb70-ebd87ce14e48 tempest-VolumesExtendTest-172453353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (578da35f-b39a-4de6-9663-d560b6283645) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:35:13.356541 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-52a953fd-b140-41ee-bb70-ebd87ce14e48 tempest-VolumesExtendTest-172453353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (578da35f-b39a-4de6-9663-d560b6283645) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '69a6832b-aea3-40d3-8b2a-cd428c15972f', 'volume_name': 'volume-69a6832b-aea3-40d3-8b2a-cd428c15972f', 'volume_size': 1}' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:35:13.361773 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-52a953fd-b140-41ee-bb70-ebd87ce14e48 tempest-VolumesExtendTest-172453353 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca644d5a-a8b1-4f8e-bf32-b46a2b7b351c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:35:13.365955 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-52a953fd-b140-41ee-bb70-ebd87ce14e48 tempest-VolumesExtendTest-172453353 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca644d5a-a8b1-4f8e-bf32-b46a2b7b351c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:35:13.371748 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-52a953fd-b140-41ee-bb70-ebd87ce14e48 tempest-VolumesExtendTest-172453353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d5fe0e3-85e8-4c5a-acbb-a76d62fcfd8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:35:13.372886 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.flows.manager.create_volume [None req-52a953fd-b140-41ee-bb70-ebd87ce14e48 tempest-VolumesExtendTest-172453353 None] Volume 69a6832b-aea3-40d3-8b2a-cd428c15972f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-69a6832b-aea3-40d3-8b2a-cd428c15972f', 'volume_size': 1} Jan 22 21:35:13.373306 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-52a953fd-b140-41ee-bb70-ebd87ce14e48 tempest-VolumesExtendTest-172453353 None] creating volume 'volume-69a6832b-aea3-40d3-8b2a-cd428c15972f' {{(pid=129952) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Jan 22 21:35:13.374424 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-52a953fd-b140-41ee-bb70-ebd87ce14e48 tempest-VolumesExtendTest-172453353 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:35:13.776739 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.flows.manager.create_volume [None req-67ef8905-7724-40e8-9011-67be0a34ce3d tempest-VolumesGetTest-1998535251 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129952) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Jan 22 21:35:13.780123 ncdv-master-1 cinder-volume[129952]: WARNING stevedore.named [None req-67ef8905-7724-40e8-9011-67be0a34ce3d tempest-VolumesGetTest-1998535251 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jan 22 21:35:13.780569 ncdv-master-1 cinder-volume[129952]: WARNING castellan.key_manager [None req-67ef8905-7724-40e8-9011-67be0a34ce3d tempest-VolumesGetTest-1998535251 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 22 21:35:13.813792 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-67ef8905-7724-40e8-9011-67be0a34ce3d tempest-VolumesGetTest-1998535251 None] Flow 'volume_create_manager' (59b028ac-31a6-43bc-a3e3-b27a22e7f9aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 22 21:35:13.820479 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-67ef8905-7724-40e8-9011-67be0a34ce3d tempest-VolumesGetTest-1998535251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57d485f4-6188-44ac-bc05-de324ac78d42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:35:13.834876 ncdv-master-1 cinder-volume[129952]: DEBUG oslo_db.sqlalchemy.engines [None req-67ef8905-7724-40e8-9011-67be0a34ce3d tempest-VolumesGetTest-1998535251 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129952) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 22 21:35:13.850586 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-67ef8905-7724-40e8-9011-67be0a34ce3d tempest-VolumesGetTest-1998535251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57d485f4-6188-44ac-bc05-de324ac78d42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-01-22T21:35:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1904789231',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=20e728bf-6a37-4a4e-a73e-5fed5af03fbd,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='db23715a4466471abfb9e11a261fee71',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-01-22T21:35:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=5b3b3cd3-b314-44f8-ab15-4ce06657c94a,status='creating',terminated_at=None,updated_at=2022-01-22T21:35:14Z,use_quota=True,user_id='209c06231de64d2b9d3f5eee76baf31e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6dacb05b-a7ea-4056-85ff-98f0ea5c54eb),volume_type_id=6dacb05b-a7ea-4056-85ff-98f0ea5c54eb)' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:35:13.857092 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-67ef8905-7724-40e8-9011-67be0a34ce3d tempest-VolumesGetTest-1998535251 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (450d5cac-9370-44b8-a4c6-d7b82dbf202f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:35:13.861461 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-67ef8905-7724-40e8-9011-67be0a34ce3d tempest-VolumesGetTest-1998535251 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (450d5cac-9370-44b8-a4c6-d7b82dbf202f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:35:13.866805 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-67ef8905-7724-40e8-9011-67be0a34ce3d tempest-VolumesGetTest-1998535251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc72dbd0-4603-4a64-afe3-87eeaf5c455d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:35:13.885230 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-67ef8905-7724-40e8-9011-67be0a34ce3d tempest-VolumesGetTest-1998535251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc72dbd0-4603-4a64-afe3-87eeaf5c455d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '20e728bf-6a37-4a4e-a73e-5fed5af03fbd', 'volume_name': 'volume-20e728bf-6a37-4a4e-a73e-5fed5af03fbd', 'volume_size': 1, 'source_volid': '5b3b3cd3-b314-44f8-ab15-4ce06657c94a', 'source_volstatus': 'available'}' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:35:13.890430 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-67ef8905-7724-40e8-9011-67be0a34ce3d tempest-VolumesGetTest-1998535251 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2112e7b6-83f7-4e34-a565-d0fa0f6b4fd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:35:13.894635 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-67ef8905-7724-40e8-9011-67be0a34ce3d tempest-VolumesGetTest-1998535251 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2112e7b6-83f7-4e34-a565-d0fa0f6b4fd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:35:13.900064 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-67ef8905-7724-40e8-9011-67be0a34ce3d tempest-VolumesGetTest-1998535251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1acc8198-e445-4e97-a754-7605e177052c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:35:13.901167 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.flows.manager.create_volume [None req-67ef8905-7724-40e8-9011-67be0a34ce3d tempest-VolumesGetTest-1998535251 None] Volume 20e728bf-6a37-4a4e-a73e-5fed5af03fbd: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-20e728bf-6a37-4a4e-a73e-5fed5af03fbd', 'volume_size': 1, 'source_volid': '5b3b3cd3-b314-44f8-ab15-4ce06657c94a', 'source_volstatus': 'available'} Jan 22 21:35:13.912794 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-67ef8905-7724-40e8-9011-67be0a34ce3d tempest-VolumesGetTest-1998535251 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:35:14.131928 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-67ef8905-7724-40e8-9011-67be0a34ce3d tempest-VolumesGetTest-1998535251 None] creating snapshot='volume-20e728bf-6a37-4a4e-a73e-5fed5af03fbd.clone_snap' {{(pid=129952) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:725}} Jan 22 21:35:16.376121 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-67ef8905-7724-40e8-9011-67be0a34ce3d tempest-VolumesGetTest-1998535251 None] cloning 'volume-5b3b3cd3-b314-44f8-ab15-4ce06657c94a@volume-20e728bf-6a37-4a4e-a73e-5fed5af03fbd.clone_snap' to 'volume-20e728bf-6a37-4a4e-a73e-5fed5af03fbd' {{(pid=129952) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:731}} Jan 22 21:35:16.377913 ncdv-master-1 cinder-volume[129952]: DEBUG oslo_service.periodic_task [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129952) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jan 22 21:35:16.380786 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:35:16.424348 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:35:16.455192 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.manager [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] Notifying Schedulers of capabilities ... {{(pid=129952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 22 21:35:16.464330 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-52a953fd-b140-41ee-bb70-ebd87ce14e48 tempest-VolumesExtendTest-172453353 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129952) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 22 21:35:16.464848 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-52a953fd-b140-41ee-bb70-ebd87ce14e48 tempest-VolumesExtendTest-172453353 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129952) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 22 21:35:16.468851 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-52a953fd-b140-41ee-bb70-ebd87ce14e48 tempest-VolumesExtendTest-172453353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d5fe0e3-85e8-4c5a-acbb-a76d62fcfd8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-69a6832b-aea3-40d3-8b2a-cd428c15972f', 'volume_size': 1}' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:35:16.473663 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-52a953fd-b140-41ee-bb70-ebd87ce14e48 tempest-VolumesExtendTest-172453353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6594a38-1e84-4bd1-a28c-e1798f3a66aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:35:16.611833 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.flows.manager.create_volume [None req-52a953fd-b140-41ee-bb70-ebd87ce14e48 tempest-VolumesExtendTest-172453353 None] Volume volume-69a6832b-aea3-40d3-8b2a-cd428c15972f (69a6832b-aea3-40d3-8b2a-cd428c15972f): created successfully Jan 22 21:35:16.623274 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-52a953fd-b140-41ee-bb70-ebd87ce14e48 tempest-VolumesExtendTest-172453353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6594a38-1e84-4bd1-a28c-e1798f3a66aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:35:16.623274 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-52a953fd-b140-41ee-bb70-ebd87ce14e48 tempest-VolumesExtendTest-172453353 None] Flow 'volume_create_manager' (7e76fb60-81a5-4e26-a70d-b1d1bad89ef0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129952) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 22 21:35:16.648672 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-60df9a9c-0d3c-4e9f-bc47-230969d6019c tempest-VolumesSnapshotTestJSON-664893185 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:35:16.887762 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-52a953fd-b140-41ee-bb70-ebd87ce14e48 tempest-VolumesExtendTest-172453353 None] Created volume successfully. Jan 22 21:35:17.804921 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-67ef8905-7724-40e8-9011-67be0a34ce3d tempest-VolumesGetTest-1998535251 None] Volume volume-5b3b3cd3-b314-44f8-ab15-4ce06657c94a is not a clone. {{(pid=129952) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Jan 22 21:35:17.806014 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-67ef8905-7724-40e8-9011-67be0a34ce3d tempest-VolumesGetTest-1998535251 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129952) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 22 21:35:17.806449 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-67ef8905-7724-40e8-9011-67be0a34ce3d tempest-VolumesGetTest-1998535251 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129952) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 22 21:35:18.108921 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-67ef8905-7724-40e8-9011-67be0a34ce3d tempest-VolumesGetTest-1998535251 None] clone created successfully {{(pid=129952) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:803}} Jan 22 21:35:18.112676 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-67ef8905-7724-40e8-9011-67be0a34ce3d tempest-VolumesGetTest-1998535251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1acc8198-e445-4e97-a754-7605e177052c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-20e728bf-6a37-4a4e-a73e-5fed5af03fbd', 'volume_size': 1, 'source_volid': '5b3b3cd3-b314-44f8-ab15-4ce06657c94a', 'source_volstatus': 'available'}' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:35:18.117340 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-67ef8905-7724-40e8-9011-67be0a34ce3d tempest-VolumesGetTest-1998535251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82a3e419-ac18-430f-a69b-c69be08786a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:35:18.141322 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-5ecb46f1-664f-492b-9f9b-f37c2ecd96ee tempest-VolumesExtendTest-172453353 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:35:18.447042 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.flows.manager.create_volume [None req-67ef8905-7724-40e8-9011-67be0a34ce3d tempest-VolumesGetTest-1998535251 None] Volume volume-20e728bf-6a37-4a4e-a73e-5fed5af03fbd (20e728bf-6a37-4a4e-a73e-5fed5af03fbd): created successfully Jan 22 21:35:18.451500 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-67ef8905-7724-40e8-9011-67be0a34ce3d tempest-VolumesGetTest-1998535251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82a3e419-ac18-430f-a69b-c69be08786a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:35:18.457244 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-67ef8905-7724-40e8-9011-67be0a34ce3d tempest-VolumesGetTest-1998535251 None] Flow 'volume_create_manager' (59b028ac-31a6-43bc-a3e3-b27a22e7f9aa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129952) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 22 21:35:18.526532 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-67ef8905-7724-40e8-9011-67be0a34ce3d tempest-VolumesGetTest-1998535251 None] Created volume successfully. Jan 22 21:35:19.743240 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-60df9a9c-0d3c-4e9f-bc47-230969d6019c tempest-VolumesSnapshotTestJSON-664893185 None] Create snapshot completed successfully Jan 22 21:35:19.941398 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.flows.manager.create_volume [None req-a69a0787-89d5-4e48-8b40-3fdea7af532f tempest-VolumesGetTest-1998535251 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129952) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Jan 22 21:35:19.945074 ncdv-master-1 cinder-volume[129952]: WARNING stevedore.named [None req-a69a0787-89d5-4e48-8b40-3fdea7af532f tempest-VolumesGetTest-1998535251 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jan 22 21:35:19.945541 ncdv-master-1 cinder-volume[129952]: WARNING castellan.key_manager [None req-a69a0787-89d5-4e48-8b40-3fdea7af532f tempest-VolumesGetTest-1998535251 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 22 21:35:19.965982 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-a69a0787-89d5-4e48-8b40-3fdea7af532f tempest-VolumesGetTest-1998535251 None] Flow 'volume_create_manager' (770d6ee8-5a41-4f1e-8c29-ed00bf3aafbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 22 21:35:19.973326 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-a69a0787-89d5-4e48-8b40-3fdea7af532f tempest-VolumesGetTest-1998535251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6393dbfa-631c-4149-a3cf-067c30990069) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:35:19.981776 ncdv-master-1 cinder-volume[129952]: DEBUG oslo_db.sqlalchemy.engines [None req-a69a0787-89d5-4e48-8b40-3fdea7af532f tempest-VolumesGetTest-1998535251 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129952) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 22 21:35:19.998703 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-a69a0787-89d5-4e48-8b40-3fdea7af532f tempest-VolumesGetTest-1998535251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6393dbfa-631c-4149-a3cf-067c30990069) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-01-22T21:35:19Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1856708494',display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=84dad856-fdc7-4593-85af-b2ef01664792,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db23715a4466471abfb9e11a261fee71',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-01-22T21:35:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-01-22T21:35:20Z,use_quota=True,user_id='209c06231de64d2b9d3f5eee76baf31e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6dacb05b-a7ea-4056-85ff-98f0ea5c54eb),volume_type_id=6dacb05b-a7ea-4056-85ff-98f0ea5c54eb)' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:35:20.004286 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-a69a0787-89d5-4e48-8b40-3fdea7af532f tempest-VolumesGetTest-1998535251 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d00df243-8e0d-4f24-a5cb-58dffc50ea91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:35:20.008655 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-a69a0787-89d5-4e48-8b40-3fdea7af532f tempest-VolumesGetTest-1998535251 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d00df243-8e0d-4f24-a5cb-58dffc50ea91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:35:20.014103 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-a69a0787-89d5-4e48-8b40-3fdea7af532f tempest-VolumesGetTest-1998535251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (244d4d33-eea4-486f-8430-cb4064298fe1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:35:20.018366 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-a69a0787-89d5-4e48-8b40-3fdea7af532f tempest-VolumesGetTest-1998535251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (244d4d33-eea4-486f-8430-cb4064298fe1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '84dad856-fdc7-4593-85af-b2ef01664792', 'volume_name': 'volume-84dad856-fdc7-4593-85af-b2ef01664792', 'volume_size': 1}' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:35:20.023543 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-a69a0787-89d5-4e48-8b40-3fdea7af532f tempest-VolumesGetTest-1998535251 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72002b82-025a-40c4-a16c-f618800226ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:35:20.027692 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-a69a0787-89d5-4e48-8b40-3fdea7af532f tempest-VolumesGetTest-1998535251 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72002b82-025a-40c4-a16c-f618800226ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:35:20.032624 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-a69a0787-89d5-4e48-8b40-3fdea7af532f tempest-VolumesGetTest-1998535251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58d52c53-b402-432a-bde6-2eabf588ad52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:35:20.033993 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.flows.manager.create_volume [None req-a69a0787-89d5-4e48-8b40-3fdea7af532f tempest-VolumesGetTest-1998535251 None] Volume 84dad856-fdc7-4593-85af-b2ef01664792: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-84dad856-fdc7-4593-85af-b2ef01664792', 'volume_size': 1} Jan 22 21:35:20.034455 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-a69a0787-89d5-4e48-8b40-3fdea7af532f tempest-VolumesGetTest-1998535251 None] creating volume 'volume-84dad856-fdc7-4593-85af-b2ef01664792' {{(pid=129952) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Jan 22 21:35:20.035425 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-a69a0787-89d5-4e48-8b40-3fdea7af532f tempest-VolumesGetTest-1998535251 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:35:21.112798 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-922f77e7-83ee-4bcd-8f2e-11ddfb789b37 tempest-VolumesSnapshotTestJSON-664893185 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:35:21.422374 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-a69a0787-89d5-4e48-8b40-3fdea7af532f tempest-VolumesGetTest-1998535251 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129952) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 22 21:35:21.422756 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-a69a0787-89d5-4e48-8b40-3fdea7af532f tempest-VolumesGetTest-1998535251 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129952) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 22 21:35:21.427041 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-a69a0787-89d5-4e48-8b40-3fdea7af532f tempest-VolumesGetTest-1998535251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58d52c53-b402-432a-bde6-2eabf588ad52) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-84dad856-fdc7-4593-85af-b2ef01664792', 'volume_size': 1}' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:35:21.431736 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-a69a0787-89d5-4e48-8b40-3fdea7af532f tempest-VolumesGetTest-1998535251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02a7df17-832a-4aa7-b1aa-6fdd3b7ebbb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:35:21.494365 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.flows.manager.create_volume [None req-a69a0787-89d5-4e48-8b40-3fdea7af532f tempest-VolumesGetTest-1998535251 None] Volume volume-84dad856-fdc7-4593-85af-b2ef01664792 (84dad856-fdc7-4593-85af-b2ef01664792): created successfully Jan 22 21:35:21.499470 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-a69a0787-89d5-4e48-8b40-3fdea7af532f tempest-VolumesGetTest-1998535251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02a7df17-832a-4aa7-b1aa-6fdd3b7ebbb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:35:21.505261 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-a69a0787-89d5-4e48-8b40-3fdea7af532f tempest-VolumesGetTest-1998535251 None] Flow 'volume_create_manager' (770d6ee8-5a41-4f1e-8c29-ed00bf3aafbf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129952) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 22 21:35:21.577632 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-a69a0787-89d5-4e48-8b40-3fdea7af532f tempest-VolumesGetTest-1998535251 None] Created volume successfully. Jan 22 21:35:21.863198 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-5ecb46f1-664f-492b-9f9b-f37c2ecd96ee tempest-VolumesExtendTest-172453353 None] Create snapshot completed successfully Jan 22 21:35:22.099336 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.coordination [None req-57504c62-d0fa-4a84-a108-c69014e2861a tempest-VolumesGetTest-1998535251 None] Lock "b'cinder-84dad856-fdc7-4593-85af-b2ef01664792-delete_volume'" acquired by "delete_volume" :: waited 0.010s {{(pid=129952) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 22 21:35:22.197881 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-57504c62-d0fa-4a84-a108-c69014e2861a tempest-VolumesGetTest-1998535251 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:35:22.405997 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-57504c62-d0fa-4a84-a108-c69014e2861a tempest-VolumesGetTest-1998535251 None] volume has no backup snaps {{(pid=129952) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Jan 22 21:35:22.406425 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-57504c62-d0fa-4a84-a108-c69014e2861a tempest-VolumesGetTest-1998535251 None] Volume volume-84dad856-fdc7-4593-85af-b2ef01664792 is not a clone. {{(pid=129952) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Jan 22 21:35:22.612391 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-57504c62-d0fa-4a84-a108-c69014e2861a tempest-VolumesGetTest-1998535251 None] deleting rbd volume volume-84dad856-fdc7-4593-85af-b2ef01664792 {{(pid=129952) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Jan 22 21:35:23.144268 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-b9d8c830-c9be-4cda-a8b7-c5d6685963ca tempest-VolumesExtendTest-172453353 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:35:24.434596 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-922f77e7-83ee-4bcd-8f2e-11ddfb789b37 tempest-VolumesSnapshotTestJSON-664893185 None] Create snapshot completed successfully Jan 22 21:35:25.206622 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-b9d8c830-c9be-4cda-a8b7-c5d6685963ca tempest-VolumesExtendTest-172453353 None] Extend volume from 1 GB to 2 GB. {{(pid=129952) extend_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1732}} Jan 22 21:35:25.463741 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-b9d8c830-c9be-4cda-a8b7-c5d6685963ca tempest-VolumesExtendTest-172453353 None] Extend volume completed successfully. Jan 22 21:35:25.736443 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-fc408f63-ee88-43bc-9573-69d6f63425ea tempest-VolumesSnapshotTestJSON-664893185 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:35:26.542896 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.coordination [None req-e79d5423-fff9-47ed-b8c6-986f833699ec tempest-VolumesExtendTest-172453353 None] Lock "b'cinder-f21ed21d-85a8-4c9a-aa4b-b151a788d995-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.011s {{(pid=129952) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 22 21:35:26.544328 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-e79d5423-fff9-47ed-b8c6-986f833699ec tempest-VolumesExtendTest-172453353 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:35:29.305427 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-fc408f63-ee88-43bc-9573-69d6f63425ea tempest-VolumesSnapshotTestJSON-664893185 None] Create snapshot completed successfully Jan 22 21:35:29.483269 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.quota [None req-57504c62-d0fa-4a84-a108-c69014e2861a tempest-VolumesGetTest-1998535251 None] Created reservations ['426c92d2-186e-4176-8a14-84aa539a0268', 'dd619689-d8e0-44eb-8a51-8db0fc20c73c', 'ef485637-a7e6-4d33-9aa4-959cbc16754c', '9350a83d-83f4-45cf-91c8-3c6c4fb96c3e'] {{(pid=129952) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 22 21:35:29.666287 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-57504c62-d0fa-4a84-a108-c69014e2861a tempest-VolumesGetTest-1998535251 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:35:29.691758 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-57504c62-d0fa-4a84-a108-c69014e2861a tempest-VolumesGetTest-1998535251 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:35:29.718829 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.manager [None req-57504c62-d0fa-4a84-a108-c69014e2861a tempest-VolumesGetTest-1998535251 None] Notifying Schedulers of capabilities ... {{(pid=129952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 22 21:35:29.722959 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-57504c62-d0fa-4a84-a108-c69014e2861a tempest-VolumesGetTest-1998535251 None] Deleted volume successfully. Jan 22 21:35:29.829028 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.coordination [None req-57504c62-d0fa-4a84-a108-c69014e2861a tempest-VolumesGetTest-1998535251 None] Lock "b'cinder-84dad856-fdc7-4593-85af-b2ef01664792-delete_volume'" released by "delete_volume" :: held 7.730s {{(pid=129952) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 22 21:35:29.832635 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.coordination [None req-5b5c2423-a9a8-4a13-99dd-11d5c38336b8 tempest-VolumesSnapshotTestJSON-664893185 None] Lock "b'cinder-991e363c-4b86-4b90-9129-e2b650b2f0eb-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.012s {{(pid=129952) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 22 21:35:29.834217 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-5b5c2423-a9a8-4a13-99dd-11d5c38336b8 tempest-VolumesSnapshotTestJSON-664893185 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:35:30.812195 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.coordination [None req-cceaf115-12c6-47da-961e-966767e1c26e tempest-VolumesGetTest-1998535251 None] Lock "b'cinder-20e728bf-6a37-4a4e-a73e-5fed5af03fbd-delete_volume'" acquired by "delete_volume" :: waited 0.011s {{(pid=129952) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 22 21:35:30.954233 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-cceaf115-12c6-47da-961e-966767e1c26e tempest-VolumesGetTest-1998535251 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:35:31.326816 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-cceaf115-12c6-47da-961e-966767e1c26e tempest-VolumesGetTest-1998535251 None] volume has no backup snaps {{(pid=129952) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Jan 22 21:35:31.592955 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-cceaf115-12c6-47da-961e-966767e1c26e tempest-VolumesGetTest-1998535251 None] deleting rbd volume volume-20e728bf-6a37-4a4e-a73e-5fed5af03fbd {{(pid=129952) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Jan 22 21:35:31.703199 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.quota [None req-e79d5423-fff9-47ed-b8c6-986f833699ec tempest-VolumesExtendTest-172453353 None] Created reservations ['078f2ba5-62e4-4e80-a248-11e6ae0d69dc', 'd89c68d1-7a74-4a87-9962-16c6aac0a2ea', '4824974a-984e-4aec-b403-2a97d2b6fc2e', '94b69c20-d003-4120-b3ea-7e088467f1e0'] {{(pid=129952) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 22 21:35:31.868870 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-e79d5423-fff9-47ed-b8c6-986f833699ec tempest-VolumesExtendTest-172453353 None] Delete snapshot completed successfully. Jan 22 21:35:31.873673 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.coordination [None req-e79d5423-fff9-47ed-b8c6-986f833699ec tempest-VolumesExtendTest-172453353 None] Lock "b'cinder-f21ed21d-85a8-4c9a-aa4b-b151a788d995-delete_snapshot'" released by "delete_snapshot" :: held 5.331s {{(pid=129952) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 22 21:35:32.927991 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.coordination [None req-6eec6392-528c-4336-883a-05bc8ef362d4 tempest-VolumesExtendTest-172453353 None] Lock "b'cinder-69a6832b-aea3-40d3-8b2a-cd428c15972f-delete_volume'" acquired by "delete_volume" :: waited 0.014s {{(pid=129952) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 22 21:35:33.027646 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-6eec6392-528c-4336-883a-05bc8ef362d4 tempest-VolumesExtendTest-172453353 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:35:33.270935 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-6eec6392-528c-4336-883a-05bc8ef362d4 tempest-VolumesExtendTest-172453353 None] volume has no backup snaps {{(pid=129952) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Jan 22 21:35:33.271700 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-6eec6392-528c-4336-883a-05bc8ef362d4 tempest-VolumesExtendTest-172453353 None] Volume volume-69a6832b-aea3-40d3-8b2a-cd428c15972f is not a clone. {{(pid=129952) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Jan 22 21:35:33.500663 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-6eec6392-528c-4336-883a-05bc8ef362d4 tempest-VolumesExtendTest-172453353 None] deleting rbd volume volume-69a6832b-aea3-40d3-8b2a-cd428c15972f {{(pid=129952) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Jan 22 21:35:36.835020 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-cceaf115-12c6-47da-961e-966767e1c26e tempest-VolumesGetTest-1998535251 None] volume is a clone so cleaning references {{(pid=129952) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1266}} Jan 22 21:35:37.030001 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-cceaf115-12c6-47da-961e-966767e1c26e tempest-VolumesGetTest-1998535251 None] Volume volume-5b3b3cd3-b314-44f8-ab15-4ce06657c94a is not a clone. {{(pid=129952) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Jan 22 21:35:37.030565 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-cceaf115-12c6-47da-961e-966767e1c26e tempest-VolumesGetTest-1998535251 None] deleting parent snapshot volume-20e728bf-6a37-4a4e-a73e-5fed5af03fbd.clone_snap {{(pid=129952) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1158}} Jan 22 21:35:40.534987 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.quota [None req-cceaf115-12c6-47da-961e-966767e1c26e tempest-VolumesGetTest-1998535251 None] Created reservations ['4269e68a-39df-43bd-a509-66973d273089', '4e0f24e7-68ca-4b10-880b-bcfa222f0f5f', '6895b5d3-4ec8-4ab5-bbba-bb3396f01d36', 'bc638566-0f3e-4d5f-b692-8552093d0e73'] {{(pid=129952) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 22 21:35:40.571391 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.quota [None req-6eec6392-528c-4336-883a-05bc8ef362d4 tempest-VolumesExtendTest-172453353 None] Created reservations ['7250089d-b5e1-40a0-9860-3a140d5bbda6', 'b0f28868-e8ac-4644-8d79-27c04f047e2e', 'b15271ad-3818-4355-8991-492f85d945b1', '9d95f0c5-ecaa-4489-b130-e71a87967b7e'] {{(pid=129952) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 22 21:35:40.699638 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-cceaf115-12c6-47da-961e-966767e1c26e tempest-VolumesGetTest-1998535251 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:35:40.721864 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-cceaf115-12c6-47da-961e-966767e1c26e tempest-VolumesGetTest-1998535251 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:35:40.745367 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.manager [None req-cceaf115-12c6-47da-961e-966767e1c26e tempest-VolumesGetTest-1998535251 None] Notifying Schedulers of capabilities ... {{(pid=129952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 22 21:35:40.751159 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-cceaf115-12c6-47da-961e-966767e1c26e tempest-VolumesGetTest-1998535251 None] Deleted volume successfully. Jan 22 21:35:40.838101 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.coordination [None req-cceaf115-12c6-47da-961e-966767e1c26e tempest-VolumesGetTest-1998535251 None] Lock "b'cinder-20e728bf-6a37-4a4e-a73e-5fed5af03fbd-delete_volume'" released by "delete_volume" :: held 10.027s {{(pid=129952) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 22 21:35:40.862955 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-6eec6392-528c-4336-883a-05bc8ef362d4 tempest-VolumesExtendTest-172453353 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:35:40.883462 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-6eec6392-528c-4336-883a-05bc8ef362d4 tempest-VolumesExtendTest-172453353 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:35:40.906197 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.manager [None req-6eec6392-528c-4336-883a-05bc8ef362d4 tempest-VolumesExtendTest-172453353 None] Notifying Schedulers of capabilities ... {{(pid=129952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 22 21:35:40.911469 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-6eec6392-528c-4336-883a-05bc8ef362d4 tempest-VolumesExtendTest-172453353 None] Deleted volume successfully. Jan 22 21:35:41.004078 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.coordination [None req-6eec6392-528c-4336-883a-05bc8ef362d4 tempest-VolumesExtendTest-172453353 None] Lock "b'cinder-69a6832b-aea3-40d3-8b2a-cd428c15972f-delete_volume'" released by "delete_volume" :: held 8.077s {{(pid=129952) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 22 21:35:41.567740 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.coordination [None req-1014e8e5-93d5-43ed-bf09-8e0518e30dbe tempest-VolumesExtendTest-172453353 None] Lock "b'cinder-1aae6e34-1ad9-45a9-b65c-5468341db12f-delete_volume'" acquired by "delete_volume" :: waited 0.016s {{(pid=129952) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 22 21:35:41.663212 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-1014e8e5-93d5-43ed-bf09-8e0518e30dbe tempest-VolumesExtendTest-172453353 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:35:41.834365 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-1014e8e5-93d5-43ed-bf09-8e0518e30dbe tempest-VolumesExtendTest-172453353 None] volume has no backup snaps {{(pid=129952) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Jan 22 21:35:41.915793 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-1014e8e5-93d5-43ed-bf09-8e0518e30dbe tempest-VolumesExtendTest-172453353 None] deleting rbd volume volume-1aae6e34-1ad9-45a9-b65c-5468341db12f {{(pid=129952) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Jan 22 21:35:42.272535 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.flows.manager.create_volume [None req-c1df48d2-be64-4346-adaa-f25b2a0ab9f4 tempest-VolumesGetTest-1998535251 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129952) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Jan 22 21:35:42.276032 ncdv-master-1 cinder-volume[129952]: WARNING stevedore.named [None req-c1df48d2-be64-4346-adaa-f25b2a0ab9f4 tempest-VolumesGetTest-1998535251 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jan 22 21:35:42.276480 ncdv-master-1 cinder-volume[129952]: WARNING castellan.key_manager [None req-c1df48d2-be64-4346-adaa-f25b2a0ab9f4 tempest-VolumesGetTest-1998535251 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 22 21:35:42.296844 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-c1df48d2-be64-4346-adaa-f25b2a0ab9f4 tempest-VolumesGetTest-1998535251 None] Flow 'volume_create_manager' (a06c3868-146b-4903-b9a1-38d16d192188) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 22 21:35:42.303566 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-c1df48d2-be64-4346-adaa-f25b2a0ab9f4 tempest-VolumesGetTest-1998535251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36a3d70f-942f-40f3-b107-8285c7352d30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:35:42.309633 ncdv-master-1 cinder-volume[129952]: DEBUG oslo_db.sqlalchemy.engines [None req-c1df48d2-be64-4346-adaa-f25b2a0ab9f4 tempest-VolumesGetTest-1998535251 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129952) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 22 21:35:42.323880 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-c1df48d2-be64-4346-adaa-f25b2a0ab9f4 tempest-VolumesGetTest-1998535251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36a3d70f-942f-40f3-b107-8285c7352d30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-01-22T21:35:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1834711635',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=bbbc389b-9e2c-49b4-ba04-4329cc02a38b,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='db23715a4466471abfb9e11a261fee71',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-01-22T21:35:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-01-22T21:35:42Z,use_quota=True,user_id='209c06231de64d2b9d3f5eee76baf31e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6dacb05b-a7ea-4056-85ff-98f0ea5c54eb),volume_type_id=6dacb05b-a7ea-4056-85ff-98f0ea5c54eb)' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:35:42.330110 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-c1df48d2-be64-4346-adaa-f25b2a0ab9f4 tempest-VolumesGetTest-1998535251 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fee3b6f1-df5f-46a5-b514-c76b2a7caf72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:35:42.335117 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-c1df48d2-be64-4346-adaa-f25b2a0ab9f4 tempest-VolumesGetTest-1998535251 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fee3b6f1-df5f-46a5-b514-c76b2a7caf72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:35:42.342113 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-c1df48d2-be64-4346-adaa-f25b2a0ab9f4 tempest-VolumesGetTest-1998535251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8c61298-5c71-4bd1-88ed-8a4959201b50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:35:42.428049 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-c1df48d2-be64-4346-adaa-f25b2a0ab9f4 tempest-VolumesGetTest-1998535251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8c61298-5c71-4bd1-88ed-8a4959201b50) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'bbbc389b-9e2c-49b4-ba04-4329cc02a38b', 'volume_name': 'volume-bbbc389b-9e2c-49b4-ba04-4329cc02a38b', 'volume_size': 1, 'image_id': '373cb480-3bc4-4821-93e2-442b4e852b80', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '994e8f6963f04af3be3dbae11a73cdfd', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '373cb480-3bc4-4821-93e2-442b4e852b80', 'created_at': datetime.datetime(2022, 1, 22, 20, 50, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 1, 22, 20, 50, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/373cb480-3bc4-4821-93e2-442b4e852b80/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:35:42.433334 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-c1df48d2-be64-4346-adaa-f25b2a0ab9f4 tempest-VolumesGetTest-1998535251 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b113f1d9-a9b1-4e8d-bfa5-4bfa403a599e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:35:42.437489 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-c1df48d2-be64-4346-adaa-f25b2a0ab9f4 tempest-VolumesGetTest-1998535251 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b113f1d9-a9b1-4e8d-bfa5-4bfa403a599e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:35:42.442430 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-c1df48d2-be64-4346-adaa-f25b2a0ab9f4 tempest-VolumesGetTest-1998535251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b823bf3-2b7e-4840-ae08-b86362508186) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:35:42.443571 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.flows.manager.create_volume [None req-c1df48d2-be64-4346-adaa-f25b2a0ab9f4 tempest-VolumesGetTest-1998535251 None] Volume bbbc389b-9e2c-49b4-ba04-4329cc02a38b: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-bbbc389b-9e2c-49b4-ba04-4329cc02a38b', 'volume_size': 1, 'image_id': '373cb480-3bc4-4821-93e2-442b4e852b80', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '994e8f6963f04af3be3dbae11a73cdfd', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '373cb480-3bc4-4821-93e2-442b4e852b80', 'created_at': datetime.datetime(2022, 1, 22, 20, 50, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 1, 22, 20, 50, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/373cb480-3bc4-4821-93e2-442b4e852b80/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jan 22 21:35:42.444137 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.flows.manager.create_volume [None req-c1df48d2-be64-4346-adaa-f25b2a0ab9f4 tempest-VolumesGetTest-1998535251 None] Cloning bbbc389b-9e2c-49b4-ba04-4329cc02a38b from image 373cb480-3bc4-4821-93e2-442b4e852b80 at location (None, None). {{(pid=129952) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1046}} Jan 22 21:35:42.452376 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.coordination [None req-c1df48d2-be64-4346-adaa-f25b2a0ab9f4 tempest-VolumesGetTest-1998535251 None] Lock "b'cinder-373cb480-3bc4-4821-93e2-442b4e852b80'" acquired by "_prepare_image_cache_entry" :: waited 0.007s {{(pid=129952) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 22 21:35:42.543026 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.image.cache [None req-c1df48d2-be64-4346-adaa-f25b2a0ab9f4 tempest-VolumesGetTest-1998535251 None] Found image-volume cache entry: {'id': 1, 'image_id': '373cb480-3bc4-4821-93e2-442b4e852b80', 'volume_id': 'f39c1078-cff4-40dd-93df-4ce49cd873b4', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 1, 22, 20, 50, 57), 'last_used': datetime.datetime(2022, 1, 22, 21, 35, 42, 456908)}. {{(pid=129952) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Jan 22 21:35:42.545879 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.image.cache [None req-c1df48d2-be64-4346-adaa-f25b2a0ab9f4 tempest-VolumesGetTest-1998535251 None] Image-volume cache entry image_update_at = 2022-01-22 20:50:57+00:00, requested image updated_at = 2022-01-22 20:50:57+00:00. {{(pid=129952) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Jan 22 21:35:42.545879 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.flows.manager.create_volume [None req-c1df48d2-be64-4346-adaa-f25b2a0ab9f4 tempest-VolumesGetTest-1998535251 None] Found cache entry for image = 373cb480-3bc4-4821-93e2-442b4e852b80 on host ncdv-master-1@ceph#ceph. {{(pid=129952) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:869}} Jan 22 21:35:42.548232 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.coordination [None req-c1df48d2-be64-4346-adaa-f25b2a0ab9f4 tempest-VolumesGetTest-1998535251 None] Lock "b'cinder-373cb480-3bc4-4821-93e2-442b4e852b80'" released by "_prepare_image_cache_entry" :: held 0.096s {{(pid=129952) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 22 21:35:42.549127 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.flows.manager.create_volume [None req-c1df48d2-be64-4346-adaa-f25b2a0ab9f4 tempest-VolumesGetTest-1998535251 None] Attempting to retrieve cache entry for image = 373cb480-3bc4-4821-93e2-442b4e852b80 on host ncdv-master-1@ceph#ceph. {{(pid=129952) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:810}} Jan 22 21:35:42.674849 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.image.cache [None req-c1df48d2-be64-4346-adaa-f25b2a0ab9f4 tempest-VolumesGetTest-1998535251 None] Found image-volume cache entry: {'id': 1, 'image_id': '373cb480-3bc4-4821-93e2-442b4e852b80', 'volume_id': 'f39c1078-cff4-40dd-93df-4ce49cd873b4', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 1, 22, 20, 50, 57), 'last_used': datetime.datetime(2022, 1, 22, 21, 35, 42, 553128)}. {{(pid=129952) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Jan 22 21:35:42.675466 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.image.cache [None req-c1df48d2-be64-4346-adaa-f25b2a0ab9f4 tempest-VolumesGetTest-1998535251 None] Image-volume cache entry image_update_at = 2022-01-22 20:50:57+00:00, requested image updated_at = 2022-01-22 20:50:57+00:00. {{(pid=129952) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Jan 22 21:35:42.675597 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.flows.manager.create_volume [None req-c1df48d2-be64-4346-adaa-f25b2a0ab9f4 tempest-VolumesGetTest-1998535251 None] Creating from source image-volume f39c1078-cff4-40dd-93df-4ce49cd873b4 {{(pid=129952) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:824}} Jan 22 21:35:42.687962 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-c1df48d2-be64-4346-adaa-f25b2a0ab9f4 tempest-VolumesGetTest-1998535251 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:35:42.871057 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-c1df48d2-be64-4346-adaa-f25b2a0ab9f4 tempest-VolumesGetTest-1998535251 None] creating snapshot='volume-bbbc389b-9e2c-49b4-ba04-4329cc02a38b.clone_snap' {{(pid=129952) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:725}} Jan 22 21:35:45.589372 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-c1df48d2-be64-4346-adaa-f25b2a0ab9f4 tempest-VolumesGetTest-1998535251 None] cloning 'volume-f39c1078-cff4-40dd-93df-4ce49cd873b4@volume-bbbc389b-9e2c-49b4-ba04-4329cc02a38b.clone_snap' to 'volume-bbbc389b-9e2c-49b4-ba04-4329cc02a38b' {{(pid=129952) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:731}} Jan 22 21:35:46.869776 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-1014e8e5-93d5-43ed-bf09-8e0518e30dbe tempest-VolumesExtendTest-172453353 None] volume is a clone so cleaning references {{(pid=129952) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1266}} Jan 22 21:35:47.106058 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-1014e8e5-93d5-43ed-bf09-8e0518e30dbe tempest-VolumesExtendTest-172453353 None] deleting parent snapshot volume-1aae6e34-1ad9-45a9-b65c-5468341db12f.clone_snap {{(pid=129952) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1158}} Jan 22 21:35:48.786744 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-c1df48d2-be64-4346-adaa-f25b2a0ab9f4 tempest-VolumesGetTest-1998535251 None] Volume volume-0b17e2f4-e149-4a4b-b525-3d029be2e6f6.deleted is not a clone. {{(pid=129952) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Jan 22 21:35:48.788194 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-c1df48d2-be64-4346-adaa-f25b2a0ab9f4 tempest-VolumesGetTest-1998535251 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129952) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 22 21:35:48.788634 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-c1df48d2-be64-4346-adaa-f25b2a0ab9f4 tempest-VolumesGetTest-1998535251 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129952) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 22 21:35:49.078242 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-c1df48d2-be64-4346-adaa-f25b2a0ab9f4 tempest-VolumesGetTest-1998535251 None] clone created successfully {{(pid=129952) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:803}} Jan 22 21:35:49.078887 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.volume_utils [None req-c1df48d2-be64-4346-adaa-f25b2a0ab9f4 tempest-VolumesGetTest-1998535251 None] Marking volume bbbc389b-9e2c-49b4-ba04-4329cc02a38b as bootable. {{(pid=129952) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1178}} Jan 22 21:35:49.191626 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.flows.manager.create_volume [None req-c1df48d2-be64-4346-adaa-f25b2a0ab9f4 tempest-VolumesGetTest-1998535251 None] Copying metadata from image 373cb480-3bc4-4821-93e2-442b4e852b80 to bbbc389b-9e2c-49b4-ba04-4329cc02a38b. {{(pid=129952) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:443}} Jan 22 21:35:49.191984 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.flows.manager.create_volume [None req-c1df48d2-be64-4346-adaa-f25b2a0ab9f4 tempest-VolumesGetTest-1998535251 None] Creating volume glance metadata for volume bbbc389b-9e2c-49b4-ba04-4329cc02a38b backed by image 373cb480-3bc4-4821-93e2-442b4e852b80 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '373cb480-3bc4-4821-93e2-442b4e852b80', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=129952) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:666}} Jan 22 21:35:49.225106 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.quota [None req-1014e8e5-93d5-43ed-bf09-8e0518e30dbe tempest-VolumesExtendTest-172453353 None] Created reservations ['e18335c6-d22f-4157-9185-24145d9b1f8f', '72c97af8-6b2c-44c1-836f-90f22ea7af21', '7896e36f-dd6d-4d08-99bd-6b970405113b', '45059b52-e33d-49d4-bde0-6d57f5ac6ddd'] {{(pid=129952) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 22 21:35:49.372210 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-c1df48d2-be64-4346-adaa-f25b2a0ab9f4 tempest-VolumesGetTest-1998535251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b823bf3-2b7e-4840-ae08-b86362508186) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bbbc389b-9e2c-49b4-ba04-4329cc02a38b', 'volume_size': 1, 'image_id': '373cb480-3bc4-4821-93e2-442b4e852b80', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '994e8f6963f04af3be3dbae11a73cdfd', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '373cb480-3bc4-4821-93e2-442b4e852b80', 'created_at': datetime.datetime(2022, 1, 22, 20, 50, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 1, 22, 20, 50, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/373cb480-3bc4-4821-93e2-442b4e852b80/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:35:49.377740 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-c1df48d2-be64-4346-adaa-f25b2a0ab9f4 tempest-VolumesGetTest-1998535251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47e68d95-368b-41f2-a8ae-9767762e0621) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:35:49.426588 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-1014e8e5-93d5-43ed-bf09-8e0518e30dbe tempest-VolumesExtendTest-172453353 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:35:49.493528 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-1014e8e5-93d5-43ed-bf09-8e0518e30dbe tempest-VolumesExtendTest-172453353 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:35:49.521179 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.manager [None req-1014e8e5-93d5-43ed-bf09-8e0518e30dbe tempest-VolumesExtendTest-172453353 None] Notifying Schedulers of capabilities ... {{(pid=129952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 22 21:35:49.525788 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-1014e8e5-93d5-43ed-bf09-8e0518e30dbe tempest-VolumesExtendTest-172453353 None] Deleted volume successfully. Jan 22 21:35:49.530383 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.flows.manager.create_volume [None req-c1df48d2-be64-4346-adaa-f25b2a0ab9f4 tempest-VolumesGetTest-1998535251 None] Volume volume-bbbc389b-9e2c-49b4-ba04-4329cc02a38b (bbbc389b-9e2c-49b4-ba04-4329cc02a38b): created successfully Jan 22 21:35:49.535000 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-c1df48d2-be64-4346-adaa-f25b2a0ab9f4 tempest-VolumesGetTest-1998535251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47e68d95-368b-41f2-a8ae-9767762e0621) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:35:49.540998 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-c1df48d2-be64-4346-adaa-f25b2a0ab9f4 tempest-VolumesGetTest-1998535251 None] Flow 'volume_create_manager' (a06c3868-146b-4903-b9a1-38d16d192188) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129952) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 22 21:35:49.636241 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-c1df48d2-be64-4346-adaa-f25b2a0ab9f4 tempest-VolumesGetTest-1998535251 None] Created volume successfully. Jan 22 21:35:49.642412 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.coordination [None req-1014e8e5-93d5-43ed-bf09-8e0518e30dbe tempest-VolumesExtendTest-172453353 None] Lock "b'cinder-1aae6e34-1ad9-45a9-b65c-5468341db12f-delete_volume'" released by "delete_volume" :: held 8.075s {{(pid=129952) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 22 21:35:51.579030 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.flows.manager.create_volume [None req-b653d8b6-6396-425c-83a2-f2ca5e6aa115 tempest-VolumesGetTest-1998535251 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129952) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Jan 22 21:35:51.583387 ncdv-master-1 cinder-volume[129952]: WARNING stevedore.named [None req-b653d8b6-6396-425c-83a2-f2ca5e6aa115 tempest-VolumesGetTest-1998535251 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jan 22 21:35:51.583921 ncdv-master-1 cinder-volume[129952]: WARNING castellan.key_manager [None req-b653d8b6-6396-425c-83a2-f2ca5e6aa115 tempest-VolumesGetTest-1998535251 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 22 21:35:51.605272 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-b653d8b6-6396-425c-83a2-f2ca5e6aa115 tempest-VolumesGetTest-1998535251 None] Flow 'volume_create_manager' (5657651f-dbd6-4542-aa5a-392e34ddeed0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 22 21:35:51.612808 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-b653d8b6-6396-425c-83a2-f2ca5e6aa115 tempest-VolumesGetTest-1998535251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a50055c4-b626-48ab-b73c-66475813235f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:35:51.619299 ncdv-master-1 cinder-volume[129952]: DEBUG oslo_db.sqlalchemy.engines [None req-b653d8b6-6396-425c-83a2-f2ca5e6aa115 tempest-VolumesGetTest-1998535251 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129952) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 22 21:35:51.633734 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-b653d8b6-6396-425c-83a2-f2ca5e6aa115 tempest-VolumesGetTest-1998535251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a50055c4-b626-48ab-b73c-66475813235f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-01-22T21:35:51Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-9967476',display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=ccc91ebb-89b7-404b-885a-84c9c0a40521,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db23715a4466471abfb9e11a261fee71',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-01-22T21:35:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-01-22T21:35:51Z,use_quota=True,user_id='209c06231de64d2b9d3f5eee76baf31e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6dacb05b-a7ea-4056-85ff-98f0ea5c54eb),volume_type_id=6dacb05b-a7ea-4056-85ff-98f0ea5c54eb)' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:35:51.639340 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-b653d8b6-6396-425c-83a2-f2ca5e6aa115 tempest-VolumesGetTest-1998535251 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b79b9056-4552-4087-a38c-286876dd28a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:35:51.643695 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-b653d8b6-6396-425c-83a2-f2ca5e6aa115 tempest-VolumesGetTest-1998535251 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b79b9056-4552-4087-a38c-286876dd28a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:35:51.649033 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-b653d8b6-6396-425c-83a2-f2ca5e6aa115 tempest-VolumesGetTest-1998535251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (403d1abb-a4fa-41f8-a2a2-876414f3898e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:35:51.653373 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-b653d8b6-6396-425c-83a2-f2ca5e6aa115 tempest-VolumesGetTest-1998535251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (403d1abb-a4fa-41f8-a2a2-876414f3898e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ccc91ebb-89b7-404b-885a-84c9c0a40521', 'volume_name': 'volume-ccc91ebb-89b7-404b-885a-84c9c0a40521', 'volume_size': 1}' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:35:51.659446 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-b653d8b6-6396-425c-83a2-f2ca5e6aa115 tempest-VolumesGetTest-1998535251 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82efbbb7-689e-4e66-afbd-f92665a52081) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:35:51.663597 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-b653d8b6-6396-425c-83a2-f2ca5e6aa115 tempest-VolumesGetTest-1998535251 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82efbbb7-689e-4e66-afbd-f92665a52081) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:35:51.668506 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-b653d8b6-6396-425c-83a2-f2ca5e6aa115 tempest-VolumesGetTest-1998535251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b787f41-3a3e-4f76-82ee-6356b29df123) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:35:51.669635 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.flows.manager.create_volume [None req-b653d8b6-6396-425c-83a2-f2ca5e6aa115 tempest-VolumesGetTest-1998535251 None] Volume ccc91ebb-89b7-404b-885a-84c9c0a40521: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ccc91ebb-89b7-404b-885a-84c9c0a40521', 'volume_size': 1} Jan 22 21:35:51.670031 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-b653d8b6-6396-425c-83a2-f2ca5e6aa115 tempest-VolumesGetTest-1998535251 None] creating volume 'volume-ccc91ebb-89b7-404b-885a-84c9c0a40521' {{(pid=129952) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Jan 22 21:35:51.671023 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-b653d8b6-6396-425c-83a2-f2ca5e6aa115 tempest-VolumesGetTest-1998535251 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:35:52.210913 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-b653d8b6-6396-425c-83a2-f2ca5e6aa115 tempest-VolumesGetTest-1998535251 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129952) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 22 21:35:52.211706 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-b653d8b6-6396-425c-83a2-f2ca5e6aa115 tempest-VolumesGetTest-1998535251 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129952) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 22 21:35:52.215620 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-b653d8b6-6396-425c-83a2-f2ca5e6aa115 tempest-VolumesGetTest-1998535251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b787f41-3a3e-4f76-82ee-6356b29df123) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ccc91ebb-89b7-404b-885a-84c9c0a40521', 'volume_size': 1}' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:35:52.220422 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-b653d8b6-6396-425c-83a2-f2ca5e6aa115 tempest-VolumesGetTest-1998535251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3982702-d9be-4fe5-a231-6f30329d130f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:35:52.280102 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.flows.manager.create_volume [None req-b653d8b6-6396-425c-83a2-f2ca5e6aa115 tempest-VolumesGetTest-1998535251 None] Volume volume-ccc91ebb-89b7-404b-885a-84c9c0a40521 (ccc91ebb-89b7-404b-885a-84c9c0a40521): created successfully Jan 22 21:35:52.284858 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-b653d8b6-6396-425c-83a2-f2ca5e6aa115 tempest-VolumesGetTest-1998535251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3982702-d9be-4fe5-a231-6f30329d130f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:35:52.290585 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-b653d8b6-6396-425c-83a2-f2ca5e6aa115 tempest-VolumesGetTest-1998535251 None] Flow 'volume_create_manager' (5657651f-dbd6-4542-aa5a-392e34ddeed0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129952) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 22 21:35:52.396798 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-b653d8b6-6396-425c-83a2-f2ca5e6aa115 tempest-VolumesGetTest-1998535251 None] Created volume successfully. Jan 22 21:35:52.703111 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.coordination [None req-25ff4471-3eb7-4530-9934-421d7939637b tempest-VolumesGetTest-1998535251 None] Lock "b'cinder-ccc91ebb-89b7-404b-885a-84c9c0a40521-delete_volume'" acquired by "delete_volume" :: waited 0.008s {{(pid=129952) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 22 21:35:52.811302 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-25ff4471-3eb7-4530-9934-421d7939637b tempest-VolumesGetTest-1998535251 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:35:53.076524 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-25ff4471-3eb7-4530-9934-421d7939637b tempest-VolumesGetTest-1998535251 None] volume has no backup snaps {{(pid=129952) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Jan 22 21:35:53.076524 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-25ff4471-3eb7-4530-9934-421d7939637b tempest-VolumesGetTest-1998535251 None] Volume volume-ccc91ebb-89b7-404b-885a-84c9c0a40521 is not a clone. {{(pid=129952) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Jan 22 21:35:53.223441 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-25ff4471-3eb7-4530-9934-421d7939637b tempest-VolumesGetTest-1998535251 None] deleting rbd volume volume-ccc91ebb-89b7-404b-885a-84c9c0a40521 {{(pid=129952) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Jan 22 21:35:56.983407 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.quota [None req-25ff4471-3eb7-4530-9934-421d7939637b tempest-VolumesGetTest-1998535251 None] Created reservations ['e4327495-c66b-4265-ba49-7ff4dd7f812e', '05996656-5a86-4158-924a-d5cbe9a2da52', '61b0c28b-83a0-4eac-bdb5-d2596dc2d9a5', '447b3648-f1b9-438c-a056-0bcd07b73373'] {{(pid=129952) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 22 21:35:57.167070 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-25ff4471-3eb7-4530-9934-421d7939637b tempest-VolumesGetTest-1998535251 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:35:57.203165 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-25ff4471-3eb7-4530-9934-421d7939637b tempest-VolumesGetTest-1998535251 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:35:57.241715 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.manager [None req-25ff4471-3eb7-4530-9934-421d7939637b tempest-VolumesGetTest-1998535251 None] Notifying Schedulers of capabilities ... {{(pid=129952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 22 21:35:57.246244 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-25ff4471-3eb7-4530-9934-421d7939637b tempest-VolumesGetTest-1998535251 None] Deleted volume successfully. Jan 22 21:35:57.354802 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.coordination [None req-25ff4471-3eb7-4530-9934-421d7939637b tempest-VolumesGetTest-1998535251 None] Lock "b'cinder-ccc91ebb-89b7-404b-885a-84c9c0a40521-delete_volume'" released by "delete_volume" :: held 4.652s {{(pid=129952) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 22 21:35:58.195919 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.coordination [None req-2b1c5329-698f-4fd8-862f-479afa462fc1 tempest-VolumesGetTest-1998535251 None] Lock "b'cinder-bbbc389b-9e2c-49b4-ba04-4329cc02a38b-delete_volume'" acquired by "delete_volume" :: waited 0.014s {{(pid=129952) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 22 21:35:58.309725 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-2b1c5329-698f-4fd8-862f-479afa462fc1 tempest-VolumesGetTest-1998535251 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:35:58.539312 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-2b1c5329-698f-4fd8-862f-479afa462fc1 tempest-VolumesGetTest-1998535251 None] volume has no backup snaps {{(pid=129952) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Jan 22 21:35:58.707362 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-2b1c5329-698f-4fd8-862f-479afa462fc1 tempest-VolumesGetTest-1998535251 None] deleting rbd volume volume-bbbc389b-9e2c-49b4-ba04-4329cc02a38b {{(pid=129952) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Jan 22 21:36:01.369187 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.quota [None req-5b5c2423-a9a8-4a13-99dd-11d5c38336b8 tempest-VolumesSnapshotTestJSON-664893185 None] Created reservations ['a7e48ad1-c6f4-4d25-a0cc-07c1d660351a', 'af77529b-1f0e-4303-a185-a65071ad51af', 'd09ce67b-fc23-4ce3-894d-9aff4332b3b6', '81489b2b-cf1f-410b-b5c2-cbf905fbc8d4'] {{(pid=129952) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 22 21:36:01.686511 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-5b5c2423-a9a8-4a13-99dd-11d5c38336b8 tempest-VolumesSnapshotTestJSON-664893185 None] Delete snapshot completed successfully. Jan 22 21:36:01.696823 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.coordination [None req-5b5c2423-a9a8-4a13-99dd-11d5c38336b8 tempest-VolumesSnapshotTestJSON-664893185 None] Lock "b'cinder-991e363c-4b86-4b90-9129-e2b650b2f0eb-delete_snapshot'" released by "delete_snapshot" :: held 31.862s {{(pid=129952) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 22 21:36:01.885748 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.coordination [None req-711bc17e-1e8b-4fc5-a1c8-bb08b30ee132 tempest-VolumesSnapshotTestJSON-664893185 None] Lock "b'cinder-9a1ca7cd-2086-4578-ac6f-aedbc892ed0b-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.015s {{(pid=129952) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 22 21:36:01.888091 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-711bc17e-1e8b-4fc5-a1c8-bb08b30ee132 tempest-VolumesSnapshotTestJSON-664893185 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:36:02.921686 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-2b1c5329-698f-4fd8-862f-479afa462fc1 tempest-VolumesGetTest-1998535251 None] volume is a clone so cleaning references {{(pid=129952) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1266}} Jan 22 21:36:03.178794 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-2b1c5329-698f-4fd8-862f-479afa462fc1 tempest-VolumesGetTest-1998535251 None] deleting parent snapshot volume-bbbc389b-9e2c-49b4-ba04-4329cc02a38b.clone_snap {{(pid=129952) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1158}} Jan 22 21:36:05.594759 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.quota [None req-2b1c5329-698f-4fd8-862f-479afa462fc1 tempest-VolumesGetTest-1998535251 None] Created reservations ['26230f96-c808-41e9-96c4-825fef85fd2b', '9a68afd3-213b-4da9-936e-bdcaf28817c6', '155eafab-0aab-4149-bf6d-d7ed980b6506', '758ab457-4c2c-433e-803c-a355a69247d8'] {{(pid=129952) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 22 21:36:05.808581 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-2b1c5329-698f-4fd8-862f-479afa462fc1 tempest-VolumesGetTest-1998535251 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:36:05.845628 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-2b1c5329-698f-4fd8-862f-479afa462fc1 tempest-VolumesGetTest-1998535251 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:36:05.869436 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.manager [None req-2b1c5329-698f-4fd8-862f-479afa462fc1 tempest-VolumesGetTest-1998535251 None] Notifying Schedulers of capabilities ... {{(pid=129952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 22 21:36:05.874906 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-2b1c5329-698f-4fd8-862f-479afa462fc1 tempest-VolumesGetTest-1998535251 None] Deleted volume successfully. Jan 22 21:36:05.950213 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.coordination [None req-dffda368-8cbd-493d-a4be-053ee2d9aba4 tempest-VolumesGetTest-1998535251 None] Lock "b'cinder-5b3b3cd3-b314-44f8-ab15-4ce06657c94a-delete_volume'" acquired by "delete_volume" :: waited 0.009s {{(pid=129952) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 22 21:36:05.957158 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.coordination [None req-2b1c5329-698f-4fd8-862f-479afa462fc1 tempest-VolumesGetTest-1998535251 None] Lock "b'cinder-bbbc389b-9e2c-49b4-ba04-4329cc02a38b-delete_volume'" released by "delete_volume" :: held 7.765s {{(pid=129952) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 22 21:36:06.049710 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-dffda368-8cbd-493d-a4be-053ee2d9aba4 tempest-VolumesGetTest-1998535251 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:36:06.176990 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-dffda368-8cbd-493d-a4be-053ee2d9aba4 tempest-VolumesGetTest-1998535251 None] volume has no backup snaps {{(pid=129952) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Jan 22 21:36:06.177453 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-dffda368-8cbd-493d-a4be-053ee2d9aba4 tempest-VolumesGetTest-1998535251 None] Volume volume-5b3b3cd3-b314-44f8-ab15-4ce06657c94a is not a clone. {{(pid=129952) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Jan 22 21:36:06.260745 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-dffda368-8cbd-493d-a4be-053ee2d9aba4 tempest-VolumesGetTest-1998535251 None] deleting rbd volume volume-5b3b3cd3-b314-44f8-ab15-4ce06657c94a {{(pid=129952) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Jan 22 21:36:09.891669 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.quota [None req-dffda368-8cbd-493d-a4be-053ee2d9aba4 tempest-VolumesGetTest-1998535251 None] Created reservations ['5dd8bbff-b6a9-4509-8bcd-2ae53e98771b', 'ca9d131a-0a53-45d9-a8fb-9640b58fdec3', '336175ef-a557-4a70-9e08-685406c7cfe8', 'f2293e03-49dd-49a0-a0d5-e87b8cf86fad'] {{(pid=129952) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 22 21:36:10.036843 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-dffda368-8cbd-493d-a4be-053ee2d9aba4 tempest-VolumesGetTest-1998535251 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:36:10.057779 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-dffda368-8cbd-493d-a4be-053ee2d9aba4 tempest-VolumesGetTest-1998535251 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:36:10.080780 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.manager [None req-dffda368-8cbd-493d-a4be-053ee2d9aba4 tempest-VolumesGetTest-1998535251 None] Notifying Schedulers of capabilities ... {{(pid=129952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 22 21:36:10.084845 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-dffda368-8cbd-493d-a4be-053ee2d9aba4 tempest-VolumesGetTest-1998535251 None] Deleted volume successfully. Jan 22 21:36:10.132535 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.coordination [None req-dffda368-8cbd-493d-a4be-053ee2d9aba4 tempest-VolumesGetTest-1998535251 None] Lock "b'cinder-5b3b3cd3-b314-44f8-ab15-4ce06657c94a-delete_volume'" released by "delete_volume" :: held 4.184s {{(pid=129952) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 22 21:36:13.225185 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.flows.manager.create_volume [None req-9c6e82ec-e008-4231-9b6a-b486b2e6e361 tempest-VolumesSnapshotListTestJSON-187945433 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129952) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Jan 22 21:36:13.228431 ncdv-master-1 cinder-volume[129952]: WARNING stevedore.named [None req-9c6e82ec-e008-4231-9b6a-b486b2e6e361 tempest-VolumesSnapshotListTestJSON-187945433 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jan 22 21:36:13.228886 ncdv-master-1 cinder-volume[129952]: WARNING castellan.key_manager [None req-9c6e82ec-e008-4231-9b6a-b486b2e6e361 tempest-VolumesSnapshotListTestJSON-187945433 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 22 21:36:13.249303 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-9c6e82ec-e008-4231-9b6a-b486b2e6e361 tempest-VolumesSnapshotListTestJSON-187945433 None] Flow 'volume_create_manager' (c04e7b29-603d-49ac-943f-6506bb6fc452) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 22 21:36:13.256685 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-9c6e82ec-e008-4231-9b6a-b486b2e6e361 tempest-VolumesSnapshotListTestJSON-187945433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a13b4e95-5e55-4ceb-9488-48ceae39f422) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:36:13.263215 ncdv-master-1 cinder-volume[129952]: DEBUG oslo_db.sqlalchemy.engines [None req-9c6e82ec-e008-4231-9b6a-b486b2e6e361 tempest-VolumesSnapshotListTestJSON-187945433 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129952) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 22 21:36:13.278007 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-9c6e82ec-e008-4231-9b6a-b486b2e6e361 tempest-VolumesSnapshotListTestJSON-187945433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a13b4e95-5e55-4ceb-9488-48ceae39f422) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-01-22T21:36:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-244735897',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=04038263-be9b-4da3-8b99-5019e597441d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='77858ceef9fe4ed59c7cee8d37f09cbf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-01-22T21:36:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-01-22T21:36:13Z,use_quota=True,user_id='e988e7d0809c4506a96b968fa86fa6c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6dacb05b-a7ea-4056-85ff-98f0ea5c54eb),volume_type_id=6dacb05b-a7ea-4056-85ff-98f0ea5c54eb)' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:36:13.283943 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-9c6e82ec-e008-4231-9b6a-b486b2e6e361 tempest-VolumesSnapshotListTestJSON-187945433 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83a72b2d-831b-4324-a5e2-722b68894527) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:36:13.288193 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-9c6e82ec-e008-4231-9b6a-b486b2e6e361 tempest-VolumesSnapshotListTestJSON-187945433 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83a72b2d-831b-4324-a5e2-722b68894527) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:36:13.293403 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-9c6e82ec-e008-4231-9b6a-b486b2e6e361 tempest-VolumesSnapshotListTestJSON-187945433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f439fd6-700d-47e4-980b-3bca67b23963) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:36:13.297766 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-9c6e82ec-e008-4231-9b6a-b486b2e6e361 tempest-VolumesSnapshotListTestJSON-187945433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f439fd6-700d-47e4-980b-3bca67b23963) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '04038263-be9b-4da3-8b99-5019e597441d', 'volume_name': 'volume-04038263-be9b-4da3-8b99-5019e597441d', 'volume_size': 1}' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:36:13.306918 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-9c6e82ec-e008-4231-9b6a-b486b2e6e361 tempest-VolumesSnapshotListTestJSON-187945433 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (005a80e8-1b6e-496e-80e5-2df84001cd86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:36:13.311352 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-9c6e82ec-e008-4231-9b6a-b486b2e6e361 tempest-VolumesSnapshotListTestJSON-187945433 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (005a80e8-1b6e-496e-80e5-2df84001cd86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:36:13.317005 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-9c6e82ec-e008-4231-9b6a-b486b2e6e361 tempest-VolumesSnapshotListTestJSON-187945433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c06121a-0eea-466d-b4b5-47a628b0db51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:36:13.318152 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.flows.manager.create_volume [None req-9c6e82ec-e008-4231-9b6a-b486b2e6e361 tempest-VolumesSnapshotListTestJSON-187945433 None] Volume 04038263-be9b-4da3-8b99-5019e597441d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-04038263-be9b-4da3-8b99-5019e597441d', 'volume_size': 1} Jan 22 21:36:13.318540 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-9c6e82ec-e008-4231-9b6a-b486b2e6e361 tempest-VolumesSnapshotListTestJSON-187945433 None] creating volume 'volume-04038263-be9b-4da3-8b99-5019e597441d' {{(pid=129952) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Jan 22 21:36:13.319539 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-9c6e82ec-e008-4231-9b6a-b486b2e6e361 tempest-VolumesSnapshotListTestJSON-187945433 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:36:13.919026 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-9c6e82ec-e008-4231-9b6a-b486b2e6e361 tempest-VolumesSnapshotListTestJSON-187945433 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129952) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 22 21:36:13.919557 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-9c6e82ec-e008-4231-9b6a-b486b2e6e361 tempest-VolumesSnapshotListTestJSON-187945433 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129952) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 22 21:36:13.924306 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-9c6e82ec-e008-4231-9b6a-b486b2e6e361 tempest-VolumesSnapshotListTestJSON-187945433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c06121a-0eea-466d-b4b5-47a628b0db51) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-04038263-be9b-4da3-8b99-5019e597441d', 'volume_size': 1}' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:36:13.929622 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-9c6e82ec-e008-4231-9b6a-b486b2e6e361 tempest-VolumesSnapshotListTestJSON-187945433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be0161eb-c301-4128-aa90-eb72b89ccc8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:36:13.985344 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.flows.manager.create_volume [None req-9c6e82ec-e008-4231-9b6a-b486b2e6e361 tempest-VolumesSnapshotListTestJSON-187945433 None] Volume volume-04038263-be9b-4da3-8b99-5019e597441d (04038263-be9b-4da3-8b99-5019e597441d): created successfully Jan 22 21:36:13.989711 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-9c6e82ec-e008-4231-9b6a-b486b2e6e361 tempest-VolumesSnapshotListTestJSON-187945433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be0161eb-c301-4128-aa90-eb72b89ccc8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:36:13.997340 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-9c6e82ec-e008-4231-9b6a-b486b2e6e361 tempest-VolumesSnapshotListTestJSON-187945433 None] Flow 'volume_create_manager' (c04e7b29-603d-49ac-943f-6506bb6fc452) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129952) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 22 21:36:14.063096 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-9c6e82ec-e008-4231-9b6a-b486b2e6e361 tempest-VolumesSnapshotListTestJSON-187945433 None] Created volume successfully. Jan 22 21:36:14.657259 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-288dc863-4c29-45c3-aec8-1a70f6a8e957 tempest-VolumesSnapshotListTestJSON-187945433 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:36:16.362137 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-288dc863-4c29-45c3-aec8-1a70f6a8e957 tempest-VolumesSnapshotListTestJSON-187945433 None] Create snapshot completed successfully Jan 22 21:36:16.382882 ncdv-master-1 cinder-volume[129952]: DEBUG oslo_service.periodic_task [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129952) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jan 22 21:36:16.383662 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:36:16.406960 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:36:16.429236 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.manager [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] Notifying Schedulers of capabilities ... {{(pid=129952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 22 21:36:16.985419 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-75b36166-da18-4270-b073-767fe967e3d9 tempest-VolumesSnapshotListTestJSON-187945433 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:36:19.744644 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-75b36166-da18-4270-b073-767fe967e3d9 tempest-VolumesSnapshotListTestJSON-187945433 None] Create snapshot completed successfully Jan 22 21:36:20.419762 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-9ca12711-5eb5-4745-8c7d-ab57e060554e tempest-VolumesSnapshotListTestJSON-187945433 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:36:22.430311 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-9ca12711-5eb5-4745-8c7d-ab57e060554e tempest-VolumesSnapshotListTestJSON-187945433 None] Create snapshot completed successfully Jan 22 21:36:24.104570 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.coordination [None req-4cf0b016-7bcf-400e-b86f-ade2c6c6d715 tempest-VolumesSnapshotListTestJSON-187945433 None] Lock "b'cinder-7ed60f8e-1938-4f7c-b3a6-b735ae5f8440-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.009s {{(pid=129952) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 22 21:36:24.106132 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-4cf0b016-7bcf-400e-b86f-ade2c6c6d715 tempest-VolumesSnapshotListTestJSON-187945433 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:36:26.006055 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.quota [None req-4cf0b016-7bcf-400e-b86f-ade2c6c6d715 tempest-VolumesSnapshotListTestJSON-187945433 None] Created reservations ['f7b327ce-9560-46ec-9f2f-facc51f3a2d7', 'eb003f1c-937b-4b18-9fcc-e6e5106f8a56', '683e1a00-ea14-4611-9e07-e5692b9be460', '45f3f5a7-5384-4884-822e-683cc80f00ab'] {{(pid=129952) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 22 21:36:26.184717 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-4cf0b016-7bcf-400e-b86f-ade2c6c6d715 tempest-VolumesSnapshotListTestJSON-187945433 None] Delete snapshot completed successfully. Jan 22 21:36:26.189650 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.coordination [None req-4cf0b016-7bcf-400e-b86f-ade2c6c6d715 tempest-VolumesSnapshotListTestJSON-187945433 None] Lock "b'cinder-7ed60f8e-1938-4f7c-b3a6-b735ae5f8440-delete_snapshot'" released by "delete_snapshot" :: held 2.085s {{(pid=129952) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 22 21:36:26.282565 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.coordination [None req-1f587cb2-3366-4563-b164-74c0a53a51a1 tempest-VolumesSnapshotListTestJSON-187945433 None] Lock "b'cinder-2784e8e3-9b89-447d-9cd0-2517f82725f0-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.009s {{(pid=129952) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 22 21:36:26.284600 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-1f587cb2-3366-4563-b164-74c0a53a51a1 tempest-VolumesSnapshotListTestJSON-187945433 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:36:28.086151 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.quota [None req-1f587cb2-3366-4563-b164-74c0a53a51a1 tempest-VolumesSnapshotListTestJSON-187945433 None] Created reservations ['5d8f9659-8370-427e-bb53-a2d7d582f364', '8b814212-fc5e-4645-9788-dfd559928641', '02bae411-effc-4383-9831-c978ee742ad0', '8af02606-95c2-4286-88c4-c208a972cd58'] {{(pid=129952) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 22 21:36:28.276026 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-1f587cb2-3366-4563-b164-74c0a53a51a1 tempest-VolumesSnapshotListTestJSON-187945433 None] Delete snapshot completed successfully. Jan 22 21:36:28.280284 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.coordination [None req-1f587cb2-3366-4563-b164-74c0a53a51a1 tempest-VolumesSnapshotListTestJSON-187945433 None] Lock "b'cinder-2784e8e3-9b89-447d-9cd0-2517f82725f0-delete_snapshot'" released by "delete_snapshot" :: held 1.999s {{(pid=129952) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 22 21:36:28.652007 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.coordination [None req-b54e24e6-30fd-4b8c-b9aa-adbc4a570065 tempest-VolumesSnapshotListTestJSON-187945433 None] Lock "b'cinder-b5491719-d2ea-4988-b55c-c23684cf3c6f-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.008s {{(pid=129952) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 22 21:36:28.653351 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-b54e24e6-30fd-4b8c-b9aa-adbc4a570065 tempest-VolumesSnapshotListTestJSON-187945433 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:36:30.847139 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.quota [None req-b54e24e6-30fd-4b8c-b9aa-adbc4a570065 tempest-VolumesSnapshotListTestJSON-187945433 None] Created reservations ['3be6fc03-f401-4765-a5de-0036c17deacb', '8d4894ad-9a09-4a44-aed2-536703186a58', 'bf01f3d7-4482-4683-89a0-2e72cf53cadc', 'b7f046f1-c242-4648-a192-5870eadd363e'] {{(pid=129952) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 22 21:36:30.967525 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-b54e24e6-30fd-4b8c-b9aa-adbc4a570065 tempest-VolumesSnapshotListTestJSON-187945433 None] Delete snapshot completed successfully. Jan 22 21:36:30.971936 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.coordination [None req-b54e24e6-30fd-4b8c-b9aa-adbc4a570065 tempest-VolumesSnapshotListTestJSON-187945433 None] Lock "b'cinder-b5491719-d2ea-4988-b55c-c23684cf3c6f-delete_snapshot'" released by "delete_snapshot" :: held 2.321s {{(pid=129952) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 22 21:36:31.969196 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.coordination [None req-9c401111-4e28-4879-9040-9e61ed3bd742 tempest-VolumesSnapshotListTestJSON-187945433 None] Lock "b'cinder-04038263-be9b-4da3-8b99-5019e597441d-delete_volume'" acquired by "delete_volume" :: waited 0.008s {{(pid=129952) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 22 21:36:32.042811 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-9c401111-4e28-4879-9040-9e61ed3bd742 tempest-VolumesSnapshotListTestJSON-187945433 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:36:32.154207 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-9c401111-4e28-4879-9040-9e61ed3bd742 tempest-VolumesSnapshotListTestJSON-187945433 None] volume has no backup snaps {{(pid=129952) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Jan 22 21:36:32.154680 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-9c401111-4e28-4879-9040-9e61ed3bd742 tempest-VolumesSnapshotListTestJSON-187945433 None] Volume volume-04038263-be9b-4da3-8b99-5019e597441d is not a clone. {{(pid=129952) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Jan 22 21:36:32.259533 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-9c401111-4e28-4879-9040-9e61ed3bd742 tempest-VolumesSnapshotListTestJSON-187945433 None] deleting rbd volume volume-04038263-be9b-4da3-8b99-5019e597441d {{(pid=129952) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Jan 22 21:36:33.276011 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.quota [None req-711bc17e-1e8b-4fc5-a1c8-bb08b30ee132 tempest-VolumesSnapshotTestJSON-664893185 None] Created reservations ['6ea330a6-eff2-41d7-8dd6-3190acb982d2', '26f1889d-8f26-495c-9b0f-e682abf27e99', '61f73fc9-cfb6-4959-ab9b-d6e213c68a49', 'd3e12405-c500-446b-a130-5fa1f9a3f321'] {{(pid=129952) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 22 21:36:33.577680 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-711bc17e-1e8b-4fc5-a1c8-bb08b30ee132 tempest-VolumesSnapshotTestJSON-664893185 None] Delete snapshot completed successfully. Jan 22 21:36:33.585013 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.coordination [None req-711bc17e-1e8b-4fc5-a1c8-bb08b30ee132 tempest-VolumesSnapshotTestJSON-664893185 None] Lock "b'cinder-9a1ca7cd-2086-4578-ac6f-aedbc892ed0b-delete_snapshot'" released by "delete_snapshot" :: held 31.697s {{(pid=129952) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 22 21:36:33.881485 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.coordination [None req-b8828eec-1fb1-4c15-aa3a-c0819494193b tempest-VolumesSnapshotTestJSON-664893185 None] Lock "b'cinder-d5b2d20b-4490-4e22-9c2e-822630164704-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.008s {{(pid=129952) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 22 21:36:33.883297 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-b8828eec-1fb1-4c15-aa3a-c0819494193b tempest-VolumesSnapshotTestJSON-664893185 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:36:36.218966 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.quota [None req-9c401111-4e28-4879-9040-9e61ed3bd742 tempest-VolumesSnapshotListTestJSON-187945433 None] Created reservations ['35662c1b-525d-4f77-93d7-0991d69c0398', '590e54a6-37bb-455d-8599-8e433e00cfde', 'b2ff8751-8252-4d53-9c14-56c981fa57b8', 'c288419f-c1d6-49d9-b5de-59f99eedf015'] {{(pid=129952) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 22 21:36:36.413864 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-9c401111-4e28-4879-9040-9e61ed3bd742 tempest-VolumesSnapshotListTestJSON-187945433 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:36:36.434707 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-9c401111-4e28-4879-9040-9e61ed3bd742 tempest-VolumesSnapshotListTestJSON-187945433 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:36:36.460646 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.manager [None req-9c401111-4e28-4879-9040-9e61ed3bd742 tempest-VolumesSnapshotListTestJSON-187945433 None] Notifying Schedulers of capabilities ... {{(pid=129952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 22 21:36:36.466497 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-9c401111-4e28-4879-9040-9e61ed3bd742 tempest-VolumesSnapshotListTestJSON-187945433 None] Deleted volume successfully. Jan 22 21:36:36.548541 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.coordination [None req-9c401111-4e28-4879-9040-9e61ed3bd742 tempest-VolumesSnapshotListTestJSON-187945433 None] Lock "b'cinder-04038263-be9b-4da3-8b99-5019e597441d-delete_volume'" released by "delete_volume" :: held 4.579s {{(pid=129952) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 22 21:36:40.401903 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.flows.manager.create_volume [None req-97f76504-6346-49ab-849d-6db1f83b4d74 tempest-VolumesSnapshotNegativeTestJSON-1303314792 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129952) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Jan 22 21:36:40.405199 ncdv-master-1 cinder-volume[129952]: WARNING stevedore.named [None req-97f76504-6346-49ab-849d-6db1f83b4d74 tempest-VolumesSnapshotNegativeTestJSON-1303314792 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jan 22 21:36:40.405677 ncdv-master-1 cinder-volume[129952]: WARNING castellan.key_manager [None req-97f76504-6346-49ab-849d-6db1f83b4d74 tempest-VolumesSnapshotNegativeTestJSON-1303314792 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 22 21:36:40.425802 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-97f76504-6346-49ab-849d-6db1f83b4d74 tempest-VolumesSnapshotNegativeTestJSON-1303314792 None] Flow 'volume_create_manager' (eb5d451b-5b86-45f8-a96d-011822819b4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 22 21:36:40.433044 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-97f76504-6346-49ab-849d-6db1f83b4d74 tempest-VolumesSnapshotNegativeTestJSON-1303314792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91f6fc90-0069-4ec8-9929-be00a2092689) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:36:40.439114 ncdv-master-1 cinder-volume[129952]: DEBUG oslo_db.sqlalchemy.engines [None req-97f76504-6346-49ab-849d-6db1f83b4d74 tempest-VolumesSnapshotNegativeTestJSON-1303314792 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129952) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 22 21:36:40.452842 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-97f76504-6346-49ab-849d-6db1f83b4d74 tempest-VolumesSnapshotNegativeTestJSON-1303314792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91f6fc90-0069-4ec8-9929-be00a2092689) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-01-22T21:36:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1828403405',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=f87f3db3-8937-4572-acf3-fb44196a8d3d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='459313278765421ea2f6f0ebddc01d0b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-01-22T21:36:40Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-01-22T21:36:40Z,use_quota=True,user_id='0776c71a9e12447691036d1ce2ae4e21',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6dacb05b-a7ea-4056-85ff-98f0ea5c54eb),volume_type_id=6dacb05b-a7ea-4056-85ff-98f0ea5c54eb)' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:36:40.458516 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-97f76504-6346-49ab-849d-6db1f83b4d74 tempest-VolumesSnapshotNegativeTestJSON-1303314792 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a8829d9-bc8f-410c-b2da-5f80e6e1a63a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:36:40.462762 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-97f76504-6346-49ab-849d-6db1f83b4d74 tempest-VolumesSnapshotNegativeTestJSON-1303314792 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a8829d9-bc8f-410c-b2da-5f80e6e1a63a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:36:40.468085 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-97f76504-6346-49ab-849d-6db1f83b4d74 tempest-VolumesSnapshotNegativeTestJSON-1303314792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc856133-3485-41ad-ada7-a0796b7fc319) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:36:40.472674 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-97f76504-6346-49ab-849d-6db1f83b4d74 tempest-VolumesSnapshotNegativeTestJSON-1303314792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc856133-3485-41ad-ada7-a0796b7fc319) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f87f3db3-8937-4572-acf3-fb44196a8d3d', 'volume_name': 'volume-f87f3db3-8937-4572-acf3-fb44196a8d3d', 'volume_size': 2}' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:36:40.478908 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-97f76504-6346-49ab-849d-6db1f83b4d74 tempest-VolumesSnapshotNegativeTestJSON-1303314792 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1e6a384-69f2-41e7-93ce-8c1a29a6f0a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:36:40.483117 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-97f76504-6346-49ab-849d-6db1f83b4d74 tempest-VolumesSnapshotNegativeTestJSON-1303314792 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1e6a384-69f2-41e7-93ce-8c1a29a6f0a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:36:40.488336 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-97f76504-6346-49ab-849d-6db1f83b4d74 tempest-VolumesSnapshotNegativeTestJSON-1303314792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0fdf5f9-9b8b-4bb8-b94c-8fe44476cc87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:36:40.490121 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.flows.manager.create_volume [None req-97f76504-6346-49ab-849d-6db1f83b4d74 tempest-VolumesSnapshotNegativeTestJSON-1303314792 None] Volume f87f3db3-8937-4572-acf3-fb44196a8d3d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f87f3db3-8937-4572-acf3-fb44196a8d3d', 'volume_size': 2} Jan 22 21:36:40.490522 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-97f76504-6346-49ab-849d-6db1f83b4d74 tempest-VolumesSnapshotNegativeTestJSON-1303314792 None] creating volume 'volume-f87f3db3-8937-4572-acf3-fb44196a8d3d' {{(pid=129952) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Jan 22 21:36:40.491508 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-97f76504-6346-49ab-849d-6db1f83b4d74 tempest-VolumesSnapshotNegativeTestJSON-1303314792 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:36:40.913488 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-97f76504-6346-49ab-849d-6db1f83b4d74 tempest-VolumesSnapshotNegativeTestJSON-1303314792 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129952) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 22 21:36:40.913905 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-97f76504-6346-49ab-849d-6db1f83b4d74 tempest-VolumesSnapshotNegativeTestJSON-1303314792 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129952) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 22 21:36:40.917884 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-97f76504-6346-49ab-849d-6db1f83b4d74 tempest-VolumesSnapshotNegativeTestJSON-1303314792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0fdf5f9-9b8b-4bb8-b94c-8fe44476cc87) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f87f3db3-8937-4572-acf3-fb44196a8d3d', 'volume_size': 2}' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:36:40.922713 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-97f76504-6346-49ab-849d-6db1f83b4d74 tempest-VolumesSnapshotNegativeTestJSON-1303314792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (079bcb91-b82e-4776-b312-32614dedb2ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:36:40.972847 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.flows.manager.create_volume [None req-97f76504-6346-49ab-849d-6db1f83b4d74 tempest-VolumesSnapshotNegativeTestJSON-1303314792 None] Volume volume-f87f3db3-8937-4572-acf3-fb44196a8d3d (f87f3db3-8937-4572-acf3-fb44196a8d3d): created successfully Jan 22 21:36:40.977957 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-97f76504-6346-49ab-849d-6db1f83b4d74 tempest-VolumesSnapshotNegativeTestJSON-1303314792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (079bcb91-b82e-4776-b312-32614dedb2ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:36:40.984501 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-97f76504-6346-49ab-849d-6db1f83b4d74 tempest-VolumesSnapshotNegativeTestJSON-1303314792 None] Flow 'volume_create_manager' (eb5d451b-5b86-45f8-a96d-011822819b4a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129952) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 22 21:36:41.053557 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-97f76504-6346-49ab-849d-6db1f83b4d74 tempest-VolumesSnapshotNegativeTestJSON-1303314792 None] Created volume successfully. Jan 22 21:36:41.852423 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-d63b0563-fb1d-471c-a054-0be411678fdc tempest-VolumesSnapshotNegativeTestJSON-1303314792 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:36:44.778363 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-d63b0563-fb1d-471c-a054-0be411678fdc tempest-VolumesSnapshotNegativeTestJSON-1303314792 None] Create snapshot completed successfully Jan 22 21:36:44.972689 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.coordination [None req-325625c4-de3c-48f9-96a0-49ec5cd18be7 tempest-VolumesSnapshotNegativeTestJSON-1303314792 None] Lock "b'cinder-ae86355e-0391-48b3-920e-f360553aaa22-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.008s {{(pid=129952) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 22 21:36:44.972689 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-325625c4-de3c-48f9-96a0-49ec5cd18be7 tempest-VolumesSnapshotNegativeTestJSON-1303314792 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:36:48.093264 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.quota [None req-325625c4-de3c-48f9-96a0-49ec5cd18be7 tempest-VolumesSnapshotNegativeTestJSON-1303314792 None] Created reservations ['25e1b23d-ebc9-4282-9994-6285d7ef6fff', 'd24fc6a7-3ac9-4d4a-90d2-ccbd71d34fe4', '29a3ca58-c2c8-4532-9f66-78343c6a545e', '82e4db99-4c7c-4ec8-9c09-3637facfd5f9'] {{(pid=129952) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 22 21:36:48.247534 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-325625c4-de3c-48f9-96a0-49ec5cd18be7 tempest-VolumesSnapshotNegativeTestJSON-1303314792 None] Delete snapshot completed successfully. Jan 22 21:36:48.255966 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.coordination [None req-325625c4-de3c-48f9-96a0-49ec5cd18be7 tempest-VolumesSnapshotNegativeTestJSON-1303314792 None] Lock "b'cinder-ae86355e-0391-48b3-920e-f360553aaa22-delete_snapshot'" released by "delete_snapshot" :: held 3.286s {{(pid=129952) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 22 21:36:49.281151 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.coordination [None req-fd598074-1c4d-4d59-b353-ea5b40ba9bb8 tempest-VolumesSnapshotNegativeTestJSON-1303314792 None] Lock "b'cinder-f87f3db3-8937-4572-acf3-fb44196a8d3d-delete_volume'" acquired by "delete_volume" :: waited 0.011s {{(pid=129952) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 22 21:36:49.351338 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-fd598074-1c4d-4d59-b353-ea5b40ba9bb8 tempest-VolumesSnapshotNegativeTestJSON-1303314792 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:36:49.486925 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-fd598074-1c4d-4d59-b353-ea5b40ba9bb8 tempest-VolumesSnapshotNegativeTestJSON-1303314792 None] volume has no backup snaps {{(pid=129952) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Jan 22 21:36:49.487360 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-fd598074-1c4d-4d59-b353-ea5b40ba9bb8 tempest-VolumesSnapshotNegativeTestJSON-1303314792 None] Volume volume-f87f3db3-8937-4572-acf3-fb44196a8d3d is not a clone. {{(pid=129952) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Jan 22 21:36:49.573240 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-fd598074-1c4d-4d59-b353-ea5b40ba9bb8 tempest-VolumesSnapshotNegativeTestJSON-1303314792 None] deleting rbd volume volume-f87f3db3-8937-4572-acf3-fb44196a8d3d {{(pid=129952) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Jan 22 21:36:52.537905 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.quota [None req-fd598074-1c4d-4d59-b353-ea5b40ba9bb8 tempest-VolumesSnapshotNegativeTestJSON-1303314792 None] Created reservations ['134ecb03-f589-4ab6-b6f0-f1f75638551e', 'b0ddbdf0-4e7d-4b6f-8689-979f7c06e2c7', '95ced9c2-951b-44b6-887f-2693d6180870', '4bbbd0e7-4636-4bc8-87c0-03cdce8e9ea0'] {{(pid=129952) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 22 21:36:52.710583 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-fd598074-1c4d-4d59-b353-ea5b40ba9bb8 tempest-VolumesSnapshotNegativeTestJSON-1303314792 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:36:52.731824 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-fd598074-1c4d-4d59-b353-ea5b40ba9bb8 tempest-VolumesSnapshotNegativeTestJSON-1303314792 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:36:52.755039 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.manager [None req-fd598074-1c4d-4d59-b353-ea5b40ba9bb8 tempest-VolumesSnapshotNegativeTestJSON-1303314792 None] Notifying Schedulers of capabilities ... {{(pid=129952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 22 21:36:52.759227 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-fd598074-1c4d-4d59-b353-ea5b40ba9bb8 tempest-VolumesSnapshotNegativeTestJSON-1303314792 None] Deleted volume successfully. Jan 22 21:36:52.833805 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.coordination [None req-fd598074-1c4d-4d59-b353-ea5b40ba9bb8 tempest-VolumesSnapshotNegativeTestJSON-1303314792 None] Lock "b'cinder-f87f3db3-8937-4572-acf3-fb44196a8d3d-delete_volume'" released by "delete_volume" :: held 3.553s {{(pid=129952) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 22 21:37:04.926925 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.quota [None req-b8828eec-1fb1-4c15-aa3a-c0819494193b tempest-VolumesSnapshotTestJSON-664893185 None] Created reservations ['8cfdc2f7-2fe1-4d8b-a7a5-c08472b6915b', 'e92a8952-139f-4929-b3dc-6cc2e7db457a', '77e5f0df-2f5a-4d89-ae11-1080cb76ccf0', '5c8609f0-73ef-463c-ab4e-20cb20fdfd5c'] {{(pid=129952) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 22 21:37:05.172584 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-b8828eec-1fb1-4c15-aa3a-c0819494193b tempest-VolumesSnapshotTestJSON-664893185 None] Delete snapshot completed successfully. Jan 22 21:37:05.176989 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.coordination [None req-b8828eec-1fb1-4c15-aa3a-c0819494193b tempest-VolumesSnapshotTestJSON-664893185 None] Lock "b'cinder-d5b2d20b-4490-4e22-9c2e-822630164704-delete_snapshot'" released by "delete_snapshot" :: held 31.296s {{(pid=129952) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 22 21:37:06.956469 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [req-ea387795-fbbe-471f-9c07-a6aaa8c2bc36 req-e97dfc07-c20b-47cd-9ab7-2f1edea9cc49 tempest-VolumesSnapshotTestJSON-664893185 None] Terminate volume connection completed successfully. Jan 22 21:37:06.957100 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [req-ea387795-fbbe-471f-9c07-a6aaa8c2bc36 req-e97dfc07-c20b-47cd-9ab7-2f1edea9cc49 tempest-VolumesSnapshotTestJSON-664893185 None] Deleting attachment 19a7ca78-a92f-43b4-a890-217920daa30d. {{(pid=129952) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4947}} Jan 22 21:37:11.566408 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-bac388ed-3cf0-4a6d-b32c-8b7b1502ca78 tempest-VolumesSnapshotTestJSON-664893185 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:37:13.308714 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-bac388ed-3cf0-4a6d-b32c-8b7b1502ca78 tempest-VolumesSnapshotTestJSON-664893185 None] Create snapshot completed successfully Jan 22 21:37:13.732703 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.coordination [None req-30da4a00-92e2-4fc3-875b-9f425048e2f1 tempest-VolumesSnapshotTestJSON-664893185 None] Lock "b'cinder-98daad75-583d-42d1-ada1-812ed10badb6-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.009s {{(pid=129952) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 22 21:37:13.734182 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-30da4a00-92e2-4fc3-875b-9f425048e2f1 tempest-VolumesSnapshotTestJSON-664893185 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:37:16.132207 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.quota [None req-30da4a00-92e2-4fc3-875b-9f425048e2f1 tempest-VolumesSnapshotTestJSON-664893185 None] Created reservations ['1b922e08-da6e-4aea-b362-9cfcb724258d', '761e5cee-0ffe-4423-98ba-1986f244ba1b', '95056493-5e09-4e29-97cf-5ed275980a66', 'fb99b0b1-abf2-4b31-b3e1-9ae654c9d801'] {{(pid=129952) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 22 21:37:16.263473 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-30da4a00-92e2-4fc3-875b-9f425048e2f1 tempest-VolumesSnapshotTestJSON-664893185 None] Delete snapshot completed successfully. Jan 22 21:37:16.276532 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.coordination [None req-30da4a00-92e2-4fc3-875b-9f425048e2f1 tempest-VolumesSnapshotTestJSON-664893185 None] Lock "b'cinder-98daad75-583d-42d1-ada1-812ed10badb6-delete_snapshot'" released by "delete_snapshot" :: held 2.543s {{(pid=129952) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 22 21:37:16.384450 ncdv-master-1 cinder-volume[129952]: DEBUG oslo_service.periodic_task [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129952) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jan 22 21:37:16.385363 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:37:16.408380 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:37:16.432423 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.manager [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] Notifying Schedulers of capabilities ... {{(pid=129952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 22 21:37:17.320434 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-325947bb-6a10-4fc2-837c-e2d4ddfe756b tempest-VolumesSnapshotTestJSON-664893185 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:37:18.914936 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-325947bb-6a10-4fc2-837c-e2d4ddfe756b tempest-VolumesSnapshotTestJSON-664893185 None] Create snapshot completed successfully Jan 22 21:37:32.577967 ncdv-master-1 cinder-volume[129952]: DEBUG oslo_concurrency.processutils [req-dcf09ae1-97b9-4a03-8582-2a9add6be89d req-8139643b-1128-4e62-b04d-121e8b3761db tempest-VolumesSnapshotTestJSON-664893185 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129952) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jan 22 21:37:33.263996 ncdv-master-1 cinder-volume[129952]: DEBUG oslo_concurrency.processutils [req-dcf09ae1-97b9-4a03-8582-2a9add6be89d req-8139643b-1128-4e62-b04d-121e8b3761db tempest-VolumesSnapshotTestJSON-664893185 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.686s {{(pid=129952) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jan 22 21:37:33.264846 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [req-dcf09ae1-97b9-4a03-8582-2a9add6be89d req-8139643b-1128-4e62-b04d-121e8b3761db tempest-VolumesSnapshotTestJSON-664893185 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-f6238c78-261a-421a-b7a2-43273813620f', 'hosts': ['10.222.0.100'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'c7ee930a-3b87-450e-91f6-d4eef70cb484', 'volume_id': 'f6238c78-261a-421a-b7a2-43273813620f', 'discard': True}} {{(pid=129952) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Jan 22 21:37:33.372399 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [req-dcf09ae1-97b9-4a03-8582-2a9add6be89d req-8139643b-1128-4e62-b04d-121e8b3761db tempest-VolumesSnapshotTestJSON-664893185 None] Connection info returned from driver {'name': 'volumes/volume-f6238c78-261a-421a-b7a2-43273813620f', 'hosts': ['10.222.0.100'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'f6238c78-261a-421a-b7a2-43273813620f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'bd8bda4b-7f38-4a48-808d-ac62439155d6'} {{(pid=129952) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4811}} Jan 22 21:37:33.445569 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [req-dcf09ae1-97b9-4a03-8582-2a9add6be89d req-8139643b-1128-4e62-b04d-121e8b3761db tempest-VolumesSnapshotTestJSON-664893185 None] attachment_update completed successfully. Jan 22 21:37:36.135172 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-f60c5259-d0ec-4e81-a3f6-7014310010d6 tempest-VolumesSnapshotTestJSON-664893185 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:37:37.554785 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-f60c5259-d0ec-4e81-a3f6-7014310010d6 tempest-VolumesSnapshotTestJSON-664893185 None] Create snapshot completed successfully Jan 22 21:37:38.540028 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-09b7a489-0ec9-49e3-9eec-624bf65eff74 tempest-VolumesSnapshotTestJSON-664893185 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:37:40.126718 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-09b7a489-0ec9-49e3-9eec-624bf65eff74 tempest-VolumesSnapshotTestJSON-664893185 None] Create snapshot completed successfully Jan 22 21:37:40.602997 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.coordination [None req-16a74dca-b020-49bf-a672-0228cf03628d tempest-VolumesSnapshotTestJSON-664893185 None] Lock "b'cinder-823a3075-cacf-449c-bd19-a6be3855cdb9-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.023s {{(pid=129952) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 22 21:37:40.606006 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-16a74dca-b020-49bf-a672-0228cf03628d tempest-VolumesSnapshotTestJSON-664893185 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:38:11.309958 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.quota [None req-16a74dca-b020-49bf-a672-0228cf03628d tempest-VolumesSnapshotTestJSON-664893185 None] Created reservations ['374adec1-a7a2-47e4-9f14-115758714ec1', '3ea54202-d605-47aa-9082-2fbf6db3b6ca', '3bc49872-3082-42bb-b037-c2b8cbcb7d09', '90e3a4a8-ad4f-4719-9d8c-99dd24c44233'] {{(pid=129952) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 22 21:38:11.532206 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-16a74dca-b020-49bf-a672-0228cf03628d tempest-VolumesSnapshotTestJSON-664893185 None] Delete snapshot completed successfully. Jan 22 21:38:11.536462 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.coordination [None req-16a74dca-b020-49bf-a672-0228cf03628d tempest-VolumesSnapshotTestJSON-664893185 None] Lock "b'cinder-823a3075-cacf-449c-bd19-a6be3855cdb9-delete_snapshot'" released by "delete_snapshot" :: held 30.934s {{(pid=129952) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 22 21:38:11.626468 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.coordination [None req-71f8c635-e92b-4510-8c66-1a78231d9fb9 tempest-VolumesSnapshotTestJSON-664893185 None] Lock "b'cinder-010fc1ff-dd53-4966-8a4e-512ce70a346d-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.013s {{(pid=129952) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 22 21:38:11.631260 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-71f8c635-e92b-4510-8c66-1a78231d9fb9 tempest-VolumesSnapshotTestJSON-664893185 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:38:42.600017 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.quota [None req-71f8c635-e92b-4510-8c66-1a78231d9fb9 tempest-VolumesSnapshotTestJSON-664893185 None] Created reservations ['3e114f3a-6c01-4fb1-a14b-8f8c1790bf4d', '86c68285-5189-4fad-b521-96dc30903e48', 'f5cc003e-f243-42c8-8ce4-fa3704b86b10', '2655f269-8e6a-4745-b0ed-7449c911280b'] {{(pid=129952) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 22 21:38:42.754277 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-71f8c635-e92b-4510-8c66-1a78231d9fb9 tempest-VolumesSnapshotTestJSON-664893185 None] Delete snapshot completed successfully. Jan 22 21:38:42.786497 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.coordination [None req-71f8c635-e92b-4510-8c66-1a78231d9fb9 tempest-VolumesSnapshotTestJSON-664893185 None] Lock "b'cinder-010fc1ff-dd53-4966-8a4e-512ce70a346d-delete_snapshot'" released by "delete_snapshot" :: held 31.133s {{(pid=129952) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 22 21:38:43.573920 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.coordination [None req-243b2302-5755-4286-9b9d-4de341c10cae tempest-VolumesSnapshotTestJSON-664893185 None] Lock "b'cinder-e4678f66-0896-4e40-9520-429f7c04c876-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.009s {{(pid=129952) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 22 21:38:43.576077 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-243b2302-5755-4286-9b9d-4de341c10cae tempest-VolumesSnapshotTestJSON-664893185 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:39:14.416835 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.quota [None req-243b2302-5755-4286-9b9d-4de341c10cae tempest-VolumesSnapshotTestJSON-664893185 None] Created reservations ['a057dd0f-da4d-4306-998d-3ad2b672b100', 'b36e8703-f254-40ab-a810-dd1dbbd5824f', '9f6c1669-7a40-4f3f-9b60-48307841d923', '6b916cb8-0e8b-4aae-8674-40f338071d9e'] {{(pid=129952) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 22 21:39:14.586632 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-243b2302-5755-4286-9b9d-4de341c10cae tempest-VolumesSnapshotTestJSON-664893185 None] Delete snapshot completed successfully. Jan 22 21:39:14.591770 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.coordination [None req-243b2302-5755-4286-9b9d-4de341c10cae tempest-VolumesSnapshotTestJSON-664893185 None] Lock "b'cinder-e4678f66-0896-4e40-9520-429f7c04c876-delete_snapshot'" released by "delete_snapshot" :: held 31.018s {{(pid=129952) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 22 21:39:16.390312 ncdv-master-1 cinder-volume[129952]: DEBUG oslo_service.periodic_task [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129952) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jan 22 21:39:16.392293 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:39:16.432181 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:39:16.458916 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.manager [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] Notifying Schedulers of capabilities ... {{(pid=129952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 22 21:39:16.481528 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [req-01a4c30d-cfe1-425e-bc7b-8dd4cdb222c0 req-0987bf3b-136b-4ccf-ac6d-bbad9671abab tempest-VolumesSnapshotTestJSON-664893185 None] Terminate volume connection completed successfully. Jan 22 21:39:16.481963 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [req-01a4c30d-cfe1-425e-bc7b-8dd4cdb222c0 req-0987bf3b-136b-4ccf-ac6d-bbad9671abab tempest-VolumesSnapshotTestJSON-664893185 None] Deleting attachment bd8bda4b-7f38-4a48-808d-ac62439155d6. {{(pid=129952) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4947}} Jan 22 21:39:21.390409 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.flows.manager.create_volume [None req-fe1351e7-bc19-4e5e-adc3-36c5570e73c1 tempest-VolumesSnapshotTestJSON-664893185 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129952) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Jan 22 21:39:21.394038 ncdv-master-1 cinder-volume[129952]: WARNING stevedore.named [None req-fe1351e7-bc19-4e5e-adc3-36c5570e73c1 tempest-VolumesSnapshotTestJSON-664893185 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jan 22 21:39:21.394519 ncdv-master-1 cinder-volume[129952]: WARNING castellan.key_manager [None req-fe1351e7-bc19-4e5e-adc3-36c5570e73c1 tempest-VolumesSnapshotTestJSON-664893185 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 22 21:39:21.415215 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-fe1351e7-bc19-4e5e-adc3-36c5570e73c1 tempest-VolumesSnapshotTestJSON-664893185 None] Flow 'volume_create_manager' (68da2f76-3025-4373-afde-35bb972b7759) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 22 21:39:21.422042 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-fe1351e7-bc19-4e5e-adc3-36c5570e73c1 tempest-VolumesSnapshotTestJSON-664893185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (095e946b-a866-4646-b902-0b7e575f9a44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:39:21.429152 ncdv-master-1 cinder-volume[129952]: DEBUG oslo_db.sqlalchemy.engines [None req-fe1351e7-bc19-4e5e-adc3-36c5570e73c1 tempest-VolumesSnapshotTestJSON-664893185 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129952) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 22 21:39:21.443733 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-fe1351e7-bc19-4e5e-adc3-36c5570e73c1 tempest-VolumesSnapshotTestJSON-664893185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (095e946b-a866-4646-b902-0b7e575f9a44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-01-22T21:39:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-524303878',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=c3305bf3-2cbb-4463-9006-d635a8131249,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='037b801bacb742d89e5ea8f5e59ec7b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-01-22T21:39:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-01-22T21:39:21Z,use_quota=True,user_id='912fa15040dc442fa281a72320a10dc5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6dacb05b-a7ea-4056-85ff-98f0ea5c54eb),volume_type_id=6dacb05b-a7ea-4056-85ff-98f0ea5c54eb)' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:39:21.449193 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-fe1351e7-bc19-4e5e-adc3-36c5570e73c1 tempest-VolumesSnapshotTestJSON-664893185 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6eadc73-0500-484f-aede-dd07319663fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:39:21.453376 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-fe1351e7-bc19-4e5e-adc3-36c5570e73c1 tempest-VolumesSnapshotTestJSON-664893185 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6eadc73-0500-484f-aede-dd07319663fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:39:21.458625 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-fe1351e7-bc19-4e5e-adc3-36c5570e73c1 tempest-VolumesSnapshotTestJSON-664893185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76ef4f7e-b133-4fa3-93d7-e75b07bfc6eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:39:21.463043 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-fe1351e7-bc19-4e5e-adc3-36c5570e73c1 tempest-VolumesSnapshotTestJSON-664893185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76ef4f7e-b133-4fa3-93d7-e75b07bfc6eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c3305bf3-2cbb-4463-9006-d635a8131249', 'volume_name': 'volume-c3305bf3-2cbb-4463-9006-d635a8131249', 'volume_size': 1}' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:39:21.468739 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-fe1351e7-bc19-4e5e-adc3-36c5570e73c1 tempest-VolumesSnapshotTestJSON-664893185 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58b1426e-d8da-4ae5-8033-c82371057d75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:39:21.472337 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-fe1351e7-bc19-4e5e-adc3-36c5570e73c1 tempest-VolumesSnapshotTestJSON-664893185 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58b1426e-d8da-4ae5-8033-c82371057d75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:39:21.477200 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-fe1351e7-bc19-4e5e-adc3-36c5570e73c1 tempest-VolumesSnapshotTestJSON-664893185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ec8eca3-f373-4fbc-a1f6-c09cf375fe0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:39:21.478337 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.flows.manager.create_volume [None req-fe1351e7-bc19-4e5e-adc3-36c5570e73c1 tempest-VolumesSnapshotTestJSON-664893185 None] Volume c3305bf3-2cbb-4463-9006-d635a8131249: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c3305bf3-2cbb-4463-9006-d635a8131249', 'volume_size': 1} Jan 22 21:39:21.478729 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-fe1351e7-bc19-4e5e-adc3-36c5570e73c1 tempest-VolumesSnapshotTestJSON-664893185 None] creating volume 'volume-c3305bf3-2cbb-4463-9006-d635a8131249' {{(pid=129952) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Jan 22 21:39:21.479698 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-fe1351e7-bc19-4e5e-adc3-36c5570e73c1 tempest-VolumesSnapshotTestJSON-664893185 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:39:21.934746 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-fe1351e7-bc19-4e5e-adc3-36c5570e73c1 tempest-VolumesSnapshotTestJSON-664893185 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129952) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 22 21:39:21.935384 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-fe1351e7-bc19-4e5e-adc3-36c5570e73c1 tempest-VolumesSnapshotTestJSON-664893185 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129952) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 22 21:39:21.939491 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-fe1351e7-bc19-4e5e-adc3-36c5570e73c1 tempest-VolumesSnapshotTestJSON-664893185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ec8eca3-f373-4fbc-a1f6-c09cf375fe0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c3305bf3-2cbb-4463-9006-d635a8131249', 'volume_size': 1}' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:39:21.945731 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-fe1351e7-bc19-4e5e-adc3-36c5570e73c1 tempest-VolumesSnapshotTestJSON-664893185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65723135-705d-4999-b34b-b1d1252a51a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:39:22.010365 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.flows.manager.create_volume [None req-fe1351e7-bc19-4e5e-adc3-36c5570e73c1 tempest-VolumesSnapshotTestJSON-664893185 None] Volume volume-c3305bf3-2cbb-4463-9006-d635a8131249 (c3305bf3-2cbb-4463-9006-d635a8131249): created successfully Jan 22 21:39:22.014211 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-fe1351e7-bc19-4e5e-adc3-36c5570e73c1 tempest-VolumesSnapshotTestJSON-664893185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65723135-705d-4999-b34b-b1d1252a51a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:39:22.019923 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-fe1351e7-bc19-4e5e-adc3-36c5570e73c1 tempest-VolumesSnapshotTestJSON-664893185 None] Flow 'volume_create_manager' (68da2f76-3025-4373-afde-35bb972b7759) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129952) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 22 21:39:22.089544 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-fe1351e7-bc19-4e5e-adc3-36c5570e73c1 tempest-VolumesSnapshotTestJSON-664893185 None] Created volume successfully. Jan 22 21:39:22.765239 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-13b5c546-bcc3-4c7c-b230-7e50308cb740 tempest-VolumesSnapshotTestJSON-664893185 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:39:25.148143 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-13b5c546-bcc3-4c7c-b230-7e50308cb740 tempest-VolumesSnapshotTestJSON-664893185 None] Create snapshot completed successfully Jan 22 21:39:26.596247 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.flows.manager.create_volume [None req-f9b7b983-b6cd-4797-bb2e-ae308b2a2cf6 tempest-VolumesSnapshotTestJSON-664893185 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129952) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Jan 22 21:39:26.600215 ncdv-master-1 cinder-volume[129952]: WARNING stevedore.named [None req-f9b7b983-b6cd-4797-bb2e-ae308b2a2cf6 tempest-VolumesSnapshotTestJSON-664893185 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jan 22 21:39:26.600789 ncdv-master-1 cinder-volume[129952]: WARNING castellan.key_manager [None req-f9b7b983-b6cd-4797-bb2e-ae308b2a2cf6 tempest-VolumesSnapshotTestJSON-664893185 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 22 21:39:26.629527 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-f9b7b983-b6cd-4797-bb2e-ae308b2a2cf6 tempest-VolumesSnapshotTestJSON-664893185 None] Flow 'volume_create_manager' (a39ef5b6-236e-4c9f-8cc3-8a3ea2c5e6e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 22 21:39:26.636955 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-f9b7b983-b6cd-4797-bb2e-ae308b2a2cf6 tempest-VolumesSnapshotTestJSON-664893185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (119753ce-f1c9-4066-85c4-addac5cba6a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:39:26.644116 ncdv-master-1 cinder-volume[129952]: DEBUG oslo_db.sqlalchemy.engines [None req-f9b7b983-b6cd-4797-bb2e-ae308b2a2cf6 tempest-VolumesSnapshotTestJSON-664893185 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129952) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 22 21:39:26.660173 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-f9b7b983-b6cd-4797-bb2e-ae308b2a2cf6 tempest-VolumesSnapshotTestJSON-664893185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (119753ce-f1c9-4066-85c4-addac5cba6a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-01-22T21:39:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1230464267',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=4daeb9c4-3b52-4629-bffe-596a7b3c32f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='037b801bacb742d89e5ea8f5e59ec7b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-01-22T21:39:26Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=f67eac3d-b20e-4232-b3cd-b9f8802c4293,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-01-22T21:39:26Z,use_quota=True,user_id='912fa15040dc442fa281a72320a10dc5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6dacb05b-a7ea-4056-85ff-98f0ea5c54eb),volume_type_id=6dacb05b-a7ea-4056-85ff-98f0ea5c54eb)' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:39:26.664166 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-f9b7b983-b6cd-4797-bb2e-ae308b2a2cf6 tempest-VolumesSnapshotTestJSON-664893185 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf3773f9-1b0b-45fb-8079-be0207e92ff0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:39:26.668422 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-f9b7b983-b6cd-4797-bb2e-ae308b2a2cf6 tempest-VolumesSnapshotTestJSON-664893185 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf3773f9-1b0b-45fb-8079-be0207e92ff0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:39:26.673762 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-f9b7b983-b6cd-4797-bb2e-ae308b2a2cf6 tempest-VolumesSnapshotTestJSON-664893185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f2a5472-ae61-4f4e-a7b4-355d2dcfdf46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:39:26.678070 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-f9b7b983-b6cd-4797-bb2e-ae308b2a2cf6 tempest-VolumesSnapshotTestJSON-664893185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f2a5472-ae61-4f4e-a7b4-355d2dcfdf46) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '4daeb9c4-3b52-4629-bffe-596a7b3c32f2', 'volume_name': 'volume-4daeb9c4-3b52-4629-bffe-596a7b3c32f2', 'volume_size': 2, 'snapshot_id': 'f67eac3d-b20e-4232-b3cd-b9f8802c4293'}' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:39:26.683851 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-f9b7b983-b6cd-4797-bb2e-ae308b2a2cf6 tempest-VolumesSnapshotTestJSON-664893185 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c615ca3e-4bcb-455a-85f9-f630ab72af70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:39:26.687922 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-f9b7b983-b6cd-4797-bb2e-ae308b2a2cf6 tempest-VolumesSnapshotTestJSON-664893185 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c615ca3e-4bcb-455a-85f9-f630ab72af70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:39:26.692728 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-f9b7b983-b6cd-4797-bb2e-ae308b2a2cf6 tempest-VolumesSnapshotTestJSON-664893185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f01c9de-8627-4aef-9dc2-f28daeb76808) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:39:26.693891 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.flows.manager.create_volume [None req-f9b7b983-b6cd-4797-bb2e-ae308b2a2cf6 tempest-VolumesSnapshotTestJSON-664893185 None] Volume 4daeb9c4-3b52-4629-bffe-596a7b3c32f2: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-4daeb9c4-3b52-4629-bffe-596a7b3c32f2', 'volume_size': 2, 'snapshot_id': 'f67eac3d-b20e-4232-b3cd-b9f8802c4293'} Jan 22 21:39:26.715459 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-f9b7b983-b6cd-4797-bb2e-ae308b2a2cf6 tempest-VolumesSnapshotTestJSON-664893185 None] cloning volumes/volume-c3305bf3-2cbb-4463-9006-d635a8131249@snapshot-f67eac3d-b20e-4232-b3cd-b9f8802c4293 to volume-4daeb9c4-3b52-4629-bffe-596a7b3c32f2 {{(pid=129952) _clone /opt/stack/cinder/cinder/volume/drivers/rbd.py:1028}} Jan 22 21:39:26.716439 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-f9b7b983-b6cd-4797-bb2e-ae308b2a2cf6 tempest-VolumesSnapshotTestJSON-664893185 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:39:26.765717 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-f9b7b983-b6cd-4797-bb2e-ae308b2a2cf6 tempest-VolumesSnapshotTestJSON-664893185 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:39:27.847766 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-f9b7b983-b6cd-4797-bb2e-ae308b2a2cf6 tempest-VolumesSnapshotTestJSON-664893185 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129952) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 22 21:39:27.848359 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-f9b7b983-b6cd-4797-bb2e-ae308b2a2cf6 tempest-VolumesSnapshotTestJSON-664893185 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129952) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 22 21:39:27.852462 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-f9b7b983-b6cd-4797-bb2e-ae308b2a2cf6 tempest-VolumesSnapshotTestJSON-664893185 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:39:28.635376 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-f9b7b983-b6cd-4797-bb2e-ae308b2a2cf6 tempest-VolumesSnapshotTestJSON-664893185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f01c9de-8627-4aef-9dc2-f28daeb76808) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4daeb9c4-3b52-4629-bffe-596a7b3c32f2', 'volume_size': 2, 'snapshot_id': 'f67eac3d-b20e-4232-b3cd-b9f8802c4293'}' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:39:28.640171 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-f9b7b983-b6cd-4797-bb2e-ae308b2a2cf6 tempest-VolumesSnapshotTestJSON-664893185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (acd7328e-3e5c-442e-b4f6-e3479bf1a8c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:39:28.700284 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.flows.manager.create_volume [None req-f9b7b983-b6cd-4797-bb2e-ae308b2a2cf6 tempest-VolumesSnapshotTestJSON-664893185 None] Volume volume-4daeb9c4-3b52-4629-bffe-596a7b3c32f2 (4daeb9c4-3b52-4629-bffe-596a7b3c32f2): created successfully Jan 22 21:39:28.704102 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-f9b7b983-b6cd-4797-bb2e-ae308b2a2cf6 tempest-VolumesSnapshotTestJSON-664893185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (acd7328e-3e5c-442e-b4f6-e3479bf1a8c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:39:28.709643 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-f9b7b983-b6cd-4797-bb2e-ae308b2a2cf6 tempest-VolumesSnapshotTestJSON-664893185 None] Flow 'volume_create_manager' (a39ef5b6-236e-4c9f-8cc3-8a3ea2c5e6e8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129952) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 22 21:39:28.774400 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-f9b7b983-b6cd-4797-bb2e-ae308b2a2cf6 tempest-VolumesSnapshotTestJSON-664893185 None] Created volume successfully. Jan 22 21:39:29.626872 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.coordination [None req-c287941f-90f5-4e5e-87e6-924d6f0afb8d tempest-VolumesSnapshotTestJSON-664893185 None] Lock "b'cinder-4daeb9c4-3b52-4629-bffe-596a7b3c32f2-delete_volume'" acquired by "delete_volume" :: waited 0.009s {{(pid=129952) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 22 21:39:29.713815 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-c287941f-90f5-4e5e-87e6-924d6f0afb8d tempest-VolumesSnapshotTestJSON-664893185 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:39:29.848789 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-c287941f-90f5-4e5e-87e6-924d6f0afb8d tempest-VolumesSnapshotTestJSON-664893185 None] volume has no backup snaps {{(pid=129952) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Jan 22 21:39:29.961336 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-c287941f-90f5-4e5e-87e6-924d6f0afb8d tempest-VolumesSnapshotTestJSON-664893185 None] deleting rbd volume volume-4daeb9c4-3b52-4629-bffe-596a7b3c32f2 {{(pid=129952) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Jan 22 21:39:34.017327 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.quota [None req-c287941f-90f5-4e5e-87e6-924d6f0afb8d tempest-VolumesSnapshotTestJSON-664893185 None] Created reservations ['02cbcb4c-dae3-4b59-b980-f2c53b2d743b', 'e4f19281-4443-4de0-bc3f-7e6128cc5dd7', 'b798e2c4-bd31-4931-902a-d56fed52a85d', 'eaaaeb8b-6ebd-46d0-9ac5-ac0ed8bde552'] {{(pid=129952) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 22 21:39:34.188907 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-c287941f-90f5-4e5e-87e6-924d6f0afb8d tempest-VolumesSnapshotTestJSON-664893185 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:39:34.213373 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-c287941f-90f5-4e5e-87e6-924d6f0afb8d tempest-VolumesSnapshotTestJSON-664893185 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:39:34.240162 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.manager [None req-c287941f-90f5-4e5e-87e6-924d6f0afb8d tempest-VolumesSnapshotTestJSON-664893185 None] Notifying Schedulers of capabilities ... {{(pid=129952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 22 21:39:34.244642 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-c287941f-90f5-4e5e-87e6-924d6f0afb8d tempest-VolumesSnapshotTestJSON-664893185 None] Deleted volume successfully. Jan 22 21:39:34.330121 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.coordination [None req-c287941f-90f5-4e5e-87e6-924d6f0afb8d tempest-VolumesSnapshotTestJSON-664893185 None] Lock "b'cinder-4daeb9c4-3b52-4629-bffe-596a7b3c32f2-delete_volume'" released by "delete_volume" :: held 4.703s {{(pid=129952) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 22 21:39:35.755668 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.flows.manager.create_volume [None req-bd505d7f-788b-4f45-a924-7e9fc57c2178 tempest-VolumesSnapshotTestJSON-664893185 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129952) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Jan 22 21:39:35.758923 ncdv-master-1 cinder-volume[129952]: WARNING stevedore.named [None req-bd505d7f-788b-4f45-a924-7e9fc57c2178 tempest-VolumesSnapshotTestJSON-664893185 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jan 22 21:39:35.759419 ncdv-master-1 cinder-volume[129952]: WARNING castellan.key_manager [None req-bd505d7f-788b-4f45-a924-7e9fc57c2178 tempest-VolumesSnapshotTestJSON-664893185 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 22 21:39:35.785598 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-bd505d7f-788b-4f45-a924-7e9fc57c2178 tempest-VolumesSnapshotTestJSON-664893185 None] Flow 'volume_create_manager' (e2b5d5b3-2852-47fc-abf2-0ba2737536fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 22 21:39:35.793346 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-bd505d7f-788b-4f45-a924-7e9fc57c2178 tempest-VolumesSnapshotTestJSON-664893185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8bdfb31a-d5bd-4b0e-9807-d483c2552a40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:39:35.800385 ncdv-master-1 cinder-volume[129952]: DEBUG oslo_db.sqlalchemy.engines [None req-bd505d7f-788b-4f45-a924-7e9fc57c2178 tempest-VolumesSnapshotTestJSON-664893185 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129952) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 22 21:39:35.817529 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-bd505d7f-788b-4f45-a924-7e9fc57c2178 tempest-VolumesSnapshotTestJSON-664893185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8bdfb31a-d5bd-4b0e-9807-d483c2552a40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-01-22T21:39:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1626290085',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=da4b79a0-239f-47fb-8bcd-f2400a76ab72,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='037b801bacb742d89e5ea8f5e59ec7b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-01-22T21:39:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-01-22T21:39:36Z,use_quota=True,user_id='912fa15040dc442fa281a72320a10dc5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6dacb05b-a7ea-4056-85ff-98f0ea5c54eb),volume_type_id=6dacb05b-a7ea-4056-85ff-98f0ea5c54eb)' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:39:35.824106 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-bd505d7f-788b-4f45-a924-7e9fc57c2178 tempest-VolumesSnapshotTestJSON-664893185 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f77c461c-f964-40d9-945b-6d6c6c48c736) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:39:35.827956 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-bd505d7f-788b-4f45-a924-7e9fc57c2178 tempest-VolumesSnapshotTestJSON-664893185 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f77c461c-f964-40d9-945b-6d6c6c48c736) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:39:35.833575 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-bd505d7f-788b-4f45-a924-7e9fc57c2178 tempest-VolumesSnapshotTestJSON-664893185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e90a1601-3fe3-46dc-baae-b1727845c5c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:39:35.838535 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-bd505d7f-788b-4f45-a924-7e9fc57c2178 tempest-VolumesSnapshotTestJSON-664893185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e90a1601-3fe3-46dc-baae-b1727845c5c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'da4b79a0-239f-47fb-8bcd-f2400a76ab72', 'volume_name': 'volume-da4b79a0-239f-47fb-8bcd-f2400a76ab72', 'volume_size': 1}' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:39:35.844038 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-bd505d7f-788b-4f45-a924-7e9fc57c2178 tempest-VolumesSnapshotTestJSON-664893185 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31622fb9-cae7-478d-befa-b46d4a2726c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:39:35.848367 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-bd505d7f-788b-4f45-a924-7e9fc57c2178 tempest-VolumesSnapshotTestJSON-664893185 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31622fb9-cae7-478d-befa-b46d4a2726c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:39:35.854090 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-bd505d7f-788b-4f45-a924-7e9fc57c2178 tempest-VolumesSnapshotTestJSON-664893185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13136001-2836-4668-b014-769b2b9bad22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:39:35.855211 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.flows.manager.create_volume [None req-bd505d7f-788b-4f45-a924-7e9fc57c2178 tempest-VolumesSnapshotTestJSON-664893185 None] Volume da4b79a0-239f-47fb-8bcd-f2400a76ab72: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-da4b79a0-239f-47fb-8bcd-f2400a76ab72', 'volume_size': 1} Jan 22 21:39:35.855607 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-bd505d7f-788b-4f45-a924-7e9fc57c2178 tempest-VolumesSnapshotTestJSON-664893185 None] creating volume 'volume-da4b79a0-239f-47fb-8bcd-f2400a76ab72' {{(pid=129952) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Jan 22 21:39:35.856605 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-bd505d7f-788b-4f45-a924-7e9fc57c2178 tempest-VolumesSnapshotTestJSON-664893185 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:39:36.299984 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-bd505d7f-788b-4f45-a924-7e9fc57c2178 tempest-VolumesSnapshotTestJSON-664893185 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129952) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 22 21:39:36.300832 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-bd505d7f-788b-4f45-a924-7e9fc57c2178 tempest-VolumesSnapshotTestJSON-664893185 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129952) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 22 21:39:36.309120 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-bd505d7f-788b-4f45-a924-7e9fc57c2178 tempest-VolumesSnapshotTestJSON-664893185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13136001-2836-4668-b014-769b2b9bad22) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-da4b79a0-239f-47fb-8bcd-f2400a76ab72', 'volume_size': 1}' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:39:36.314191 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-bd505d7f-788b-4f45-a924-7e9fc57c2178 tempest-VolumesSnapshotTestJSON-664893185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4ec0a9d-4fdb-4774-befd-382db73003e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:39:36.419665 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.flows.manager.create_volume [None req-bd505d7f-788b-4f45-a924-7e9fc57c2178 tempest-VolumesSnapshotTestJSON-664893185 None] Volume volume-da4b79a0-239f-47fb-8bcd-f2400a76ab72 (da4b79a0-239f-47fb-8bcd-f2400a76ab72): created successfully Jan 22 21:39:36.419665 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-bd505d7f-788b-4f45-a924-7e9fc57c2178 tempest-VolumesSnapshotTestJSON-664893185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4ec0a9d-4fdb-4774-befd-382db73003e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:39:36.424919 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-bd505d7f-788b-4f45-a924-7e9fc57c2178 tempest-VolumesSnapshotTestJSON-664893185 None] Flow 'volume_create_manager' (e2b5d5b3-2852-47fc-abf2-0ba2737536fa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129952) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 22 21:39:36.486716 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-bd505d7f-788b-4f45-a924-7e9fc57c2178 tempest-VolumesSnapshotTestJSON-664893185 None] Created volume successfully. Jan 22 21:39:37.226624 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-e9e324a1-4016-4fa6-8bc4-17715c0fd23b tempest-VolumesSnapshotTestJSON-664893185 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:39:39.514791 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-e9e324a1-4016-4fa6-8bc4-17715c0fd23b tempest-VolumesSnapshotTestJSON-664893185 None] Create snapshot completed successfully Jan 22 21:39:40.984671 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.flows.manager.create_volume [None req-4d39f127-0d5e-4e5e-a206-d71404d8e4a8 tempest-VolumesSnapshotTestJSON-664893185 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129952) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Jan 22 21:39:40.988558 ncdv-master-1 cinder-volume[129952]: WARNING stevedore.named [None req-4d39f127-0d5e-4e5e-a206-d71404d8e4a8 tempest-VolumesSnapshotTestJSON-664893185 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jan 22 21:39:40.989012 ncdv-master-1 cinder-volume[129952]: WARNING castellan.key_manager [None req-4d39f127-0d5e-4e5e-a206-d71404d8e4a8 tempest-VolumesSnapshotTestJSON-664893185 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 22 21:39:41.019922 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-4d39f127-0d5e-4e5e-a206-d71404d8e4a8 tempest-VolumesSnapshotTestJSON-664893185 None] Flow 'volume_create_manager' (d4384f82-9159-4a74-9cc6-ec3bde857520) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 22 21:39:41.027993 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-4d39f127-0d5e-4e5e-a206-d71404d8e4a8 tempest-VolumesSnapshotTestJSON-664893185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd3e231c-7082-4d22-8f90-c64320a2d070) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:39:41.044022 ncdv-master-1 cinder-volume[129952]: DEBUG oslo_db.sqlalchemy.engines [None req-4d39f127-0d5e-4e5e-a206-d71404d8e4a8 tempest-VolumesSnapshotTestJSON-664893185 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129952) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 22 21:39:41.065171 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-4d39f127-0d5e-4e5e-a206-d71404d8e4a8 tempest-VolumesSnapshotTestJSON-664893185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd3e231c-7082-4d22-8f90-c64320a2d070) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-01-22T21:39:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1937447870',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=cab2e87f-9b1e-46b9-8d94-3137d9a021e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='037b801bacb742d89e5ea8f5e59ec7b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-01-22T21:39:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=dd2bbf04-a1d6-481f-8e26-0386d5817231,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-01-22T21:39:41Z,use_quota=True,user_id='912fa15040dc442fa281a72320a10dc5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6dacb05b-a7ea-4056-85ff-98f0ea5c54eb),volume_type_id=6dacb05b-a7ea-4056-85ff-98f0ea5c54eb)' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:39:41.071417 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-4d39f127-0d5e-4e5e-a206-d71404d8e4a8 tempest-VolumesSnapshotTestJSON-664893185 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e316d478-6502-4edf-a7e8-f4354498bb03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:39:41.075652 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-4d39f127-0d5e-4e5e-a206-d71404d8e4a8 tempest-VolumesSnapshotTestJSON-664893185 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e316d478-6502-4edf-a7e8-f4354498bb03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:39:41.081038 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-4d39f127-0d5e-4e5e-a206-d71404d8e4a8 tempest-VolumesSnapshotTestJSON-664893185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e28034b2-8c79-4c93-bfb0-dae86b48774c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:39:41.087005 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-4d39f127-0d5e-4e5e-a206-d71404d8e4a8 tempest-VolumesSnapshotTestJSON-664893185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e28034b2-8c79-4c93-bfb0-dae86b48774c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'cab2e87f-9b1e-46b9-8d94-3137d9a021e8', 'volume_name': 'volume-cab2e87f-9b1e-46b9-8d94-3137d9a021e8', 'volume_size': 1, 'snapshot_id': 'dd2bbf04-a1d6-481f-8e26-0386d5817231'}' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:39:41.092487 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-4d39f127-0d5e-4e5e-a206-d71404d8e4a8 tempest-VolumesSnapshotTestJSON-664893185 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c2bf692-889f-4fd2-b17e-dcf7448c2d6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:39:41.096706 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-4d39f127-0d5e-4e5e-a206-d71404d8e4a8 tempest-VolumesSnapshotTestJSON-664893185 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c2bf692-889f-4fd2-b17e-dcf7448c2d6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:39:41.102273 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-4d39f127-0d5e-4e5e-a206-d71404d8e4a8 tempest-VolumesSnapshotTestJSON-664893185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd5a6d81-8209-43f5-ba3f-b91f716714e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:39:41.103632 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.flows.manager.create_volume [None req-4d39f127-0d5e-4e5e-a206-d71404d8e4a8 tempest-VolumesSnapshotTestJSON-664893185 None] Volume cab2e87f-9b1e-46b9-8d94-3137d9a021e8: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-cab2e87f-9b1e-46b9-8d94-3137d9a021e8', 'volume_size': 1, 'snapshot_id': 'dd2bbf04-a1d6-481f-8e26-0386d5817231'} Jan 22 21:39:41.124652 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-4d39f127-0d5e-4e5e-a206-d71404d8e4a8 tempest-VolumesSnapshotTestJSON-664893185 None] cloning volumes/volume-da4b79a0-239f-47fb-8bcd-f2400a76ab72@snapshot-dd2bbf04-a1d6-481f-8e26-0386d5817231 to volume-cab2e87f-9b1e-46b9-8d94-3137d9a021e8 {{(pid=129952) _clone /opt/stack/cinder/cinder/volume/drivers/rbd.py:1028}} Jan 22 21:39:41.125662 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-4d39f127-0d5e-4e5e-a206-d71404d8e4a8 tempest-VolumesSnapshotTestJSON-664893185 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:39:41.187426 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-4d39f127-0d5e-4e5e-a206-d71404d8e4a8 tempest-VolumesSnapshotTestJSON-664893185 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:39:42.506190 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-4d39f127-0d5e-4e5e-a206-d71404d8e4a8 tempest-VolumesSnapshotTestJSON-664893185 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129952) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 22 21:39:42.507446 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-4d39f127-0d5e-4e5e-a206-d71404d8e4a8 tempest-VolumesSnapshotTestJSON-664893185 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129952) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 22 21:39:42.529100 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-4d39f127-0d5e-4e5e-a206-d71404d8e4a8 tempest-VolumesSnapshotTestJSON-664893185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd5a6d81-8209-43f5-ba3f-b91f716714e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cab2e87f-9b1e-46b9-8d94-3137d9a021e8', 'volume_size': 1, 'snapshot_id': 'dd2bbf04-a1d6-481f-8e26-0386d5817231'}' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:39:42.534337 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-4d39f127-0d5e-4e5e-a206-d71404d8e4a8 tempest-VolumesSnapshotTestJSON-664893185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c64ec06e-01e0-47d3-8af3-693d6f22180d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:39:42.610777 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.flows.manager.create_volume [None req-4d39f127-0d5e-4e5e-a206-d71404d8e4a8 tempest-VolumesSnapshotTestJSON-664893185 None] Volume volume-cab2e87f-9b1e-46b9-8d94-3137d9a021e8 (cab2e87f-9b1e-46b9-8d94-3137d9a021e8): created successfully Jan 22 21:39:42.614556 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-4d39f127-0d5e-4e5e-a206-d71404d8e4a8 tempest-VolumesSnapshotTestJSON-664893185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c64ec06e-01e0-47d3-8af3-693d6f22180d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:39:42.621015 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-4d39f127-0d5e-4e5e-a206-d71404d8e4a8 tempest-VolumesSnapshotTestJSON-664893185 None] Flow 'volume_create_manager' (d4384f82-9159-4a74-9cc6-ec3bde857520) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129952) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 22 21:39:42.705831 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-4d39f127-0d5e-4e5e-a206-d71404d8e4a8 tempest-VolumesSnapshotTestJSON-664893185 None] Created volume successfully. Jan 22 21:39:43.047985 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.coordination [None req-98347d25-ed0a-4fbd-9529-f76988bb8a65 tempest-VolumesSnapshotTestJSON-664893185 None] Lock "b'cinder-cab2e87f-9b1e-46b9-8d94-3137d9a021e8-delete_volume'" acquired by "delete_volume" :: waited 0.010s {{(pid=129952) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 22 21:39:43.174426 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-98347d25-ed0a-4fbd-9529-f76988bb8a65 tempest-VolumesSnapshotTestJSON-664893185 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:39:43.376874 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-98347d25-ed0a-4fbd-9529-f76988bb8a65 tempest-VolumesSnapshotTestJSON-664893185 None] volume has no backup snaps {{(pid=129952) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Jan 22 21:39:43.588999 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-98347d25-ed0a-4fbd-9529-f76988bb8a65 tempest-VolumesSnapshotTestJSON-664893185 None] deleting rbd volume volume-cab2e87f-9b1e-46b9-8d94-3137d9a021e8 {{(pid=129952) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Jan 22 21:39:47.551707 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.quota [None req-98347d25-ed0a-4fbd-9529-f76988bb8a65 tempest-VolumesSnapshotTestJSON-664893185 None] Created reservations ['de922116-7fa0-4c77-94a4-1b4fef6cb550', '4fc2d692-e4e3-471e-9b2c-6939ec5dba14', 'b53d6ff2-61c8-4db6-b44f-26cee4974771', '85328763-1e30-40b7-a7f8-018da5faea50'] {{(pid=129952) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 22 21:39:47.740610 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-98347d25-ed0a-4fbd-9529-f76988bb8a65 tempest-VolumesSnapshotTestJSON-664893185 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:39:47.762472 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-98347d25-ed0a-4fbd-9529-f76988bb8a65 tempest-VolumesSnapshotTestJSON-664893185 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:39:47.785422 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.manager [None req-98347d25-ed0a-4fbd-9529-f76988bb8a65 tempest-VolumesSnapshotTestJSON-664893185 None] Notifying Schedulers of capabilities ... {{(pid=129952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 22 21:39:47.790129 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-98347d25-ed0a-4fbd-9529-f76988bb8a65 tempest-VolumesSnapshotTestJSON-664893185 None] Deleted volume successfully. Jan 22 21:39:47.860745 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.coordination [None req-98347d25-ed0a-4fbd-9529-f76988bb8a65 tempest-VolumesSnapshotTestJSON-664893185 None] Lock "b'cinder-cab2e87f-9b1e-46b9-8d94-3137d9a021e8-delete_volume'" released by "delete_volume" :: held 4.813s {{(pid=129952) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 22 21:39:48.471677 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.coordination [None req-c096cea8-0632-4d8a-8b09-59c5b6703263 tempest-VolumesSnapshotTestJSON-664893185 None] Lock "b'cinder-dd2bbf04-a1d6-481f-8e26-0386d5817231-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.009s {{(pid=129952) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 22 21:39:48.473199 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-c096cea8-0632-4d8a-8b09-59c5b6703263 tempest-VolumesSnapshotTestJSON-664893185 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:39:50.845642 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.quota [None req-c096cea8-0632-4d8a-8b09-59c5b6703263 tempest-VolumesSnapshotTestJSON-664893185 None] Created reservations ['aae40b46-19f0-4617-bafb-cbf3656f48c6', 'b275a38a-dbab-459e-916e-6166797e3e80', '0a80ee41-70fb-48ab-bfe1-d5b09c290834', 'ecfac7b1-39fb-4668-87aa-4be37e2ac2c0'] {{(pid=129952) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 22 21:39:51.039276 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-c096cea8-0632-4d8a-8b09-59c5b6703263 tempest-VolumesSnapshotTestJSON-664893185 None] Delete snapshot completed successfully. Jan 22 21:39:51.042087 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.coordination [None req-c096cea8-0632-4d8a-8b09-59c5b6703263 tempest-VolumesSnapshotTestJSON-664893185 None] Lock "b'cinder-dd2bbf04-a1d6-481f-8e26-0386d5817231-delete_snapshot'" released by "delete_snapshot" :: held 2.570s {{(pid=129952) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 22 21:39:51.743614 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.coordination [None req-b9a26d62-5ad4-4f9f-aee9-f5bf38b7952b tempest-VolumesSnapshotTestJSON-664893185 None] Lock "b'cinder-da4b79a0-239f-47fb-8bcd-f2400a76ab72-delete_volume'" acquired by "delete_volume" :: waited 0.009s {{(pid=129952) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 22 21:39:51.837681 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-b9a26d62-5ad4-4f9f-aee9-f5bf38b7952b tempest-VolumesSnapshotTestJSON-664893185 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:39:51.958918 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-b9a26d62-5ad4-4f9f-aee9-f5bf38b7952b tempest-VolumesSnapshotTestJSON-664893185 None] volume has no backup snaps {{(pid=129952) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Jan 22 21:39:51.959585 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-b9a26d62-5ad4-4f9f-aee9-f5bf38b7952b tempest-VolumesSnapshotTestJSON-664893185 None] Volume volume-da4b79a0-239f-47fb-8bcd-f2400a76ab72 is not a clone. {{(pid=129952) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Jan 22 21:39:52.085817 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-b9a26d62-5ad4-4f9f-aee9-f5bf38b7952b tempest-VolumesSnapshotTestJSON-664893185 None] deleting rbd volume volume-da4b79a0-239f-47fb-8bcd-f2400a76ab72 {{(pid=129952) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Jan 22 21:39:55.153890 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.quota [None req-b9a26d62-5ad4-4f9f-aee9-f5bf38b7952b tempest-VolumesSnapshotTestJSON-664893185 None] Created reservations ['f5127c6e-78b0-44cd-b894-1a566f4419fa', '34e48d11-6a01-40e1-a066-1fe5d4cfffe5', '6d9c6e02-c1b0-4e3a-afcd-16a0b965eb84', 'fc62e85b-b565-47ad-a809-49685ef8ad04'] {{(pid=129952) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 22 21:39:55.346202 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-b9a26d62-5ad4-4f9f-aee9-f5bf38b7952b tempest-VolumesSnapshotTestJSON-664893185 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:39:55.368253 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-b9a26d62-5ad4-4f9f-aee9-f5bf38b7952b tempest-VolumesSnapshotTestJSON-664893185 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:39:55.394505 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.manager [None req-b9a26d62-5ad4-4f9f-aee9-f5bf38b7952b tempest-VolumesSnapshotTestJSON-664893185 None] Notifying Schedulers of capabilities ... {{(pid=129952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 22 21:39:55.399447 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-b9a26d62-5ad4-4f9f-aee9-f5bf38b7952b tempest-VolumesSnapshotTestJSON-664893185 None] Deleted volume successfully. Jan 22 21:39:55.462586 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.coordination [None req-b9a26d62-5ad4-4f9f-aee9-f5bf38b7952b tempest-VolumesSnapshotTestJSON-664893185 None] Lock "b'cinder-da4b79a0-239f-47fb-8bcd-f2400a76ab72-delete_volume'" released by "delete_volume" :: held 3.719s {{(pid=129952) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 22 21:39:56.095064 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.coordination [None req-c0b1c767-dcf4-4325-bb42-45a158077045 tempest-VolumesSnapshotTestJSON-664893185 None] Lock "b'cinder-f67eac3d-b20e-4232-b3cd-b9f8802c4293-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.010s {{(pid=129952) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 22 21:39:56.096914 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-c0b1c767-dcf4-4325-bb42-45a158077045 tempest-VolumesSnapshotTestJSON-664893185 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:39:58.559553 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.quota [None req-c0b1c767-dcf4-4325-bb42-45a158077045 tempest-VolumesSnapshotTestJSON-664893185 None] Created reservations ['284c587e-a168-463b-80d3-c63a9773da73', '2438afd5-ccda-4973-a421-7158e4e7379d', 'df78362e-cba7-40ef-8b76-75fc3ac9e53e', 'dd0b7e97-98e2-45db-b362-160d90456c78'] {{(pid=129952) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 22 21:39:58.702275 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-c0b1c767-dcf4-4325-bb42-45a158077045 tempest-VolumesSnapshotTestJSON-664893185 None] Delete snapshot completed successfully. Jan 22 21:39:58.706478 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.coordination [None req-c0b1c767-dcf4-4325-bb42-45a158077045 tempest-VolumesSnapshotTestJSON-664893185 None] Lock "b'cinder-f67eac3d-b20e-4232-b3cd-b9f8802c4293-delete_snapshot'" released by "delete_snapshot" :: held 2.612s {{(pid=129952) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 22 21:39:59.393721 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.coordination [None req-ddc4aec7-0b61-445c-9b37-2ca507c9832a tempest-VolumesSnapshotTestJSON-664893185 None] Lock "b'cinder-c3305bf3-2cbb-4463-9006-d635a8131249-delete_volume'" acquired by "delete_volume" :: waited 0.009s {{(pid=129952) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 22 21:39:59.496493 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-ddc4aec7-0b61-445c-9b37-2ca507c9832a tempest-VolumesSnapshotTestJSON-664893185 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:39:59.616248 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-ddc4aec7-0b61-445c-9b37-2ca507c9832a tempest-VolumesSnapshotTestJSON-664893185 None] volume has no backup snaps {{(pid=129952) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Jan 22 21:39:59.616877 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-ddc4aec7-0b61-445c-9b37-2ca507c9832a tempest-VolumesSnapshotTestJSON-664893185 None] Volume volume-c3305bf3-2cbb-4463-9006-d635a8131249 is not a clone. {{(pid=129952) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Jan 22 21:39:59.708267 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-ddc4aec7-0b61-445c-9b37-2ca507c9832a tempest-VolumesSnapshotTestJSON-664893185 None] deleting rbd volume volume-c3305bf3-2cbb-4463-9006-d635a8131249 {{(pid=129952) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Jan 22 21:40:03.291615 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.quota [None req-ddc4aec7-0b61-445c-9b37-2ca507c9832a tempest-VolumesSnapshotTestJSON-664893185 None] Created reservations ['c71829f0-ccc2-450a-8565-9a82b80d0afa', 'da747d27-bc6d-4e23-b6be-2cc839f2a854', '1a92b248-9176-40c9-b605-8776b386c6b8', '072224ad-ba4a-4677-bad7-080145b33a85'] {{(pid=129952) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 22 21:40:03.483298 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-ddc4aec7-0b61-445c-9b37-2ca507c9832a tempest-VolumesSnapshotTestJSON-664893185 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:40:03.507581 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-ddc4aec7-0b61-445c-9b37-2ca507c9832a tempest-VolumesSnapshotTestJSON-664893185 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:40:03.531639 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.manager [None req-ddc4aec7-0b61-445c-9b37-2ca507c9832a tempest-VolumesSnapshotTestJSON-664893185 None] Notifying Schedulers of capabilities ... {{(pid=129952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 22 21:40:03.536046 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-ddc4aec7-0b61-445c-9b37-2ca507c9832a tempest-VolumesSnapshotTestJSON-664893185 None] Deleted volume successfully. Jan 22 21:40:03.624470 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.coordination [None req-ddc4aec7-0b61-445c-9b37-2ca507c9832a tempest-VolumesSnapshotTestJSON-664893185 None] Lock "b'cinder-c3305bf3-2cbb-4463-9006-d635a8131249-delete_volume'" released by "delete_volume" :: held 4.230s {{(pid=129952) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 22 21:40:03.971795 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.coordination [None req-2f72e9de-dc92-475a-870f-fe6735155daf tempest-VolumesSnapshotTestJSON-664893185 None] Lock "b'cinder-03eda9d7-c3c3-4b8d-8aa5-a1533f9ce58b-delete_volume'" acquired by "delete_volume" :: waited 0.014s {{(pid=129952) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 22 21:40:04.226188 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-2f72e9de-dc92-475a-870f-fe6735155daf tempest-VolumesSnapshotTestJSON-664893185 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:40:04.419269 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-2f72e9de-dc92-475a-870f-fe6735155daf tempest-VolumesSnapshotTestJSON-664893185 None] volume has no backup snaps {{(pid=129952) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Jan 22 21:40:04.532517 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-2f72e9de-dc92-475a-870f-fe6735155daf tempest-VolumesSnapshotTestJSON-664893185 None] deleting rbd volume volume-03eda9d7-c3c3-4b8d-8aa5-a1533f9ce58b {{(pid=129952) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Jan 22 21:40:08.604125 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-2f72e9de-dc92-475a-870f-fe6735155daf tempest-VolumesSnapshotTestJSON-664893185 None] volume is a clone so cleaning references {{(pid=129952) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1266}} Jan 22 21:40:08.706316 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-2f72e9de-dc92-475a-870f-fe6735155daf tempest-VolumesSnapshotTestJSON-664893185 None] deleting parent snapshot volume-03eda9d7-c3c3-4b8d-8aa5-a1533f9ce58b.clone_snap {{(pid=129952) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1158}} Jan 22 21:40:11.405652 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.quota [None req-2f72e9de-dc92-475a-870f-fe6735155daf tempest-VolumesSnapshotTestJSON-664893185 None] Created reservations ['02301917-4271-42b2-9df4-c3d054e98dda', 'ff2bcb8f-1ec1-4e3d-b23f-393c10dec52d', '5d810507-c579-4935-bf2e-2a222d05743e', '4b0b1ce7-0af5-4ef2-a81f-dd036385bd70'] {{(pid=129952) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 22 21:40:11.562977 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-2f72e9de-dc92-475a-870f-fe6735155daf tempest-VolumesSnapshotTestJSON-664893185 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:40:11.594243 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-2f72e9de-dc92-475a-870f-fe6735155daf tempest-VolumesSnapshotTestJSON-664893185 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:40:11.620563 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.manager [None req-2f72e9de-dc92-475a-870f-fe6735155daf tempest-VolumesSnapshotTestJSON-664893185 None] Notifying Schedulers of capabilities ... {{(pid=129952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 22 21:40:11.624770 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-2f72e9de-dc92-475a-870f-fe6735155daf tempest-VolumesSnapshotTestJSON-664893185 None] Deleted volume successfully. Jan 22 21:40:11.720877 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.coordination [None req-2f72e9de-dc92-475a-870f-fe6735155daf tempest-VolumesSnapshotTestJSON-664893185 None] Lock "b'cinder-03eda9d7-c3c3-4b8d-8aa5-a1533f9ce58b-delete_volume'" released by "delete_volume" :: held 7.749s {{(pid=129952) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 22 21:40:12.504235 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.coordination [None req-c5e4f102-f869-494d-8299-fc899ba0f219 tempest-VolumesSnapshotTestJSON-664893185 None] Lock "b'cinder-7c63570e-c956-483e-9263-a774676c22d8-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.009s {{(pid=129952) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 22 21:40:12.505833 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-c5e4f102-f869-494d-8299-fc899ba0f219 tempest-VolumesSnapshotTestJSON-664893185 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:40:14.733975 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.quota [None req-c5e4f102-f869-494d-8299-fc899ba0f219 tempest-VolumesSnapshotTestJSON-664893185 None] Created reservations ['54729c8b-d93b-474d-b977-32fd4611d45e', 'bf2cab10-b4e6-4ee8-93ac-485d0aa04e9c', 'e1173132-5a8d-4b33-a9b1-f219b65de960', '759e9b80-6c6f-4bae-aaba-c045a4989dee'] {{(pid=129952) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 22 21:40:14.908018 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-c5e4f102-f869-494d-8299-fc899ba0f219 tempest-VolumesSnapshotTestJSON-664893185 None] Delete snapshot completed successfully. Jan 22 21:40:14.917339 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.coordination [None req-c5e4f102-f869-494d-8299-fc899ba0f219 tempest-VolumesSnapshotTestJSON-664893185 None] Lock "b'cinder-7c63570e-c956-483e-9263-a774676c22d8-delete_snapshot'" released by "delete_snapshot" :: held 2.408s {{(pid=129952) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 22 21:40:15.753563 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.coordination [None req-cde5ea95-bb77-46f5-bb8b-4a3e53e58d1a tempest-VolumesSnapshotTestJSON-664893185 None] Lock "b'cinder-f6238c78-261a-421a-b7a2-43273813620f-delete_volume'" acquired by "delete_volume" :: waited 0.008s {{(pid=129952) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 22 21:40:15.844806 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-cde5ea95-bb77-46f5-bb8b-4a3e53e58d1a tempest-VolumesSnapshotTestJSON-664893185 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:40:15.947416 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-cde5ea95-bb77-46f5-bb8b-4a3e53e58d1a tempest-VolumesSnapshotTestJSON-664893185 None] volume has no backup snaps {{(pid=129952) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Jan 22 21:40:15.947985 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-cde5ea95-bb77-46f5-bb8b-4a3e53e58d1a tempest-VolumesSnapshotTestJSON-664893185 None] Volume volume-f6238c78-261a-421a-b7a2-43273813620f is not a clone. {{(pid=129952) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Jan 22 21:40:16.036568 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-cde5ea95-bb77-46f5-bb8b-4a3e53e58d1a tempest-VolumesSnapshotTestJSON-664893185 None] deleting rbd volume volume-f6238c78-261a-421a-b7a2-43273813620f {{(pid=129952) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Jan 22 21:40:16.386696 ncdv-master-1 cinder-volume[129952]: DEBUG oslo_service.periodic_task [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129952) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jan 22 21:40:16.387476 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:40:16.411023 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:40:16.450113 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.manager [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] Notifying Schedulers of capabilities ... {{(pid=129952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 22 21:40:19.587916 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.quota [None req-cde5ea95-bb77-46f5-bb8b-4a3e53e58d1a tempest-VolumesSnapshotTestJSON-664893185 None] Created reservations ['0d1220f2-20ed-4766-a93f-8ec0cbdaeabd', 'aeb0cbb2-9abe-4548-91b1-b14ca44890e6', '1fb7a072-5348-4ade-a61e-fa8f21f4fe52', '120244c8-fe69-45ce-88aa-3ed5945d505c'] {{(pid=129952) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 22 21:40:19.788321 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-cde5ea95-bb77-46f5-bb8b-4a3e53e58d1a tempest-VolumesSnapshotTestJSON-664893185 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:40:19.810718 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-cde5ea95-bb77-46f5-bb8b-4a3e53e58d1a tempest-VolumesSnapshotTestJSON-664893185 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:40:19.833525 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.manager [None req-cde5ea95-bb77-46f5-bb8b-4a3e53e58d1a tempest-VolumesSnapshotTestJSON-664893185 None] Notifying Schedulers of capabilities ... {{(pid=129952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 22 21:40:19.838535 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-cde5ea95-bb77-46f5-bb8b-4a3e53e58d1a tempest-VolumesSnapshotTestJSON-664893185 None] Deleted volume successfully. Jan 22 21:40:19.908976 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.coordination [None req-cde5ea95-bb77-46f5-bb8b-4a3e53e58d1a tempest-VolumesSnapshotTestJSON-664893185 None] Lock "b'cinder-f6238c78-261a-421a-b7a2-43273813620f-delete_volume'" released by "delete_volume" :: held 4.155s {{(pid=129952) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 22 21:40:32.455368 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.flows.manager.create_volume [req-90b98a58-e574-49cf-956c-1e3b42852af3 req-b50c1fb1-396e-4deb-8e0c-0bb05bb0b15f tempest-VolumesSnapshotsTestJSON-620201569 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129952) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Jan 22 21:40:32.458588 ncdv-master-1 cinder-volume[129952]: WARNING stevedore.named [req-90b98a58-e574-49cf-956c-1e3b42852af3 req-b50c1fb1-396e-4deb-8e0c-0bb05bb0b15f tempest-VolumesSnapshotsTestJSON-620201569 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jan 22 21:40:32.459043 ncdv-master-1 cinder-volume[129952]: WARNING castellan.key_manager [req-90b98a58-e574-49cf-956c-1e3b42852af3 req-b50c1fb1-396e-4deb-8e0c-0bb05bb0b15f tempest-VolumesSnapshotsTestJSON-620201569 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 22 21:40:32.496568 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [req-90b98a58-e574-49cf-956c-1e3b42852af3 req-b50c1fb1-396e-4deb-8e0c-0bb05bb0b15f tempest-VolumesSnapshotsTestJSON-620201569 None] Flow 'volume_create_manager' (fa702db6-70d0-418d-ae4a-553be62330d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 22 21:40:32.518215 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [req-90b98a58-e574-49cf-956c-1e3b42852af3 req-b50c1fb1-396e-4deb-8e0c-0bb05bb0b15f tempest-VolumesSnapshotsTestJSON-620201569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (662ba67d-4bf9-4461-9185-7cae0e78811e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:40:32.526484 ncdv-master-1 cinder-volume[129952]: DEBUG oslo_db.sqlalchemy.engines [req-90b98a58-e574-49cf-956c-1e3b42852af3 req-b50c1fb1-396e-4deb-8e0c-0bb05bb0b15f tempest-VolumesSnapshotsTestJSON-620201569 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129952) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 22 21:40:32.545662 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [req-90b98a58-e574-49cf-956c-1e3b42852af3 req-b50c1fb1-396e-4deb-8e0c-0bb05bb0b15f tempest-VolumesSnapshotsTestJSON-620201569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (662ba67d-4bf9-4461-9185-7cae0e78811e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-01-22T21:40:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-672437625',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=131af0b9-b9c0-48fe-af9e-6e5dcdb01405,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9382dd32bd904a088fc0fef4715331c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-01-22T21:40:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-01-22T21:40:32Z,use_quota=True,user_id='05f894f84ded424fb71a2514c5451141',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6dacb05b-a7ea-4056-85ff-98f0ea5c54eb),volume_type_id=6dacb05b-a7ea-4056-85ff-98f0ea5c54eb)' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:40:32.552549 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [req-90b98a58-e574-49cf-956c-1e3b42852af3 req-b50c1fb1-396e-4deb-8e0c-0bb05bb0b15f tempest-VolumesSnapshotsTestJSON-620201569 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2efff7df-411b-48e7-b7c7-d74a321a8f5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:40:32.557349 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [req-90b98a58-e574-49cf-956c-1e3b42852af3 req-b50c1fb1-396e-4deb-8e0c-0bb05bb0b15f tempest-VolumesSnapshotsTestJSON-620201569 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2efff7df-411b-48e7-b7c7-d74a321a8f5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:40:32.563258 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [req-90b98a58-e574-49cf-956c-1e3b42852af3 req-b50c1fb1-396e-4deb-8e0c-0bb05bb0b15f tempest-VolumesSnapshotsTestJSON-620201569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ab52c61-7aea-47e9-b285-a8168d574696) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:40:32.567996 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [req-90b98a58-e574-49cf-956c-1e3b42852af3 req-b50c1fb1-396e-4deb-8e0c-0bb05bb0b15f tempest-VolumesSnapshotsTestJSON-620201569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ab52c61-7aea-47e9-b285-a8168d574696) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '131af0b9-b9c0-48fe-af9e-6e5dcdb01405', 'volume_name': 'volume-131af0b9-b9c0-48fe-af9e-6e5dcdb01405', 'volume_size': 1}' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:40:32.574948 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [req-90b98a58-e574-49cf-956c-1e3b42852af3 req-b50c1fb1-396e-4deb-8e0c-0bb05bb0b15f tempest-VolumesSnapshotsTestJSON-620201569 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9409f5d-02b6-486d-9906-f06662712e65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:40:32.579434 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [req-90b98a58-e574-49cf-956c-1e3b42852af3 req-b50c1fb1-396e-4deb-8e0c-0bb05bb0b15f tempest-VolumesSnapshotsTestJSON-620201569 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9409f5d-02b6-486d-9906-f06662712e65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:40:32.584936 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [req-90b98a58-e574-49cf-956c-1e3b42852af3 req-b50c1fb1-396e-4deb-8e0c-0bb05bb0b15f tempest-VolumesSnapshotsTestJSON-620201569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac53b004-8d1c-4a9d-a9f5-3c30a7e8b22e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:40:32.586317 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.flows.manager.create_volume [req-90b98a58-e574-49cf-956c-1e3b42852af3 req-b50c1fb1-396e-4deb-8e0c-0bb05bb0b15f tempest-VolumesSnapshotsTestJSON-620201569 None] Volume 131af0b9-b9c0-48fe-af9e-6e5dcdb01405: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-131af0b9-b9c0-48fe-af9e-6e5dcdb01405', 'volume_size': 1} Jan 22 21:40:32.586936 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [req-90b98a58-e574-49cf-956c-1e3b42852af3 req-b50c1fb1-396e-4deb-8e0c-0bb05bb0b15f tempest-VolumesSnapshotsTestJSON-620201569 None] creating volume 'volume-131af0b9-b9c0-48fe-af9e-6e5dcdb01405' {{(pid=129952) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Jan 22 21:40:32.588735 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [req-90b98a58-e574-49cf-956c-1e3b42852af3 req-b50c1fb1-396e-4deb-8e0c-0bb05bb0b15f tempest-VolumesSnapshotsTestJSON-620201569 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:40:33.246536 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [req-90b98a58-e574-49cf-956c-1e3b42852af3 req-b50c1fb1-396e-4deb-8e0c-0bb05bb0b15f tempest-VolumesSnapshotsTestJSON-620201569 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129952) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 22 21:40:33.253399 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [req-90b98a58-e574-49cf-956c-1e3b42852af3 req-b50c1fb1-396e-4deb-8e0c-0bb05bb0b15f tempest-VolumesSnapshotsTestJSON-620201569 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129952) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 22 21:40:33.272728 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [req-90b98a58-e574-49cf-956c-1e3b42852af3 req-b50c1fb1-396e-4deb-8e0c-0bb05bb0b15f tempest-VolumesSnapshotsTestJSON-620201569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac53b004-8d1c-4a9d-a9f5-3c30a7e8b22e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-131af0b9-b9c0-48fe-af9e-6e5dcdb01405', 'volume_size': 1}' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:40:33.295771 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [req-90b98a58-e574-49cf-956c-1e3b42852af3 req-b50c1fb1-396e-4deb-8e0c-0bb05bb0b15f tempest-VolumesSnapshotsTestJSON-620201569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8cd4716-7eec-4eda-8c45-1ad256c4ec34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:40:33.397096 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.flows.manager.create_volume [req-90b98a58-e574-49cf-956c-1e3b42852af3 req-b50c1fb1-396e-4deb-8e0c-0bb05bb0b15f tempest-VolumesSnapshotsTestJSON-620201569 None] Volume volume-131af0b9-b9c0-48fe-af9e-6e5dcdb01405 (131af0b9-b9c0-48fe-af9e-6e5dcdb01405): created successfully Jan 22 21:40:33.406586 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [req-90b98a58-e574-49cf-956c-1e3b42852af3 req-b50c1fb1-396e-4deb-8e0c-0bb05bb0b15f tempest-VolumesSnapshotsTestJSON-620201569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8cd4716-7eec-4eda-8c45-1ad256c4ec34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:40:33.417520 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [req-90b98a58-e574-49cf-956c-1e3b42852af3 req-b50c1fb1-396e-4deb-8e0c-0bb05bb0b15f tempest-VolumesSnapshotsTestJSON-620201569 None] Flow 'volume_create_manager' (fa702db6-70d0-418d-ae4a-553be62330d8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129952) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 22 21:40:33.485449 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [req-90b98a58-e574-49cf-956c-1e3b42852af3 req-b50c1fb1-396e-4deb-8e0c-0bb05bb0b15f tempest-VolumesSnapshotsTestJSON-620201569 None] Created volume successfully. Jan 22 21:40:35.451560 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [req-aba893aa-f99e-4363-834a-647d92df170e req-5fb219f4-0ca1-4f30-9933-db4ac38e5997 tempest-VolumesSnapshotsTestJSON-620201569 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:40:36.163877 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.flows.manager.create_volume [None req-2c703c29-03b2-47ca-82bc-0600679209f9 tempest-TestVolumeBootPattern-763913219 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129952) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Jan 22 21:40:36.168150 ncdv-master-1 cinder-volume[129952]: WARNING stevedore.named [None req-2c703c29-03b2-47ca-82bc-0600679209f9 tempest-TestVolumeBootPattern-763913219 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jan 22 21:40:36.168594 ncdv-master-1 cinder-volume[129952]: WARNING castellan.key_manager [None req-2c703c29-03b2-47ca-82bc-0600679209f9 tempest-TestVolumeBootPattern-763913219 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 22 21:40:36.188839 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-2c703c29-03b2-47ca-82bc-0600679209f9 tempest-TestVolumeBootPattern-763913219 None] Flow 'volume_create_manager' (33801253-de7f-4699-87dc-62913ba9c278) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 22 21:40:36.195413 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-2c703c29-03b2-47ca-82bc-0600679209f9 tempest-TestVolumeBootPattern-763913219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e40179e-d47e-4849-b984-84d468373204) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:40:36.202675 ncdv-master-1 cinder-volume[129952]: DEBUG oslo_db.sqlalchemy.engines [None req-2c703c29-03b2-47ca-82bc-0600679209f9 tempest-TestVolumeBootPattern-763913219 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129952) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 22 21:40:36.216827 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-2c703c29-03b2-47ca-82bc-0600679209f9 tempest-TestVolumeBootPattern-763913219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e40179e-d47e-4849-b984-84d468373204) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-01-22T21:40:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeBootPattern-volume-origin-1627881870',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=5583d5af-6867-45b1-8bde-cb3a067f238f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61bfb71de54c471193d2c71859a7f051',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-01-22T21:40:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-01-22T21:40:36Z,use_quota=True,user_id='29e976f05d60471b9e6fb8290f07ccce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6dacb05b-a7ea-4056-85ff-98f0ea5c54eb),volume_type_id=6dacb05b-a7ea-4056-85ff-98f0ea5c54eb)' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:40:36.222384 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-2c703c29-03b2-47ca-82bc-0600679209f9 tempest-TestVolumeBootPattern-763913219 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06b0f44e-fec7-4573-bc27-351177876c2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:40:36.226650 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-2c703c29-03b2-47ca-82bc-0600679209f9 tempest-TestVolumeBootPattern-763913219 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06b0f44e-fec7-4573-bc27-351177876c2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:40:36.232466 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-2c703c29-03b2-47ca-82bc-0600679209f9 tempest-TestVolumeBootPattern-763913219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81a94d4a-5417-4465-b0e7-67b1801ea653) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:40:36.319504 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-2c703c29-03b2-47ca-82bc-0600679209f9 tempest-TestVolumeBootPattern-763913219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81a94d4a-5417-4465-b0e7-67b1801ea653) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '5583d5af-6867-45b1-8bde-cb3a067f238f', 'volume_name': 'volume-5583d5af-6867-45b1-8bde-cb3a067f238f', 'volume_size': 1, 'image_id': '373cb480-3bc4-4821-93e2-442b4e852b80', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '994e8f6963f04af3be3dbae11a73cdfd', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '373cb480-3bc4-4821-93e2-442b4e852b80', 'created_at': datetime.datetime(2022, 1, 22, 20, 50, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 1, 22, 20, 50, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/373cb480-3bc4-4821-93e2-442b4e852b80/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:40:36.325169 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-2c703c29-03b2-47ca-82bc-0600679209f9 tempest-TestVolumeBootPattern-763913219 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b45dab1-ddf4-4784-a592-6f9b67564291) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:40:36.329329 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-2c703c29-03b2-47ca-82bc-0600679209f9 tempest-TestVolumeBootPattern-763913219 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b45dab1-ddf4-4784-a592-6f9b67564291) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:40:36.334214 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-2c703c29-03b2-47ca-82bc-0600679209f9 tempest-TestVolumeBootPattern-763913219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (509a9097-46bf-4d84-82a1-bf87da6ecb63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:40:36.335385 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.flows.manager.create_volume [None req-2c703c29-03b2-47ca-82bc-0600679209f9 tempest-TestVolumeBootPattern-763913219 None] Volume 5583d5af-6867-45b1-8bde-cb3a067f238f: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-5583d5af-6867-45b1-8bde-cb3a067f238f', 'volume_size': 1, 'image_id': '373cb480-3bc4-4821-93e2-442b4e852b80', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '994e8f6963f04af3be3dbae11a73cdfd', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '373cb480-3bc4-4821-93e2-442b4e852b80', 'created_at': datetime.datetime(2022, 1, 22, 20, 50, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 1, 22, 20, 50, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/373cb480-3bc4-4821-93e2-442b4e852b80/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jan 22 21:40:36.335948 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.flows.manager.create_volume [None req-2c703c29-03b2-47ca-82bc-0600679209f9 tempest-TestVolumeBootPattern-763913219 None] Cloning 5583d5af-6867-45b1-8bde-cb3a067f238f from image 373cb480-3bc4-4821-93e2-442b4e852b80 at location (None, None). {{(pid=129952) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1046}} Jan 22 21:40:36.346495 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.coordination [None req-2c703c29-03b2-47ca-82bc-0600679209f9 tempest-TestVolumeBootPattern-763913219 None] Lock "b'cinder-373cb480-3bc4-4821-93e2-442b4e852b80'" acquired by "_prepare_image_cache_entry" :: waited 0.010s {{(pid=129952) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 22 21:40:36.424294 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.image.cache [None req-2c703c29-03b2-47ca-82bc-0600679209f9 tempest-TestVolumeBootPattern-763913219 None] Found image-volume cache entry: {'id': 1, 'image_id': '373cb480-3bc4-4821-93e2-442b4e852b80', 'volume_id': 'f39c1078-cff4-40dd-93df-4ce49cd873b4', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 1, 22, 20, 50, 57), 'last_used': datetime.datetime(2022, 1, 22, 21, 40, 36, 350460)}. {{(pid=129952) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Jan 22 21:40:36.424729 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.image.cache [None req-2c703c29-03b2-47ca-82bc-0600679209f9 tempest-TestVolumeBootPattern-763913219 None] Image-volume cache entry image_update_at = 2022-01-22 20:50:57+00:00, requested image updated_at = 2022-01-22 20:50:57+00:00. {{(pid=129952) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Jan 22 21:40:36.425143 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.flows.manager.create_volume [None req-2c703c29-03b2-47ca-82bc-0600679209f9 tempest-TestVolumeBootPattern-763913219 None] Found cache entry for image = 373cb480-3bc4-4821-93e2-442b4e852b80 on host ncdv-master-1@ceph#ceph. {{(pid=129952) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:869}} Jan 22 21:40:36.429575 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.coordination [None req-2c703c29-03b2-47ca-82bc-0600679209f9 tempest-TestVolumeBootPattern-763913219 None] Lock "b'cinder-373cb480-3bc4-4821-93e2-442b4e852b80'" released by "_prepare_image_cache_entry" :: held 0.083s {{(pid=129952) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 22 21:40:36.430517 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.flows.manager.create_volume [None req-2c703c29-03b2-47ca-82bc-0600679209f9 tempest-TestVolumeBootPattern-763913219 None] Attempting to retrieve cache entry for image = 373cb480-3bc4-4821-93e2-442b4e852b80 on host ncdv-master-1@ceph#ceph. {{(pid=129952) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:810}} Jan 22 21:40:36.436274 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.image.cache [None req-2c703c29-03b2-47ca-82bc-0600679209f9 tempest-TestVolumeBootPattern-763913219 None] Found image-volume cache entry: {'id': 1, 'image_id': '373cb480-3bc4-4821-93e2-442b4e852b80', 'volume_id': 'f39c1078-cff4-40dd-93df-4ce49cd873b4', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 1, 22, 20, 50, 57), 'last_used': datetime.datetime(2022, 1, 22, 21, 40, 36, 434080)}. {{(pid=129952) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Jan 22 21:40:36.436690 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.image.cache [None req-2c703c29-03b2-47ca-82bc-0600679209f9 tempest-TestVolumeBootPattern-763913219 None] Image-volume cache entry image_update_at = 2022-01-22 20:50:57+00:00, requested image updated_at = 2022-01-22 20:50:57+00:00. {{(pid=129952) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Jan 22 21:40:36.437087 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.flows.manager.create_volume [None req-2c703c29-03b2-47ca-82bc-0600679209f9 tempest-TestVolumeBootPattern-763913219 None] Creating from source image-volume f39c1078-cff4-40dd-93df-4ce49cd873b4 {{(pid=129952) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:824}} Jan 22 21:40:36.448593 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-2c703c29-03b2-47ca-82bc-0600679209f9 tempest-TestVolumeBootPattern-763913219 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:40:36.659115 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-2c703c29-03b2-47ca-82bc-0600679209f9 tempest-TestVolumeBootPattern-763913219 None] creating snapshot='volume-5583d5af-6867-45b1-8bde-cb3a067f238f.clone_snap' {{(pid=129952) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:725}} Jan 22 21:40:38.751784 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-2c703c29-03b2-47ca-82bc-0600679209f9 tempest-TestVolumeBootPattern-763913219 None] cloning 'volume-f39c1078-cff4-40dd-93df-4ce49cd873b4@volume-5583d5af-6867-45b1-8bde-cb3a067f238f.clone_snap' to 'volume-5583d5af-6867-45b1-8bde-cb3a067f238f' {{(pid=129952) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:731}} Jan 22 21:40:39.647631 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [req-aba893aa-f99e-4363-834a-647d92df170e req-5fb219f4-0ca1-4f30-9933-db4ac38e5997 tempest-VolumesSnapshotsTestJSON-620201569 None] Create snapshot completed successfully Jan 22 21:40:40.290891 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-2c703c29-03b2-47ca-82bc-0600679209f9 tempest-TestVolumeBootPattern-763913219 None] Volume volume-0b17e2f4-e149-4a4b-b525-3d029be2e6f6.deleted is not a clone. {{(pid=129952) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Jan 22 21:40:40.292652 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-2c703c29-03b2-47ca-82bc-0600679209f9 tempest-TestVolumeBootPattern-763913219 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129952) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 22 21:40:40.297183 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-2c703c29-03b2-47ca-82bc-0600679209f9 tempest-TestVolumeBootPattern-763913219 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129952) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 22 21:40:40.661394 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-2c703c29-03b2-47ca-82bc-0600679209f9 tempest-TestVolumeBootPattern-763913219 None] clone created successfully {{(pid=129952) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:803}} Jan 22 21:40:40.662521 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.volume_utils [None req-2c703c29-03b2-47ca-82bc-0600679209f9 tempest-TestVolumeBootPattern-763913219 None] Marking volume 5583d5af-6867-45b1-8bde-cb3a067f238f as bootable. {{(pid=129952) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1178}} Jan 22 21:40:40.783734 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.coordination [req-375f1646-f057-44d8-b685-41992a6de17e req-ba3d16f6-7bf2-4c2a-bf9e-b83e35ea4e8c tempest-VolumesSnapshotsTestJSON-620201569 None] Lock "b'cinder-ce6780aa-f0d3-499c-b5cf-82d7e746129d-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.014s {{(pid=129952) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 22 21:40:40.785241 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [req-375f1646-f057-44d8-b685-41992a6de17e req-ba3d16f6-7bf2-4c2a-bf9e-b83e35ea4e8c tempest-VolumesSnapshotsTestJSON-620201569 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:40:40.929082 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.flows.manager.create_volume [None req-2c703c29-03b2-47ca-82bc-0600679209f9 tempest-TestVolumeBootPattern-763913219 None] Copying metadata from image 373cb480-3bc4-4821-93e2-442b4e852b80 to 5583d5af-6867-45b1-8bde-cb3a067f238f. {{(pid=129952) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:443}} Jan 22 21:40:40.929576 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.flows.manager.create_volume [None req-2c703c29-03b2-47ca-82bc-0600679209f9 tempest-TestVolumeBootPattern-763913219 None] Creating volume glance metadata for volume 5583d5af-6867-45b1-8bde-cb3a067f238f backed by image 373cb480-3bc4-4821-93e2-442b4e852b80 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '373cb480-3bc4-4821-93e2-442b4e852b80', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=129952) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:666}} Jan 22 21:40:41.062875 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-2c703c29-03b2-47ca-82bc-0600679209f9 tempest-TestVolumeBootPattern-763913219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (509a9097-46bf-4d84-82a1-bf87da6ecb63) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5583d5af-6867-45b1-8bde-cb3a067f238f', 'volume_size': 1, 'image_id': '373cb480-3bc4-4821-93e2-442b4e852b80', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '994e8f6963f04af3be3dbae11a73cdfd', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '373cb480-3bc4-4821-93e2-442b4e852b80', 'created_at': datetime.datetime(2022, 1, 22, 20, 50, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 1, 22, 20, 50, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/373cb480-3bc4-4821-93e2-442b4e852b80/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:40:41.067662 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-2c703c29-03b2-47ca-82bc-0600679209f9 tempest-TestVolumeBootPattern-763913219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0d7c92a-0185-49dd-8518-d95a8cbe4647) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:40:41.161714 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.flows.manager.create_volume [None req-2c703c29-03b2-47ca-82bc-0600679209f9 tempest-TestVolumeBootPattern-763913219 None] Volume volume-5583d5af-6867-45b1-8bde-cb3a067f238f (5583d5af-6867-45b1-8bde-cb3a067f238f): created successfully Jan 22 21:40:41.165965 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-2c703c29-03b2-47ca-82bc-0600679209f9 tempest-TestVolumeBootPattern-763913219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0d7c92a-0185-49dd-8518-d95a8cbe4647) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:40:41.171636 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-2c703c29-03b2-47ca-82bc-0600679209f9 tempest-TestVolumeBootPattern-763913219 None] Flow 'volume_create_manager' (33801253-de7f-4699-87dc-62913ba9c278) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129952) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 22 21:40:41.241587 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-2c703c29-03b2-47ca-82bc-0600679209f9 tempest-TestVolumeBootPattern-763913219 None] Created volume successfully. Jan 22 21:40:42.839931 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-49813286-9801-4593-be3c-f87cf88332eb tempest-TestVolumeBootPattern-763913219 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:40:43.778794 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.quota [req-375f1646-f057-44d8-b685-41992a6de17e req-ba3d16f6-7bf2-4c2a-bf9e-b83e35ea4e8c tempest-VolumesSnapshotsTestJSON-620201569 None] Created reservations ['57355064-b1ac-4c28-a70f-ee5c6336a0e9', 'ccf97928-cb27-44ef-aced-fee26d8db5a4', '32566efc-8033-4c92-9231-220d5d3e489f', 'f5fc871d-cf07-437f-ad11-a729db70c280'] {{(pid=129952) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 22 21:40:43.939320 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [req-375f1646-f057-44d8-b685-41992a6de17e req-ba3d16f6-7bf2-4c2a-bf9e-b83e35ea4e8c tempest-VolumesSnapshotsTestJSON-620201569 None] Delete snapshot completed successfully. Jan 22 21:40:43.944007 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.coordination [req-375f1646-f057-44d8-b685-41992a6de17e req-ba3d16f6-7bf2-4c2a-bf9e-b83e35ea4e8c tempest-VolumesSnapshotsTestJSON-620201569 None] Lock "b'cinder-ce6780aa-f0d3-499c-b5cf-82d7e746129d-delete_snapshot'" released by "delete_snapshot" :: held 3.160s {{(pid=129952) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 22 21:40:44.163146 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.coordination [req-acf30b9c-92ea-403a-9ddc-1942ec1a2a46 req-55c1c851-d9cd-4e8b-a284-fc6624082bd9 tempest-VolumesSnapshotsTestJSON-620201569 None] Lock "b'cinder-131af0b9-b9c0-48fe-af9e-6e5dcdb01405-delete_volume'" acquired by "delete_volume" :: waited 0.009s {{(pid=129952) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 22 21:40:44.253488 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [req-acf30b9c-92ea-403a-9ddc-1942ec1a2a46 req-55c1c851-d9cd-4e8b-a284-fc6624082bd9 tempest-VolumesSnapshotsTestJSON-620201569 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:40:44.498489 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [req-acf30b9c-92ea-403a-9ddc-1942ec1a2a46 req-55c1c851-d9cd-4e8b-a284-fc6624082bd9 tempest-VolumesSnapshotsTestJSON-620201569 None] volume has no backup snaps {{(pid=129952) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Jan 22 21:40:44.498926 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [req-acf30b9c-92ea-403a-9ddc-1942ec1a2a46 req-55c1c851-d9cd-4e8b-a284-fc6624082bd9 tempest-VolumesSnapshotsTestJSON-620201569 None] Volume volume-131af0b9-b9c0-48fe-af9e-6e5dcdb01405 is not a clone. {{(pid=129952) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Jan 22 21:40:44.630795 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [req-acf30b9c-92ea-403a-9ddc-1942ec1a2a46 req-55c1c851-d9cd-4e8b-a284-fc6624082bd9 tempest-VolumesSnapshotsTestJSON-620201569 None] deleting rbd volume volume-131af0b9-b9c0-48fe-af9e-6e5dcdb01405 {{(pid=129952) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Jan 22 21:40:45.679188 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-49813286-9801-4593-be3c-f87cf88332eb tempest-TestVolumeBootPattern-763913219 None] Create snapshot completed successfully Jan 22 21:40:48.424592 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.quota [req-acf30b9c-92ea-403a-9ddc-1942ec1a2a46 req-55c1c851-d9cd-4e8b-a284-fc6624082bd9 tempest-VolumesSnapshotsTestJSON-620201569 None] Created reservations ['d066a7e9-ff44-4ff7-ba0f-7f17da06338c', '2c26b037-d80d-4065-bb06-0e31267520b2', 'b8770987-5320-47e9-9fa2-2a627611d7ec', '4aedc059-272f-4380-b4ad-abc8002541d6'] {{(pid=129952) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 22 21:40:48.567729 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [req-acf30b9c-92ea-403a-9ddc-1942ec1a2a46 req-55c1c851-d9cd-4e8b-a284-fc6624082bd9 tempest-VolumesSnapshotsTestJSON-620201569 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:40:48.596285 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [req-acf30b9c-92ea-403a-9ddc-1942ec1a2a46 req-55c1c851-d9cd-4e8b-a284-fc6624082bd9 tempest-VolumesSnapshotsTestJSON-620201569 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:40:48.645222 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.manager [req-acf30b9c-92ea-403a-9ddc-1942ec1a2a46 req-55c1c851-d9cd-4e8b-a284-fc6624082bd9 tempest-VolumesSnapshotsTestJSON-620201569 None] Notifying Schedulers of capabilities ... {{(pid=129952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 22 21:40:48.649816 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [req-acf30b9c-92ea-403a-9ddc-1942ec1a2a46 req-55c1c851-d9cd-4e8b-a284-fc6624082bd9 tempest-VolumesSnapshotsTestJSON-620201569 None] Deleted volume successfully. Jan 22 21:40:48.768596 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.coordination [req-acf30b9c-92ea-403a-9ddc-1942ec1a2a46 req-55c1c851-d9cd-4e8b-a284-fc6624082bd9 tempest-VolumesSnapshotsTestJSON-620201569 None] Lock "b'cinder-131af0b9-b9c0-48fe-af9e-6e5dcdb01405-delete_volume'" released by "delete_volume" :: held 4.605s {{(pid=129952) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 22 21:40:49.876911 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.flows.manager.create_volume [req-e46ddd0a-97e8-4d86-b997-96d43977d1df req-43970f26-0b42-425b-bb44-013c7a38e353 tempest-TestVolumeBootPattern-763913219 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129952) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Jan 22 21:40:49.880539 ncdv-master-1 cinder-volume[129952]: WARNING stevedore.named [req-e46ddd0a-97e8-4d86-b997-96d43977d1df req-43970f26-0b42-425b-bb44-013c7a38e353 tempest-TestVolumeBootPattern-763913219 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jan 22 21:40:49.881071 ncdv-master-1 cinder-volume[129952]: WARNING castellan.key_manager [req-e46ddd0a-97e8-4d86-b997-96d43977d1df req-43970f26-0b42-425b-bb44-013c7a38e353 tempest-TestVolumeBootPattern-763913219 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 22 21:40:49.913573 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [req-e46ddd0a-97e8-4d86-b997-96d43977d1df req-43970f26-0b42-425b-bb44-013c7a38e353 tempest-TestVolumeBootPattern-763913219 None] Flow 'volume_create_manager' (603b2534-48fc-466e-8849-840eb773010f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 22 21:40:49.920847 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [req-e46ddd0a-97e8-4d86-b997-96d43977d1df req-43970f26-0b42-425b-bb44-013c7a38e353 tempest-TestVolumeBootPattern-763913219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d65828e-f573-41e4-b8f6-1c55fd5d74c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:40:49.927296 ncdv-master-1 cinder-volume[129952]: DEBUG oslo_db.sqlalchemy.engines [req-e46ddd0a-97e8-4d86-b997-96d43977d1df req-43970f26-0b42-425b-bb44-013c7a38e353 tempest-TestVolumeBootPattern-763913219 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129952) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 22 21:40:49.943752 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [req-e46ddd0a-97e8-4d86-b997-96d43977d1df req-43970f26-0b42-425b-bb44-013c7a38e353 tempest-TestVolumeBootPattern-763913219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d65828e-f573-41e4-b8f6-1c55fd5d74c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=True,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-01-22T21:40:49Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=e3f7c0ce-b7d4-49f4-8c46-cd7db554e546,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61bfb71de54c471193d2c71859a7f051',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-01-22T21:40:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=709f7487-685f-4f76-8a90-fe865459ee83,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-01-22T21:40:50Z,use_quota=True,user_id='29e976f05d60471b9e6fb8290f07ccce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6dacb05b-a7ea-4056-85ff-98f0ea5c54eb),volume_type_id=6dacb05b-a7ea-4056-85ff-98f0ea5c54eb)' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:40:49.949456 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [req-e46ddd0a-97e8-4d86-b997-96d43977d1df req-43970f26-0b42-425b-bb44-013c7a38e353 tempest-TestVolumeBootPattern-763913219 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1219716-4922-4ae5-a69b-30b388d0b472) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:40:49.954848 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [req-e46ddd0a-97e8-4d86-b997-96d43977d1df req-43970f26-0b42-425b-bb44-013c7a38e353 tempest-TestVolumeBootPattern-763913219 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1219716-4922-4ae5-a69b-30b388d0b472) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:40:49.960229 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [req-e46ddd0a-97e8-4d86-b997-96d43977d1df req-43970f26-0b42-425b-bb44-013c7a38e353 tempest-TestVolumeBootPattern-763913219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e8e37b6-49fd-4ee4-893c-2515ee47c48a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:40:49.978520 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [req-e46ddd0a-97e8-4d86-b997-96d43977d1df req-43970f26-0b42-425b-bb44-013c7a38e353 tempest-TestVolumeBootPattern-763913219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e8e37b6-49fd-4ee4-893c-2515ee47c48a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'e3f7c0ce-b7d4-49f4-8c46-cd7db554e546', 'volume_name': 'volume-e3f7c0ce-b7d4-49f4-8c46-cd7db554e546', 'volume_size': 1, 'snapshot_id': '709f7487-685f-4f76-8a90-fe865459ee83'}' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:40:49.978520 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [req-e46ddd0a-97e8-4d86-b997-96d43977d1df req-43970f26-0b42-425b-bb44-013c7a38e353 tempest-TestVolumeBootPattern-763913219 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3878fc30-891d-45df-b881-97dc89fa9d5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:40:49.978520 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [req-e46ddd0a-97e8-4d86-b997-96d43977d1df req-43970f26-0b42-425b-bb44-013c7a38e353 tempest-TestVolumeBootPattern-763913219 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3878fc30-891d-45df-b881-97dc89fa9d5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:40:49.979106 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [req-e46ddd0a-97e8-4d86-b997-96d43977d1df req-43970f26-0b42-425b-bb44-013c7a38e353 tempest-TestVolumeBootPattern-763913219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b47c1a07-3634-41da-bdcc-3abd535364c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:40:49.980215 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.flows.manager.create_volume [req-e46ddd0a-97e8-4d86-b997-96d43977d1df req-43970f26-0b42-425b-bb44-013c7a38e353 tempest-TestVolumeBootPattern-763913219 None] Volume e3f7c0ce-b7d4-49f4-8c46-cd7db554e546: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-e3f7c0ce-b7d4-49f4-8c46-cd7db554e546', 'volume_size': 1, 'snapshot_id': '709f7487-685f-4f76-8a90-fe865459ee83'} Jan 22 21:40:49.997476 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [req-e46ddd0a-97e8-4d86-b997-96d43977d1df req-43970f26-0b42-425b-bb44-013c7a38e353 tempest-TestVolumeBootPattern-763913219 None] cloning volumes/volume-5583d5af-6867-45b1-8bde-cb3a067f238f@snapshot-709f7487-685f-4f76-8a90-fe865459ee83 to volume-e3f7c0ce-b7d4-49f4-8c46-cd7db554e546 {{(pid=129952) _clone /opt/stack/cinder/cinder/volume/drivers/rbd.py:1028}} Jan 22 21:40:49.998420 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [req-e46ddd0a-97e8-4d86-b997-96d43977d1df req-43970f26-0b42-425b-bb44-013c7a38e353 tempest-TestVolumeBootPattern-763913219 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:40:50.077294 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [req-e46ddd0a-97e8-4d86-b997-96d43977d1df req-43970f26-0b42-425b-bb44-013c7a38e353 tempest-TestVolumeBootPattern-763913219 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:40:51.389455 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [req-e46ddd0a-97e8-4d86-b997-96d43977d1df req-43970f26-0b42-425b-bb44-013c7a38e353 tempest-TestVolumeBootPattern-763913219 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129952) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 22 21:40:51.390548 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [req-e46ddd0a-97e8-4d86-b997-96d43977d1df req-43970f26-0b42-425b-bb44-013c7a38e353 tempest-TestVolumeBootPattern-763913219 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129952) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 22 21:40:51.412533 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.volume_utils [req-e46ddd0a-97e8-4d86-b997-96d43977d1df req-43970f26-0b42-425b-bb44-013c7a38e353 tempest-TestVolumeBootPattern-763913219 None] Marking volume e3f7c0ce-b7d4-49f4-8c46-cd7db554e546 as bootable. {{(pid=129952) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1178}} Jan 22 21:40:51.492992 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.flows.manager.create_volume [req-e46ddd0a-97e8-4d86-b997-96d43977d1df req-43970f26-0b42-425b-bb44-013c7a38e353 tempest-TestVolumeBootPattern-763913219 None] Copying metadata from snapshot 709f7487-685f-4f76-8a90-fe865459ee83 to e3f7c0ce-b7d4-49f4-8c46-cd7db554e546. {{(pid=129952) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:422}} Jan 22 21:40:51.605051 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [req-e46ddd0a-97e8-4d86-b997-96d43977d1df req-43970f26-0b42-425b-bb44-013c7a38e353 tempest-TestVolumeBootPattern-763913219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b47c1a07-3634-41da-bdcc-3abd535364c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e3f7c0ce-b7d4-49f4-8c46-cd7db554e546', 'volume_size': 1, 'snapshot_id': '709f7487-685f-4f76-8a90-fe865459ee83'}' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:40:51.610419 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [req-e46ddd0a-97e8-4d86-b997-96d43977d1df req-43970f26-0b42-425b-bb44-013c7a38e353 tempest-TestVolumeBootPattern-763913219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (316a740f-8bff-4996-9e69-5ec04759ab42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:40:51.681527 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.flows.manager.create_volume [req-e46ddd0a-97e8-4d86-b997-96d43977d1df req-43970f26-0b42-425b-bb44-013c7a38e353 tempest-TestVolumeBootPattern-763913219 None] Volume volume-e3f7c0ce-b7d4-49f4-8c46-cd7db554e546 (e3f7c0ce-b7d4-49f4-8c46-cd7db554e546): created successfully Jan 22 21:40:51.686036 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [req-e46ddd0a-97e8-4d86-b997-96d43977d1df req-43970f26-0b42-425b-bb44-013c7a38e353 tempest-TestVolumeBootPattern-763913219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (316a740f-8bff-4996-9e69-5ec04759ab42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:40:51.691648 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [req-e46ddd0a-97e8-4d86-b997-96d43977d1df req-43970f26-0b42-425b-bb44-013c7a38e353 tempest-TestVolumeBootPattern-763913219 None] Flow 'volume_create_manager' (603b2534-48fc-466e-8849-840eb773010f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129952) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 22 21:40:51.782626 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [req-e46ddd0a-97e8-4d86-b997-96d43977d1df req-43970f26-0b42-425b-bb44-013c7a38e353 tempest-TestVolumeBootPattern-763913219 None] Created volume successfully. Jan 22 21:40:53.083839 ncdv-master-1 cinder-volume[129952]: DEBUG oslo_concurrency.processutils [req-e46ddd0a-97e8-4d86-b997-96d43977d1df req-ace2b809-d88e-4b15-b568-4a93b389ddad tempest-TestVolumeBootPattern-763913219 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129952) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jan 22 21:40:53.759629 ncdv-master-1 cinder-volume[129952]: DEBUG oslo_concurrency.processutils [req-e46ddd0a-97e8-4d86-b997-96d43977d1df req-ace2b809-d88e-4b15-b568-4a93b389ddad tempest-TestVolumeBootPattern-763913219 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.675s {{(pid=129952) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jan 22 21:40:53.760474 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [req-e46ddd0a-97e8-4d86-b997-96d43977d1df req-ace2b809-d88e-4b15-b568-4a93b389ddad tempest-TestVolumeBootPattern-763913219 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-e3f7c0ce-b7d4-49f4-8c46-cd7db554e546', 'hosts': ['10.222.0.100'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'c7ee930a-3b87-450e-91f6-d4eef70cb484', 'volume_id': 'e3f7c0ce-b7d4-49f4-8c46-cd7db554e546', 'discard': True}} {{(pid=129952) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Jan 22 21:40:53.904680 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [req-e46ddd0a-97e8-4d86-b997-96d43977d1df req-ace2b809-d88e-4b15-b568-4a93b389ddad tempest-TestVolumeBootPattern-763913219 None] Connection info returned from driver {'name': 'volumes/volume-e3f7c0ce-b7d4-49f4-8c46-cd7db554e546', 'hosts': ['10.222.0.100'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'e3f7c0ce-b7d4-49f4-8c46-cd7db554e546', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'a3986020-6a35-4433-8b2d-59543eb2f2ef'} {{(pid=129952) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4811}} Jan 22 21:40:54.030200 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [req-e46ddd0a-97e8-4d86-b997-96d43977d1df req-ace2b809-d88e-4b15-b568-4a93b389ddad tempest-TestVolumeBootPattern-763913219 None] attachment_update completed successfully. Jan 22 21:41:07.182643 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [req-26cb3808-faf7-4c21-ad8d-ed045c7e967c req-5294749c-dec6-46ce-9f2d-ff8c21b82d02 tempest-TestVolumeBootPattern-763913219 None] Terminate volume connection completed successfully. Jan 22 21:41:07.183311 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [req-26cb3808-faf7-4c21-ad8d-ed045c7e967c req-5294749c-dec6-46ce-9f2d-ff8c21b82d02 tempest-TestVolumeBootPattern-763913219 None] Deleting attachment a3986020-6a35-4433-8b2d-59543eb2f2ef. {{(pid=129952) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4947}} Jan 22 21:41:07.552739 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.coordination [req-26cb3808-faf7-4c21-ad8d-ed045c7e967c req-c762fd72-2034-467b-ad68-bf7298b07167 tempest-TestVolumeBootPattern-763913219 None] Lock "b'cinder-e3f7c0ce-b7d4-49f4-8c46-cd7db554e546-delete_volume'" acquired by "delete_volume" :: waited 0.018s {{(pid=129952) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 22 21:41:07.644248 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [req-26cb3808-faf7-4c21-ad8d-ed045c7e967c req-c762fd72-2034-467b-ad68-bf7298b07167 tempest-TestVolumeBootPattern-763913219 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:41:07.812702 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [req-26cb3808-faf7-4c21-ad8d-ed045c7e967c req-c762fd72-2034-467b-ad68-bf7298b07167 tempest-TestVolumeBootPattern-763913219 None] volume has no backup snaps {{(pid=129952) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Jan 22 21:41:07.926458 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [req-26cb3808-faf7-4c21-ad8d-ed045c7e967c req-c762fd72-2034-467b-ad68-bf7298b07167 tempest-TestVolumeBootPattern-763913219 None] deleting rbd volume volume-e3f7c0ce-b7d4-49f4-8c46-cd7db554e546 {{(pid=129952) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Jan 22 21:41:11.429457 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.quota [req-26cb3808-faf7-4c21-ad8d-ed045c7e967c req-c762fd72-2034-467b-ad68-bf7298b07167 tempest-TestVolumeBootPattern-763913219 None] Created reservations ['8b1f6504-34b8-41c1-ad7a-d05fe35e7bee', 'a627fb48-5c59-4a1c-b422-246b7657d2c0', '866b4f18-e155-4eb9-a1b2-7b16a31fe331', 'a813a702-ada8-4edb-a4c7-4d71f4927e51'] {{(pid=129952) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 22 21:41:11.654890 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [req-26cb3808-faf7-4c21-ad8d-ed045c7e967c req-c762fd72-2034-467b-ad68-bf7298b07167 tempest-TestVolumeBootPattern-763913219 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:41:11.684603 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [req-26cb3808-faf7-4c21-ad8d-ed045c7e967c req-c762fd72-2034-467b-ad68-bf7298b07167 tempest-TestVolumeBootPattern-763913219 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:41:11.710044 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.manager [req-26cb3808-faf7-4c21-ad8d-ed045c7e967c req-c762fd72-2034-467b-ad68-bf7298b07167 tempest-TestVolumeBootPattern-763913219 None] Notifying Schedulers of capabilities ... {{(pid=129952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 22 21:41:11.714833 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [req-26cb3808-faf7-4c21-ad8d-ed045c7e967c req-c762fd72-2034-467b-ad68-bf7298b07167 tempest-TestVolumeBootPattern-763913219 None] Deleted volume successfully. Jan 22 21:41:11.757553 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.coordination [None req-a080d149-d76e-4ba6-94da-1547fbae557a tempest-TestVolumeBootPattern-763913219 None] Lock "b'cinder-709f7487-685f-4f76-8a90-fe865459ee83-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.016s {{(pid=129952) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 22 21:41:11.759327 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-a080d149-d76e-4ba6-94da-1547fbae557a tempest-TestVolumeBootPattern-763913219 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:41:11.921340 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.coordination [req-26cb3808-faf7-4c21-ad8d-ed045c7e967c req-c762fd72-2034-467b-ad68-bf7298b07167 tempest-TestVolumeBootPattern-763913219 None] Lock "b'cinder-e3f7c0ce-b7d4-49f4-8c46-cd7db554e546-delete_volume'" released by "delete_volume" :: held 4.369s {{(pid=129952) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 22 21:41:14.181953 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.quota [None req-a080d149-d76e-4ba6-94da-1547fbae557a tempest-TestVolumeBootPattern-763913219 None] Created reservations ['52bee51d-6f48-447c-b72b-cfb8b11722da', '7641ae63-0119-42c2-b5f0-f658d501c815', '9189b98d-def0-428d-8533-58d362487b4f', '8c227335-b889-4a8a-9ab0-8601211b6c5a'] {{(pid=129952) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 22 21:41:14.458103 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-a080d149-d76e-4ba6-94da-1547fbae557a tempest-TestVolumeBootPattern-763913219 None] Delete snapshot completed successfully. Jan 22 21:41:14.462737 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.coordination [None req-a080d149-d76e-4ba6-94da-1547fbae557a tempest-TestVolumeBootPattern-763913219 None] Lock "b'cinder-709f7487-685f-4f76-8a90-fe865459ee83-delete_snapshot'" released by "delete_snapshot" :: held 2.705s {{(pid=129952) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 22 21:41:15.067970 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.coordination [None req-1231ec3d-5841-403a-9f3c-5a3c4f3dd4e9 tempest-TestVolumeBootPattern-763913219 None] Lock "b'cinder-5583d5af-6867-45b1-8bde-cb3a067f238f-delete_volume'" acquired by "delete_volume" :: waited 0.009s {{(pid=129952) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 22 21:41:15.167732 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-1231ec3d-5841-403a-9f3c-5a3c4f3dd4e9 tempest-TestVolumeBootPattern-763913219 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:41:15.307058 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-1231ec3d-5841-403a-9f3c-5a3c4f3dd4e9 tempest-TestVolumeBootPattern-763913219 None] volume has no backup snaps {{(pid=129952) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Jan 22 21:41:15.487519 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-1231ec3d-5841-403a-9f3c-5a3c4f3dd4e9 tempest-TestVolumeBootPattern-763913219 None] deleting rbd volume volume-5583d5af-6867-45b1-8bde-cb3a067f238f {{(pid=129952) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Jan 22 21:41:16.386822 ncdv-master-1 cinder-volume[129952]: DEBUG oslo_service.periodic_task [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129952) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jan 22 21:41:16.387577 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:41:16.416192 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:41:16.444576 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.manager [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] Notifying Schedulers of capabilities ... {{(pid=129952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 22 21:41:18.567714 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-1231ec3d-5841-403a-9f3c-5a3c4f3dd4e9 tempest-TestVolumeBootPattern-763913219 None] volume is a clone so cleaning references {{(pid=129952) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1266}} Jan 22 21:41:18.659564 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-1231ec3d-5841-403a-9f3c-5a3c4f3dd4e9 tempest-TestVolumeBootPattern-763913219 None] deleting parent snapshot volume-5583d5af-6867-45b1-8bde-cb3a067f238f.clone_snap {{(pid=129952) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1158}} Jan 22 21:41:20.771803 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.quota [None req-1231ec3d-5841-403a-9f3c-5a3c4f3dd4e9 tempest-TestVolumeBootPattern-763913219 None] Created reservations ['3fa724a1-196c-4bcb-8b48-06d072fb9a67', '306e4c7c-354b-4111-8e88-f8f2a17654c1', 'a97fb4f6-ec07-4ead-b312-df1c25d31ee9', 'ef508070-104c-4043-8e22-e5efb9d7858a'] {{(pid=129952) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 22 21:41:20.926944 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-1231ec3d-5841-403a-9f3c-5a3c4f3dd4e9 tempest-TestVolumeBootPattern-763913219 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:41:20.953050 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-1231ec3d-5841-403a-9f3c-5a3c4f3dd4e9 tempest-TestVolumeBootPattern-763913219 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:41:20.980478 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.manager [None req-1231ec3d-5841-403a-9f3c-5a3c4f3dd4e9 tempest-TestVolumeBootPattern-763913219 None] Notifying Schedulers of capabilities ... {{(pid=129952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 22 21:41:20.986066 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-1231ec3d-5841-403a-9f3c-5a3c4f3dd4e9 tempest-TestVolumeBootPattern-763913219 None] Deleted volume successfully. Jan 22 21:41:21.122674 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.coordination [None req-1231ec3d-5841-403a-9f3c-5a3c4f3dd4e9 tempest-TestVolumeBootPattern-763913219 None] Lock "b'cinder-5583d5af-6867-45b1-8bde-cb3a067f238f-delete_volume'" released by "delete_volume" :: held 6.055s {{(pid=129952) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 22 21:41:22.362935 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.flows.manager.create_volume [None req-c3e1d021-da9d-42f6-8234-42f9a233e051 tempest-TestVolumeBootPattern-763913219 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129952) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Jan 22 21:41:22.366790 ncdv-master-1 cinder-volume[129952]: WARNING stevedore.named [None req-c3e1d021-da9d-42f6-8234-42f9a233e051 tempest-TestVolumeBootPattern-763913219 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jan 22 21:41:22.369688 ncdv-master-1 cinder-volume[129952]: WARNING castellan.key_manager [None req-c3e1d021-da9d-42f6-8234-42f9a233e051 tempest-TestVolumeBootPattern-763913219 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 22 21:41:22.395100 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-c3e1d021-da9d-42f6-8234-42f9a233e051 tempest-TestVolumeBootPattern-763913219 None] Flow 'volume_create_manager' (0b233c1a-1a30-4ad2-9c59-79006744fda5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 22 21:41:22.397617 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-c3e1d021-da9d-42f6-8234-42f9a233e051 tempest-TestVolumeBootPattern-763913219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2ed9c9c-6164-4a33-99d4-a5e009dfe05a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:41:22.403961 ncdv-master-1 cinder-volume[129952]: DEBUG oslo_db.sqlalchemy.engines [None req-c3e1d021-da9d-42f6-8234-42f9a233e051 tempest-TestVolumeBootPattern-763913219 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129952) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 22 21:41:22.419399 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-c3e1d021-da9d-42f6-8234-42f9a233e051 tempest-TestVolumeBootPattern-763913219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2ed9c9c-6164-4a33-99d4-a5e009dfe05a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-01-22T21:41:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeBootPattern-volume-origin-342262461',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=5372a0ff-89fb-48b9-9dc8-50dcd6dd4944,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61bfb71de54c471193d2c71859a7f051',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-01-22T21:41:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-01-22T21:41:22Z,use_quota=True,user_id='29e976f05d60471b9e6fb8290f07ccce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6dacb05b-a7ea-4056-85ff-98f0ea5c54eb),volume_type_id=6dacb05b-a7ea-4056-85ff-98f0ea5c54eb)' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:41:22.426016 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-c3e1d021-da9d-42f6-8234-42f9a233e051 tempest-TestVolumeBootPattern-763913219 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad667c46-f94e-4c17-a431-d175212a1547) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:41:22.430381 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-c3e1d021-da9d-42f6-8234-42f9a233e051 tempest-TestVolumeBootPattern-763913219 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad667c46-f94e-4c17-a431-d175212a1547) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:41:22.435724 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-c3e1d021-da9d-42f6-8234-42f9a233e051 tempest-TestVolumeBootPattern-763913219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d17c041a-c106-4873-94fe-36261084a7cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:41:22.514937 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-c3e1d021-da9d-42f6-8234-42f9a233e051 tempest-TestVolumeBootPattern-763913219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d17c041a-c106-4873-94fe-36261084a7cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '5372a0ff-89fb-48b9-9dc8-50dcd6dd4944', 'volume_name': 'volume-5372a0ff-89fb-48b9-9dc8-50dcd6dd4944', 'volume_size': 1, 'image_id': '373cb480-3bc4-4821-93e2-442b4e852b80', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '994e8f6963f04af3be3dbae11a73cdfd', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '373cb480-3bc4-4821-93e2-442b4e852b80', 'created_at': datetime.datetime(2022, 1, 22, 20, 50, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 1, 22, 20, 50, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/373cb480-3bc4-4821-93e2-442b4e852b80/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:41:22.520820 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-c3e1d021-da9d-42f6-8234-42f9a233e051 tempest-TestVolumeBootPattern-763913219 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be3f3eb7-18a3-4f44-906f-bedaa0bcb310) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:41:22.528266 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-c3e1d021-da9d-42f6-8234-42f9a233e051 tempest-TestVolumeBootPattern-763913219 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be3f3eb7-18a3-4f44-906f-bedaa0bcb310) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:41:22.530233 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-c3e1d021-da9d-42f6-8234-42f9a233e051 tempest-TestVolumeBootPattern-763913219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b91452c8-1bcd-44a9-a92e-684bf260b15a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:41:22.531788 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.flows.manager.create_volume [None req-c3e1d021-da9d-42f6-8234-42f9a233e051 tempest-TestVolumeBootPattern-763913219 None] Volume 5372a0ff-89fb-48b9-9dc8-50dcd6dd4944: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-5372a0ff-89fb-48b9-9dc8-50dcd6dd4944', 'volume_size': 1, 'image_id': '373cb480-3bc4-4821-93e2-442b4e852b80', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '994e8f6963f04af3be3dbae11a73cdfd', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '373cb480-3bc4-4821-93e2-442b4e852b80', 'created_at': datetime.datetime(2022, 1, 22, 20, 50, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 1, 22, 20, 50, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/373cb480-3bc4-4821-93e2-442b4e852b80/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jan 22 21:41:22.532025 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.flows.manager.create_volume [None req-c3e1d021-da9d-42f6-8234-42f9a233e051 tempest-TestVolumeBootPattern-763913219 None] Cloning 5372a0ff-89fb-48b9-9dc8-50dcd6dd4944 from image 373cb480-3bc4-4821-93e2-442b4e852b80 at location (None, None). {{(pid=129952) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1046}} Jan 22 21:41:22.540682 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.coordination [None req-c3e1d021-da9d-42f6-8234-42f9a233e051 tempest-TestVolumeBootPattern-763913219 None] Lock "b'cinder-373cb480-3bc4-4821-93e2-442b4e852b80'" acquired by "_prepare_image_cache_entry" :: waited 0.008s {{(pid=129952) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 22 21:41:22.600743 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.image.cache [None req-c3e1d021-da9d-42f6-8234-42f9a233e051 tempest-TestVolumeBootPattern-763913219 None] Found image-volume cache entry: {'id': 1, 'image_id': '373cb480-3bc4-4821-93e2-442b4e852b80', 'volume_id': 'f39c1078-cff4-40dd-93df-4ce49cd873b4', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 1, 22, 20, 50, 57), 'last_used': datetime.datetime(2022, 1, 22, 21, 41, 22, 545115)}. {{(pid=129952) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Jan 22 21:41:22.601257 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.image.cache [None req-c3e1d021-da9d-42f6-8234-42f9a233e051 tempest-TestVolumeBootPattern-763913219 None] Image-volume cache entry image_update_at = 2022-01-22 20:50:57+00:00, requested image updated_at = 2022-01-22 20:50:57+00:00. {{(pid=129952) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Jan 22 21:41:22.601713 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.flows.manager.create_volume [None req-c3e1d021-da9d-42f6-8234-42f9a233e051 tempest-TestVolumeBootPattern-763913219 None] Found cache entry for image = 373cb480-3bc4-4821-93e2-442b4e852b80 on host ncdv-master-1@ceph#ceph. {{(pid=129952) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:869}} Jan 22 21:41:22.606221 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.coordination [None req-c3e1d021-da9d-42f6-8234-42f9a233e051 tempest-TestVolumeBootPattern-763913219 None] Lock "b'cinder-373cb480-3bc4-4821-93e2-442b4e852b80'" released by "_prepare_image_cache_entry" :: held 0.066s {{(pid=129952) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 22 21:41:22.607185 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.flows.manager.create_volume [None req-c3e1d021-da9d-42f6-8234-42f9a233e051 tempest-TestVolumeBootPattern-763913219 None] Attempting to retrieve cache entry for image = 373cb480-3bc4-4821-93e2-442b4e852b80 on host ncdv-master-1@ceph#ceph. {{(pid=129952) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:810}} Jan 22 21:41:22.613074 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.image.cache [None req-c3e1d021-da9d-42f6-8234-42f9a233e051 tempest-TestVolumeBootPattern-763913219 None] Found image-volume cache entry: {'id': 1, 'image_id': '373cb480-3bc4-4821-93e2-442b4e852b80', 'volume_id': 'f39c1078-cff4-40dd-93df-4ce49cd873b4', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 1, 22, 20, 50, 57), 'last_used': datetime.datetime(2022, 1, 22, 21, 41, 22, 610535)}. {{(pid=129952) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Jan 22 21:41:22.619896 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.image.cache [None req-c3e1d021-da9d-42f6-8234-42f9a233e051 tempest-TestVolumeBootPattern-763913219 None] Image-volume cache entry image_update_at = 2022-01-22 20:50:57+00:00, requested image updated_at = 2022-01-22 20:50:57+00:00. {{(pid=129952) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Jan 22 21:41:22.619896 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.flows.manager.create_volume [None req-c3e1d021-da9d-42f6-8234-42f9a233e051 tempest-TestVolumeBootPattern-763913219 None] Creating from source image-volume f39c1078-cff4-40dd-93df-4ce49cd873b4 {{(pid=129952) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:824}} Jan 22 21:41:22.625494 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-c3e1d021-da9d-42f6-8234-42f9a233e051 tempest-TestVolumeBootPattern-763913219 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:41:22.800386 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-c3e1d021-da9d-42f6-8234-42f9a233e051 tempest-TestVolumeBootPattern-763913219 None] creating snapshot='volume-5372a0ff-89fb-48b9-9dc8-50dcd6dd4944.clone_snap' {{(pid=129952) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:725}} Jan 22 21:41:24.229821 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-c3e1d021-da9d-42f6-8234-42f9a233e051 tempest-TestVolumeBootPattern-763913219 None] cloning 'volume-f39c1078-cff4-40dd-93df-4ce49cd873b4@volume-5372a0ff-89fb-48b9-9dc8-50dcd6dd4944.clone_snap' to 'volume-5372a0ff-89fb-48b9-9dc8-50dcd6dd4944' {{(pid=129952) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:731}} Jan 22 21:41:25.404488 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-c3e1d021-da9d-42f6-8234-42f9a233e051 tempest-TestVolumeBootPattern-763913219 None] Volume volume-0b17e2f4-e149-4a4b-b525-3d029be2e6f6.deleted is not a clone. {{(pid=129952) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Jan 22 21:41:25.405843 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-c3e1d021-da9d-42f6-8234-42f9a233e051 tempest-TestVolumeBootPattern-763913219 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129952) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 22 21:41:25.406224 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-c3e1d021-da9d-42f6-8234-42f9a233e051 tempest-TestVolumeBootPattern-763913219 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129952) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 22 21:41:25.656359 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-c3e1d021-da9d-42f6-8234-42f9a233e051 tempest-TestVolumeBootPattern-763913219 None] clone created successfully {{(pid=129952) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:803}} Jan 22 21:41:25.657033 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.volume_utils [None req-c3e1d021-da9d-42f6-8234-42f9a233e051 tempest-TestVolumeBootPattern-763913219 None] Marking volume 5372a0ff-89fb-48b9-9dc8-50dcd6dd4944 as bootable. {{(pid=129952) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1178}} Jan 22 21:41:25.748827 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.flows.manager.create_volume [None req-c3e1d021-da9d-42f6-8234-42f9a233e051 tempest-TestVolumeBootPattern-763913219 None] Copying metadata from image 373cb480-3bc4-4821-93e2-442b4e852b80 to 5372a0ff-89fb-48b9-9dc8-50dcd6dd4944. {{(pid=129952) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:443}} Jan 22 21:41:25.749268 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.flows.manager.create_volume [None req-c3e1d021-da9d-42f6-8234-42f9a233e051 tempest-TestVolumeBootPattern-763913219 None] Creating volume glance metadata for volume 5372a0ff-89fb-48b9-9dc8-50dcd6dd4944 backed by image 373cb480-3bc4-4821-93e2-442b4e852b80 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '373cb480-3bc4-4821-93e2-442b4e852b80', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=129952) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:666}} Jan 22 21:41:25.907076 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-c3e1d021-da9d-42f6-8234-42f9a233e051 tempest-TestVolumeBootPattern-763913219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b91452c8-1bcd-44a9-a92e-684bf260b15a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5372a0ff-89fb-48b9-9dc8-50dcd6dd4944', 'volume_size': 1, 'image_id': '373cb480-3bc4-4821-93e2-442b4e852b80', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '994e8f6963f04af3be3dbae11a73cdfd', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '373cb480-3bc4-4821-93e2-442b4e852b80', 'created_at': datetime.datetime(2022, 1, 22, 20, 50, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 1, 22, 20, 50, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/373cb480-3bc4-4821-93e2-442b4e852b80/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:41:25.912248 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-c3e1d021-da9d-42f6-8234-42f9a233e051 tempest-TestVolumeBootPattern-763913219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f75beb67-a539-4914-b107-d0e2ad934672) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:41:25.988809 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.flows.manager.create_volume [None req-c3e1d021-da9d-42f6-8234-42f9a233e051 tempest-TestVolumeBootPattern-763913219 None] Volume volume-5372a0ff-89fb-48b9-9dc8-50dcd6dd4944 (5372a0ff-89fb-48b9-9dc8-50dcd6dd4944): created successfully Jan 22 21:41:25.992558 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-c3e1d021-da9d-42f6-8234-42f9a233e051 tempest-TestVolumeBootPattern-763913219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f75beb67-a539-4914-b107-d0e2ad934672) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:41:25.998284 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-c3e1d021-da9d-42f6-8234-42f9a233e051 tempest-TestVolumeBootPattern-763913219 None] Flow 'volume_create_manager' (0b233c1a-1a30-4ad2-9c59-79006744fda5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129952) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 22 21:41:26.074511 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-c3e1d021-da9d-42f6-8234-42f9a233e051 tempest-TestVolumeBootPattern-763913219 None] Created volume successfully. Jan 22 21:41:30.249951 ncdv-master-1 cinder-volume[129952]: DEBUG oslo_concurrency.processutils [req-517b2022-0bd7-46c8-b084-f28252f1bf46 req-814a0f90-e1b2-457e-9e42-12eda05889a5 tempest-TestVolumeBootPattern-763913219 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129952) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jan 22 21:41:30.935544 ncdv-master-1 cinder-volume[129952]: DEBUG oslo_concurrency.processutils [req-517b2022-0bd7-46c8-b084-f28252f1bf46 req-814a0f90-e1b2-457e-9e42-12eda05889a5 tempest-TestVolumeBootPattern-763913219 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.685s {{(pid=129952) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jan 22 21:41:30.936401 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [req-517b2022-0bd7-46c8-b084-f28252f1bf46 req-814a0f90-e1b2-457e-9e42-12eda05889a5 tempest-TestVolumeBootPattern-763913219 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-5372a0ff-89fb-48b9-9dc8-50dcd6dd4944', 'hosts': ['10.222.0.100'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'c7ee930a-3b87-450e-91f6-d4eef70cb484', 'volume_id': '5372a0ff-89fb-48b9-9dc8-50dcd6dd4944', 'discard': True}} {{(pid=129952) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Jan 22 21:41:31.051645 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [req-517b2022-0bd7-46c8-b084-f28252f1bf46 req-814a0f90-e1b2-457e-9e42-12eda05889a5 tempest-TestVolumeBootPattern-763913219 None] Connection info returned from driver {'name': 'volumes/volume-5372a0ff-89fb-48b9-9dc8-50dcd6dd4944', 'hosts': ['10.222.0.100'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '5372a0ff-89fb-48b9-9dc8-50dcd6dd4944', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '29b98c29-b8bb-4e67-ae84-783d14c96353'} {{(pid=129952) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4811}} Jan 22 21:41:31.179681 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [req-517b2022-0bd7-46c8-b084-f28252f1bf46 req-814a0f90-e1b2-457e-9e42-12eda05889a5 tempest-TestVolumeBootPattern-763913219 None] attachment_update completed successfully. Jan 22 21:41:43.523583 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [req-47031efb-4d5e-4266-9ab7-fb3f96671a73 req-7baffa8a-144a-482e-bdfc-adf3e53b78f7 tempest-TestVolumeBootPattern-763913219 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:41:45.873913 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [req-47031efb-4d5e-4266-9ab7-fb3f96671a73 req-7baffa8a-144a-482e-bdfc-adf3e53b78f7 tempest-TestVolumeBootPattern-763913219 None] Create snapshot completed successfully Jan 22 21:41:50.761441 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.flows.manager.create_volume [req-e33af1e5-2c72-40bc-99fb-52b1c66c8fc6 req-26d3a418-af84-46cd-8eec-f801db80cae4 tempest-TestVolumeBootPattern-763913219 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129952) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Jan 22 21:41:50.766534 ncdv-master-1 cinder-volume[129952]: WARNING stevedore.named [req-e33af1e5-2c72-40bc-99fb-52b1c66c8fc6 req-26d3a418-af84-46cd-8eec-f801db80cae4 tempest-TestVolumeBootPattern-763913219 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jan 22 21:41:50.771411 ncdv-master-1 cinder-volume[129952]: WARNING castellan.key_manager [req-e33af1e5-2c72-40bc-99fb-52b1c66c8fc6 req-26d3a418-af84-46cd-8eec-f801db80cae4 tempest-TestVolumeBootPattern-763913219 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 22 21:41:50.816637 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [req-e33af1e5-2c72-40bc-99fb-52b1c66c8fc6 req-26d3a418-af84-46cd-8eec-f801db80cae4 tempest-TestVolumeBootPattern-763913219 None] Flow 'volume_create_manager' (495edfea-896d-4a88-b958-ec0a79330ae6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 22 21:41:50.827941 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [req-e33af1e5-2c72-40bc-99fb-52b1c66c8fc6 req-26d3a418-af84-46cd-8eec-f801db80cae4 tempest-TestVolumeBootPattern-763913219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6416a06-bda9-4e93-bb1d-90d51a4b45ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:41:50.844526 ncdv-master-1 cinder-volume[129952]: DEBUG oslo_db.sqlalchemy.engines [req-e33af1e5-2c72-40bc-99fb-52b1c66c8fc6 req-26d3a418-af84-46cd-8eec-f801db80cae4 tempest-TestVolumeBootPattern-763913219 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129952) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 22 21:41:50.865184 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [req-e33af1e5-2c72-40bc-99fb-52b1c66c8fc6 req-26d3a418-af84-46cd-8eec-f801db80cae4 tempest-TestVolumeBootPattern-763913219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6416a06-bda9-4e93-bb1d-90d51a4b45ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=True,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-01-22T21:41:50Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=7ad9814c-ae76-4816-b19d-87eef100880d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61bfb71de54c471193d2c71859a7f051',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-01-22T21:41:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=d45f94a9-6b17-42e9-a7fe-43568a5ee7e5,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-01-22T21:41:51Z,use_quota=True,user_id='29e976f05d60471b9e6fb8290f07ccce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6dacb05b-a7ea-4056-85ff-98f0ea5c54eb),volume_type_id=6dacb05b-a7ea-4056-85ff-98f0ea5c54eb)' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:41:50.872801 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [req-e33af1e5-2c72-40bc-99fb-52b1c66c8fc6 req-26d3a418-af84-46cd-8eec-f801db80cae4 tempest-TestVolumeBootPattern-763913219 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bbe9c73d-acfb-44f3-97ca-fc0bb7adb578) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:41:50.879326 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [req-e33af1e5-2c72-40bc-99fb-52b1c66c8fc6 req-26d3a418-af84-46cd-8eec-f801db80cae4 tempest-TestVolumeBootPattern-763913219 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bbe9c73d-acfb-44f3-97ca-fc0bb7adb578) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:41:50.891786 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [req-e33af1e5-2c72-40bc-99fb-52b1c66c8fc6 req-26d3a418-af84-46cd-8eec-f801db80cae4 tempest-TestVolumeBootPattern-763913219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff4ecdfa-4e94-4bdd-99a2-c5a56ca65401) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:41:50.892482 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [req-e33af1e5-2c72-40bc-99fb-52b1c66c8fc6 req-26d3a418-af84-46cd-8eec-f801db80cae4 tempest-TestVolumeBootPattern-763913219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff4ecdfa-4e94-4bdd-99a2-c5a56ca65401) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '7ad9814c-ae76-4816-b19d-87eef100880d', 'volume_name': 'volume-7ad9814c-ae76-4816-b19d-87eef100880d', 'volume_size': 1, 'snapshot_id': 'd45f94a9-6b17-42e9-a7fe-43568a5ee7e5'}' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:41:50.898797 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [req-e33af1e5-2c72-40bc-99fb-52b1c66c8fc6 req-26d3a418-af84-46cd-8eec-f801db80cae4 tempest-TestVolumeBootPattern-763913219 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f9ba1e8-e006-4c6e-a657-2d92cf7ad807) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:41:50.905156 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [req-e33af1e5-2c72-40bc-99fb-52b1c66c8fc6 req-26d3a418-af84-46cd-8eec-f801db80cae4 tempest-TestVolumeBootPattern-763913219 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f9ba1e8-e006-4c6e-a657-2d92cf7ad807) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:41:50.912054 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [req-e33af1e5-2c72-40bc-99fb-52b1c66c8fc6 req-26d3a418-af84-46cd-8eec-f801db80cae4 tempest-TestVolumeBootPattern-763913219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e01c105-a09e-4b46-9ec4-1f00e762e3b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:41:50.914603 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.flows.manager.create_volume [req-e33af1e5-2c72-40bc-99fb-52b1c66c8fc6 req-26d3a418-af84-46cd-8eec-f801db80cae4 tempest-TestVolumeBootPattern-763913219 None] Volume 7ad9814c-ae76-4816-b19d-87eef100880d: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-7ad9814c-ae76-4816-b19d-87eef100880d', 'volume_size': 1, 'snapshot_id': 'd45f94a9-6b17-42e9-a7fe-43568a5ee7e5'} Jan 22 21:41:50.955666 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [req-e33af1e5-2c72-40bc-99fb-52b1c66c8fc6 req-26d3a418-af84-46cd-8eec-f801db80cae4 tempest-TestVolumeBootPattern-763913219 None] cloning volumes/volume-5372a0ff-89fb-48b9-9dc8-50dcd6dd4944@snapshot-d45f94a9-6b17-42e9-a7fe-43568a5ee7e5 to volume-7ad9814c-ae76-4816-b19d-87eef100880d {{(pid=129952) _clone /opt/stack/cinder/cinder/volume/drivers/rbd.py:1028}} Jan 22 21:41:50.957558 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [req-e33af1e5-2c72-40bc-99fb-52b1c66c8fc6 req-26d3a418-af84-46cd-8eec-f801db80cae4 tempest-TestVolumeBootPattern-763913219 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:41:51.075127 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [req-e33af1e5-2c72-40bc-99fb-52b1c66c8fc6 req-26d3a418-af84-46cd-8eec-f801db80cae4 tempest-TestVolumeBootPattern-763913219 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:41:53.226162 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [req-e33af1e5-2c72-40bc-99fb-52b1c66c8fc6 req-26d3a418-af84-46cd-8eec-f801db80cae4 tempest-TestVolumeBootPattern-763913219 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129952) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 22 21:41:53.226955 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [req-e33af1e5-2c72-40bc-99fb-52b1c66c8fc6 req-26d3a418-af84-46cd-8eec-f801db80cae4 tempest-TestVolumeBootPattern-763913219 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129952) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 22 21:41:53.258202 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.volume_utils [req-e33af1e5-2c72-40bc-99fb-52b1c66c8fc6 req-26d3a418-af84-46cd-8eec-f801db80cae4 tempest-TestVolumeBootPattern-763913219 None] Marking volume 7ad9814c-ae76-4816-b19d-87eef100880d as bootable. {{(pid=129952) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1178}} Jan 22 21:41:53.319560 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.flows.manager.create_volume [req-e33af1e5-2c72-40bc-99fb-52b1c66c8fc6 req-26d3a418-af84-46cd-8eec-f801db80cae4 tempest-TestVolumeBootPattern-763913219 None] Copying metadata from snapshot d45f94a9-6b17-42e9-a7fe-43568a5ee7e5 to 7ad9814c-ae76-4816-b19d-87eef100880d. {{(pid=129952) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:422}} Jan 22 21:41:53.435907 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [req-e33af1e5-2c72-40bc-99fb-52b1c66c8fc6 req-26d3a418-af84-46cd-8eec-f801db80cae4 tempest-TestVolumeBootPattern-763913219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e01c105-a09e-4b46-9ec4-1f00e762e3b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7ad9814c-ae76-4816-b19d-87eef100880d', 'volume_size': 1, 'snapshot_id': 'd45f94a9-6b17-42e9-a7fe-43568a5ee7e5'}' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:41:53.441071 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [req-e33af1e5-2c72-40bc-99fb-52b1c66c8fc6 req-26d3a418-af84-46cd-8eec-f801db80cae4 tempest-TestVolumeBootPattern-763913219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b7ba0c4-d6c9-439d-ad3c-691bb98e6f5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:41:53.513815 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.flows.manager.create_volume [req-e33af1e5-2c72-40bc-99fb-52b1c66c8fc6 req-26d3a418-af84-46cd-8eec-f801db80cae4 tempest-TestVolumeBootPattern-763913219 None] Volume volume-7ad9814c-ae76-4816-b19d-87eef100880d (7ad9814c-ae76-4816-b19d-87eef100880d): created successfully Jan 22 21:41:53.518072 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [req-e33af1e5-2c72-40bc-99fb-52b1c66c8fc6 req-26d3a418-af84-46cd-8eec-f801db80cae4 tempest-TestVolumeBootPattern-763913219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b7ba0c4-d6c9-439d-ad3c-691bb98e6f5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:41:53.524463 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [req-e33af1e5-2c72-40bc-99fb-52b1c66c8fc6 req-26d3a418-af84-46cd-8eec-f801db80cae4 tempest-TestVolumeBootPattern-763913219 None] Flow 'volume_create_manager' (495edfea-896d-4a88-b958-ec0a79330ae6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129952) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 22 21:41:53.593710 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [req-e33af1e5-2c72-40bc-99fb-52b1c66c8fc6 req-26d3a418-af84-46cd-8eec-f801db80cae4 tempest-TestVolumeBootPattern-763913219 None] Created volume successfully. Jan 22 21:41:54.190401 ncdv-master-1 cinder-volume[129952]: DEBUG oslo_concurrency.processutils [req-e33af1e5-2c72-40bc-99fb-52b1c66c8fc6 req-0a82704a-ca39-4b1b-a09b-8b1cd483c315 tempest-TestVolumeBootPattern-763913219 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129952) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jan 22 21:41:54.863441 ncdv-master-1 cinder-volume[129952]: DEBUG oslo_concurrency.processutils [req-e33af1e5-2c72-40bc-99fb-52b1c66c8fc6 req-0a82704a-ca39-4b1b-a09b-8b1cd483c315 tempest-TestVolumeBootPattern-763913219 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.674s {{(pid=129952) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jan 22 21:41:54.865148 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [req-e33af1e5-2c72-40bc-99fb-52b1c66c8fc6 req-0a82704a-ca39-4b1b-a09b-8b1cd483c315 tempest-TestVolumeBootPattern-763913219 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-7ad9814c-ae76-4816-b19d-87eef100880d', 'hosts': ['10.222.0.100'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'c7ee930a-3b87-450e-91f6-d4eef70cb484', 'volume_id': '7ad9814c-ae76-4816-b19d-87eef100880d', 'discard': True}} {{(pid=129952) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Jan 22 21:41:54.954059 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [req-e33af1e5-2c72-40bc-99fb-52b1c66c8fc6 req-0a82704a-ca39-4b1b-a09b-8b1cd483c315 tempest-TestVolumeBootPattern-763913219 None] Connection info returned from driver {'name': 'volumes/volume-7ad9814c-ae76-4816-b19d-87eef100880d', 'hosts': ['10.222.0.100'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '7ad9814c-ae76-4816-b19d-87eef100880d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'ada9df52-a2e0-47a1-a6cb-80ba5b41512b'} {{(pid=129952) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4811}} Jan 22 21:41:55.086433 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [req-e33af1e5-2c72-40bc-99fb-52b1c66c8fc6 req-0a82704a-ca39-4b1b-a09b-8b1cd483c315 tempest-TestVolumeBootPattern-763913219 None] attachment_update completed successfully. Jan 22 21:42:05.340322 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-1948244e-106f-456e-b25d-d18f0f60df68 tempest-GroupsV314Test-837858608 None] Group tempest-GroupsV314Test-Group-2103915867: creating Jan 22 21:42:05.472489 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-1948244e-106f-456e-b25d-d18f0f60df68 tempest-GroupsV314Test-837858608 None] Group tempest-GroupsV314Test-Group-2103915867: created successfully Jan 22 21:42:05.481789 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-1948244e-106f-456e-b25d-d18f0f60df68 tempest-GroupsV314Test-837858608 None] Create group completed successfully. Jan 22 21:42:06.701711 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [req-a2817699-3e30-4a98-8fdc-ea1dca3b1bff req-79eea425-9872-4c73-859b-a9e59631e640 tempest-TestVolumeBootPattern-763913219 None] Terminate volume connection completed successfully. Jan 22 21:42:06.701711 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [req-a2817699-3e30-4a98-8fdc-ea1dca3b1bff req-79eea425-9872-4c73-859b-a9e59631e640 tempest-TestVolumeBootPattern-763913219 None] Deleting attachment ada9df52-a2e0-47a1-a6cb-80ba5b41512b. {{(pid=129952) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4947}} Jan 22 21:42:07.119041 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.coordination [req-a2817699-3e30-4a98-8fdc-ea1dca3b1bff req-451d22f9-8c62-4f2e-9e09-19d865b56941 tempest-TestVolumeBootPattern-763913219 None] Lock "b'cinder-7ad9814c-ae76-4816-b19d-87eef100880d-delete_volume'" acquired by "delete_volume" :: waited 0.011s {{(pid=129952) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 22 21:42:07.229332 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [req-a2817699-3e30-4a98-8fdc-ea1dca3b1bff req-451d22f9-8c62-4f2e-9e09-19d865b56941 tempest-TestVolumeBootPattern-763913219 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:42:08.194454 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [req-a2817699-3e30-4a98-8fdc-ea1dca3b1bff req-451d22f9-8c62-4f2e-9e09-19d865b56941 tempest-TestVolumeBootPattern-763913219 None] volume has no backup snaps {{(pid=129952) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Jan 22 21:42:08.556118 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [req-a2817699-3e30-4a98-8fdc-ea1dca3b1bff req-451d22f9-8c62-4f2e-9e09-19d865b56941 tempest-TestVolumeBootPattern-763913219 None] deleting rbd volume volume-7ad9814c-ae76-4816-b19d-87eef100880d {{(pid=129952) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Jan 22 21:42:08.618147 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.flows.manager.create_volume [None req-5e14f5e8-4b34-4a5d-ae46-d6dba486a306 tempest-GroupsV314Test-837858608 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129952) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Jan 22 21:42:08.621886 ncdv-master-1 cinder-volume[129952]: WARNING stevedore.named [None req-5e14f5e8-4b34-4a5d-ae46-d6dba486a306 tempest-GroupsV314Test-837858608 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jan 22 21:42:08.623714 ncdv-master-1 cinder-volume[129952]: WARNING castellan.key_manager [None req-5e14f5e8-4b34-4a5d-ae46-d6dba486a306 tempest-GroupsV314Test-837858608 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 22 21:42:08.642218 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-5e14f5e8-4b34-4a5d-ae46-d6dba486a306 tempest-GroupsV314Test-837858608 None] Flow 'volume_create_manager' (5d0eba1b-a683-45e4-b2c1-675aa6ffe1a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 22 21:42:08.649452 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-5e14f5e8-4b34-4a5d-ae46-d6dba486a306 tempest-GroupsV314Test-837858608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4be26cff-16dc-4e8a-abc5-7232c414fada) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:42:08.657795 ncdv-master-1 cinder-volume[129952]: DEBUG oslo_db.sqlalchemy.engines [None req-5e14f5e8-4b34-4a5d-ae46-d6dba486a306 tempest-GroupsV314Test-837858608 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129952) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 22 21:42:08.679147 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-5e14f5e8-4b34-4a5d-ae46-d6dba486a306 tempest-GroupsV314Test-837858608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4be26cff-16dc-4e8a-abc5-7232c414fada) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-01-22T21:42:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-GroupsV314Test-Volume-1015112629',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=a234ed39-98ae-4780-bd49-07fbb6f5aca9,host='ncdv-master-1@ceph#ceph',id=61b0ab78-6a21-4666-a3f7-ce44f65442de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12f50f98599a48bea6c88ccac37b8c44',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-01-22T21:42:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-01-22T21:42:07Z,use_quota=True,user_id='7ab8aa5569244f4c929cfd33cd6e84d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d1a2dd2-52aa-42df-a1e9-d4b43715c07f),volume_type_id=7d1a2dd2-52aa-42df-a1e9-d4b43715c07f)' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:42:08.684763 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-5e14f5e8-4b34-4a5d-ae46-d6dba486a306 tempest-GroupsV314Test-837858608 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5187d14-5a29-43fc-adc7-853313924b1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:42:08.689047 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-5e14f5e8-4b34-4a5d-ae46-d6dba486a306 tempest-GroupsV314Test-837858608 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5187d14-5a29-43fc-adc7-853313924b1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:42:08.694414 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-5e14f5e8-4b34-4a5d-ae46-d6dba486a306 tempest-GroupsV314Test-837858608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3be0e6b-70ee-42a9-aaf3-d5e84d8659c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:42:08.698730 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-5e14f5e8-4b34-4a5d-ae46-d6dba486a306 tempest-GroupsV314Test-837858608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3be0e6b-70ee-42a9-aaf3-d5e84d8659c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '61b0ab78-6a21-4666-a3f7-ce44f65442de', 'volume_name': 'volume-61b0ab78-6a21-4666-a3f7-ce44f65442de', 'volume_size': 1}' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:42:08.703803 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-5e14f5e8-4b34-4a5d-ae46-d6dba486a306 tempest-GroupsV314Test-837858608 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4704584f-b909-49e7-a205-8b4419c860f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:42:08.708545 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-5e14f5e8-4b34-4a5d-ae46-d6dba486a306 tempest-GroupsV314Test-837858608 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4704584f-b909-49e7-a205-8b4419c860f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:42:08.713463 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-5e14f5e8-4b34-4a5d-ae46-d6dba486a306 tempest-GroupsV314Test-837858608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6220c31e-6a68-4510-954d-fa0ea9ed4fd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:42:08.714656 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.flows.manager.create_volume [None req-5e14f5e8-4b34-4a5d-ae46-d6dba486a306 tempest-GroupsV314Test-837858608 None] Volume 61b0ab78-6a21-4666-a3f7-ce44f65442de: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-61b0ab78-6a21-4666-a3f7-ce44f65442de', 'volume_size': 1} Jan 22 21:42:08.715063 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-5e14f5e8-4b34-4a5d-ae46-d6dba486a306 tempest-GroupsV314Test-837858608 None] creating volume 'volume-61b0ab78-6a21-4666-a3f7-ce44f65442de' {{(pid=129952) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Jan 22 21:42:08.716060 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-5e14f5e8-4b34-4a5d-ae46-d6dba486a306 tempest-GroupsV314Test-837858608 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:42:09.492914 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-5e14f5e8-4b34-4a5d-ae46-d6dba486a306 tempest-GroupsV314Test-837858608 None] extra_specs: {} {{(pid=129952) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 22 21:42:09.493565 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-5e14f5e8-4b34-4a5d-ae46-d6dba486a306 tempest-GroupsV314Test-837858608 None] extra_specs: {} {{(pid=129952) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 22 21:42:09.497081 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-5e14f5e8-4b34-4a5d-ae46-d6dba486a306 tempest-GroupsV314Test-837858608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6220c31e-6a68-4510-954d-fa0ea9ed4fd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-61b0ab78-6a21-4666-a3f7-ce44f65442de', 'volume_size': 1}' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:42:09.501839 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-5e14f5e8-4b34-4a5d-ae46-d6dba486a306 tempest-GroupsV314Test-837858608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7de2f9ce-dc3f-48bc-ba6f-60197714c6bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:42:09.569253 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.flows.manager.create_volume [None req-5e14f5e8-4b34-4a5d-ae46-d6dba486a306 tempest-GroupsV314Test-837858608 None] Volume volume-61b0ab78-6a21-4666-a3f7-ce44f65442de (61b0ab78-6a21-4666-a3f7-ce44f65442de): created successfully Jan 22 21:42:09.572962 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-5e14f5e8-4b34-4a5d-ae46-d6dba486a306 tempest-GroupsV314Test-837858608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7de2f9ce-dc3f-48bc-ba6f-60197714c6bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:42:09.578506 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-5e14f5e8-4b34-4a5d-ae46-d6dba486a306 tempest-GroupsV314Test-837858608 None] Flow 'volume_create_manager' (5d0eba1b-a683-45e4-b2c1-675aa6ffe1a2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129952) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 22 21:42:09.661186 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-5e14f5e8-4b34-4a5d-ae46-d6dba486a306 tempest-GroupsV314Test-837858608 None] Created volume successfully. Jan 22 21:42:11.317730 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-49a4cd82-ca1e-436d-88c6-3d8e4277fd2c tempest-GroupsV314Test-837858608 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:42:11.677868 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-49a4cd82-ca1e-436d-88c6-3d8e4277fd2c tempest-GroupsV314Test-837858608 None] creating snapshot='volume-04f400fd-9d80-4db1-89f6-61274e3da3b8.clone_snap' {{(pid=129952) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:725}} Jan 22 21:42:14.051229 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-49a4cd82-ca1e-436d-88c6-3d8e4277fd2c tempest-GroupsV314Test-837858608 None] cloning 'volume-61b0ab78-6a21-4666-a3f7-ce44f65442de@volume-04f400fd-9d80-4db1-89f6-61274e3da3b8.clone_snap' to 'volume-04f400fd-9d80-4db1-89f6-61274e3da3b8' {{(pid=129952) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:731}} Jan 22 21:42:15.731200 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.quota [req-a2817699-3e30-4a98-8fdc-ea1dca3b1bff req-451d22f9-8c62-4f2e-9e09-19d865b56941 tempest-TestVolumeBootPattern-763913219 None] Created reservations ['67dbe9e0-febf-411f-b72d-82346d98bfa7', 'eb3a5099-f1b8-408f-a9b0-736874bc01d8', '8a6317e7-1f1c-490e-bf62-32609a68fcda', 'f0e79a72-b3e3-4eb9-a910-9fc59938b5d7'] {{(pid=129952) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 22 21:42:15.885330 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [req-a2817699-3e30-4a98-8fdc-ea1dca3b1bff req-451d22f9-8c62-4f2e-9e09-19d865b56941 tempest-TestVolumeBootPattern-763913219 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:42:15.907678 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [req-a2817699-3e30-4a98-8fdc-ea1dca3b1bff req-451d22f9-8c62-4f2e-9e09-19d865b56941 tempest-TestVolumeBootPattern-763913219 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:42:15.931487 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.manager [req-a2817699-3e30-4a98-8fdc-ea1dca3b1bff req-451d22f9-8c62-4f2e-9e09-19d865b56941 tempest-TestVolumeBootPattern-763913219 None] Notifying Schedulers of capabilities ... {{(pid=129952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 22 21:42:15.935533 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [req-a2817699-3e30-4a98-8fdc-ea1dca3b1bff req-451d22f9-8c62-4f2e-9e09-19d865b56941 tempest-TestVolumeBootPattern-763913219 None] Deleted volume successfully. Jan 22 21:42:16.019312 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.coordination [req-a2817699-3e30-4a98-8fdc-ea1dca3b1bff req-451d22f9-8c62-4f2e-9e09-19d865b56941 tempest-TestVolumeBootPattern-763913219 None] Lock "b'cinder-7ad9814c-ae76-4816-b19d-87eef100880d-delete_volume'" released by "delete_volume" :: held 8.900s {{(pid=129952) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 22 21:42:16.097897 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-49a4cd82-ca1e-436d-88c6-3d8e4277fd2c tempest-GroupsV314Test-837858608 None] Volume volume-61b0ab78-6a21-4666-a3f7-ce44f65442de is not a clone. {{(pid=129952) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Jan 22 21:42:16.103808 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-49a4cd82-ca1e-436d-88c6-3d8e4277fd2c tempest-GroupsV314Test-837858608 None] extra_specs: {} {{(pid=129952) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 22 21:42:16.104195 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-49a4cd82-ca1e-436d-88c6-3d8e4277fd2c tempest-GroupsV314Test-837858608 None] extra_specs: {} {{(pid=129952) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 22 21:42:16.922923 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-49a4cd82-ca1e-436d-88c6-3d8e4277fd2c tempest-GroupsV314Test-837858608 None] clone created successfully {{(pid=129952) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:803}} Jan 22 21:42:16.928593 ncdv-master-1 cinder-volume[129952]: DEBUG oslo_service.periodic_task [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129952) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jan 22 21:42:16.929324 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:42:16.954111 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:42:16.976862 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.manager [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] Notifying Schedulers of capabilities ... {{(pid=129952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 22 21:42:16.996323 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.coordination [None req-ae95169c-ffbd-40af-b23c-891639b734d0 tempest-TestVolumeBootPattern-763913219 None] Lock "b'cinder-d45f94a9-6b17-42e9-a7fe-43568a5ee7e5-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.011s {{(pid=129952) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 22 21:42:16.997950 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-ae95169c-ffbd-40af-b23c-891639b734d0 tempest-TestVolumeBootPattern-763913219 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:42:17.438351 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-49a4cd82-ca1e-436d-88c6-3d8e4277fd2c tempest-GroupsV314Test-837858608 None] Create group from source-group-a234ed39-98ae-4780-bd49-07fbb6f5aca9 completed successfully. Jan 22 21:42:18.452366 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-d70bc828-6b6f-430e-ae23-dd82abb8e2fe tempest-GroupsV314Test-837858608 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:42:19.147246 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-d70bc828-6b6f-430e-ae23-dd82abb8e2fe tempest-GroupsV314Test-837858608 None] volume has no backup snaps {{(pid=129952) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Jan 22 21:42:19.519670 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-d70bc828-6b6f-430e-ae23-dd82abb8e2fe tempest-GroupsV314Test-837858608 None] deleting rbd volume volume-04f400fd-9d80-4db1-89f6-61274e3da3b8 {{(pid=129952) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Jan 22 21:42:24.187915 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-d70bc828-6b6f-430e-ae23-dd82abb8e2fe tempest-GroupsV314Test-837858608 None] volume is a clone so cleaning references {{(pid=129952) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1266}} Jan 22 21:42:24.393151 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-d70bc828-6b6f-430e-ae23-dd82abb8e2fe tempest-GroupsV314Test-837858608 None] Volume volume-61b0ab78-6a21-4666-a3f7-ce44f65442de is not a clone. {{(pid=129952) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Jan 22 21:42:24.393808 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-d70bc828-6b6f-430e-ae23-dd82abb8e2fe tempest-GroupsV314Test-837858608 None] deleting parent snapshot volume-04f400fd-9d80-4db1-89f6-61274e3da3b8.clone_snap {{(pid=129952) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1158}} Jan 22 21:42:28.546884 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.quota [None req-d70bc828-6b6f-430e-ae23-dd82abb8e2fe tempest-GroupsV314Test-837858608 None] Created reservations ['c627a0d0-b10b-4fb4-9598-00e981e9a154'] {{(pid=129952) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 22 21:42:28.563459 ncdv-master-1 cinder-volume[129952]: WARNING cinder.quota [None req-d70bc828-6b6f-430e-ae23-dd82abb8e2fe tempest-GroupsV314Test-837858608 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-61258105 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-61258105, it is now deprecated. Please use the default quota class for default quota. Jan 22 21:42:28.564437 ncdv-master-1 cinder-volume[129952]: WARNING cinder.quota [None req-d70bc828-6b6f-430e-ae23-dd82abb8e2fe tempest-GroupsV314Test-837858608 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-61258105 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-61258105, it is now deprecated. Please use the default quota class for default quota. Jan 22 21:42:28.649645 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.quota [None req-d70bc828-6b6f-430e-ae23-dd82abb8e2fe tempest-GroupsV314Test-837858608 None] Created reservations ['27778035-1661-42e6-be94-a427949df04c', '43be28ce-99a8-4787-baa3-3f4c57b3f670', '750e6d80-f628-4f15-90db-389a0176e649', '3955fe1b-d535-4df2-ab39-86e7d297c0f3'] {{(pid=129952) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 22 21:42:28.995465 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-d70bc828-6b6f-430e-ae23-dd82abb8e2fe tempest-GroupsV314Test-837858608 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:42:29.017281 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-d70bc828-6b6f-430e-ae23-dd82abb8e2fe tempest-GroupsV314Test-837858608 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:42:29.041818 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.manager [None req-d70bc828-6b6f-430e-ae23-dd82abb8e2fe tempest-GroupsV314Test-837858608 None] Notifying Schedulers of capabilities ... {{(pid=129952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 22 21:42:29.046920 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-d70bc828-6b6f-430e-ae23-dd82abb8e2fe tempest-GroupsV314Test-837858608 None] Delete group completed successfully. Jan 22 21:42:29.460819 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-ec4969cd-c0fa-4934-afac-295451d2d6f9 tempest-GroupsV314Test-837858608 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:42:29.729293 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-ec4969cd-c0fa-4934-afac-295451d2d6f9 tempest-GroupsV314Test-837858608 None] volume has no backup snaps {{(pid=129952) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Jan 22 21:42:29.729938 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-ec4969cd-c0fa-4934-afac-295451d2d6f9 tempest-GroupsV314Test-837858608 None] Volume volume-61b0ab78-6a21-4666-a3f7-ce44f65442de is not a clone. {{(pid=129952) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Jan 22 21:42:29.930192 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-ec4969cd-c0fa-4934-afac-295451d2d6f9 tempest-GroupsV314Test-837858608 None] deleting rbd volume volume-61b0ab78-6a21-4666-a3f7-ce44f65442de {{(pid=129952) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Jan 22 21:42:35.958035 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.quota [None req-ec4969cd-c0fa-4934-afac-295451d2d6f9 tempest-GroupsV314Test-837858608 None] Created reservations ['16f0617c-75e6-4cc8-94fc-9dbefe0d34fb'] {{(pid=129952) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 22 21:42:36.037973 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.quota [None req-ec4969cd-c0fa-4934-afac-295451d2d6f9 tempest-GroupsV314Test-837858608 None] Created reservations ['f62990b7-1b77-4d4b-8a9c-bccd36ad9588', '617fee85-837b-4561-ac0a-5b1d12ef6659', '6327af26-3b28-418c-97b8-56ddbaff65bd', '48ace66c-cb6c-4fa6-8b69-2cca71352dab'] {{(pid=129952) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 22 21:42:36.294813 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-ec4969cd-c0fa-4934-afac-295451d2d6f9 tempest-GroupsV314Test-837858608 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:42:36.316327 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-ec4969cd-c0fa-4934-afac-295451d2d6f9 tempest-GroupsV314Test-837858608 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:42:36.340923 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.manager [None req-ec4969cd-c0fa-4934-afac-295451d2d6f9 tempest-GroupsV314Test-837858608 None] Notifying Schedulers of capabilities ... {{(pid=129952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 22 21:42:36.346802 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-ec4969cd-c0fa-4934-afac-295451d2d6f9 tempest-GroupsV314Test-837858608 None] Delete group completed successfully. Jan 22 21:42:48.523406 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.quota [None req-ae95169c-ffbd-40af-b23c-891639b734d0 tempest-TestVolumeBootPattern-763913219 None] Created reservations ['ecdf3265-c87d-4424-897d-4d0b74d4cbb5', '2c01aa09-16a7-4252-841c-8bce41ae7086', 'e59b55a6-4722-404b-99ce-71d187829911', '5fc7df92-b2dc-4302-a274-ff50fb0fae1f'] {{(pid=129952) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 22 21:42:48.758023 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-ae95169c-ffbd-40af-b23c-891639b734d0 tempest-TestVolumeBootPattern-763913219 None] Delete snapshot completed successfully. Jan 22 21:42:48.763067 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.coordination [None req-ae95169c-ffbd-40af-b23c-891639b734d0 tempest-TestVolumeBootPattern-763913219 None] Lock "b'cinder-d45f94a9-6b17-42e9-a7fe-43568a5ee7e5-delete_snapshot'" released by "delete_snapshot" :: held 31.767s {{(pid=129952) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 22 21:42:49.624372 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.flows.manager.create_volume [None req-83ed65e9-5143-457e-8a4c-6adae7a366d7 tempest-SnapshotMetadataTestJSON-1598969011 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129952) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Jan 22 21:42:49.627745 ncdv-master-1 cinder-volume[129952]: WARNING stevedore.named [None req-83ed65e9-5143-457e-8a4c-6adae7a366d7 tempest-SnapshotMetadataTestJSON-1598969011 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jan 22 21:42:49.636080 ncdv-master-1 cinder-volume[129952]: WARNING castellan.key_manager [None req-83ed65e9-5143-457e-8a4c-6adae7a366d7 tempest-SnapshotMetadataTestJSON-1598969011 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 22 21:42:49.648242 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-83ed65e9-5143-457e-8a4c-6adae7a366d7 tempest-SnapshotMetadataTestJSON-1598969011 None] Flow 'volume_create_manager' (3ccff770-9fc3-4a28-837e-77c8b5808bbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 22 21:42:49.656504 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-83ed65e9-5143-457e-8a4c-6adae7a366d7 tempest-SnapshotMetadataTestJSON-1598969011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7cc4827f-a50b-463c-acb1-a1c713961b8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:42:49.663827 ncdv-master-1 cinder-volume[129952]: DEBUG oslo_db.sqlalchemy.engines [None req-83ed65e9-5143-457e-8a4c-6adae7a366d7 tempest-SnapshotMetadataTestJSON-1598969011 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129952) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 22 21:42:49.678088 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-83ed65e9-5143-457e-8a4c-6adae7a366d7 tempest-SnapshotMetadataTestJSON-1598969011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7cc4827f-a50b-463c-acb1-a1c713961b8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-01-22T21:42:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1386814375',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=24c37a66-7d89-4ebd-be89-e2b761e04f19,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='895794e222b74533bea852b73a3f09d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-01-22T21:42:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-01-22T21:42:49Z,use_quota=True,user_id='fb456005b3c84b81b8ea1084bf780d2f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6dacb05b-a7ea-4056-85ff-98f0ea5c54eb),volume_type_id=6dacb05b-a7ea-4056-85ff-98f0ea5c54eb)' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:42:49.684239 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-83ed65e9-5143-457e-8a4c-6adae7a366d7 tempest-SnapshotMetadataTestJSON-1598969011 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5daa38ab-829a-4b0c-9b3a-afd92b2ce6b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:42:49.688661 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-83ed65e9-5143-457e-8a4c-6adae7a366d7 tempest-SnapshotMetadataTestJSON-1598969011 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5daa38ab-829a-4b0c-9b3a-afd92b2ce6b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:42:49.694028 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-83ed65e9-5143-457e-8a4c-6adae7a366d7 tempest-SnapshotMetadataTestJSON-1598969011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (759ebf3f-14de-4447-8931-5babba13024d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:42:49.699165 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-83ed65e9-5143-457e-8a4c-6adae7a366d7 tempest-SnapshotMetadataTestJSON-1598969011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (759ebf3f-14de-4447-8931-5babba13024d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '24c37a66-7d89-4ebd-be89-e2b761e04f19', 'volume_name': 'volume-24c37a66-7d89-4ebd-be89-e2b761e04f19', 'volume_size': 1}' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:42:49.704304 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-83ed65e9-5143-457e-8a4c-6adae7a366d7 tempest-SnapshotMetadataTestJSON-1598969011 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4975cffd-d1e3-492c-b6f6-d810ef1f4cf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:42:49.708914 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-83ed65e9-5143-457e-8a4c-6adae7a366d7 tempest-SnapshotMetadataTestJSON-1598969011 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4975cffd-d1e3-492c-b6f6-d810ef1f4cf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:42:49.713876 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-83ed65e9-5143-457e-8a4c-6adae7a366d7 tempest-SnapshotMetadataTestJSON-1598969011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (975aa5f8-0318-4022-8caf-e892f0785eeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:42:49.715003 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.flows.manager.create_volume [None req-83ed65e9-5143-457e-8a4c-6adae7a366d7 tempest-SnapshotMetadataTestJSON-1598969011 None] Volume 24c37a66-7d89-4ebd-be89-e2b761e04f19: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-24c37a66-7d89-4ebd-be89-e2b761e04f19', 'volume_size': 1} Jan 22 21:42:49.715402 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-83ed65e9-5143-457e-8a4c-6adae7a366d7 tempest-SnapshotMetadataTestJSON-1598969011 None] creating volume 'volume-24c37a66-7d89-4ebd-be89-e2b761e04f19' {{(pid=129952) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Jan 22 21:42:49.716399 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-83ed65e9-5143-457e-8a4c-6adae7a366d7 tempest-SnapshotMetadataTestJSON-1598969011 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:42:50.503648 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-83ed65e9-5143-457e-8a4c-6adae7a366d7 tempest-SnapshotMetadataTestJSON-1598969011 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129952) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 22 21:42:50.504038 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-83ed65e9-5143-457e-8a4c-6adae7a366d7 tempest-SnapshotMetadataTestJSON-1598969011 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129952) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 22 21:42:50.507881 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-83ed65e9-5143-457e-8a4c-6adae7a366d7 tempest-SnapshotMetadataTestJSON-1598969011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (975aa5f8-0318-4022-8caf-e892f0785eeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-24c37a66-7d89-4ebd-be89-e2b761e04f19', 'volume_size': 1}' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:42:50.515590 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-83ed65e9-5143-457e-8a4c-6adae7a366d7 tempest-SnapshotMetadataTestJSON-1598969011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc8fe01d-7879-433e-b350-6a3737b48289) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:42:50.614916 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.flows.manager.create_volume [None req-83ed65e9-5143-457e-8a4c-6adae7a366d7 tempest-SnapshotMetadataTestJSON-1598969011 None] Volume volume-24c37a66-7d89-4ebd-be89-e2b761e04f19 (24c37a66-7d89-4ebd-be89-e2b761e04f19): created successfully Jan 22 21:42:50.618633 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-83ed65e9-5143-457e-8a4c-6adae7a366d7 tempest-SnapshotMetadataTestJSON-1598969011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc8fe01d-7879-433e-b350-6a3737b48289) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:42:50.624894 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-83ed65e9-5143-457e-8a4c-6adae7a366d7 tempest-SnapshotMetadataTestJSON-1598969011 None] Flow 'volume_create_manager' (3ccff770-9fc3-4a28-837e-77c8b5808bbc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129952) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 22 21:42:50.723251 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-83ed65e9-5143-457e-8a4c-6adae7a366d7 tempest-SnapshotMetadataTestJSON-1598969011 None] Created volume successfully. Jan 22 21:42:51.935070 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-fcf21927-b64e-4aff-b4f0-b10b6401e7fa tempest-SnapshotMetadataTestJSON-1598969011 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:42:52.130762 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [req-b0e5a6d6-cf69-4b11-bbed-561574a18374 req-01e3d669-cdb6-4215-8fe3-53146e87bb07 tempest-TestVolumeBootPattern-763913219 None] Terminate volume connection completed successfully. Jan 22 21:42:52.131105 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [req-b0e5a6d6-cf69-4b11-bbed-561574a18374 req-01e3d669-cdb6-4215-8fe3-53146e87bb07 tempest-TestVolumeBootPattern-763913219 None] Deleting attachment 29b98c29-b8bb-4e67-ae84-783d14c96353. {{(pid=129952) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4947}} Jan 22 21:42:52.437670 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.coordination [req-b0e5a6d6-cf69-4b11-bbed-561574a18374 req-5d5dedcc-3fb0-407e-8a46-e33bfd5f6d07 tempest-TestVolumeBootPattern-763913219 None] Lock "b'cinder-5372a0ff-89fb-48b9-9dc8-50dcd6dd4944-delete_volume'" acquired by "delete_volume" :: waited 0.009s {{(pid=129952) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 22 21:42:52.501271 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [req-b0e5a6d6-cf69-4b11-bbed-561574a18374 req-5d5dedcc-3fb0-407e-8a46-e33bfd5f6d07 tempest-TestVolumeBootPattern-763913219 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:42:52.637436 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [req-b0e5a6d6-cf69-4b11-bbed-561574a18374 req-5d5dedcc-3fb0-407e-8a46-e33bfd5f6d07 tempest-TestVolumeBootPattern-763913219 None] volume has no backup snaps {{(pid=129952) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Jan 22 21:42:52.782624 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [req-b0e5a6d6-cf69-4b11-bbed-561574a18374 req-5d5dedcc-3fb0-407e-8a46-e33bfd5f6d07 tempest-TestVolumeBootPattern-763913219 None] deleting rbd volume volume-5372a0ff-89fb-48b9-9dc8-50dcd6dd4944 {{(pid=129952) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Jan 22 21:42:55.071721 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-fcf21927-b64e-4aff-b4f0-b10b6401e7fa tempest-SnapshotMetadataTestJSON-1598969011 None] Create snapshot completed successfully Jan 22 21:42:57.078833 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [req-b0e5a6d6-cf69-4b11-bbed-561574a18374 req-5d5dedcc-3fb0-407e-8a46-e33bfd5f6d07 tempest-TestVolumeBootPattern-763913219 None] volume is a clone so cleaning references {{(pid=129952) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1266}} Jan 22 21:42:57.204646 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [req-b0e5a6d6-cf69-4b11-bbed-561574a18374 req-5d5dedcc-3fb0-407e-8a46-e33bfd5f6d07 tempest-TestVolumeBootPattern-763913219 None] deleting parent snapshot volume-5372a0ff-89fb-48b9-9dc8-50dcd6dd4944.clone_snap {{(pid=129952) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1158}} Jan 22 21:42:59.095940 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.coordination [None req-12fafb7e-897c-4add-8a41-2def4c493c09 tempest-SnapshotMetadataTestJSON-1598969011 None] Lock "b'cinder-f350d58b-7492-4929-9572-d9983fb2abb6-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.014s {{(pid=129952) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 22 21:42:59.097278 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-12fafb7e-897c-4add-8a41-2def4c493c09 tempest-SnapshotMetadataTestJSON-1598969011 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:42:59.266476 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.quota [req-b0e5a6d6-cf69-4b11-bbed-561574a18374 req-5d5dedcc-3fb0-407e-8a46-e33bfd5f6d07 tempest-TestVolumeBootPattern-763913219 None] Created reservations ['132adad8-f49f-45d2-818d-6fdabea21ac3', 'ddea2f15-4843-4187-9b42-1619604d3fd1', '03e9ec19-7c4b-47a6-9c8e-1d364ad9c9fc', '29f93b27-9884-4d81-a46c-40c9f3534ab0'] {{(pid=129952) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 22 21:42:59.505676 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [req-b0e5a6d6-cf69-4b11-bbed-561574a18374 req-5d5dedcc-3fb0-407e-8a46-e33bfd5f6d07 tempest-TestVolumeBootPattern-763913219 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:42:59.524749 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [req-b0e5a6d6-cf69-4b11-bbed-561574a18374 req-5d5dedcc-3fb0-407e-8a46-e33bfd5f6d07 tempest-TestVolumeBootPattern-763913219 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:42:59.549826 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.manager [req-b0e5a6d6-cf69-4b11-bbed-561574a18374 req-5d5dedcc-3fb0-407e-8a46-e33bfd5f6d07 tempest-TestVolumeBootPattern-763913219 None] Notifying Schedulers of capabilities ... {{(pid=129952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 22 21:42:59.553982 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [req-b0e5a6d6-cf69-4b11-bbed-561574a18374 req-5d5dedcc-3fb0-407e-8a46-e33bfd5f6d07 tempest-TestVolumeBootPattern-763913219 None] Deleted volume successfully. Jan 22 21:42:59.653481 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.coordination [req-b0e5a6d6-cf69-4b11-bbed-561574a18374 req-5d5dedcc-3fb0-407e-8a46-e33bfd5f6d07 tempest-TestVolumeBootPattern-763913219 None] Lock "b'cinder-5372a0ff-89fb-48b9-9dc8-50dcd6dd4944-delete_volume'" released by "delete_volume" :: held 7.218s {{(pid=129952) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 22 21:43:01.637831 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.quota [None req-12fafb7e-897c-4add-8a41-2def4c493c09 tempest-SnapshotMetadataTestJSON-1598969011 None] Created reservations ['52f634dd-cd8b-4931-ac06-043e54008b6c', 'd0fe407b-435e-4676-83ac-0b43c65ea22f', '4bbc9c5e-6e8b-4a1d-abcd-34f2788aa68c', '591a04ff-e2dc-4410-8b44-0de3a9dc081a'] {{(pid=129952) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 22 21:43:01.826407 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-12fafb7e-897c-4add-8a41-2def4c493c09 tempest-SnapshotMetadataTestJSON-1598969011 None] Delete snapshot completed successfully. Jan 22 21:43:01.831713 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.coordination [None req-12fafb7e-897c-4add-8a41-2def4c493c09 tempest-SnapshotMetadataTestJSON-1598969011 None] Lock "b'cinder-f350d58b-7492-4929-9572-d9983fb2abb6-delete_snapshot'" released by "delete_snapshot" :: held 2.735s {{(pid=129952) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 22 21:43:02.405755 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.coordination [None req-dd2f4628-3092-4cc7-ba9f-86940ac2ccfd tempest-SnapshotMetadataTestJSON-1598969011 None] Lock "b'cinder-24c37a66-7d89-4ebd-be89-e2b761e04f19-delete_volume'" acquired by "delete_volume" :: waited 0.011s {{(pid=129952) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 22 21:43:02.501400 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-dd2f4628-3092-4cc7-ba9f-86940ac2ccfd tempest-SnapshotMetadataTestJSON-1598969011 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:43:02.619912 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-dd2f4628-3092-4cc7-ba9f-86940ac2ccfd tempest-SnapshotMetadataTestJSON-1598969011 None] volume has no backup snaps {{(pid=129952) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Jan 22 21:43:02.620274 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-dd2f4628-3092-4cc7-ba9f-86940ac2ccfd tempest-SnapshotMetadataTestJSON-1598969011 None] Volume volume-24c37a66-7d89-4ebd-be89-e2b761e04f19 is not a clone. {{(pid=129952) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Jan 22 21:43:02.712169 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-dd2f4628-3092-4cc7-ba9f-86940ac2ccfd tempest-SnapshotMetadataTestJSON-1598969011 None] deleting rbd volume volume-24c37a66-7d89-4ebd-be89-e2b761e04f19 {{(pid=129952) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Jan 22 21:43:04.982903 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.flows.manager.create_volume [None req-0c1344a3-83e0-46a1-b267-bc737d4c7707 tempest-TestVolumeBootPattern-763913219 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129952) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Jan 22 21:43:04.986491 ncdv-master-1 cinder-volume[129952]: WARNING stevedore.named [None req-0c1344a3-83e0-46a1-b267-bc737d4c7707 tempest-TestVolumeBootPattern-763913219 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jan 22 21:43:04.986958 ncdv-master-1 cinder-volume[129952]: WARNING castellan.key_manager [None req-0c1344a3-83e0-46a1-b267-bc737d4c7707 tempest-TestVolumeBootPattern-763913219 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 22 21:43:05.007991 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-0c1344a3-83e0-46a1-b267-bc737d4c7707 tempest-TestVolumeBootPattern-763913219 None] Flow 'volume_create_manager' (b040ebbe-78fe-4e5a-9af1-b75607dcd3cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 22 21:43:05.015124 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-0c1344a3-83e0-46a1-b267-bc737d4c7707 tempest-TestVolumeBootPattern-763913219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59b4746a-c58f-4ec0-aba1-5c08d8d37052) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:43:05.021923 ncdv-master-1 cinder-volume[129952]: DEBUG oslo_db.sqlalchemy.engines [None req-0c1344a3-83e0-46a1-b267-bc737d4c7707 tempest-TestVolumeBootPattern-763913219 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129952) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 22 21:43:05.037435 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-0c1344a3-83e0-46a1-b267-bc737d4c7707 tempest-TestVolumeBootPattern-763913219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59b4746a-c58f-4ec0-aba1-5c08d8d37052) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-01-22T21:43:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeBootPattern-volume-origin-1232108884',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=0bfe528f-1900-4abf-897d-9ebc47bcb9b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61bfb71de54c471193d2c71859a7f051',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-01-22T21:43:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-01-22T21:43:05Z,use_quota=True,user_id='29e976f05d60471b9e6fb8290f07ccce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6dacb05b-a7ea-4056-85ff-98f0ea5c54eb),volume_type_id=6dacb05b-a7ea-4056-85ff-98f0ea5c54eb)' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:43:05.043163 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-0c1344a3-83e0-46a1-b267-bc737d4c7707 tempest-TestVolumeBootPattern-763913219 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3a8264a-481f-488f-b31c-9de878cf94c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:43:05.048060 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-0c1344a3-83e0-46a1-b267-bc737d4c7707 tempest-TestVolumeBootPattern-763913219 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3a8264a-481f-488f-b31c-9de878cf94c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:43:05.053749 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-0c1344a3-83e0-46a1-b267-bc737d4c7707 tempest-TestVolumeBootPattern-763913219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09e1c439-3f7a-43ae-bb2e-7191b8cf0b81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:43:05.135201 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-0c1344a3-83e0-46a1-b267-bc737d4c7707 tempest-TestVolumeBootPattern-763913219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09e1c439-3f7a-43ae-bb2e-7191b8cf0b81) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '0bfe528f-1900-4abf-897d-9ebc47bcb9b1', 'volume_name': 'volume-0bfe528f-1900-4abf-897d-9ebc47bcb9b1', 'volume_size': 1, 'image_id': '373cb480-3bc4-4821-93e2-442b4e852b80', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '994e8f6963f04af3be3dbae11a73cdfd', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '373cb480-3bc4-4821-93e2-442b4e852b80', 'created_at': datetime.datetime(2022, 1, 22, 20, 50, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 1, 22, 20, 50, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/373cb480-3bc4-4821-93e2-442b4e852b80/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:43:05.140839 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-0c1344a3-83e0-46a1-b267-bc737d4c7707 tempest-TestVolumeBootPattern-763913219 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (141dd737-7ea2-4a1b-b908-6e160c52b602) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:43:05.145014 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-0c1344a3-83e0-46a1-b267-bc737d4c7707 tempest-TestVolumeBootPattern-763913219 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (141dd737-7ea2-4a1b-b908-6e160c52b602) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:43:05.149964 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-0c1344a3-83e0-46a1-b267-bc737d4c7707 tempest-TestVolumeBootPattern-763913219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3625b040-96e0-449e-840a-b362b01b31e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:43:05.151438 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.flows.manager.create_volume [None req-0c1344a3-83e0-46a1-b267-bc737d4c7707 tempest-TestVolumeBootPattern-763913219 None] Volume 0bfe528f-1900-4abf-897d-9ebc47bcb9b1: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-0bfe528f-1900-4abf-897d-9ebc47bcb9b1', 'volume_size': 1, 'image_id': '373cb480-3bc4-4821-93e2-442b4e852b80', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '994e8f6963f04af3be3dbae11a73cdfd', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '373cb480-3bc4-4821-93e2-442b4e852b80', 'created_at': datetime.datetime(2022, 1, 22, 20, 50, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 1, 22, 20, 50, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/373cb480-3bc4-4821-93e2-442b4e852b80/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jan 22 21:43:05.152008 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.flows.manager.create_volume [None req-0c1344a3-83e0-46a1-b267-bc737d4c7707 tempest-TestVolumeBootPattern-763913219 None] Cloning 0bfe528f-1900-4abf-897d-9ebc47bcb9b1 from image 373cb480-3bc4-4821-93e2-442b4e852b80 at location (None, None). {{(pid=129952) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1046}} Jan 22 21:43:05.159952 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.coordination [None req-0c1344a3-83e0-46a1-b267-bc737d4c7707 tempest-TestVolumeBootPattern-763913219 None] Lock "b'cinder-373cb480-3bc4-4821-93e2-442b4e852b80'" acquired by "_prepare_image_cache_entry" :: waited 0.007s {{(pid=129952) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 22 21:43:05.208729 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.image.cache [None req-0c1344a3-83e0-46a1-b267-bc737d4c7707 tempest-TestVolumeBootPattern-763913219 None] Found image-volume cache entry: {'id': 1, 'image_id': '373cb480-3bc4-4821-93e2-442b4e852b80', 'volume_id': 'f39c1078-cff4-40dd-93df-4ce49cd873b4', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 1, 22, 20, 50, 57), 'last_used': datetime.datetime(2022, 1, 22, 21, 43, 5, 163918)}. {{(pid=129952) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Jan 22 21:43:05.209092 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.image.cache [None req-0c1344a3-83e0-46a1-b267-bc737d4c7707 tempest-TestVolumeBootPattern-763913219 None] Image-volume cache entry image_update_at = 2022-01-22 20:50:57+00:00, requested image updated_at = 2022-01-22 20:50:57+00:00. {{(pid=129952) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Jan 22 21:43:05.209528 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.flows.manager.create_volume [None req-0c1344a3-83e0-46a1-b267-bc737d4c7707 tempest-TestVolumeBootPattern-763913219 None] Found cache entry for image = 373cb480-3bc4-4821-93e2-442b4e852b80 on host ncdv-master-1@ceph#ceph. {{(pid=129952) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:869}} Jan 22 21:43:05.214334 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.coordination [None req-0c1344a3-83e0-46a1-b267-bc737d4c7707 tempest-TestVolumeBootPattern-763913219 None] Lock "b'cinder-373cb480-3bc4-4821-93e2-442b4e852b80'" released by "_prepare_image_cache_entry" :: held 0.054s {{(pid=129952) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 22 21:43:05.215234 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.flows.manager.create_volume [None req-0c1344a3-83e0-46a1-b267-bc737d4c7707 tempest-TestVolumeBootPattern-763913219 None] Attempting to retrieve cache entry for image = 373cb480-3bc4-4821-93e2-442b4e852b80 on host ncdv-master-1@ceph#ceph. {{(pid=129952) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:810}} Jan 22 21:43:05.221533 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.image.cache [None req-0c1344a3-83e0-46a1-b267-bc737d4c7707 tempest-TestVolumeBootPattern-763913219 None] Found image-volume cache entry: {'id': 1, 'image_id': '373cb480-3bc4-4821-93e2-442b4e852b80', 'volume_id': 'f39c1078-cff4-40dd-93df-4ce49cd873b4', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 1, 22, 20, 50, 57), 'last_used': datetime.datetime(2022, 1, 22, 21, 43, 5, 219222)}. {{(pid=129952) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Jan 22 21:43:05.221948 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.image.cache [None req-0c1344a3-83e0-46a1-b267-bc737d4c7707 tempest-TestVolumeBootPattern-763913219 None] Image-volume cache entry image_update_at = 2022-01-22 20:50:57+00:00, requested image updated_at = 2022-01-22 20:50:57+00:00. {{(pid=129952) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Jan 22 21:43:05.222343 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.flows.manager.create_volume [None req-0c1344a3-83e0-46a1-b267-bc737d4c7707 tempest-TestVolumeBootPattern-763913219 None] Creating from source image-volume f39c1078-cff4-40dd-93df-4ce49cd873b4 {{(pid=129952) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:824}} Jan 22 21:43:05.234024 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-0c1344a3-83e0-46a1-b267-bc737d4c7707 tempest-TestVolumeBootPattern-763913219 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:43:05.420550 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-0c1344a3-83e0-46a1-b267-bc737d4c7707 tempest-TestVolumeBootPattern-763913219 None] creating snapshot='volume-0bfe528f-1900-4abf-897d-9ebc47bcb9b1.clone_snap' {{(pid=129952) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:725}} Jan 22 21:43:06.798149 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-0c1344a3-83e0-46a1-b267-bc737d4c7707 tempest-TestVolumeBootPattern-763913219 None] cloning 'volume-f39c1078-cff4-40dd-93df-4ce49cd873b4@volume-0bfe528f-1900-4abf-897d-9ebc47bcb9b1.clone_snap' to 'volume-0bfe528f-1900-4abf-897d-9ebc47bcb9b1' {{(pid=129952) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:731}} Jan 22 21:43:06.976570 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.quota [None req-dd2f4628-3092-4cc7-ba9f-86940ac2ccfd tempest-SnapshotMetadataTestJSON-1598969011 None] Created reservations ['a361da48-c484-459b-911e-44387db549c3', 'e6879cda-fb7a-4a7b-b65b-0160f2c6f4ac', '60d3d773-5af7-4d6e-b05c-5abc5aed40b3', 'f75c9ddb-e14b-4dc5-8ff1-c72b4bbb0a85'] {{(pid=129952) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 22 21:43:07.146371 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-dd2f4628-3092-4cc7-ba9f-86940ac2ccfd tempest-SnapshotMetadataTestJSON-1598969011 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:43:07.169458 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-dd2f4628-3092-4cc7-ba9f-86940ac2ccfd tempest-SnapshotMetadataTestJSON-1598969011 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:43:07.195174 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.manager [None req-dd2f4628-3092-4cc7-ba9f-86940ac2ccfd tempest-SnapshotMetadataTestJSON-1598969011 None] Notifying Schedulers of capabilities ... {{(pid=129952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 22 21:43:07.201093 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-dd2f4628-3092-4cc7-ba9f-86940ac2ccfd tempest-SnapshotMetadataTestJSON-1598969011 None] Deleted volume successfully. Jan 22 21:43:07.258522 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.coordination [None req-dd2f4628-3092-4cc7-ba9f-86940ac2ccfd tempest-SnapshotMetadataTestJSON-1598969011 None] Lock "b'cinder-24c37a66-7d89-4ebd-be89-e2b761e04f19-delete_volume'" released by "delete_volume" :: held 4.853s {{(pid=129952) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 22 21:43:07.945972 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-0c1344a3-83e0-46a1-b267-bc737d4c7707 tempest-TestVolumeBootPattern-763913219 None] Volume volume-0b17e2f4-e149-4a4b-b525-3d029be2e6f6.deleted is not a clone. {{(pid=129952) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Jan 22 21:43:07.949137 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-0c1344a3-83e0-46a1-b267-bc737d4c7707 tempest-TestVolumeBootPattern-763913219 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129952) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 22 21:43:07.949137 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-0c1344a3-83e0-46a1-b267-bc737d4c7707 tempest-TestVolumeBootPattern-763913219 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129952) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 22 21:43:08.190920 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-0c1344a3-83e0-46a1-b267-bc737d4c7707 tempest-TestVolumeBootPattern-763913219 None] clone created successfully {{(pid=129952) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:803}} Jan 22 21:43:08.191665 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.volume_utils [None req-0c1344a3-83e0-46a1-b267-bc737d4c7707 tempest-TestVolumeBootPattern-763913219 None] Marking volume 0bfe528f-1900-4abf-897d-9ebc47bcb9b1 as bootable. {{(pid=129952) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1178}} Jan 22 21:43:08.265890 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.flows.manager.create_volume [None req-0c1344a3-83e0-46a1-b267-bc737d4c7707 tempest-TestVolumeBootPattern-763913219 None] Copying metadata from image 373cb480-3bc4-4821-93e2-442b4e852b80 to 0bfe528f-1900-4abf-897d-9ebc47bcb9b1. {{(pid=129952) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:443}} Jan 22 21:43:08.266423 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.flows.manager.create_volume [None req-0c1344a3-83e0-46a1-b267-bc737d4c7707 tempest-TestVolumeBootPattern-763913219 None] Creating volume glance metadata for volume 0bfe528f-1900-4abf-897d-9ebc47bcb9b1 backed by image 373cb480-3bc4-4821-93e2-442b4e852b80 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '373cb480-3bc4-4821-93e2-442b4e852b80', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=129952) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:666}} Jan 22 21:43:08.384009 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-0c1344a3-83e0-46a1-b267-bc737d4c7707 tempest-TestVolumeBootPattern-763913219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3625b040-96e0-449e-840a-b362b01b31e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0bfe528f-1900-4abf-897d-9ebc47bcb9b1', 'volume_size': 1, 'image_id': '373cb480-3bc4-4821-93e2-442b4e852b80', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '994e8f6963f04af3be3dbae11a73cdfd', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '373cb480-3bc4-4821-93e2-442b4e852b80', 'created_at': datetime.datetime(2022, 1, 22, 20, 50, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 1, 22, 20, 50, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/373cb480-3bc4-4821-93e2-442b4e852b80/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:43:08.389955 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-0c1344a3-83e0-46a1-b267-bc737d4c7707 tempest-TestVolumeBootPattern-763913219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b0f040d-4d6f-44fe-aa89-a33455d572e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:43:08.454891 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.flows.manager.create_volume [None req-0c1344a3-83e0-46a1-b267-bc737d4c7707 tempest-TestVolumeBootPattern-763913219 None] Volume volume-0bfe528f-1900-4abf-897d-9ebc47bcb9b1 (0bfe528f-1900-4abf-897d-9ebc47bcb9b1): created successfully Jan 22 21:43:08.458681 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-0c1344a3-83e0-46a1-b267-bc737d4c7707 tempest-TestVolumeBootPattern-763913219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b0f040d-4d6f-44fe-aa89-a33455d572e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:43:08.465106 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-0c1344a3-83e0-46a1-b267-bc737d4c7707 tempest-TestVolumeBootPattern-763913219 None] Flow 'volume_create_manager' (b040ebbe-78fe-4e5a-9af1-b75607dcd3cb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129952) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 22 21:43:08.540350 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-0c1344a3-83e0-46a1-b267-bc737d4c7707 tempest-TestVolumeBootPattern-763913219 None] Created volume successfully. Jan 22 21:43:12.781718 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.flows.manager.create_volume [None req-d872edb7-0a4b-4486-afdf-6901fd25a506 tempest-VolumesListTestJSON-112216048 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129952) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Jan 22 21:43:12.785412 ncdv-master-1 cinder-volume[129952]: WARNING stevedore.named [None req-d872edb7-0a4b-4486-afdf-6901fd25a506 tempest-VolumesListTestJSON-112216048 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jan 22 21:43:12.785893 ncdv-master-1 cinder-volume[129952]: WARNING castellan.key_manager [None req-d872edb7-0a4b-4486-afdf-6901fd25a506 tempest-VolumesListTestJSON-112216048 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 22 21:43:12.805879 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-d872edb7-0a4b-4486-afdf-6901fd25a506 tempest-VolumesListTestJSON-112216048 None] Flow 'volume_create_manager' (d4e4cb5b-0a11-4ae8-a7c2-54f6970b96e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 22 21:43:12.813861 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-d872edb7-0a4b-4486-afdf-6901fd25a506 tempest-VolumesListTestJSON-112216048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2635c423-542a-4289-8cf1-9c392c00fab1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:43:12.820696 ncdv-master-1 cinder-volume[129952]: DEBUG oslo_db.sqlalchemy.engines [None req-d872edb7-0a4b-4486-afdf-6901fd25a506 tempest-VolumesListTestJSON-112216048 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129952) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 22 21:43:12.837552 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-d872edb7-0a4b-4486-afdf-6901fd25a506 tempest-VolumesListTestJSON-112216048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2635c423-542a-4289-8cf1-9c392c00fab1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-01-22T21:43:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-16293593',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=3a862012-d6eb-4f8f-aec2-a5879e4e988a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='4df056e08b664542b5f095b884e9439b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-01-22T21:43:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-01-22T21:43:13Z,use_quota=True,user_id='12c05537f1bb448c944d4ff0c70bcaf5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6dacb05b-a7ea-4056-85ff-98f0ea5c54eb),volume_type_id=6dacb05b-a7ea-4056-85ff-98f0ea5c54eb)' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:43:12.843865 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-d872edb7-0a4b-4486-afdf-6901fd25a506 tempest-VolumesListTestJSON-112216048 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85c34325-8f9c-4148-a047-d99a5e69d0f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:43:12.848166 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-d872edb7-0a4b-4486-afdf-6901fd25a506 tempest-VolumesListTestJSON-112216048 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85c34325-8f9c-4148-a047-d99a5e69d0f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:43:12.854690 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-d872edb7-0a4b-4486-afdf-6901fd25a506 tempest-VolumesListTestJSON-112216048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18cbf542-e854-4134-af41-4bf627c29ec8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:43:12.860207 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-d872edb7-0a4b-4486-afdf-6901fd25a506 tempest-VolumesListTestJSON-112216048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18cbf542-e854-4134-af41-4bf627c29ec8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3a862012-d6eb-4f8f-aec2-a5879e4e988a', 'volume_name': 'volume-3a862012-d6eb-4f8f-aec2-a5879e4e988a', 'volume_size': 1}' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:43:12.865276 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-d872edb7-0a4b-4486-afdf-6901fd25a506 tempest-VolumesListTestJSON-112216048 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc5576ac-57f8-44a7-9931-6d0394de0c80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:43:12.869354 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-d872edb7-0a4b-4486-afdf-6901fd25a506 tempest-VolumesListTestJSON-112216048 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc5576ac-57f8-44a7-9931-6d0394de0c80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:43:12.875318 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-d872edb7-0a4b-4486-afdf-6901fd25a506 tempest-VolumesListTestJSON-112216048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91add113-502d-43aa-a766-9197fae0aa49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:43:12.876427 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.flows.manager.create_volume [None req-d872edb7-0a4b-4486-afdf-6901fd25a506 tempest-VolumesListTestJSON-112216048 None] Volume 3a862012-d6eb-4f8f-aec2-a5879e4e988a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3a862012-d6eb-4f8f-aec2-a5879e4e988a', 'volume_size': 1} Jan 22 21:43:12.876821 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-d872edb7-0a4b-4486-afdf-6901fd25a506 tempest-VolumesListTestJSON-112216048 None] creating volume 'volume-3a862012-d6eb-4f8f-aec2-a5879e4e988a' {{(pid=129952) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Jan 22 21:43:12.877836 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-d872edb7-0a4b-4486-afdf-6901fd25a506 tempest-VolumesListTestJSON-112216048 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:43:13.200300 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-d872edb7-0a4b-4486-afdf-6901fd25a506 tempest-VolumesListTestJSON-112216048 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129952) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 22 21:43:13.200682 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-d872edb7-0a4b-4486-afdf-6901fd25a506 tempest-VolumesListTestJSON-112216048 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129952) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 22 21:43:13.206057 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-d872edb7-0a4b-4486-afdf-6901fd25a506 tempest-VolumesListTestJSON-112216048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91add113-502d-43aa-a766-9197fae0aa49) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3a862012-d6eb-4f8f-aec2-a5879e4e988a', 'volume_size': 1}' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:43:13.210860 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-d872edb7-0a4b-4486-afdf-6901fd25a506 tempest-VolumesListTestJSON-112216048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ec75224-e249-47c0-b7dc-2cfec1c7fb31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:43:13.282772 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.flows.manager.create_volume [None req-d872edb7-0a4b-4486-afdf-6901fd25a506 tempest-VolumesListTestJSON-112216048 None] Volume volume-3a862012-d6eb-4f8f-aec2-a5879e4e988a (3a862012-d6eb-4f8f-aec2-a5879e4e988a): created successfully Jan 22 21:43:13.286731 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-d872edb7-0a4b-4486-afdf-6901fd25a506 tempest-VolumesListTestJSON-112216048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ec75224-e249-47c0-b7dc-2cfec1c7fb31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:43:13.292621 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-d872edb7-0a4b-4486-afdf-6901fd25a506 tempest-VolumesListTestJSON-112216048 None] Flow 'volume_create_manager' (d4e4cb5b-0a11-4ae8-a7c2-54f6970b96e6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129952) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 22 21:43:13.343570 ncdv-master-1 cinder-volume[129952]: DEBUG oslo_concurrency.processutils [req-8a4088a1-a99e-4d55-be6e-3fde23bc626f req-0b9d08cd-409d-4919-962b-db338bf37408 tempest-TestVolumeBootPattern-763913219 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129952) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jan 22 21:43:13.376748 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-d872edb7-0a4b-4486-afdf-6901fd25a506 tempest-VolumesListTestJSON-112216048 None] Created volume successfully. Jan 22 21:43:14.013481 ncdv-master-1 cinder-volume[129952]: DEBUG oslo_concurrency.processutils [req-8a4088a1-a99e-4d55-be6e-3fde23bc626f req-0b9d08cd-409d-4919-962b-db338bf37408 tempest-TestVolumeBootPattern-763913219 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.671s {{(pid=129952) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jan 22 21:43:14.014247 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [req-8a4088a1-a99e-4d55-be6e-3fde23bc626f req-0b9d08cd-409d-4919-962b-db338bf37408 tempest-TestVolumeBootPattern-763913219 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-0bfe528f-1900-4abf-897d-9ebc47bcb9b1', 'hosts': ['10.222.0.100'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'c7ee930a-3b87-450e-91f6-d4eef70cb484', 'volume_id': '0bfe528f-1900-4abf-897d-9ebc47bcb9b1', 'discard': True}} {{(pid=129952) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Jan 22 21:43:14.094662 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [req-8a4088a1-a99e-4d55-be6e-3fde23bc626f req-0b9d08cd-409d-4919-962b-db338bf37408 tempest-TestVolumeBootPattern-763913219 None] Connection info returned from driver {'name': 'volumes/volume-0bfe528f-1900-4abf-897d-9ebc47bcb9b1', 'hosts': ['10.222.0.100'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '0bfe528f-1900-4abf-897d-9ebc47bcb9b1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'c6a9e6e3-1c23-408f-855b-773301e38613'} {{(pid=129952) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4811}} Jan 22 21:43:14.209825 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [req-8a4088a1-a99e-4d55-be6e-3fde23bc626f req-0b9d08cd-409d-4919-962b-db338bf37408 tempest-TestVolumeBootPattern-763913219 None] attachment_update completed successfully. Jan 22 21:43:14.462431 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.flows.manager.create_volume [None req-37646a13-7142-4585-a777-09de9c7e6600 tempest-VolumesListTestJSON-112216048 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129952) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Jan 22 21:43:14.470777 ncdv-master-1 cinder-volume[129952]: WARNING stevedore.named [None req-37646a13-7142-4585-a777-09de9c7e6600 tempest-VolumesListTestJSON-112216048 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jan 22 21:43:14.471559 ncdv-master-1 cinder-volume[129952]: WARNING castellan.key_manager [None req-37646a13-7142-4585-a777-09de9c7e6600 tempest-VolumesListTestJSON-112216048 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 22 21:43:14.495473 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-37646a13-7142-4585-a777-09de9c7e6600 tempest-VolumesListTestJSON-112216048 None] Flow 'volume_create_manager' (b5e894fa-d926-4f45-b029-20c2f29b9992) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 22 21:43:14.502711 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-37646a13-7142-4585-a777-09de9c7e6600 tempest-VolumesListTestJSON-112216048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12380b1a-b38f-4b20-9172-29879450181f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:43:14.509817 ncdv-master-1 cinder-volume[129952]: DEBUG oslo_db.sqlalchemy.engines [None req-37646a13-7142-4585-a777-09de9c7e6600 tempest-VolumesListTestJSON-112216048 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129952) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 22 21:43:14.524928 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-37646a13-7142-4585-a777-09de9c7e6600 tempest-VolumesListTestJSON-112216048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12380b1a-b38f-4b20-9172-29879450181f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-01-22T21:43:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1975736289',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=dbb8a5e1-77bd-4bb7-8a6a-4daf76f88d88,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='4df056e08b664542b5f095b884e9439b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-01-22T21:43:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-01-22T21:43:14Z,use_quota=True,user_id='12c05537f1bb448c944d4ff0c70bcaf5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6dacb05b-a7ea-4056-85ff-98f0ea5c54eb),volume_type_id=6dacb05b-a7ea-4056-85ff-98f0ea5c54eb)' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:43:14.531835 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-37646a13-7142-4585-a777-09de9c7e6600 tempest-VolumesListTestJSON-112216048 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73dec4b3-002d-4989-a3f9-1ba31814689b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:43:14.536188 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-37646a13-7142-4585-a777-09de9c7e6600 tempest-VolumesListTestJSON-112216048 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73dec4b3-002d-4989-a3f9-1ba31814689b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:43:14.541609 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-37646a13-7142-4585-a777-09de9c7e6600 tempest-VolumesListTestJSON-112216048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e08823cc-a5df-421a-a1d9-04133350f76e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:43:14.546693 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-37646a13-7142-4585-a777-09de9c7e6600 tempest-VolumesListTestJSON-112216048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e08823cc-a5df-421a-a1d9-04133350f76e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dbb8a5e1-77bd-4bb7-8a6a-4daf76f88d88', 'volume_name': 'volume-dbb8a5e1-77bd-4bb7-8a6a-4daf76f88d88', 'volume_size': 1}' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:43:14.552298 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-37646a13-7142-4585-a777-09de9c7e6600 tempest-VolumesListTestJSON-112216048 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d5f3ab5-2db7-429e-bdd0-f42eff0bfbbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:43:14.556844 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-37646a13-7142-4585-a777-09de9c7e6600 tempest-VolumesListTestJSON-112216048 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d5f3ab5-2db7-429e-bdd0-f42eff0bfbbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:43:14.561838 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-37646a13-7142-4585-a777-09de9c7e6600 tempest-VolumesListTestJSON-112216048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9979f3f-1b38-4821-ad89-97ed5a179aa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:43:14.562972 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.flows.manager.create_volume [None req-37646a13-7142-4585-a777-09de9c7e6600 tempest-VolumesListTestJSON-112216048 None] Volume dbb8a5e1-77bd-4bb7-8a6a-4daf76f88d88: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dbb8a5e1-77bd-4bb7-8a6a-4daf76f88d88', 'volume_size': 1} Jan 22 21:43:14.563384 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-37646a13-7142-4585-a777-09de9c7e6600 tempest-VolumesListTestJSON-112216048 None] creating volume 'volume-dbb8a5e1-77bd-4bb7-8a6a-4daf76f88d88' {{(pid=129952) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Jan 22 21:43:14.564505 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-37646a13-7142-4585-a777-09de9c7e6600 tempest-VolumesListTestJSON-112216048 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:43:15.081805 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-37646a13-7142-4585-a777-09de9c7e6600 tempest-VolumesListTestJSON-112216048 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129952) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 22 21:43:15.082446 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-37646a13-7142-4585-a777-09de9c7e6600 tempest-VolumesListTestJSON-112216048 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129952) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 22 21:43:15.086447 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-37646a13-7142-4585-a777-09de9c7e6600 tempest-VolumesListTestJSON-112216048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9979f3f-1b38-4821-ad89-97ed5a179aa3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dbb8a5e1-77bd-4bb7-8a6a-4daf76f88d88', 'volume_size': 1}' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:43:15.099585 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-37646a13-7142-4585-a777-09de9c7e6600 tempest-VolumesListTestJSON-112216048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a7ed852-794f-4ffc-b0c4-8020f54bd79a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:43:15.197249 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.flows.manager.create_volume [None req-37646a13-7142-4585-a777-09de9c7e6600 tempest-VolumesListTestJSON-112216048 None] Volume volume-dbb8a5e1-77bd-4bb7-8a6a-4daf76f88d88 (dbb8a5e1-77bd-4bb7-8a6a-4daf76f88d88): created successfully Jan 22 21:43:15.202866 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-37646a13-7142-4585-a777-09de9c7e6600 tempest-VolumesListTestJSON-112216048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a7ed852-794f-4ffc-b0c4-8020f54bd79a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:43:15.207689 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-37646a13-7142-4585-a777-09de9c7e6600 tempest-VolumesListTestJSON-112216048 None] Flow 'volume_create_manager' (b5e894fa-d926-4f45-b029-20c2f29b9992) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129952) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 22 21:43:15.254111 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-37646a13-7142-4585-a777-09de9c7e6600 tempest-VolumesListTestJSON-112216048 None] Created volume successfully. Jan 22 21:43:16.170112 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.flows.manager.create_volume [None req-9452611c-fae8-408d-b0da-567a54d4422e tempest-VolumesListTestJSON-112216048 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129952) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Jan 22 21:43:16.174041 ncdv-master-1 cinder-volume[129952]: WARNING stevedore.named [None req-9452611c-fae8-408d-b0da-567a54d4422e tempest-VolumesListTestJSON-112216048 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jan 22 21:43:16.174485 ncdv-master-1 cinder-volume[129952]: WARNING castellan.key_manager [None req-9452611c-fae8-408d-b0da-567a54d4422e tempest-VolumesListTestJSON-112216048 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 22 21:43:16.194519 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-9452611c-fae8-408d-b0da-567a54d4422e tempest-VolumesListTestJSON-112216048 None] Flow 'volume_create_manager' (2215dd8c-18ac-4f78-bff3-453c673f60f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 22 21:43:16.201195 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-9452611c-fae8-408d-b0da-567a54d4422e tempest-VolumesListTestJSON-112216048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (881e5a33-2b29-4cbe-9106-531a1094ab4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:43:16.207913 ncdv-master-1 cinder-volume[129952]: DEBUG oslo_db.sqlalchemy.engines [None req-9452611c-fae8-408d-b0da-567a54d4422e tempest-VolumesListTestJSON-112216048 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129952) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 22 21:43:16.222541 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-9452611c-fae8-408d-b0da-567a54d4422e tempest-VolumesListTestJSON-112216048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (881e5a33-2b29-4cbe-9106-531a1094ab4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-01-22T21:43:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-2050064399',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=c6ea04b1-91f0-4a82-9c79-9badcd81ba48,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='4df056e08b664542b5f095b884e9439b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-01-22T21:43:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-01-22T21:43:16Z,use_quota=True,user_id='12c05537f1bb448c944d4ff0c70bcaf5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6dacb05b-a7ea-4056-85ff-98f0ea5c54eb),volume_type_id=6dacb05b-a7ea-4056-85ff-98f0ea5c54eb)' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:43:16.228171 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-9452611c-fae8-408d-b0da-567a54d4422e tempest-VolumesListTestJSON-112216048 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f8fb649-62f6-45bb-adca-d590ec02a7bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:43:16.234474 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-9452611c-fae8-408d-b0da-567a54d4422e tempest-VolumesListTestJSON-112216048 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f8fb649-62f6-45bb-adca-d590ec02a7bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:43:16.238661 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-9452611c-fae8-408d-b0da-567a54d4422e tempest-VolumesListTestJSON-112216048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d44f3ec-8de4-43df-92d1-1d53026757f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:43:16.242983 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-9452611c-fae8-408d-b0da-567a54d4422e tempest-VolumesListTestJSON-112216048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d44f3ec-8de4-43df-92d1-1d53026757f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c6ea04b1-91f0-4a82-9c79-9badcd81ba48', 'volume_name': 'volume-c6ea04b1-91f0-4a82-9c79-9badcd81ba48', 'volume_size': 1}' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:43:16.248119 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-9452611c-fae8-408d-b0da-567a54d4422e tempest-VolumesListTestJSON-112216048 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d9b13b2-b072-4e6e-9579-4bf10793401c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:43:16.253172 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-9452611c-fae8-408d-b0da-567a54d4422e tempest-VolumesListTestJSON-112216048 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d9b13b2-b072-4e6e-9579-4bf10793401c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:43:16.258056 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-9452611c-fae8-408d-b0da-567a54d4422e tempest-VolumesListTestJSON-112216048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (515c2408-e28e-4d68-a499-73189ebcd86b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:43:16.259147 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.flows.manager.create_volume [None req-9452611c-fae8-408d-b0da-567a54d4422e tempest-VolumesListTestJSON-112216048 None] Volume c6ea04b1-91f0-4a82-9c79-9badcd81ba48: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c6ea04b1-91f0-4a82-9c79-9badcd81ba48', 'volume_size': 1} Jan 22 21:43:16.259543 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-9452611c-fae8-408d-b0da-567a54d4422e tempest-VolumesListTestJSON-112216048 None] creating volume 'volume-c6ea04b1-91f0-4a82-9c79-9badcd81ba48' {{(pid=129952) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Jan 22 21:43:16.260515 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-9452611c-fae8-408d-b0da-567a54d4422e tempest-VolumesListTestJSON-112216048 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:43:16.868944 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-9452611c-fae8-408d-b0da-567a54d4422e tempest-VolumesListTestJSON-112216048 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129952) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 22 21:43:16.869317 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-9452611c-fae8-408d-b0da-567a54d4422e tempest-VolumesListTestJSON-112216048 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129952) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 22 21:43:16.873643 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-9452611c-fae8-408d-b0da-567a54d4422e tempest-VolumesListTestJSON-112216048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (515c2408-e28e-4d68-a499-73189ebcd86b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c6ea04b1-91f0-4a82-9c79-9badcd81ba48', 'volume_size': 1}' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:43:16.880176 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-9452611c-fae8-408d-b0da-567a54d4422e tempest-VolumesListTestJSON-112216048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3a4e958-2fb3-459f-a800-6cf87ddecd17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:43:16.930756 ncdv-master-1 cinder-volume[129952]: DEBUG oslo_service.periodic_task [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129952) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jan 22 21:43:16.931535 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:43:16.954373 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:43:16.977641 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.manager [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] Notifying Schedulers of capabilities ... {{(pid=129952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 22 21:43:16.981241 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.flows.manager.create_volume [None req-9452611c-fae8-408d-b0da-567a54d4422e tempest-VolumesListTestJSON-112216048 None] Volume volume-c6ea04b1-91f0-4a82-9c79-9badcd81ba48 (c6ea04b1-91f0-4a82-9c79-9badcd81ba48): created successfully Jan 22 21:43:16.985721 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-9452611c-fae8-408d-b0da-567a54d4422e tempest-VolumesListTestJSON-112216048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3a4e958-2fb3-459f-a800-6cf87ddecd17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:43:16.991248 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-9452611c-fae8-408d-b0da-567a54d4422e tempest-VolumesListTestJSON-112216048 None] Flow 'volume_create_manager' (2215dd8c-18ac-4f78-bff3-453c673f60f3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129952) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 22 21:43:17.042809 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-9452611c-fae8-408d-b0da-567a54d4422e tempest-VolumesListTestJSON-112216048 None] Created volume successfully. Jan 22 21:43:20.286989 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.coordination [None req-29e1d339-78bb-4af5-800b-978d08358851 tempest-VolumesListTestJSON-112216048 None] Lock "b'cinder-c6ea04b1-91f0-4a82-9c79-9badcd81ba48-delete_volume'" acquired by "delete_volume" :: waited 0.009s {{(pid=129952) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 22 21:43:20.369748 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-29e1d339-78bb-4af5-800b-978d08358851 tempest-VolumesListTestJSON-112216048 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:43:20.471048 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-29e1d339-78bb-4af5-800b-978d08358851 tempest-VolumesListTestJSON-112216048 None] volume has no backup snaps {{(pid=129952) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Jan 22 21:43:20.471503 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-29e1d339-78bb-4af5-800b-978d08358851 tempest-VolumesListTestJSON-112216048 None] Volume volume-c6ea04b1-91f0-4a82-9c79-9badcd81ba48 is not a clone. {{(pid=129952) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Jan 22 21:43:20.546454 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-29e1d339-78bb-4af5-800b-978d08358851 tempest-VolumesListTestJSON-112216048 None] deleting rbd volume volume-c6ea04b1-91f0-4a82-9c79-9badcd81ba48 {{(pid=129952) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Jan 22 21:43:23.162902 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.quota [None req-29e1d339-78bb-4af5-800b-978d08358851 tempest-VolumesListTestJSON-112216048 None] Created reservations ['8f6aadf8-c961-4b9e-913f-ec62d10136fa', 'bf1017ca-d4c0-4ae8-b420-5622c7c73bbc', 'cd451a30-e16c-4e1d-b1d9-809060a331d9', '5454bb8a-85f6-4b99-ac98-14f78dc4c762'] {{(pid=129952) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 22 21:43:23.318116 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-29e1d339-78bb-4af5-800b-978d08358851 tempest-VolumesListTestJSON-112216048 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:43:23.342135 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-29e1d339-78bb-4af5-800b-978d08358851 tempest-VolumesListTestJSON-112216048 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:43:23.369533 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.manager [None req-29e1d339-78bb-4af5-800b-978d08358851 tempest-VolumesListTestJSON-112216048 None] Notifying Schedulers of capabilities ... {{(pid=129952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 22 21:43:23.380263 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-29e1d339-78bb-4af5-800b-978d08358851 tempest-VolumesListTestJSON-112216048 None] Deleted volume successfully. Jan 22 21:43:23.484124 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.coordination [None req-29e1d339-78bb-4af5-800b-978d08358851 tempest-VolumesListTestJSON-112216048 None] Lock "b'cinder-c6ea04b1-91f0-4a82-9c79-9badcd81ba48-delete_volume'" released by "delete_volume" :: held 3.197s {{(pid=129952) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 22 21:43:23.670548 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.coordination [None req-843afd0a-a292-4eaf-b0b6-db7b35f93358 tempest-VolumesListTestJSON-112216048 None] Lock "b'cinder-dbb8a5e1-77bd-4bb7-8a6a-4daf76f88d88-delete_volume'" acquired by "delete_volume" :: waited 0.009s {{(pid=129952) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 22 21:43:23.775881 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-843afd0a-a292-4eaf-b0b6-db7b35f93358 tempest-VolumesListTestJSON-112216048 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:43:23.939782 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-843afd0a-a292-4eaf-b0b6-db7b35f93358 tempest-VolumesListTestJSON-112216048 None] volume has no backup snaps {{(pid=129952) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Jan 22 21:43:23.940164 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-843afd0a-a292-4eaf-b0b6-db7b35f93358 tempest-VolumesListTestJSON-112216048 None] Volume volume-dbb8a5e1-77bd-4bb7-8a6a-4daf76f88d88 is not a clone. {{(pid=129952) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Jan 22 21:43:24.094696 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-843afd0a-a292-4eaf-b0b6-db7b35f93358 tempest-VolumesListTestJSON-112216048 None] deleting rbd volume volume-dbb8a5e1-77bd-4bb7-8a6a-4daf76f88d88 {{(pid=129952) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Jan 22 21:43:27.397622 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.quota [None req-843afd0a-a292-4eaf-b0b6-db7b35f93358 tempest-VolumesListTestJSON-112216048 None] Created reservations ['086eba1a-6270-4cae-bf19-2ca0911eed0b', '3cb05bba-a927-416e-9b87-8a84a2f740fb', '0138e8cb-2e35-4e28-b832-2db2ba5fd391', 'fd7ebd49-9329-4b44-92eb-a7e820fba5ef'] {{(pid=129952) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 22 21:43:27.581329 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-843afd0a-a292-4eaf-b0b6-db7b35f93358 tempest-VolumesListTestJSON-112216048 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:43:27.603523 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-843afd0a-a292-4eaf-b0b6-db7b35f93358 tempest-VolumesListTestJSON-112216048 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:43:27.635029 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.manager [None req-843afd0a-a292-4eaf-b0b6-db7b35f93358 tempest-VolumesListTestJSON-112216048 None] Notifying Schedulers of capabilities ... {{(pid=129952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 22 21:43:27.638961 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-843afd0a-a292-4eaf-b0b6-db7b35f93358 tempest-VolumesListTestJSON-112216048 None] Deleted volume successfully. Jan 22 21:43:27.732538 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.coordination [None req-843afd0a-a292-4eaf-b0b6-db7b35f93358 tempest-VolumesListTestJSON-112216048 None] Lock "b'cinder-dbb8a5e1-77bd-4bb7-8a6a-4daf76f88d88-delete_volume'" released by "delete_volume" :: held 4.062s {{(pid=129952) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 22 21:43:28.127214 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.coordination [None req-4c8c87d6-0680-4a96-a888-9fe15935e4b1 tempest-VolumesListTestJSON-112216048 None] Lock "b'cinder-3a862012-d6eb-4f8f-aec2-a5879e4e988a-delete_volume'" acquired by "delete_volume" :: waited 0.008s {{(pid=129952) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 22 21:43:28.206672 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-4c8c87d6-0680-4a96-a888-9fe15935e4b1 tempest-VolumesListTestJSON-112216048 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:43:28.488627 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-4c8c87d6-0680-4a96-a888-9fe15935e4b1 tempest-VolumesListTestJSON-112216048 None] volume has no backup snaps {{(pid=129952) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Jan 22 21:43:28.489442 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-4c8c87d6-0680-4a96-a888-9fe15935e4b1 tempest-VolumesListTestJSON-112216048 None] Volume volume-3a862012-d6eb-4f8f-aec2-a5879e4e988a is not a clone. {{(pid=129952) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Jan 22 21:43:28.632038 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-4c8c87d6-0680-4a96-a888-9fe15935e4b1 tempest-VolumesListTestJSON-112216048 None] deleting rbd volume volume-3a862012-d6eb-4f8f-aec2-a5879e4e988a {{(pid=129952) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Jan 22 21:43:31.768500 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.quota [None req-4c8c87d6-0680-4a96-a888-9fe15935e4b1 tempest-VolumesListTestJSON-112216048 None] Created reservations ['a4c7f765-7bba-4b6b-bffc-0d3e0a6296bb', '05b414e2-b9be-41e1-b3a0-31ae4b788bf2', '32e718b9-062d-4522-92f4-e2de7f2d9bc7', '65fa100c-2d8b-4841-942c-51f55d0b0276'] {{(pid=129952) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 22 21:43:31.963259 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-4c8c87d6-0680-4a96-a888-9fe15935e4b1 tempest-VolumesListTestJSON-112216048 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:43:31.985609 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-4c8c87d6-0680-4a96-a888-9fe15935e4b1 tempest-VolumesListTestJSON-112216048 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:43:32.008493 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.manager [None req-4c8c87d6-0680-4a96-a888-9fe15935e4b1 tempest-VolumesListTestJSON-112216048 None] Notifying Schedulers of capabilities ... {{(pid=129952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 22 21:43:32.013397 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-4c8c87d6-0680-4a96-a888-9fe15935e4b1 tempest-VolumesListTestJSON-112216048 None] Deleted volume successfully. Jan 22 21:43:32.093798 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.coordination [None req-4c8c87d6-0680-4a96-a888-9fe15935e4b1 tempest-VolumesListTestJSON-112216048 None] Lock "b'cinder-3a862012-d6eb-4f8f-aec2-a5879e4e988a-delete_volume'" released by "delete_volume" :: held 3.967s {{(pid=129952) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 22 21:44:16.936192 ncdv-master-1 cinder-volume[129952]: DEBUG oslo_service.periodic_task [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129952) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jan 22 21:44:16.936889 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:44:16.960456 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:44:16.984086 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.manager [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] Notifying Schedulers of capabilities ... {{(pid=129952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 22 21:45:16.939427 ncdv-master-1 cinder-volume[129952]: DEBUG oslo_service.periodic_task [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129952) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jan 22 21:45:16.940318 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:45:16.964731 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:45:16.988020 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.manager [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] Notifying Schedulers of capabilities ... {{(pid=129952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 22 21:46:16.943771 ncdv-master-1 cinder-volume[129952]: DEBUG oslo_service.periodic_task [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129952) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jan 22 21:46:16.944492 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:46:16.967307 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:46:16.989729 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.manager [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] Notifying Schedulers of capabilities ... {{(pid=129952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 22 21:46:53.202109 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [req-d2064f71-b70b-4021-b8ae-b87363764eb0 req-42f23cea-a5b5-4436-868b-b06f5b2c0e76 tempest-TestVolumeBootPattern-763913219 None] Terminate volume connection completed successfully. Jan 22 21:46:53.202765 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [req-d2064f71-b70b-4021-b8ae-b87363764eb0 req-42f23cea-a5b5-4436-868b-b06f5b2c0e76 tempest-TestVolumeBootPattern-763913219 None] Deleting attachment c6a9e6e3-1c23-408f-855b-773301e38613. {{(pid=129952) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4947}} Jan 22 21:46:54.436399 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.coordination [None req-964e5c35-cb51-4894-8856-8c6d760f192c tempest-TestVolumeBootPattern-763913219 None] Lock "b'cinder-0bfe528f-1900-4abf-897d-9ebc47bcb9b1-delete_volume'" acquired by "delete_volume" :: waited 0.008s {{(pid=129952) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 22 21:46:54.527034 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-964e5c35-cb51-4894-8856-8c6d760f192c tempest-TestVolumeBootPattern-763913219 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:46:54.679010 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-964e5c35-cb51-4894-8856-8c6d760f192c tempest-TestVolumeBootPattern-763913219 None] volume has no backup snaps {{(pid=129952) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Jan 22 21:46:54.766329 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-964e5c35-cb51-4894-8856-8c6d760f192c tempest-TestVolumeBootPattern-763913219 None] deleting rbd volume volume-0bfe528f-1900-4abf-897d-9ebc47bcb9b1 {{(pid=129952) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Jan 22 21:46:58.365734 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-964e5c35-cb51-4894-8856-8c6d760f192c tempest-TestVolumeBootPattern-763913219 None] volume is a clone so cleaning references {{(pid=129952) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1266}} Jan 22 21:46:58.498448 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-964e5c35-cb51-4894-8856-8c6d760f192c tempest-TestVolumeBootPattern-763913219 None] deleting parent snapshot volume-0bfe528f-1900-4abf-897d-9ebc47bcb9b1.clone_snap {{(pid=129952) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1158}} Jan 22 21:47:01.320432 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.quota [None req-964e5c35-cb51-4894-8856-8c6d760f192c tempest-TestVolumeBootPattern-763913219 None] Created reservations ['171639ac-af7e-4e5d-904a-4b41a8754a23', 'fd046810-d7cc-43c3-b897-cddfd870b115', '706dd5d8-cee5-40e1-bf0f-10e9e53c0b1b', '51d94a33-e9e3-4478-91e0-9acfb932daaa'] {{(pid=129952) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 22 21:47:01.479860 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-964e5c35-cb51-4894-8856-8c6d760f192c tempest-TestVolumeBootPattern-763913219 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:47:01.512527 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-964e5c35-cb51-4894-8856-8c6d760f192c tempest-TestVolumeBootPattern-763913219 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:47:01.582172 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.manager [None req-964e5c35-cb51-4894-8856-8c6d760f192c tempest-TestVolumeBootPattern-763913219 None] Notifying Schedulers of capabilities ... {{(pid=129952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 22 21:47:01.586351 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-964e5c35-cb51-4894-8856-8c6d760f192c tempest-TestVolumeBootPattern-763913219 None] Deleted volume successfully. Jan 22 21:47:01.678923 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.coordination [None req-964e5c35-cb51-4894-8856-8c6d760f192c tempest-TestVolumeBootPattern-763913219 None] Lock "b'cinder-0bfe528f-1900-4abf-897d-9ebc47bcb9b1-delete_volume'" released by "delete_volume" :: held 7.246s {{(pid=129952) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 22 21:47:16.946521 ncdv-master-1 cinder-volume[129952]: DEBUG oslo_service.periodic_task [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129952) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jan 22 21:47:16.947246 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:47:16.968225 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:47:16.989821 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.manager [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] Notifying Schedulers of capabilities ... {{(pid=129952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 22 21:48:16.946203 ncdv-master-1 cinder-volume[129952]: DEBUG oslo_service.periodic_task [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129952) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jan 22 21:48:16.946922 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:48:16.968166 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:48:16.991796 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.manager [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] Notifying Schedulers of capabilities ... {{(pid=129952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 22 21:49:16.947872 ncdv-master-1 cinder-volume[129952]: DEBUG oslo_service.periodic_task [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129952) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jan 22 21:49:16.948838 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:49:16.990688 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:49:17.026483 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.manager [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] Notifying Schedulers of capabilities ... {{(pid=129952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 22 21:49:17.859960 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.flows.manager.create_volume [None req-2597d7fc-da2a-4156-a2b7-23ff8135cac0 tempest-TestVolumeBackupRestore-1156611914 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129952) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Jan 22 21:49:17.863435 ncdv-master-1 cinder-volume[129952]: WARNING stevedore.named [None req-2597d7fc-da2a-4156-a2b7-23ff8135cac0 tempest-TestVolumeBackupRestore-1156611914 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jan 22 21:49:17.863890 ncdv-master-1 cinder-volume[129952]: WARNING castellan.key_manager [None req-2597d7fc-da2a-4156-a2b7-23ff8135cac0 tempest-TestVolumeBackupRestore-1156611914 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 22 21:49:17.883913 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-2597d7fc-da2a-4156-a2b7-23ff8135cac0 tempest-TestVolumeBackupRestore-1156611914 None] Flow 'volume_create_manager' (95c8e294-415b-4337-9ef6-ddf55f1116b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 22 21:49:17.890883 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-2597d7fc-da2a-4156-a2b7-23ff8135cac0 tempest-TestVolumeBackupRestore-1156611914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d9b9c83-c8f3-4b23-9407-4327dbe0b693) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:49:17.896967 ncdv-master-1 cinder-volume[129952]: DEBUG oslo_db.sqlalchemy.engines [None req-2597d7fc-da2a-4156-a2b7-23ff8135cac0 tempest-TestVolumeBackupRestore-1156611914 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129952) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 22 21:49:17.911028 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-2597d7fc-da2a-4156-a2b7-23ff8135cac0 tempest-TestVolumeBackupRestore-1156611914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d9b9c83-c8f3-4b23-9407-4327dbe0b693) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-01-22T21:49:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeBackupRestore-volume-1798072198',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=62f19c54-bca2-42c3-b76d-cd55e33e35d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='479688e52574428bab32e5f9e0ad1910',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-01-22T21:49:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-01-22T21:49:18Z,use_quota=True,user_id='2ab4c5a8b2034ac79070e92037330ab5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6dacb05b-a7ea-4056-85ff-98f0ea5c54eb),volume_type_id=6dacb05b-a7ea-4056-85ff-98f0ea5c54eb)' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:49:17.917127 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-2597d7fc-da2a-4156-a2b7-23ff8135cac0 tempest-TestVolumeBackupRestore-1156611914 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e37dff93-db29-4e67-b262-7af6bbcfa524) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:49:17.921396 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-2597d7fc-da2a-4156-a2b7-23ff8135cac0 tempest-TestVolumeBackupRestore-1156611914 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e37dff93-db29-4e67-b262-7af6bbcfa524) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:49:17.926730 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-2597d7fc-da2a-4156-a2b7-23ff8135cac0 tempest-TestVolumeBackupRestore-1156611914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d2d2e92-2c1d-4db4-812b-0f77708846b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:49:18.010243 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-2597d7fc-da2a-4156-a2b7-23ff8135cac0 tempest-TestVolumeBackupRestore-1156611914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d2d2e92-2c1d-4db4-812b-0f77708846b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '62f19c54-bca2-42c3-b76d-cd55e33e35d7', 'volume_name': 'volume-62f19c54-bca2-42c3-b76d-cd55e33e35d7', 'volume_size': 1, 'image_id': '373cb480-3bc4-4821-93e2-442b4e852b80', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '994e8f6963f04af3be3dbae11a73cdfd', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '373cb480-3bc4-4821-93e2-442b4e852b80', 'created_at': datetime.datetime(2022, 1, 22, 20, 50, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 1, 22, 20, 50, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/373cb480-3bc4-4821-93e2-442b4e852b80/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:49:18.015791 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-2597d7fc-da2a-4156-a2b7-23ff8135cac0 tempest-TestVolumeBackupRestore-1156611914 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de4392f5-cda2-4468-9d5c-1e9cb08dad97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:49:18.020040 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-2597d7fc-da2a-4156-a2b7-23ff8135cac0 tempest-TestVolumeBackupRestore-1156611914 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de4392f5-cda2-4468-9d5c-1e9cb08dad97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:49:18.025018 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-2597d7fc-da2a-4156-a2b7-23ff8135cac0 tempest-TestVolumeBackupRestore-1156611914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b62a1ca4-d2d2-4fc2-8077-d7a468165ba8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:49:18.026256 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.flows.manager.create_volume [None req-2597d7fc-da2a-4156-a2b7-23ff8135cac0 tempest-TestVolumeBackupRestore-1156611914 None] Volume 62f19c54-bca2-42c3-b76d-cd55e33e35d7: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-62f19c54-bca2-42c3-b76d-cd55e33e35d7', 'volume_size': 1, 'image_id': '373cb480-3bc4-4821-93e2-442b4e852b80', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '994e8f6963f04af3be3dbae11a73cdfd', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '373cb480-3bc4-4821-93e2-442b4e852b80', 'created_at': datetime.datetime(2022, 1, 22, 20, 50, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 1, 22, 20, 50, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/373cb480-3bc4-4821-93e2-442b4e852b80/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jan 22 21:49:18.026857 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.flows.manager.create_volume [None req-2597d7fc-da2a-4156-a2b7-23ff8135cac0 tempest-TestVolumeBackupRestore-1156611914 None] Cloning 62f19c54-bca2-42c3-b76d-cd55e33e35d7 from image 373cb480-3bc4-4821-93e2-442b4e852b80 at location (None, None). {{(pid=129952) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1046}} Jan 22 21:49:18.035070 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.coordination [None req-2597d7fc-da2a-4156-a2b7-23ff8135cac0 tempest-TestVolumeBackupRestore-1156611914 None] Lock "b'cinder-373cb480-3bc4-4821-93e2-442b4e852b80'" acquired by "_prepare_image_cache_entry" :: waited 0.007s {{(pid=129952) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 22 21:49:18.105547 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.image.cache [None req-2597d7fc-da2a-4156-a2b7-23ff8135cac0 tempest-TestVolumeBackupRestore-1156611914 None] Found image-volume cache entry: {'id': 1, 'image_id': '373cb480-3bc4-4821-93e2-442b4e852b80', 'volume_id': 'f39c1078-cff4-40dd-93df-4ce49cd873b4', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 1, 22, 20, 50, 57), 'last_used': datetime.datetime(2022, 1, 22, 21, 49, 18, 39940)}. {{(pid=129952) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Jan 22 21:49:18.105934 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.image.cache [None req-2597d7fc-da2a-4156-a2b7-23ff8135cac0 tempest-TestVolumeBackupRestore-1156611914 None] Image-volume cache entry image_update_at = 2022-01-22 20:50:57+00:00, requested image updated_at = 2022-01-22 20:50:57+00:00. {{(pid=129952) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Jan 22 21:49:18.106375 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.flows.manager.create_volume [None req-2597d7fc-da2a-4156-a2b7-23ff8135cac0 tempest-TestVolumeBackupRestore-1156611914 None] Found cache entry for image = 373cb480-3bc4-4821-93e2-442b4e852b80 on host ncdv-master-1@ceph#ceph. {{(pid=129952) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:869}} Jan 22 21:49:18.110792 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.coordination [None req-2597d7fc-da2a-4156-a2b7-23ff8135cac0 tempest-TestVolumeBackupRestore-1156611914 None] Lock "b'cinder-373cb480-3bc4-4821-93e2-442b4e852b80'" released by "_prepare_image_cache_entry" :: held 0.076s {{(pid=129952) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 22 21:49:18.111731 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.flows.manager.create_volume [None req-2597d7fc-da2a-4156-a2b7-23ff8135cac0 tempest-TestVolumeBackupRestore-1156611914 None] Attempting to retrieve cache entry for image = 373cb480-3bc4-4821-93e2-442b4e852b80 on host ncdv-master-1@ceph#ceph. {{(pid=129952) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:810}} Jan 22 21:49:18.117961 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.image.cache [None req-2597d7fc-da2a-4156-a2b7-23ff8135cac0 tempest-TestVolumeBackupRestore-1156611914 None] Found image-volume cache entry: {'id': 1, 'image_id': '373cb480-3bc4-4821-93e2-442b4e852b80', 'volume_id': 'f39c1078-cff4-40dd-93df-4ce49cd873b4', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 1, 22, 20, 50, 57), 'last_used': datetime.datetime(2022, 1, 22, 21, 49, 18, 115209)}. {{(pid=129952) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Jan 22 21:49:18.118411 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.image.cache [None req-2597d7fc-da2a-4156-a2b7-23ff8135cac0 tempest-TestVolumeBackupRestore-1156611914 None] Image-volume cache entry image_update_at = 2022-01-22 20:50:57+00:00, requested image updated_at = 2022-01-22 20:50:57+00:00. {{(pid=129952) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Jan 22 21:49:18.118806 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.flows.manager.create_volume [None req-2597d7fc-da2a-4156-a2b7-23ff8135cac0 tempest-TestVolumeBackupRestore-1156611914 None] Creating from source image-volume f39c1078-cff4-40dd-93df-4ce49cd873b4 {{(pid=129952) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:824}} Jan 22 21:49:18.130108 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-2597d7fc-da2a-4156-a2b7-23ff8135cac0 tempest-TestVolumeBackupRestore-1156611914 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:49:18.258288 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-2597d7fc-da2a-4156-a2b7-23ff8135cac0 tempest-TestVolumeBackupRestore-1156611914 None] creating snapshot='volume-62f19c54-bca2-42c3-b76d-cd55e33e35d7.clone_snap' {{(pid=129952) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:725}} Jan 22 21:49:19.614311 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-2597d7fc-da2a-4156-a2b7-23ff8135cac0 tempest-TestVolumeBackupRestore-1156611914 None] cloning 'volume-f39c1078-cff4-40dd-93df-4ce49cd873b4@volume-62f19c54-bca2-42c3-b76d-cd55e33e35d7.clone_snap' to 'volume-62f19c54-bca2-42c3-b76d-cd55e33e35d7' {{(pid=129952) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:731}} Jan 22 21:49:20.720252 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-2597d7fc-da2a-4156-a2b7-23ff8135cac0 tempest-TestVolumeBackupRestore-1156611914 None] Volume volume-0b17e2f4-e149-4a4b-b525-3d029be2e6f6.deleted is not a clone. {{(pid=129952) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Jan 22 21:49:20.723833 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-2597d7fc-da2a-4156-a2b7-23ff8135cac0 tempest-TestVolumeBackupRestore-1156611914 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129952) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 22 21:49:20.724206 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-2597d7fc-da2a-4156-a2b7-23ff8135cac0 tempest-TestVolumeBackupRestore-1156611914 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129952) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 22 21:49:21.046741 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-2597d7fc-da2a-4156-a2b7-23ff8135cac0 tempest-TestVolumeBackupRestore-1156611914 None] clone created successfully {{(pid=129952) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:803}} Jan 22 21:49:21.046741 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.volume_utils [None req-2597d7fc-da2a-4156-a2b7-23ff8135cac0 tempest-TestVolumeBackupRestore-1156611914 None] Marking volume 62f19c54-bca2-42c3-b76d-cd55e33e35d7 as bootable. {{(pid=129952) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1178}} Jan 22 21:49:21.122722 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.flows.manager.create_volume [None req-2597d7fc-da2a-4156-a2b7-23ff8135cac0 tempest-TestVolumeBackupRestore-1156611914 None] Copying metadata from image 373cb480-3bc4-4821-93e2-442b4e852b80 to 62f19c54-bca2-42c3-b76d-cd55e33e35d7. {{(pid=129952) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:443}} Jan 22 21:49:21.123173 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.flows.manager.create_volume [None req-2597d7fc-da2a-4156-a2b7-23ff8135cac0 tempest-TestVolumeBackupRestore-1156611914 None] Creating volume glance metadata for volume 62f19c54-bca2-42c3-b76d-cd55e33e35d7 backed by image 373cb480-3bc4-4821-93e2-442b4e852b80 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '373cb480-3bc4-4821-93e2-442b4e852b80', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=129952) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:666}} Jan 22 21:49:21.262190 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-2597d7fc-da2a-4156-a2b7-23ff8135cac0 tempest-TestVolumeBackupRestore-1156611914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b62a1ca4-d2d2-4fc2-8077-d7a468165ba8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-62f19c54-bca2-42c3-b76d-cd55e33e35d7', 'volume_size': 1, 'image_id': '373cb480-3bc4-4821-93e2-442b4e852b80', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '994e8f6963f04af3be3dbae11a73cdfd', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '373cb480-3bc4-4821-93e2-442b4e852b80', 'created_at': datetime.datetime(2022, 1, 22, 20, 50, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 1, 22, 20, 50, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/373cb480-3bc4-4821-93e2-442b4e852b80/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:49:21.267328 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-2597d7fc-da2a-4156-a2b7-23ff8135cac0 tempest-TestVolumeBackupRestore-1156611914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (237dc968-88a3-44ff-b86b-8cecb3872a67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:49:21.378409 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.flows.manager.create_volume [None req-2597d7fc-da2a-4156-a2b7-23ff8135cac0 tempest-TestVolumeBackupRestore-1156611914 None] Volume volume-62f19c54-bca2-42c3-b76d-cd55e33e35d7 (62f19c54-bca2-42c3-b76d-cd55e33e35d7): created successfully Jan 22 21:49:21.382358 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-2597d7fc-da2a-4156-a2b7-23ff8135cac0 tempest-TestVolumeBackupRestore-1156611914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (237dc968-88a3-44ff-b86b-8cecb3872a67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:49:21.388263 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-2597d7fc-da2a-4156-a2b7-23ff8135cac0 tempest-TestVolumeBackupRestore-1156611914 None] Flow 'volume_create_manager' (95c8e294-415b-4337-9ef6-ddf55f1116b6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129952) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 22 21:49:21.465361 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-2597d7fc-da2a-4156-a2b7-23ff8135cac0 tempest-TestVolumeBackupRestore-1156611914 None] Created volume successfully. Jan 22 21:49:22.745832 ncdv-master-1 cinder-volume[129952]: DEBUG oslo_concurrency.processutils [None req-d1c7b97c-aca3-428d-b7ee-18c15e21748c tempest-TestVolumeBackupRestore-1156611914 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129952) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jan 22 21:49:23.468933 ncdv-master-1 cinder-volume[129952]: DEBUG oslo_concurrency.processutils [None req-d1c7b97c-aca3-428d-b7ee-18c15e21748c tempest-TestVolumeBackupRestore-1156611914 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.723s {{(pid=129952) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jan 22 21:49:23.469764 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-d1c7b97c-aca3-428d-b7ee-18c15e21748c tempest-TestVolumeBackupRestore-1156611914 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-62f19c54-bca2-42c3-b76d-cd55e33e35d7', 'hosts': ['10.222.0.100'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'c7ee930a-3b87-450e-91f6-d4eef70cb484', 'volume_id': '62f19c54-bca2-42c3-b76d-cd55e33e35d7', 'discard': True}} {{(pid=129952) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Jan 22 21:49:23.485882 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-d1c7b97c-aca3-428d-b7ee-18c15e21748c tempest-TestVolumeBackupRestore-1156611914 None] Initialize volume connection completed successfully. Jan 22 21:50:08.710502 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-d1c7b97c-aca3-428d-b7ee-18c15e21748c tempest-TestVolumeBackupRestore-1156611914 None] Terminate volume connection completed successfully. Jan 22 21:50:08.726307 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-d1c7b97c-aca3-428d-b7ee-18c15e21748c tempest-TestVolumeBackupRestore-1156611914 None] Remove volume export completed successfully. Jan 22 21:50:10.458118 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.flows.manager.create_volume [None req-f76a8884-136f-43ce-b33b-b0e47ab86a10 tempest-TestVolumeBackupRestore-1156611914 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129952) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Jan 22 21:50:10.462017 ncdv-master-1 cinder-volume[129952]: WARNING stevedore.named [None req-f76a8884-136f-43ce-b33b-b0e47ab86a10 tempest-TestVolumeBackupRestore-1156611914 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jan 22 21:50:10.462516 ncdv-master-1 cinder-volume[129952]: WARNING castellan.key_manager [None req-f76a8884-136f-43ce-b33b-b0e47ab86a10 tempest-TestVolumeBackupRestore-1156611914 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 22 21:50:10.484281 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-f76a8884-136f-43ce-b33b-b0e47ab86a10 tempest-TestVolumeBackupRestore-1156611914 None] Flow 'volume_create_manager' (dcf16a07-0320-4fd7-b6c9-3215d4e611d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 22 21:50:10.491179 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-f76a8884-136f-43ce-b33b-b0e47ab86a10 tempest-TestVolumeBackupRestore-1156611914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (376fb129-81a2-4220-a66e-84eedfa943ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:50:10.501326 ncdv-master-1 cinder-volume[129952]: DEBUG oslo_db.sqlalchemy.engines [None req-f76a8884-136f-43ce-b33b-b0e47ab86a10 tempest-TestVolumeBackupRestore-1156611914 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129952) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 22 21:50:10.519245 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-f76a8884-136f-43ce-b33b-b0e47ab86a10 tempest-TestVolumeBackupRestore-1156611914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (376fb129-81a2-4220-a66e-84eedfa943ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-01-22T21:50:10Z,deleted=False,deleted_at=None,display_description='auto-created_from_restore_from_backup',display_name='restore_backup_0974b291-264a-43d8-a350-04db1b3ede47',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=7787920b-4db0-477d-a5ae-1db8121ceed7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='479688e52574428bab32e5f9e0ad1910',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-01-22T21:50:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-01-22T21:50:10Z,use_quota=True,user_id='2ab4c5a8b2034ac79070e92037330ab5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6dacb05b-a7ea-4056-85ff-98f0ea5c54eb),volume_type_id=6dacb05b-a7ea-4056-85ff-98f0ea5c54eb)' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:50:10.527472 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-f76a8884-136f-43ce-b33b-b0e47ab86a10 tempest-TestVolumeBackupRestore-1156611914 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7cfc4116-51e5-46ec-9732-5d749d70d0f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:50:10.532745 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-f76a8884-136f-43ce-b33b-b0e47ab86a10 tempest-TestVolumeBackupRestore-1156611914 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7cfc4116-51e5-46ec-9732-5d749d70d0f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:50:10.537996 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-f76a8884-136f-43ce-b33b-b0e47ab86a10 tempest-TestVolumeBackupRestore-1156611914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba1f2a09-887b-483e-ae6f-b438f58b4bdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:50:10.542245 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-f76a8884-136f-43ce-b33b-b0e47ab86a10 tempest-TestVolumeBackupRestore-1156611914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba1f2a09-887b-483e-ae6f-b438f58b4bdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7787920b-4db0-477d-a5ae-1db8121ceed7', 'volume_name': 'volume-7787920b-4db0-477d-a5ae-1db8121ceed7', 'volume_size': 1}' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:50:10.547816 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-f76a8884-136f-43ce-b33b-b0e47ab86a10 tempest-TestVolumeBackupRestore-1156611914 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb3e4db5-691b-41f2-86ef-00621d8e5982) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:50:10.551966 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-f76a8884-136f-43ce-b33b-b0e47ab86a10 tempest-TestVolumeBackupRestore-1156611914 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb3e4db5-691b-41f2-86ef-00621d8e5982) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:50:10.556777 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-f76a8884-136f-43ce-b33b-b0e47ab86a10 tempest-TestVolumeBackupRestore-1156611914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15e99280-2afc-47ca-a41e-36072a73e0fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:50:10.557910 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.flows.manager.create_volume [None req-f76a8884-136f-43ce-b33b-b0e47ab86a10 tempest-TestVolumeBackupRestore-1156611914 None] Volume 7787920b-4db0-477d-a5ae-1db8121ceed7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7787920b-4db0-477d-a5ae-1db8121ceed7', 'volume_size': 1} Jan 22 21:50:10.558316 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-f76a8884-136f-43ce-b33b-b0e47ab86a10 tempest-TestVolumeBackupRestore-1156611914 None] creating volume 'volume-7787920b-4db0-477d-a5ae-1db8121ceed7' {{(pid=129952) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Jan 22 21:50:10.559419 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-f76a8884-136f-43ce-b33b-b0e47ab86a10 tempest-TestVolumeBackupRestore-1156611914 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:50:11.079085 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-f76a8884-136f-43ce-b33b-b0e47ab86a10 tempest-TestVolumeBackupRestore-1156611914 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129952) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 22 21:50:11.079477 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-f76a8884-136f-43ce-b33b-b0e47ab86a10 tempest-TestVolumeBackupRestore-1156611914 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129952) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 22 21:50:11.083411 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-f76a8884-136f-43ce-b33b-b0e47ab86a10 tempest-TestVolumeBackupRestore-1156611914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15e99280-2afc-47ca-a41e-36072a73e0fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7787920b-4db0-477d-a5ae-1db8121ceed7', 'volume_size': 1}' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:50:11.088115 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-f76a8884-136f-43ce-b33b-b0e47ab86a10 tempest-TestVolumeBackupRestore-1156611914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61949886-1d85-42f4-a3f2-c6c488fe8ad4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 21:50:11.143850 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.flows.manager.create_volume [None req-f76a8884-136f-43ce-b33b-b0e47ab86a10 tempest-TestVolumeBackupRestore-1156611914 None] Volume volume-7787920b-4db0-477d-a5ae-1db8121ceed7 (7787920b-4db0-477d-a5ae-1db8121ceed7): created successfully Jan 22 21:50:11.147555 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-f76a8884-136f-43ce-b33b-b0e47ab86a10 tempest-TestVolumeBackupRestore-1156611914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61949886-1d85-42f4-a3f2-c6c488fe8ad4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 21:50:11.153269 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-f76a8884-136f-43ce-b33b-b0e47ab86a10 tempest-TestVolumeBackupRestore-1156611914 None] Flow 'volume_create_manager' (dcf16a07-0320-4fd7-b6c9-3215d4e611d1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129952) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 22 21:50:11.229888 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-f76a8884-136f-43ce-b33b-b0e47ab86a10 tempest-TestVolumeBackupRestore-1156611914 None] Created volume successfully. Jan 22 21:50:11.481245 ncdv-master-1 cinder-volume[129952]: DEBUG oslo_concurrency.processutils [None req-f76a8884-136f-43ce-b33b-b0e47ab86a10 tempest-TestVolumeBackupRestore-1156611914 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129952) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jan 22 21:50:12.108716 ncdv-master-1 cinder-volume[129952]: DEBUG oslo_concurrency.processutils [None req-f76a8884-136f-43ce-b33b-b0e47ab86a10 tempest-TestVolumeBackupRestore-1156611914 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.627s {{(pid=129952) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jan 22 21:50:12.109596 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-f76a8884-136f-43ce-b33b-b0e47ab86a10 tempest-TestVolumeBackupRestore-1156611914 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-7787920b-4db0-477d-a5ae-1db8121ceed7', 'hosts': ['10.222.0.100'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'c7ee930a-3b87-450e-91f6-d4eef70cb484', 'volume_id': '7787920b-4db0-477d-a5ae-1db8121ceed7', 'discard': True}} {{(pid=129952) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Jan 22 21:50:12.124889 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-f76a8884-136f-43ce-b33b-b0e47ab86a10 tempest-TestVolumeBackupRestore-1156611914 None] Initialize volume connection completed successfully. Jan 22 21:50:16.952643 ncdv-master-1 cinder-volume[129952]: DEBUG oslo_service.periodic_task [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129952) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jan 22 21:50:16.953898 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:50:16.980378 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:50:17.005451 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.manager [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] Notifying Schedulers of capabilities ... {{(pid=129952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 22 21:50:56.483970 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-f76a8884-136f-43ce-b33b-b0e47ab86a10 tempest-TestVolumeBackupRestore-1156611914 None] Terminate volume connection completed successfully. Jan 22 21:50:56.503332 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-f76a8884-136f-43ce-b33b-b0e47ab86a10 tempest-TestVolumeBackupRestore-1156611914 None] Remove volume export completed successfully. Jan 22 21:51:04.101236 ncdv-master-1 cinder-volume[129952]: DEBUG oslo_concurrency.processutils [req-88b1d930-340a-4030-825c-c67c911a47e3 req-a0bd9225-2d0e-47b9-800c-d3290500a300 tempest-TestVolumeBackupRestore-1156611914 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129952) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jan 22 21:51:04.790262 ncdv-master-1 cinder-volume[129952]: DEBUG oslo_concurrency.processutils [req-88b1d930-340a-4030-825c-c67c911a47e3 req-a0bd9225-2d0e-47b9-800c-d3290500a300 tempest-TestVolumeBackupRestore-1156611914 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.688s {{(pid=129952) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jan 22 21:51:04.791689 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [req-88b1d930-340a-4030-825c-c67c911a47e3 req-a0bd9225-2d0e-47b9-800c-d3290500a300 tempest-TestVolumeBackupRestore-1156611914 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-7787920b-4db0-477d-a5ae-1db8121ceed7', 'hosts': ['10.222.0.100'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'c7ee930a-3b87-450e-91f6-d4eef70cb484', 'volume_id': '7787920b-4db0-477d-a5ae-1db8121ceed7', 'discard': True}} {{(pid=129952) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Jan 22 21:51:04.877538 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [req-88b1d930-340a-4030-825c-c67c911a47e3 req-a0bd9225-2d0e-47b9-800c-d3290500a300 tempest-TestVolumeBackupRestore-1156611914 None] Connection info returned from driver {'name': 'volumes/volume-7787920b-4db0-477d-a5ae-1db8121ceed7', 'hosts': ['10.222.0.100'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '7787920b-4db0-477d-a5ae-1db8121ceed7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'd2fb938f-e6ac-43bf-9729-65e8a63bf286'} {{(pid=129952) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4811}} Jan 22 21:51:04.983543 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [req-88b1d930-340a-4030-825c-c67c911a47e3 req-a0bd9225-2d0e-47b9-800c-d3290500a300 tempest-TestVolumeBackupRestore-1156611914 None] attachment_update completed successfully. Jan 22 21:51:16.951117 ncdv-master-1 cinder-volume[129952]: DEBUG oslo_service.periodic_task [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129952) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jan 22 21:51:16.952168 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:51:16.984476 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:51:17.007586 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.manager [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] Notifying Schedulers of capabilities ... {{(pid=129952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 22 21:52:16.953151 ncdv-master-1 cinder-volume[129952]: DEBUG oslo_service.periodic_task [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129952) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jan 22 21:52:16.953974 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:52:16.975190 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:52:16.997668 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.manager [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] Notifying Schedulers of capabilities ... {{(pid=129952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 22 21:53:16.954889 ncdv-master-1 cinder-volume[129952]: DEBUG oslo_service.periodic_task [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129952) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jan 22 21:53:16.955555 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:53:16.977032 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:53:17.001047 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.manager [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] Notifying Schedulers of capabilities ... {{(pid=129952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 22 21:54:16.957276 ncdv-master-1 cinder-volume[129952]: DEBUG oslo_service.periodic_task [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129952) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jan 22 21:54:16.958691 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:54:16.982979 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:54:17.011728 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.manager [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] Notifying Schedulers of capabilities ... {{(pid=129952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 22 21:55:16.959220 ncdv-master-1 cinder-volume[129952]: DEBUG oslo_service.periodic_task [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129952) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jan 22 21:55:16.959878 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:55:16.981992 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:55:17.007302 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.manager [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] Notifying Schedulers of capabilities ... {{(pid=129952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 22 21:56:13.180620 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [req-9b117af5-aebe-41a5-9f2e-5afc9fa0d9d6 req-541700dd-5989-4ee4-bad2-f5aa3c0a669f tempest-TestVolumeBackupRestore-1156611914 None] Terminate volume connection completed successfully. Jan 22 21:56:13.181305 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [req-9b117af5-aebe-41a5-9f2e-5afc9fa0d9d6 req-541700dd-5989-4ee4-bad2-f5aa3c0a669f tempest-TestVolumeBackupRestore-1156611914 None] Deleting attachment d2fb938f-e6ac-43bf-9729-65e8a63bf286. {{(pid=129952) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4947}} Jan 22 21:56:15.308553 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.coordination [None req-e3ee21f8-e437-4b59-93e1-44b511d61a41 tempest-TestVolumeBackupRestore-1156611914 None] Lock "b'cinder-7787920b-4db0-477d-a5ae-1db8121ceed7-delete_volume'" acquired by "delete_volume" :: waited 0.010s {{(pid=129952) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 22 21:56:15.384523 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-e3ee21f8-e437-4b59-93e1-44b511d61a41 tempest-TestVolumeBackupRestore-1156611914 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:56:17.662650 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-e3ee21f8-e437-4b59-93e1-44b511d61a41 tempest-TestVolumeBackupRestore-1156611914 None] Volume volume-7787920b-4db0-477d-a5ae-1db8121ceed7 is not a clone. {{(pid=129952) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Jan 22 21:56:18.399885 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-e3ee21f8-e437-4b59-93e1-44b511d61a41 tempest-TestVolumeBackupRestore-1156611914 None] deleting rbd volume volume-7787920b-4db0-477d-a5ae-1db8121ceed7 {{(pid=129952) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Jan 22 21:56:18.403177 ncdv-master-1 cinder-volume[129952]: DEBUG oslo_service.periodic_task [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129952) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jan 22 21:56:18.403760 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:56:18.431047 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:56:18.468824 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.manager [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] Notifying Schedulers of capabilities ... {{(pid=129952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 22 21:56:18.502923 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.coordination [None req-5a9c72b5-89b7-40f8-9fdd-de251b30dea0 tempest-TestVolumeBackupRestore-1156611914 None] Lock "b'cinder-62f19c54-bca2-42c3-b76d-cd55e33e35d7-delete_volume'" acquired by "delete_volume" :: waited 0.017s {{(pid=129952) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 22 21:56:18.584319 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-5a9c72b5-89b7-40f8-9fdd-de251b30dea0 tempest-TestVolumeBackupRestore-1156611914 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:56:22.069612 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-5a9c72b5-89b7-40f8-9fdd-de251b30dea0 tempest-TestVolumeBackupRestore-1156611914 None] deleting rbd volume volume-62f19c54-bca2-42c3-b76d-cd55e33e35d7 {{(pid=129952) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Jan 22 21:56:29.372910 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-5a9c72b5-89b7-40f8-9fdd-de251b30dea0 tempest-TestVolumeBackupRestore-1156611914 None] volume is a clone so cleaning references {{(pid=129952) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1266}} Jan 22 21:56:29.669214 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-5a9c72b5-89b7-40f8-9fdd-de251b30dea0 tempest-TestVolumeBackupRestore-1156611914 None] deleting parent snapshot volume-62f19c54-bca2-42c3-b76d-cd55e33e35d7.clone_snap {{(pid=129952) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1158}} Jan 22 21:56:32.426599 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.quota [None req-e3ee21f8-e437-4b59-93e1-44b511d61a41 tempest-TestVolumeBackupRestore-1156611914 None] Created reservations ['bece3430-ec40-450e-86c2-6518ce099657', '739ed228-fb03-4ce7-9288-83f002cff0f4', '9de76fcb-c3dd-422c-8791-63b36ce36043', '6f0768d0-dd3b-4a53-9383-3939fdf8b9bf'] {{(pid=129952) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 22 21:56:32.575972 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.quota [None req-5a9c72b5-89b7-40f8-9fdd-de251b30dea0 tempest-TestVolumeBackupRestore-1156611914 None] Created reservations ['1f3076b8-ced5-4bd1-ba1b-af91cca4032c', '25ed35dd-2283-4161-b5ce-7cca06ab156c', '92ae7666-b49b-4b8e-9f6d-772fe5060e3a', '7ea1b90c-4780-4a9e-924b-18f0c0215caa'] {{(pid=129952) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 22 21:56:32.694968 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-e3ee21f8-e437-4b59-93e1-44b511d61a41 tempest-TestVolumeBackupRestore-1156611914 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:56:32.718989 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-e3ee21f8-e437-4b59-93e1-44b511d61a41 tempest-TestVolumeBackupRestore-1156611914 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:56:32.744540 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.manager [None req-e3ee21f8-e437-4b59-93e1-44b511d61a41 tempest-TestVolumeBackupRestore-1156611914 None] Notifying Schedulers of capabilities ... {{(pid=129952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 22 21:56:32.751564 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-e3ee21f8-e437-4b59-93e1-44b511d61a41 tempest-TestVolumeBackupRestore-1156611914 None] Deleted volume successfully. Jan 22 21:56:32.828317 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.coordination [None req-e3ee21f8-e437-4b59-93e1-44b511d61a41 tempest-TestVolumeBackupRestore-1156611914 None] Lock "b'cinder-7787920b-4db0-477d-a5ae-1db8121ceed7-delete_volume'" released by "delete_volume" :: held 17.522s {{(pid=129952) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 22 21:56:32.844884 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-5a9c72b5-89b7-40f8-9fdd-de251b30dea0 tempest-TestVolumeBackupRestore-1156611914 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:56:32.867009 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-5a9c72b5-89b7-40f8-9fdd-de251b30dea0 tempest-TestVolumeBackupRestore-1156611914 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:56:32.890733 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.manager [None req-5a9c72b5-89b7-40f8-9fdd-de251b30dea0 tempest-TestVolumeBackupRestore-1156611914 None] Notifying Schedulers of capabilities ... {{(pid=129952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 22 21:56:32.894408 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-5a9c72b5-89b7-40f8-9fdd-de251b30dea0 tempest-TestVolumeBackupRestore-1156611914 None] Deleted volume successfully. Jan 22 21:56:32.987621 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.coordination [None req-5a9c72b5-89b7-40f8-9fdd-de251b30dea0 tempest-TestVolumeBackupRestore-1156611914 None] Lock "b'cinder-62f19c54-bca2-42c3-b76d-cd55e33e35d7-delete_volume'" released by "delete_volume" :: held 14.494s {{(pid=129952) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 22 21:57:18.403441 ncdv-master-1 cinder-volume[129952]: DEBUG oslo_service.periodic_task [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129952) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jan 22 21:57:18.406439 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:57:18.444235 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:57:18.469071 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.manager [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] Notifying Schedulers of capabilities ... {{(pid=129952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 22 21:58:18.405342 ncdv-master-1 cinder-volume[129952]: DEBUG oslo_service.periodic_task [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129952) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jan 22 21:58:18.406139 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:58:18.429158 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:58:18.450794 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.manager [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] Notifying Schedulers of capabilities ... {{(pid=129952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 22 21:59:18.406087 ncdv-master-1 cinder-volume[129952]: DEBUG oslo_service.periodic_task [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129952) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jan 22 21:59:18.406805 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:59:18.434596 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 21:59:18.459393 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.manager [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] Notifying Schedulers of capabilities ... {{(pid=129952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 22 22:00:18.404949 ncdv-master-1 cinder-volume[129952]: DEBUG oslo_service.periodic_task [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129952) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jan 22 22:00:18.405662 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 22:00:18.432572 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 22:00:18.455089 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.manager [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] Notifying Schedulers of capabilities ... {{(pid=129952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 22 22:01:18.410310 ncdv-master-1 cinder-volume[129952]: DEBUG oslo_service.periodic_task [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129952) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jan 22 22:01:18.416137 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 22:01:18.433745 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 22:01:18.455839 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.manager [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] Notifying Schedulers of capabilities ... {{(pid=129952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 22 22:02:18.410745 ncdv-master-1 cinder-volume[129952]: DEBUG oslo_service.periodic_task [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129952) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jan 22 22:02:18.411413 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 22:02:18.469799 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 22:02:18.491227 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.manager [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] Notifying Schedulers of capabilities ... {{(pid=129952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 22 22:03:18.407035 ncdv-master-1 cinder-volume[129952]: DEBUG oslo_service.periodic_task [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129952) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jan 22 22:03:18.407724 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 22:03:18.430046 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 22:03:18.451425 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.manager [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] Notifying Schedulers of capabilities ... {{(pid=129952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 22 22:04:18.407244 ncdv-master-1 cinder-volume[129952]: DEBUG oslo_service.periodic_task [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129952) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jan 22 22:04:18.416492 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 22:04:18.432439 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 22:04:18.454091 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.manager [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] Notifying Schedulers of capabilities ... {{(pid=129952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 22 22:05:18.409092 ncdv-master-1 cinder-volume[129952]: DEBUG oslo_service.periodic_task [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129952) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jan 22 22:05:18.409823 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 22:05:18.432284 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 22:05:18.455003 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.manager [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] Notifying Schedulers of capabilities ... {{(pid=129952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 22 22:06:18.409646 ncdv-master-1 cinder-volume[129952]: DEBUG oslo_service.periodic_task [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129952) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jan 22 22:06:18.410596 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 22:06:18.432179 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 22:06:18.456030 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.manager [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] Notifying Schedulers of capabilities ... {{(pid=129952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 22 22:07:18.410933 ncdv-master-1 cinder-volume[129952]: DEBUG oslo_service.periodic_task [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129952) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jan 22 22:07:18.411605 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 22:07:18.435903 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 22:07:18.458615 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.manager [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] Notifying Schedulers of capabilities ... {{(pid=129952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 22 22:08:18.413026 ncdv-master-1 cinder-volume[129952]: DEBUG oslo_service.periodic_task [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129952) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jan 22 22:08:18.413887 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 22:08:18.435552 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 22:08:18.457803 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.manager [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] Notifying Schedulers of capabilities ... {{(pid=129952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 22 22:09:18.412891 ncdv-master-1 cinder-volume[129952]: DEBUG oslo_service.periodic_task [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129952) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jan 22 22:09:18.413574 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 22:09:18.452690 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 22:09:18.558415 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.manager [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] Notifying Schedulers of capabilities ... {{(pid=129952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 22 22:10:18.414505 ncdv-master-1 cinder-volume[129952]: DEBUG oslo_service.periodic_task [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129952) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jan 22 22:10:18.429183 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 22:10:18.437652 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 22:10:18.459986 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.manager [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] Notifying Schedulers of capabilities ... {{(pid=129952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 22 22:11:04.882139 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.flows.manager.create_volume [None req-a0cde96f-a9fd-4e86-b1ae-5d198874cc13 tempest-ServerActionsTestJSON-602623794 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129952) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Jan 22 22:11:04.885954 ncdv-master-1 cinder-volume[129952]: WARNING stevedore.named [None req-a0cde96f-a9fd-4e86-b1ae-5d198874cc13 tempest-ServerActionsTestJSON-602623794 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jan 22 22:11:04.886491 ncdv-master-1 cinder-volume[129952]: WARNING castellan.key_manager [None req-a0cde96f-a9fd-4e86-b1ae-5d198874cc13 tempest-ServerActionsTestJSON-602623794 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 22 22:11:04.907062 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-a0cde96f-a9fd-4e86-b1ae-5d198874cc13 tempest-ServerActionsTestJSON-602623794 None] Flow 'volume_create_manager' (32a86905-1eb9-4e7a-976b-c2c54400f85b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 22 22:11:04.913773 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-a0cde96f-a9fd-4e86-b1ae-5d198874cc13 tempest-ServerActionsTestJSON-602623794 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c03690df-1d86-4335-a221-ec8b4a13b6f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 22:11:04.921029 ncdv-master-1 cinder-volume[129952]: DEBUG oslo_db.sqlalchemy.engines [None req-a0cde96f-a9fd-4e86-b1ae-5d198874cc13 tempest-ServerActionsTestJSON-602623794 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129952) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 22 22:11:04.934951 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-a0cde96f-a9fd-4e86-b1ae-5d198874cc13 tempest-ServerActionsTestJSON-602623794 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c03690df-1d86-4335-a221-ec8b4a13b6f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-01-22T22:11:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestJSON-volume-777568483',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=6306e2dc-90a5-4e80-bc1e-986664ed75cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af530edb3b084c18bf5595f46cffdf35',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-01-22T22:11:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-01-22T22:11:05Z,use_quota=True,user_id='d51f7a75cf6144f0b3bf7e63fcea6827',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6dacb05b-a7ea-4056-85ff-98f0ea5c54eb),volume_type_id=6dacb05b-a7ea-4056-85ff-98f0ea5c54eb)' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 22:11:04.941042 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-a0cde96f-a9fd-4e86-b1ae-5d198874cc13 tempest-ServerActionsTestJSON-602623794 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca7b2921-d4eb-4564-a6e6-378a91f18a40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 22:11:04.945331 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-a0cde96f-a9fd-4e86-b1ae-5d198874cc13 tempest-ServerActionsTestJSON-602623794 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca7b2921-d4eb-4564-a6e6-378a91f18a40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 22:11:04.950744 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-a0cde96f-a9fd-4e86-b1ae-5d198874cc13 tempest-ServerActionsTestJSON-602623794 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5bfe7e98-f003-4f1f-a97f-a3a3054f072a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 22:11:04.955865 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-a0cde96f-a9fd-4e86-b1ae-5d198874cc13 tempest-ServerActionsTestJSON-602623794 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5bfe7e98-f003-4f1f-a97f-a3a3054f072a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6306e2dc-90a5-4e80-bc1e-986664ed75cd', 'volume_name': 'volume-6306e2dc-90a5-4e80-bc1e-986664ed75cd', 'volume_size': 1}' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 22:11:04.960948 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-a0cde96f-a9fd-4e86-b1ae-5d198874cc13 tempest-ServerActionsTestJSON-602623794 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b3017f9-321b-4ad4-b029-082f197b3282) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 22:11:04.965626 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-a0cde96f-a9fd-4e86-b1ae-5d198874cc13 tempest-ServerActionsTestJSON-602623794 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b3017f9-321b-4ad4-b029-082f197b3282) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 22:11:04.970016 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-a0cde96f-a9fd-4e86-b1ae-5d198874cc13 tempest-ServerActionsTestJSON-602623794 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (480f36c0-bfc3-43a7-bc1e-f85cdeaf192d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 22:11:04.971308 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.flows.manager.create_volume [None req-a0cde96f-a9fd-4e86-b1ae-5d198874cc13 tempest-ServerActionsTestJSON-602623794 None] Volume 6306e2dc-90a5-4e80-bc1e-986664ed75cd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6306e2dc-90a5-4e80-bc1e-986664ed75cd', 'volume_size': 1} Jan 22 22:11:04.971728 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-a0cde96f-a9fd-4e86-b1ae-5d198874cc13 tempest-ServerActionsTestJSON-602623794 None] creating volume 'volume-6306e2dc-90a5-4e80-bc1e-986664ed75cd' {{(pid=129952) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Jan 22 22:11:04.972717 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-a0cde96f-a9fd-4e86-b1ae-5d198874cc13 tempest-ServerActionsTestJSON-602623794 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 22:11:05.483480 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-a0cde96f-a9fd-4e86-b1ae-5d198874cc13 tempest-ServerActionsTestJSON-602623794 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129952) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 22 22:11:05.484015 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-a0cde96f-a9fd-4e86-b1ae-5d198874cc13 tempest-ServerActionsTestJSON-602623794 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129952) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 22 22:11:05.488870 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-a0cde96f-a9fd-4e86-b1ae-5d198874cc13 tempest-ServerActionsTestJSON-602623794 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (480f36c0-bfc3-43a7-bc1e-f85cdeaf192d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6306e2dc-90a5-4e80-bc1e-986664ed75cd', 'volume_size': 1}' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 22:11:05.493638 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-a0cde96f-a9fd-4e86-b1ae-5d198874cc13 tempest-ServerActionsTestJSON-602623794 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01ceb89a-f3c3-47fe-aaca-346b4339e575) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 22:11:05.557106 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.flows.manager.create_volume [None req-a0cde96f-a9fd-4e86-b1ae-5d198874cc13 tempest-ServerActionsTestJSON-602623794 None] Volume volume-6306e2dc-90a5-4e80-bc1e-986664ed75cd (6306e2dc-90a5-4e80-bc1e-986664ed75cd): created successfully Jan 22 22:11:05.560874 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-a0cde96f-a9fd-4e86-b1ae-5d198874cc13 tempest-ServerActionsTestJSON-602623794 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01ceb89a-f3c3-47fe-aaca-346b4339e575) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 22:11:05.567008 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-a0cde96f-a9fd-4e86-b1ae-5d198874cc13 tempest-ServerActionsTestJSON-602623794 None] Flow 'volume_create_manager' (32a86905-1eb9-4e7a-976b-c2c54400f85b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129952) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 22 22:11:05.666266 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-a0cde96f-a9fd-4e86-b1ae-5d198874cc13 tempest-ServerActionsTestJSON-602623794 None] Created volume successfully. Jan 22 22:11:06.921375 ncdv-master-1 cinder-volume[129952]: DEBUG oslo_concurrency.processutils [req-82d91c9b-6638-4447-9bc3-e70f52ad61c6 req-376c0d3a-4def-40a9-8606-7ab62ed1b14a tempest-ServerActionsTestJSON-602623794 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129952) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jan 22 22:11:07.558609 ncdv-master-1 cinder-volume[129952]: DEBUG oslo_concurrency.processutils [req-82d91c9b-6638-4447-9bc3-e70f52ad61c6 req-376c0d3a-4def-40a9-8606-7ab62ed1b14a tempest-ServerActionsTestJSON-602623794 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.637s {{(pid=129952) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jan 22 22:11:07.559445 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [req-82d91c9b-6638-4447-9bc3-e70f52ad61c6 req-376c0d3a-4def-40a9-8606-7ab62ed1b14a tempest-ServerActionsTestJSON-602623794 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-6306e2dc-90a5-4e80-bc1e-986664ed75cd', 'hosts': ['10.222.0.100'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'c7ee930a-3b87-450e-91f6-d4eef70cb484', 'volume_id': '6306e2dc-90a5-4e80-bc1e-986664ed75cd', 'discard': True}} {{(pid=129952) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Jan 22 22:11:07.657704 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [req-82d91c9b-6638-4447-9bc3-e70f52ad61c6 req-376c0d3a-4def-40a9-8606-7ab62ed1b14a tempest-ServerActionsTestJSON-602623794 None] Connection info returned from driver {'name': 'volumes/volume-6306e2dc-90a5-4e80-bc1e-986664ed75cd', 'hosts': ['10.222.0.100'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '6306e2dc-90a5-4e80-bc1e-986664ed75cd', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '5ae86cee-7055-4dc8-bb35-6e34b61979e2'} {{(pid=129952) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4811}} Jan 22 22:11:07.764684 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [req-82d91c9b-6638-4447-9bc3-e70f52ad61c6 req-376c0d3a-4def-40a9-8606-7ab62ed1b14a tempest-ServerActionsTestJSON-602623794 None] attachment_update completed successfully. Jan 22 22:11:18.415057 ncdv-master-1 cinder-volume[129952]: DEBUG oslo_service.periodic_task [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129952) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jan 22 22:11:18.416171 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 22:11:18.448077 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 22:11:18.475922 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.manager [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] Notifying Schedulers of capabilities ... {{(pid=129952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 22 22:11:27.445725 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [req-5715dbd8-f72a-4a53-b487-3c7e05d44050 req-a11cba45-eadb-4922-8327-32e6f225beb5 tempest-ServerActionsTestJSON-602623794 None] Terminate volume connection completed successfully. Jan 22 22:11:27.447348 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [req-5715dbd8-f72a-4a53-b487-3c7e05d44050 req-a11cba45-eadb-4922-8327-32e6f225beb5 tempest-ServerActionsTestJSON-602623794 None] Deleting attachment 5ae86cee-7055-4dc8-bb35-6e34b61979e2. {{(pid=129952) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4947}} Jan 22 22:11:30.271682 ncdv-master-1 cinder-volume[129952]: DEBUG oslo_concurrency.processutils [req-5715dbd8-f72a-4a53-b487-3c7e05d44050 req-3e7fb25a-92d6-4b3c-a932-ef715e8571eb tempest-ServerActionsTestJSON-602623794 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129952) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jan 22 22:11:30.911153 ncdv-master-1 cinder-volume[129952]: DEBUG oslo_concurrency.processutils [req-5715dbd8-f72a-4a53-b487-3c7e05d44050 req-3e7fb25a-92d6-4b3c-a932-ef715e8571eb tempest-ServerActionsTestJSON-602623794 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.639s {{(pid=129952) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jan 22 22:11:30.911951 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [req-5715dbd8-f72a-4a53-b487-3c7e05d44050 req-3e7fb25a-92d6-4b3c-a932-ef715e8571eb tempest-ServerActionsTestJSON-602623794 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-6306e2dc-90a5-4e80-bc1e-986664ed75cd', 'hosts': ['10.222.0.100'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'c7ee930a-3b87-450e-91f6-d4eef70cb484', 'volume_id': '6306e2dc-90a5-4e80-bc1e-986664ed75cd', 'discard': True}} {{(pid=129952) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Jan 22 22:11:31.030113 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [req-5715dbd8-f72a-4a53-b487-3c7e05d44050 req-3e7fb25a-92d6-4b3c-a932-ef715e8571eb tempest-ServerActionsTestJSON-602623794 None] Connection info returned from driver {'name': 'volumes/volume-6306e2dc-90a5-4e80-bc1e-986664ed75cd', 'hosts': ['10.222.0.100'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '6306e2dc-90a5-4e80-bc1e-986664ed75cd', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '81aedebf-cf44-4c38-9804-07ea5c408dea'} {{(pid=129952) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4811}} Jan 22 22:11:31.162949 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [req-5715dbd8-f72a-4a53-b487-3c7e05d44050 req-3e7fb25a-92d6-4b3c-a932-ef715e8571eb tempest-ServerActionsTestJSON-602623794 None] attachment_update completed successfully. Jan 22 22:11:40.737987 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [req-1bbe8c5e-6748-47dc-9d88-b571ec473cbb req-b50e021c-0be7-4ea7-8b7f-89be7a1c5b5a tempest-ServerActionsTestJSON-602623794 None] Terminate volume connection completed successfully. Jan 22 22:11:40.738622 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [req-1bbe8c5e-6748-47dc-9d88-b571ec473cbb req-b50e021c-0be7-4ea7-8b7f-89be7a1c5b5a tempest-ServerActionsTestJSON-602623794 None] Deleting attachment 81aedebf-cf44-4c38-9804-07ea5c408dea. {{(pid=129952) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4947}} Jan 22 22:11:43.641113 ncdv-master-1 cinder-volume[129952]: DEBUG oslo_concurrency.processutils [req-1bbe8c5e-6748-47dc-9d88-b571ec473cbb req-cf69c2c0-7fde-4cd4-a27c-09bfabac53b4 tempest-ServerActionsTestJSON-602623794 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129952) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jan 22 22:11:44.293061 ncdv-master-1 cinder-volume[129952]: DEBUG oslo_concurrency.processutils [req-1bbe8c5e-6748-47dc-9d88-b571ec473cbb req-cf69c2c0-7fde-4cd4-a27c-09bfabac53b4 tempest-ServerActionsTestJSON-602623794 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.652s {{(pid=129952) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jan 22 22:11:44.293883 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [req-1bbe8c5e-6748-47dc-9d88-b571ec473cbb req-cf69c2c0-7fde-4cd4-a27c-09bfabac53b4 tempest-ServerActionsTestJSON-602623794 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-6306e2dc-90a5-4e80-bc1e-986664ed75cd', 'hosts': ['10.222.0.100'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'c7ee930a-3b87-450e-91f6-d4eef70cb484', 'volume_id': '6306e2dc-90a5-4e80-bc1e-986664ed75cd', 'discard': True}} {{(pid=129952) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Jan 22 22:11:44.385806 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [req-1bbe8c5e-6748-47dc-9d88-b571ec473cbb req-cf69c2c0-7fde-4cd4-a27c-09bfabac53b4 tempest-ServerActionsTestJSON-602623794 None] Connection info returned from driver {'name': 'volumes/volume-6306e2dc-90a5-4e80-bc1e-986664ed75cd', 'hosts': ['10.222.0.100'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '6306e2dc-90a5-4e80-bc1e-986664ed75cd', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '61beb073-5577-4eae-9c11-f1bd520c7683'} {{(pid=129952) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4811}} Jan 22 22:11:44.505618 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [req-1bbe8c5e-6748-47dc-9d88-b571ec473cbb req-cf69c2c0-7fde-4cd4-a27c-09bfabac53b4 tempest-ServerActionsTestJSON-602623794 None] attachment_update completed successfully. Jan 22 22:11:52.799438 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [req-ef6dc410-3192-4089-8ccd-b9bb6f9672b0 req-188ae1d8-2c82-46d7-bea6-2f350d43f13a tempest-ServerActionsTestJSON-602623794 None] Terminate volume connection completed successfully. Jan 22 22:11:52.800770 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [req-ef6dc410-3192-4089-8ccd-b9bb6f9672b0 req-188ae1d8-2c82-46d7-bea6-2f350d43f13a tempest-ServerActionsTestJSON-602623794 None] Deleting attachment 61beb073-5577-4eae-9c11-f1bd520c7683. {{(pid=129952) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4947}} Jan 22 22:11:54.452678 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.coordination [None req-f72afdff-dbc1-468f-ae94-f92747f295b2 tempest-ServerActionsTestJSON-602623794 None] Lock "b'cinder-6306e2dc-90a5-4e80-bc1e-986664ed75cd-delete_volume'" acquired by "delete_volume" :: waited 0.010s {{(pid=129952) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 22 22:11:54.540350 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-f72afdff-dbc1-468f-ae94-f92747f295b2 tempest-ServerActionsTestJSON-602623794 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 22:11:54.670620 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-f72afdff-dbc1-468f-ae94-f92747f295b2 tempest-ServerActionsTestJSON-602623794 None] volume has no backup snaps {{(pid=129952) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Jan 22 22:11:54.671034 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-f72afdff-dbc1-468f-ae94-f92747f295b2 tempest-ServerActionsTestJSON-602623794 None] Volume volume-6306e2dc-90a5-4e80-bc1e-986664ed75cd is not a clone. {{(pid=129952) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Jan 22 22:11:54.785645 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-f72afdff-dbc1-468f-ae94-f92747f295b2 tempest-ServerActionsTestJSON-602623794 None] deleting rbd volume volume-6306e2dc-90a5-4e80-bc1e-986664ed75cd {{(pid=129952) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Jan 22 22:11:57.659265 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.quota [None req-f72afdff-dbc1-468f-ae94-f92747f295b2 tempest-ServerActionsTestJSON-602623794 None] Created reservations ['98b65b51-896e-4a45-a35b-8716b59f5b35', '1210203f-9726-4116-8f03-ce6b90f71fc9', 'f94cf45b-68a1-4ef6-977f-c7dfab08e12a', 'd5f4942c-fb6e-4311-969d-b9d51c729556'] {{(pid=129952) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 22 22:11:57.831108 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-f72afdff-dbc1-468f-ae94-f92747f295b2 tempest-ServerActionsTestJSON-602623794 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 22:11:57.855730 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-f72afdff-dbc1-468f-ae94-f92747f295b2 tempest-ServerActionsTestJSON-602623794 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 22:11:57.880171 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.manager [None req-f72afdff-dbc1-468f-ae94-f92747f295b2 tempest-ServerActionsTestJSON-602623794 None] Notifying Schedulers of capabilities ... {{(pid=129952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 22 22:11:57.885170 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-f72afdff-dbc1-468f-ae94-f92747f295b2 tempest-ServerActionsTestJSON-602623794 None] Deleted volume successfully. Jan 22 22:11:57.954376 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.coordination [None req-f72afdff-dbc1-468f-ae94-f92747f295b2 tempest-ServerActionsTestJSON-602623794 None] Lock "b'cinder-6306e2dc-90a5-4e80-bc1e-986664ed75cd-delete_volume'" released by "delete_volume" :: held 3.502s {{(pid=129952) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 22 22:12:18.411017 ncdv-master-1 cinder-volume[129952]: DEBUG oslo_service.periodic_task [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129952) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jan 22 22:12:18.411761 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 22:12:18.438521 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 22:12:18.464752 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.manager [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] Notifying Schedulers of capabilities ... {{(pid=129952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 22 22:13:18.410503 ncdv-master-1 cinder-volume[129952]: DEBUG oslo_service.periodic_task [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129952) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jan 22 22:13:18.411260 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 22:13:18.445019 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 22:13:18.470457 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.manager [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] Notifying Schedulers of capabilities ... {{(pid=129952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 22 22:14:03.371940 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.flows.manager.create_volume [None req-6ca115d4-3aca-400b-bfa6-d5935fcdb38e tempest-TestMinimumBasicScenario-1689229000 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129952) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Jan 22 22:14:03.376373 ncdv-master-1 cinder-volume[129952]: WARNING stevedore.named [None req-6ca115d4-3aca-400b-bfa6-d5935fcdb38e tempest-TestMinimumBasicScenario-1689229000 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jan 22 22:14:03.377647 ncdv-master-1 cinder-volume[129952]: WARNING castellan.key_manager [None req-6ca115d4-3aca-400b-bfa6-d5935fcdb38e tempest-TestMinimumBasicScenario-1689229000 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 22 22:14:03.397874 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-6ca115d4-3aca-400b-bfa6-d5935fcdb38e tempest-TestMinimumBasicScenario-1689229000 None] Flow 'volume_create_manager' (a9b5701a-9d2e-4392-8a60-e03c46c907d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 22 22:14:03.404658 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-6ca115d4-3aca-400b-bfa6-d5935fcdb38e tempest-TestMinimumBasicScenario-1689229000 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (072394e6-6cfc-402e-8b51-e2748a2ab930) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 22:14:03.411315 ncdv-master-1 cinder-volume[129952]: DEBUG oslo_db.sqlalchemy.engines [None req-6ca115d4-3aca-400b-bfa6-d5935fcdb38e tempest-TestMinimumBasicScenario-1689229000 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129952) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 22 22:14:03.425963 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-6ca115d4-3aca-400b-bfa6-d5935fcdb38e tempest-TestMinimumBasicScenario-1689229000 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (072394e6-6cfc-402e-8b51-e2748a2ab930) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-01-22T22:14:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1165411752',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=8fa161d7-5601-4846-82ec-131a92a4cdbb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6837a6f34c6c422cad0019e0f9cb0768',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-01-22T22:14:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-01-22T22:14:03Z,use_quota=True,user_id='838fe30d39014d209302ec73128bf703',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6dacb05b-a7ea-4056-85ff-98f0ea5c54eb),volume_type_id=6dacb05b-a7ea-4056-85ff-98f0ea5c54eb)' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 22:14:03.433944 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-6ca115d4-3aca-400b-bfa6-d5935fcdb38e tempest-TestMinimumBasicScenario-1689229000 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c9e8d59-4d32-4c56-adf4-d1074802de9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 22:14:03.435807 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-6ca115d4-3aca-400b-bfa6-d5935fcdb38e tempest-TestMinimumBasicScenario-1689229000 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c9e8d59-4d32-4c56-adf4-d1074802de9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 22:14:03.441773 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-6ca115d4-3aca-400b-bfa6-d5935fcdb38e tempest-TestMinimumBasicScenario-1689229000 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (381f92dc-d786-4e60-8035-9116f34eadac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 22:14:03.446137 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-6ca115d4-3aca-400b-bfa6-d5935fcdb38e tempest-TestMinimumBasicScenario-1689229000 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (381f92dc-d786-4e60-8035-9116f34eadac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8fa161d7-5601-4846-82ec-131a92a4cdbb', 'volume_name': 'volume-8fa161d7-5601-4846-82ec-131a92a4cdbb', 'volume_size': 1}' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 22:14:03.451213 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-6ca115d4-3aca-400b-bfa6-d5935fcdb38e tempest-TestMinimumBasicScenario-1689229000 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32adc9e0-856f-469d-933d-b6dccfa1d6c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 22:14:03.455531 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-6ca115d4-3aca-400b-bfa6-d5935fcdb38e tempest-TestMinimumBasicScenario-1689229000 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32adc9e0-856f-469d-933d-b6dccfa1d6c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 22:14:03.460413 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-6ca115d4-3aca-400b-bfa6-d5935fcdb38e tempest-TestMinimumBasicScenario-1689229000 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b007e220-c14b-4f50-bc2d-fa23579aae8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 22:14:03.461533 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.flows.manager.create_volume [None req-6ca115d4-3aca-400b-bfa6-d5935fcdb38e tempest-TestMinimumBasicScenario-1689229000 None] Volume 8fa161d7-5601-4846-82ec-131a92a4cdbb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8fa161d7-5601-4846-82ec-131a92a4cdbb', 'volume_size': 1} Jan 22 22:14:03.461941 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-6ca115d4-3aca-400b-bfa6-d5935fcdb38e tempest-TestMinimumBasicScenario-1689229000 None] creating volume 'volume-8fa161d7-5601-4846-82ec-131a92a4cdbb' {{(pid=129952) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Jan 22 22:14:03.462921 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-6ca115d4-3aca-400b-bfa6-d5935fcdb38e tempest-TestMinimumBasicScenario-1689229000 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 22:14:03.795681 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-6ca115d4-3aca-400b-bfa6-d5935fcdb38e tempest-TestMinimumBasicScenario-1689229000 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129952) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 22 22:14:03.796072 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-6ca115d4-3aca-400b-bfa6-d5935fcdb38e tempest-TestMinimumBasicScenario-1689229000 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129952) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 22 22:14:03.800845 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-6ca115d4-3aca-400b-bfa6-d5935fcdb38e tempest-TestMinimumBasicScenario-1689229000 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b007e220-c14b-4f50-bc2d-fa23579aae8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8fa161d7-5601-4846-82ec-131a92a4cdbb', 'volume_size': 1}' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 22:14:03.805636 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-6ca115d4-3aca-400b-bfa6-d5935fcdb38e tempest-TestMinimumBasicScenario-1689229000 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a3688c7-e46b-445d-8cf4-2299beb623d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 22:14:03.878826 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.flows.manager.create_volume [None req-6ca115d4-3aca-400b-bfa6-d5935fcdb38e tempest-TestMinimumBasicScenario-1689229000 None] Volume volume-8fa161d7-5601-4846-82ec-131a92a4cdbb (8fa161d7-5601-4846-82ec-131a92a4cdbb): created successfully Jan 22 22:14:03.882697 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-6ca115d4-3aca-400b-bfa6-d5935fcdb38e tempest-TestMinimumBasicScenario-1689229000 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a3688c7-e46b-445d-8cf4-2299beb623d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 22:14:03.888409 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-6ca115d4-3aca-400b-bfa6-d5935fcdb38e tempest-TestMinimumBasicScenario-1689229000 None] Flow 'volume_create_manager' (a9b5701a-9d2e-4392-8a60-e03c46c907d2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129952) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 22 22:14:03.935730 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-6ca115d4-3aca-400b-bfa6-d5935fcdb38e tempest-TestMinimumBasicScenario-1689229000 None] Created volume successfully. Jan 22 22:14:05.222366 ncdv-master-1 cinder-volume[129952]: DEBUG oslo_concurrency.processutils [req-23626ab8-6f90-4873-9fe4-746282253b2f req-de98c967-056b-447c-92f9-df0fc607bee7 tempest-TestMinimumBasicScenario-1689229000 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129952) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jan 22 22:14:05.912836 ncdv-master-1 cinder-volume[129952]: DEBUG oslo_concurrency.processutils [req-23626ab8-6f90-4873-9fe4-746282253b2f req-de98c967-056b-447c-92f9-df0fc607bee7 tempest-TestMinimumBasicScenario-1689229000 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.690s {{(pid=129952) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jan 22 22:14:05.913709 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [req-23626ab8-6f90-4873-9fe4-746282253b2f req-de98c967-056b-447c-92f9-df0fc607bee7 tempest-TestMinimumBasicScenario-1689229000 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-8fa161d7-5601-4846-82ec-131a92a4cdbb', 'hosts': ['10.222.0.100'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'c7ee930a-3b87-450e-91f6-d4eef70cb484', 'volume_id': '8fa161d7-5601-4846-82ec-131a92a4cdbb', 'discard': True}} {{(pid=129952) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Jan 22 22:14:06.004780 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [req-23626ab8-6f90-4873-9fe4-746282253b2f req-de98c967-056b-447c-92f9-df0fc607bee7 tempest-TestMinimumBasicScenario-1689229000 None] Connection info returned from driver {'name': 'volumes/volume-8fa161d7-5601-4846-82ec-131a92a4cdbb', 'hosts': ['10.222.0.100'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '8fa161d7-5601-4846-82ec-131a92a4cdbb', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'c6cb44cd-2b07-49d2-a08d-ee2827235a6f'} {{(pid=129952) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4811}} Jan 22 22:14:06.113471 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [req-23626ab8-6f90-4873-9fe4-746282253b2f req-de98c967-056b-447c-92f9-df0fc607bee7 tempest-TestMinimumBasicScenario-1689229000 None] attachment_update completed successfully. Jan 22 22:14:18.406536 ncdv-master-1 cinder-volume[129952]: DEBUG oslo_service.periodic_task [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129952) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jan 22 22:14:18.407805 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 22:14:18.431748 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 22:14:18.455780 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.manager [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] Notifying Schedulers of capabilities ... {{(pid=129952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 22 22:15:18.411432 ncdv-master-1 cinder-volume[129952]: DEBUG oslo_service.periodic_task [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129952) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jan 22 22:15:18.412158 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 22:15:18.433838 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 22:15:18.455284 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.manager [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] Notifying Schedulers of capabilities ... {{(pid=129952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 22 22:16:18.413058 ncdv-master-1 cinder-volume[129952]: DEBUG oslo_service.periodic_task [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129952) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jan 22 22:16:18.413762 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 22:16:18.435711 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 22:16:18.457581 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.manager [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] Notifying Schedulers of capabilities ... {{(pid=129952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 22 22:16:32.160158 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [req-6b681b7b-ab8b-44ef-8dc7-02024e32910e req-933c14b1-241a-4dde-90a7-b3a0b4fc3455 tempest-TestMinimumBasicScenario-1689229000 None] Terminate volume connection completed successfully. Jan 22 22:16:32.166342 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [req-6b681b7b-ab8b-44ef-8dc7-02024e32910e req-933c14b1-241a-4dde-90a7-b3a0b4fc3455 tempest-TestMinimumBasicScenario-1689229000 None] Deleting attachment c6cb44cd-2b07-49d2-a08d-ee2827235a6f. {{(pid=129952) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4947}} Jan 22 22:16:32.974413 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.coordination [None req-192d39fa-7a25-4db7-b2a8-fbe9e4730089 tempest-TestMinimumBasicScenario-1689229000 None] Lock "b'cinder-8fa161d7-5601-4846-82ec-131a92a4cdbb-delete_volume'" acquired by "delete_volume" :: waited 0.009s {{(pid=129952) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 22 22:16:33.068836 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-192d39fa-7a25-4db7-b2a8-fbe9e4730089 tempest-TestMinimumBasicScenario-1689229000 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 22:16:33.182721 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-192d39fa-7a25-4db7-b2a8-fbe9e4730089 tempest-TestMinimumBasicScenario-1689229000 None] volume has no backup snaps {{(pid=129952) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Jan 22 22:16:33.183374 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-192d39fa-7a25-4db7-b2a8-fbe9e4730089 tempest-TestMinimumBasicScenario-1689229000 None] Volume volume-8fa161d7-5601-4846-82ec-131a92a4cdbb is not a clone. {{(pid=129952) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Jan 22 22:16:33.271451 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-192d39fa-7a25-4db7-b2a8-fbe9e4730089 tempest-TestMinimumBasicScenario-1689229000 None] deleting rbd volume volume-8fa161d7-5601-4846-82ec-131a92a4cdbb {{(pid=129952) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Jan 22 22:16:36.360195 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.quota [None req-192d39fa-7a25-4db7-b2a8-fbe9e4730089 tempest-TestMinimumBasicScenario-1689229000 None] Created reservations ['bbd34dd1-09c0-491b-b77e-3e93ddabc8f7', '35fd1acc-28c2-4c0e-af44-8a321316903e', '5a14213c-eb7e-42ec-806e-118fcc6d368e', '6d078346-aec1-4698-a5a4-e4f398c40fa8'] {{(pid=129952) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 22 22:16:36.509030 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-192d39fa-7a25-4db7-b2a8-fbe9e4730089 tempest-TestMinimumBasicScenario-1689229000 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 22:16:36.531868 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-192d39fa-7a25-4db7-b2a8-fbe9e4730089 tempest-TestMinimumBasicScenario-1689229000 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 22:16:36.555697 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.manager [None req-192d39fa-7a25-4db7-b2a8-fbe9e4730089 tempest-TestMinimumBasicScenario-1689229000 None] Notifying Schedulers of capabilities ... {{(pid=129952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 22 22:16:36.563421 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-192d39fa-7a25-4db7-b2a8-fbe9e4730089 tempest-TestMinimumBasicScenario-1689229000 None] Deleted volume successfully. Jan 22 22:16:36.626624 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.coordination [None req-192d39fa-7a25-4db7-b2a8-fbe9e4730089 tempest-TestMinimumBasicScenario-1689229000 None] Lock "b'cinder-8fa161d7-5601-4846-82ec-131a92a4cdbb-delete_volume'" released by "delete_volume" :: held 3.653s {{(pid=129952) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 22 22:17:18.412494 ncdv-master-1 cinder-volume[129952]: DEBUG oslo_service.periodic_task [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129952) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jan 22 22:17:18.413219 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 22:17:18.440045 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 22:17:18.463742 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.manager [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] Notifying Schedulers of capabilities ... {{(pid=129952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 22 22:18:18.409657 ncdv-master-1 cinder-volume[129952]: DEBUG oslo_service.periodic_task [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129952) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jan 22 22:18:18.410320 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 22:18:18.432329 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 22:18:18.453868 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.manager [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] Notifying Schedulers of capabilities ... {{(pid=129952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 22 22:19:18.409229 ncdv-master-1 cinder-volume[129952]: DEBUG oslo_service.periodic_task [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129952) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jan 22 22:19:18.411881 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 22:19:18.433195 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 22:19:18.456367 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.manager [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] Notifying Schedulers of capabilities ... {{(pid=129952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 22 22:20:18.410895 ncdv-master-1 cinder-volume[129952]: DEBUG oslo_service.periodic_task [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129952) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jan 22 22:20:18.411552 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 22:20:18.433256 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 22:20:18.455286 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.manager [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] Notifying Schedulers of capabilities ... {{(pid=129952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 22 22:21:18.410169 ncdv-master-1 cinder-volume[129952]: DEBUG oslo_service.periodic_task [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129952) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jan 22 22:21:18.410841 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 22:21:18.432373 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 22:21:18.455613 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.manager [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] Notifying Schedulers of capabilities ... {{(pid=129952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 22 22:22:18.411613 ncdv-master-1 cinder-volume[129952]: DEBUG oslo_service.periodic_task [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129952) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jan 22 22:22:18.412272 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 22:22:18.434309 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 22:22:18.456025 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.manager [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] Notifying Schedulers of capabilities ... {{(pid=129952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 22 22:23:18.411541 ncdv-master-1 cinder-volume[129952]: DEBUG oslo_service.periodic_task [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129952) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jan 22 22:23:18.412264 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 22:23:18.444291 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 22:23:18.473442 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.manager [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] Notifying Schedulers of capabilities ... {{(pid=129952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 22 22:24:18.408130 ncdv-master-1 cinder-volume[129952]: DEBUG oslo_service.periodic_task [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129952) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jan 22 22:24:18.408791 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 22:24:18.431040 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 22:24:18.454680 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.manager [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] Notifying Schedulers of capabilities ... {{(pid=129952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 22 22:25:18.410652 ncdv-master-1 cinder-volume[129952]: DEBUG oslo_service.periodic_task [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129952) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jan 22 22:25:18.411395 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 22:25:18.438225 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 22:25:18.460902 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.manager [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] Notifying Schedulers of capabilities ... {{(pid=129952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 22 22:26:18.415336 ncdv-master-1 cinder-volume[129952]: DEBUG oslo_service.periodic_task [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129952) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jan 22 22:26:18.416018 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 22:26:18.438316 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 22:26:18.460974 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.manager [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] Notifying Schedulers of capabilities ... {{(pid=129952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 22 22:27:18.416316 ncdv-master-1 cinder-volume[129952]: DEBUG oslo_service.periodic_task [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129952) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jan 22 22:27:18.416998 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 22:27:18.495637 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 22:27:18.518416 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.manager [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] Notifying Schedulers of capabilities ... {{(pid=129952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 22 22:28:18.413915 ncdv-master-1 cinder-volume[129952]: DEBUG oslo_service.periodic_task [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129952) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jan 22 22:28:18.414595 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 22:28:18.437392 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 22:28:18.463063 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.manager [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] Notifying Schedulers of capabilities ... {{(pid=129952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 22 22:30:18.419707 ncdv-master-1 cinder-volume[129952]: DEBUG oslo_service.periodic_task [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129952) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jan 22 22:30:18.420373 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 22:30:18.444088 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 22:30:18.481922 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.manager [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] Notifying Schedulers of capabilities ... {{(pid=129952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 22 22:31:18.418252 ncdv-master-1 cinder-volume[129952]: DEBUG oslo_service.periodic_task [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129952) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jan 22 22:31:18.419283 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 22:31:18.440343 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 22:31:18.463699 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.manager [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] Notifying Schedulers of capabilities ... {{(pid=129952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 22 22:32:17.157284 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.flows.manager.create_volume [None req-125b8dcc-21e1-4a39-bc9b-65e7ae9d0836 tempest-TestShelveInstance-355964544 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129952) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Jan 22 22:32:17.160780 ncdv-master-1 cinder-volume[129952]: WARNING stevedore.named [None req-125b8dcc-21e1-4a39-bc9b-65e7ae9d0836 tempest-TestShelveInstance-355964544 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jan 22 22:32:17.161262 ncdv-master-1 cinder-volume[129952]: WARNING castellan.key_manager [None req-125b8dcc-21e1-4a39-bc9b-65e7ae9d0836 tempest-TestShelveInstance-355964544 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 22 22:32:17.182081 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-125b8dcc-21e1-4a39-bc9b-65e7ae9d0836 tempest-TestShelveInstance-355964544 None] Flow 'volume_create_manager' (96bfb933-c00f-4860-9c7c-6a3178d98438) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 22 22:32:17.188789 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-125b8dcc-21e1-4a39-bc9b-65e7ae9d0836 tempest-TestShelveInstance-355964544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4faa9cb-b2d6-4061-97ef-43ef4ed4fba5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 22:32:17.195876 ncdv-master-1 cinder-volume[129952]: DEBUG oslo_db.sqlalchemy.engines [None req-125b8dcc-21e1-4a39-bc9b-65e7ae9d0836 tempest-TestShelveInstance-355964544 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129952) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 22 22:32:17.210087 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-125b8dcc-21e1-4a39-bc9b-65e7ae9d0836 tempest-TestShelveInstance-355964544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4faa9cb-b2d6-4061-97ef-43ef4ed4fba5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-01-22T22:32:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-177234903',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=0cd27e59-cbf1-4e87-9871-9b39e1e0cbc9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bfe266ea1db64cb8ad21a3f40b9f0cf3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-01-22T22:32:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-01-22T22:32:17Z,use_quota=True,user_id='e377dada2c4e44ed9749fd92ec9d29ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6dacb05b-a7ea-4056-85ff-98f0ea5c54eb),volume_type_id=6dacb05b-a7ea-4056-85ff-98f0ea5c54eb)' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 22:32:17.215693 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-125b8dcc-21e1-4a39-bc9b-65e7ae9d0836 tempest-TestShelveInstance-355964544 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a321939-c48d-4e05-851b-3bf6aa384942) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 22:32:17.219993 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-125b8dcc-21e1-4a39-bc9b-65e7ae9d0836 tempest-TestShelveInstance-355964544 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a321939-c48d-4e05-851b-3bf6aa384942) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 22:32:17.225902 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-125b8dcc-21e1-4a39-bc9b-65e7ae9d0836 tempest-TestShelveInstance-355964544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40087274-0655-4cd7-9008-309a707aeaed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 22:32:17.303779 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-125b8dcc-21e1-4a39-bc9b-65e7ae9d0836 tempest-TestShelveInstance-355964544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40087274-0655-4cd7-9008-309a707aeaed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '0cd27e59-cbf1-4e87-9871-9b39e1e0cbc9', 'volume_name': 'volume-0cd27e59-cbf1-4e87-9871-9b39e1e0cbc9', 'volume_size': 1, 'image_id': '373cb480-3bc4-4821-93e2-442b4e852b80', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '994e8f6963f04af3be3dbae11a73cdfd', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '373cb480-3bc4-4821-93e2-442b4e852b80', 'created_at': datetime.datetime(2022, 1, 22, 20, 50, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 1, 22, 20, 50, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/373cb480-3bc4-4821-93e2-442b4e852b80/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 22:32:17.308983 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-125b8dcc-21e1-4a39-bc9b-65e7ae9d0836 tempest-TestShelveInstance-355964544 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5c8a08b-e165-448e-aa19-d21054492ed9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 22:32:17.313182 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-125b8dcc-21e1-4a39-bc9b-65e7ae9d0836 tempest-TestShelveInstance-355964544 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5c8a08b-e165-448e-aa19-d21054492ed9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 22:32:17.318127 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-125b8dcc-21e1-4a39-bc9b-65e7ae9d0836 tempest-TestShelveInstance-355964544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a9bed65-b101-4fe9-80eb-ee04bff6f340) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 22:32:17.319321 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.flows.manager.create_volume [None req-125b8dcc-21e1-4a39-bc9b-65e7ae9d0836 tempest-TestShelveInstance-355964544 None] Volume 0cd27e59-cbf1-4e87-9871-9b39e1e0cbc9: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-0cd27e59-cbf1-4e87-9871-9b39e1e0cbc9', 'volume_size': 1, 'image_id': '373cb480-3bc4-4821-93e2-442b4e852b80', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '994e8f6963f04af3be3dbae11a73cdfd', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '373cb480-3bc4-4821-93e2-442b4e852b80', 'created_at': datetime.datetime(2022, 1, 22, 20, 50, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 1, 22, 20, 50, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/373cb480-3bc4-4821-93e2-442b4e852b80/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jan 22 22:32:17.319896 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.flows.manager.create_volume [None req-125b8dcc-21e1-4a39-bc9b-65e7ae9d0836 tempest-TestShelveInstance-355964544 None] Cloning 0cd27e59-cbf1-4e87-9871-9b39e1e0cbc9 from image 373cb480-3bc4-4821-93e2-442b4e852b80 at location (None, None). {{(pid=129952) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1046}} Jan 22 22:32:17.328027 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.coordination [None req-125b8dcc-21e1-4a39-bc9b-65e7ae9d0836 tempest-TestShelveInstance-355964544 None] Lock "b'cinder-373cb480-3bc4-4821-93e2-442b4e852b80'" acquired by "_prepare_image_cache_entry" :: waited 0.007s {{(pid=129952) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 22 22:32:17.393012 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.image.cache [None req-125b8dcc-21e1-4a39-bc9b-65e7ae9d0836 tempest-TestShelveInstance-355964544 None] Found image-volume cache entry: {'id': 1, 'image_id': '373cb480-3bc4-4821-93e2-442b4e852b80', 'volume_id': 'f39c1078-cff4-40dd-93df-4ce49cd873b4', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 1, 22, 20, 50, 57), 'last_used': datetime.datetime(2022, 1, 22, 22, 32, 17, 331927)}. {{(pid=129952) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Jan 22 22:32:17.393474 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.image.cache [None req-125b8dcc-21e1-4a39-bc9b-65e7ae9d0836 tempest-TestShelveInstance-355964544 None] Image-volume cache entry image_update_at = 2022-01-22 20:50:57+00:00, requested image updated_at = 2022-01-22 20:50:57+00:00. {{(pid=129952) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Jan 22 22:32:17.393907 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.flows.manager.create_volume [None req-125b8dcc-21e1-4a39-bc9b-65e7ae9d0836 tempest-TestShelveInstance-355964544 None] Found cache entry for image = 373cb480-3bc4-4821-93e2-442b4e852b80 on host ncdv-master-1@ceph#ceph. {{(pid=129952) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:869}} Jan 22 22:32:17.398369 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.coordination [None req-125b8dcc-21e1-4a39-bc9b-65e7ae9d0836 tempest-TestShelveInstance-355964544 None] Lock "b'cinder-373cb480-3bc4-4821-93e2-442b4e852b80'" released by "_prepare_image_cache_entry" :: held 0.070s {{(pid=129952) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 22 22:32:17.399268 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.flows.manager.create_volume [None req-125b8dcc-21e1-4a39-bc9b-65e7ae9d0836 tempest-TestShelveInstance-355964544 None] Attempting to retrieve cache entry for image = 373cb480-3bc4-4821-93e2-442b4e852b80 on host ncdv-master-1@ceph#ceph. {{(pid=129952) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:810}} Jan 22 22:32:17.405526 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.image.cache [None req-125b8dcc-21e1-4a39-bc9b-65e7ae9d0836 tempest-TestShelveInstance-355964544 None] Found image-volume cache entry: {'id': 1, 'image_id': '373cb480-3bc4-4821-93e2-442b4e852b80', 'volume_id': 'f39c1078-cff4-40dd-93df-4ce49cd873b4', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 1, 22, 20, 50, 57), 'last_used': datetime.datetime(2022, 1, 22, 22, 32, 17, 403205)}. {{(pid=129952) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Jan 22 22:32:17.414104 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.image.cache [None req-125b8dcc-21e1-4a39-bc9b-65e7ae9d0836 tempest-TestShelveInstance-355964544 None] Image-volume cache entry image_update_at = 2022-01-22 20:50:57+00:00, requested image updated_at = 2022-01-22 20:50:57+00:00. {{(pid=129952) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Jan 22 22:32:17.414104 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.flows.manager.create_volume [None req-125b8dcc-21e1-4a39-bc9b-65e7ae9d0836 tempest-TestShelveInstance-355964544 None] Creating from source image-volume f39c1078-cff4-40dd-93df-4ce49cd873b4 {{(pid=129952) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:824}} Jan 22 22:32:17.417659 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-125b8dcc-21e1-4a39-bc9b-65e7ae9d0836 tempest-TestShelveInstance-355964544 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 22:32:17.552589 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-125b8dcc-21e1-4a39-bc9b-65e7ae9d0836 tempest-TestShelveInstance-355964544 None] creating snapshot='volume-0cd27e59-cbf1-4e87-9871-9b39e1e0cbc9.clone_snap' {{(pid=129952) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:725}} Jan 22 22:32:18.593291 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-125b8dcc-21e1-4a39-bc9b-65e7ae9d0836 tempest-TestShelveInstance-355964544 None] cloning 'volume-f39c1078-cff4-40dd-93df-4ce49cd873b4@volume-0cd27e59-cbf1-4e87-9871-9b39e1e0cbc9.clone_snap' to 'volume-0cd27e59-cbf1-4e87-9871-9b39e1e0cbc9' {{(pid=129952) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:731}} Jan 22 22:32:18.594927 ncdv-master-1 cinder-volume[129952]: DEBUG oslo_service.periodic_task [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129952) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jan 22 22:32:18.595753 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 22:32:18.623851 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 22:32:18.645827 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.manager [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] Notifying Schedulers of capabilities ... {{(pid=129952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 22 22:32:19.540434 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-125b8dcc-21e1-4a39-bc9b-65e7ae9d0836 tempest-TestShelveInstance-355964544 None] Volume volume-0b17e2f4-e149-4a4b-b525-3d029be2e6f6.deleted is not a clone. {{(pid=129952) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Jan 22 22:32:19.541810 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-125b8dcc-21e1-4a39-bc9b-65e7ae9d0836 tempest-TestShelveInstance-355964544 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129952) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 22 22:32:19.542190 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-125b8dcc-21e1-4a39-bc9b-65e7ae9d0836 tempest-TestShelveInstance-355964544 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129952) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 22 22:32:19.844857 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-125b8dcc-21e1-4a39-bc9b-65e7ae9d0836 tempest-TestShelveInstance-355964544 None] clone created successfully {{(pid=129952) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:803}} Jan 22 22:32:19.845561 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.volume_utils [None req-125b8dcc-21e1-4a39-bc9b-65e7ae9d0836 tempest-TestShelveInstance-355964544 None] Marking volume 0cd27e59-cbf1-4e87-9871-9b39e1e0cbc9 as bootable. {{(pid=129952) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1178}} Jan 22 22:32:19.915312 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.flows.manager.create_volume [None req-125b8dcc-21e1-4a39-bc9b-65e7ae9d0836 tempest-TestShelveInstance-355964544 None] Copying metadata from image 373cb480-3bc4-4821-93e2-442b4e852b80 to 0cd27e59-cbf1-4e87-9871-9b39e1e0cbc9. {{(pid=129952) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:443}} Jan 22 22:32:19.915751 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.flows.manager.create_volume [None req-125b8dcc-21e1-4a39-bc9b-65e7ae9d0836 tempest-TestShelveInstance-355964544 None] Creating volume glance metadata for volume 0cd27e59-cbf1-4e87-9871-9b39e1e0cbc9 backed by image 373cb480-3bc4-4821-93e2-442b4e852b80 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '373cb480-3bc4-4821-93e2-442b4e852b80', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=129952) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:666}} Jan 22 22:32:20.054744 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-125b8dcc-21e1-4a39-bc9b-65e7ae9d0836 tempest-TestShelveInstance-355964544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a9bed65-b101-4fe9-80eb-ee04bff6f340) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0cd27e59-cbf1-4e87-9871-9b39e1e0cbc9', 'volume_size': 1, 'image_id': '373cb480-3bc4-4821-93e2-442b4e852b80', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '994e8f6963f04af3be3dbae11a73cdfd', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '373cb480-3bc4-4821-93e2-442b4e852b80', 'created_at': datetime.datetime(2022, 1, 22, 20, 50, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 1, 22, 20, 50, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/373cb480-3bc4-4821-93e2-442b4e852b80/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 22:32:20.059703 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-125b8dcc-21e1-4a39-bc9b-65e7ae9d0836 tempest-TestShelveInstance-355964544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34298241-bfaa-483c-92fb-74264b5a26ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 22 22:32:20.132267 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.flows.manager.create_volume [None req-125b8dcc-21e1-4a39-bc9b-65e7ae9d0836 tempest-TestShelveInstance-355964544 None] Volume volume-0cd27e59-cbf1-4e87-9871-9b39e1e0cbc9 (0cd27e59-cbf1-4e87-9871-9b39e1e0cbc9): created successfully Jan 22 22:32:20.135956 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-125b8dcc-21e1-4a39-bc9b-65e7ae9d0836 tempest-TestShelveInstance-355964544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34298241-bfaa-483c-92fb-74264b5a26ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129952) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 22 22:32:20.141765 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [None req-125b8dcc-21e1-4a39-bc9b-65e7ae9d0836 tempest-TestShelveInstance-355964544 None] Flow 'volume_create_manager' (96bfb933-c00f-4860-9c7c-6a3178d98438) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129952) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 22 22:32:20.217959 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [None req-125b8dcc-21e1-4a39-bc9b-65e7ae9d0836 tempest-TestShelveInstance-355964544 None] Created volume successfully. Jan 22 22:32:28.583192 ncdv-master-1 cinder-volume[129952]: DEBUG oslo_concurrency.processutils [req-f8edfb28-a99c-4bb7-9615-f99e4ec5ba11 req-3d31759c-720a-442f-940d-a99ec8da6d0e tempest-TestShelveInstance-355964544 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129952) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jan 22 22:32:29.247391 ncdv-master-1 cinder-volume[129952]: DEBUG oslo_concurrency.processutils [req-f8edfb28-a99c-4bb7-9615-f99e4ec5ba11 req-3d31759c-720a-442f-940d-a99ec8da6d0e tempest-TestShelveInstance-355964544 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.664s {{(pid=129952) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jan 22 22:32:29.248166 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [req-f8edfb28-a99c-4bb7-9615-f99e4ec5ba11 req-3d31759c-720a-442f-940d-a99ec8da6d0e tempest-TestShelveInstance-355964544 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-0cd27e59-cbf1-4e87-9871-9b39e1e0cbc9', 'hosts': ['10.222.0.100'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'c7ee930a-3b87-450e-91f6-d4eef70cb484', 'volume_id': '0cd27e59-cbf1-4e87-9871-9b39e1e0cbc9', 'discard': True}} {{(pid=129952) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Jan 22 22:32:29.330477 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [req-f8edfb28-a99c-4bb7-9615-f99e4ec5ba11 req-3d31759c-720a-442f-940d-a99ec8da6d0e tempest-TestShelveInstance-355964544 None] Connection info returned from driver {'name': 'volumes/volume-0cd27e59-cbf1-4e87-9871-9b39e1e0cbc9', 'hosts': ['10.222.0.100'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '0cd27e59-cbf1-4e87-9871-9b39e1e0cbc9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '19dbb123-954c-4bbb-8f0d-0d1d7579f0fe'} {{(pid=129952) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4811}} Jan 22 22:32:29.440847 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [req-f8edfb28-a99c-4bb7-9615-f99e4ec5ba11 req-3d31759c-720a-442f-940d-a99ec8da6d0e tempest-TestShelveInstance-355964544 None] attachment_update completed successfully. Jan 22 22:33:18.591427 ncdv-master-1 cinder-volume[129952]: DEBUG oslo_service.periodic_task [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129952) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jan 22 22:33:18.592283 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 22:33:18.615830 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 22:33:18.640531 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.manager [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] Notifying Schedulers of capabilities ... {{(pid=129952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 22 22:34:18.596460 ncdv-master-1 cinder-volume[129952]: DEBUG oslo_service.periodic_task [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129952) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jan 22 22:34:18.597265 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 22:34:18.618664 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 22:34:18.644364 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.manager [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] Notifying Schedulers of capabilities ... {{(pid=129952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 22 22:35:18.600984 ncdv-master-1 cinder-volume[129952]: DEBUG oslo_service.periodic_task [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129952) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jan 22 22:35:18.601769 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 22:35:18.624418 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 22:35:18.646370 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.manager [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] Notifying Schedulers of capabilities ... {{(pid=129952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 22 22:36:10.002878 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [req-bfae310e-4fe0-4c0c-9ab0-ee42aed66352 req-766a0400-c594-48ff-8799-8153f785e8f0 tempest-TestShelveInstance-355964544 None] Terminate volume connection completed successfully. Jan 22 22:36:10.003900 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.manager [req-bfae310e-4fe0-4c0c-9ab0-ee42aed66352 req-766a0400-c594-48ff-8799-8153f785e8f0 tempest-TestShelveInstance-355964544 None] Deleting attachment 19dbb123-954c-4bbb-8f0d-0d1d7579f0fe. {{(pid=129952) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4947}} Jan 22 22:36:10.364759 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.coordination [req-bfae310e-4fe0-4c0c-9ab0-ee42aed66352 req-b466ca7a-b06f-466a-a175-7442100756e4 tempest-TestShelveInstance-355964544 None] Lock "b'cinder-0cd27e59-cbf1-4e87-9871-9b39e1e0cbc9-delete_volume'" acquired by "delete_volume" :: waited 0.009s {{(pid=129952) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 22 22:36:10.482743 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [req-bfae310e-4fe0-4c0c-9ab0-ee42aed66352 req-b466ca7a-b06f-466a-a175-7442100756e4 tempest-TestShelveInstance-355964544 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 22:36:10.743137 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [req-bfae310e-4fe0-4c0c-9ab0-ee42aed66352 req-b466ca7a-b06f-466a-a175-7442100756e4 tempest-TestShelveInstance-355964544 None] volume has no backup snaps {{(pid=129952) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Jan 22 22:36:10.868019 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [req-bfae310e-4fe0-4c0c-9ab0-ee42aed66352 req-b466ca7a-b06f-466a-a175-7442100756e4 tempest-TestShelveInstance-355964544 None] deleting rbd volume volume-0cd27e59-cbf1-4e87-9871-9b39e1e0cbc9 {{(pid=129952) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Jan 22 22:36:14.555266 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [req-bfae310e-4fe0-4c0c-9ab0-ee42aed66352 req-b466ca7a-b06f-466a-a175-7442100756e4 tempest-TestShelveInstance-355964544 None] volume is a clone so cleaning references {{(pid=129952) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1266}} Jan 22 22:36:14.721145 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [req-bfae310e-4fe0-4c0c-9ab0-ee42aed66352 req-b466ca7a-b06f-466a-a175-7442100756e4 tempest-TestShelveInstance-355964544 None] deleting parent snapshot volume-0cd27e59-cbf1-4e87-9871-9b39e1e0cbc9.clone_snap {{(pid=129952) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1158}} Jan 22 22:36:17.520635 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.quota [req-bfae310e-4fe0-4c0c-9ab0-ee42aed66352 req-b466ca7a-b06f-466a-a175-7442100756e4 tempest-TestShelveInstance-355964544 None] Created reservations ['bdc69538-4839-459c-883c-79d2a23d7c96', 'cb5f4fe6-6a94-4b6d-8d83-b55c15e9366a', 'e8e7fd0e-0783-4894-b8ac-c073096a3918', '55721497-384c-488a-922d-934434426803'] {{(pid=129952) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 22 22:36:17.678884 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [req-bfae310e-4fe0-4c0c-9ab0-ee42aed66352 req-b466ca7a-b06f-466a-a175-7442100756e4 tempest-TestShelveInstance-355964544 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 22:36:17.718155 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [req-bfae310e-4fe0-4c0c-9ab0-ee42aed66352 req-b466ca7a-b06f-466a-a175-7442100756e4 tempest-TestShelveInstance-355964544 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 22:36:17.749339 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.manager [req-bfae310e-4fe0-4c0c-9ab0-ee42aed66352 req-b466ca7a-b06f-466a-a175-7442100756e4 tempest-TestShelveInstance-355964544 None] Notifying Schedulers of capabilities ... {{(pid=129952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 22 22:36:17.755271 ncdv-master-1 cinder-volume[129952]: INFO cinder.volume.manager [req-bfae310e-4fe0-4c0c-9ab0-ee42aed66352 req-b466ca7a-b06f-466a-a175-7442100756e4 tempest-TestShelveInstance-355964544 None] Deleted volume successfully. Jan 22 22:36:17.835534 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.coordination [req-bfae310e-4fe0-4c0c-9ab0-ee42aed66352 req-b466ca7a-b06f-466a-a175-7442100756e4 tempest-TestShelveInstance-355964544 None] Lock "b'cinder-0cd27e59-cbf1-4e87-9871-9b39e1e0cbc9-delete_volume'" released by "delete_volume" :: held 7.471s {{(pid=129952) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 22 22:36:18.601784 ncdv-master-1 cinder-volume[129952]: DEBUG oslo_service.periodic_task [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129952) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jan 22 22:36:18.602563 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 22:36:18.627917 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 22:36:18.668902 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.manager [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] Notifying Schedulers of capabilities ... {{(pid=129952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 22 22:37:18.604015 ncdv-master-1 cinder-volume[129952]: DEBUG oslo_service.periodic_task [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129952) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jan 22 22:37:18.604707 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 22:37:18.625710 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 22:37:18.647736 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.manager [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] Notifying Schedulers of capabilities ... {{(pid=129952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 22 22:38:18.602903 ncdv-master-1 cinder-volume[129952]: DEBUG oslo_service.periodic_task [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129952) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jan 22 22:38:18.603574 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 22:38:18.624874 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 22:38:18.647369 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.manager [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] Notifying Schedulers of capabilities ... {{(pid=129952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 22 22:39:18.603450 ncdv-master-1 cinder-volume[129952]: DEBUG oslo_service.periodic_task [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129952) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jan 22 22:39:18.604114 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 22:39:18.625340 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 22:39:18.648348 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.manager [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] Notifying Schedulers of capabilities ... {{(pid=129952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 22 22:40:18.604438 ncdv-master-1 cinder-volume[129952]: DEBUG oslo_service.periodic_task [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129952) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jan 22 22:40:18.605211 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 22:40:18.631541 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 22:40:18.656155 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.manager [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] Notifying Schedulers of capabilities ... {{(pid=129952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 22 22:41:18.601140 ncdv-master-1 cinder-volume[129952]: DEBUG oslo_service.periodic_task [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129952) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jan 22 22:41:18.601853 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 22:41:18.623008 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 22:41:18.645723 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.manager [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] Notifying Schedulers of capabilities ... {{(pid=129952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 22 22:42:18.600763 ncdv-master-1 cinder-volume[129952]: DEBUG oslo_service.periodic_task [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129952) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jan 22 22:42:18.601905 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 22:42:18.628001 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 22:42:18.654494 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.manager [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] Notifying Schedulers of capabilities ... {{(pid=129952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 22 22:43:18.599993 ncdv-master-1 cinder-volume[129952]: DEBUG oslo_service.periodic_task [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129952) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jan 22 22:43:18.600713 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 22:43:18.623833 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 22:43:18.646352 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.manager [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] Notifying Schedulers of capabilities ... {{(pid=129952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 22 22:44:18.602296 ncdv-master-1 cinder-volume[129952]: DEBUG oslo_service.periodic_task [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129952) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jan 22 22:44:18.602994 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 22:44:18.625004 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 22:44:18.646986 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.manager [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] Notifying Schedulers of capabilities ... {{(pid=129952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 22 22:45:18.601726 ncdv-master-1 cinder-volume[129952]: DEBUG oslo_service.periodic_task [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129952) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jan 22 22:45:18.604258 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 22:45:18.625274 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 22:45:18.648252 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.manager [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] Notifying Schedulers of capabilities ... {{(pid=129952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 22 22:46:18.603217 ncdv-master-1 cinder-volume[129952]: DEBUG oslo_service.periodic_task [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129952) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jan 22 22:46:18.603876 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 22:46:18.626043 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 22:46:18.648260 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.manager [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] Notifying Schedulers of capabilities ... {{(pid=129952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 22 22:47:18.603877 ncdv-master-1 cinder-volume[129952]: DEBUG oslo_service.periodic_task [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129952) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jan 22 22:47:18.604528 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 22:47:18.626222 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 22:47:18.648138 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.manager [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] Notifying Schedulers of capabilities ... {{(pid=129952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 22 22:48:18.604448 ncdv-master-1 cinder-volume[129952]: DEBUG oslo_service.periodic_task [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129952) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jan 22 22:48:18.605113 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 22:48:18.628499 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 22:48:18.651304 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.manager [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] Notifying Schedulers of capabilities ... {{(pid=129952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 22 22:49:18.607381 ncdv-master-1 cinder-volume[129952]: DEBUG oslo_service.periodic_task [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129952) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jan 22 22:49:18.608236 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 22:49:18.630961 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.volume.drivers.rbd [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129952) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 22 22:49:18.652763 ncdv-master-1 cinder-volume[129952]: DEBUG cinder.manager [None req-b2771b94-2b73-49ed-879a-b698597bdc90 None None] Notifying Schedulers of capabilities ... {{(pid=129952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}